The Magicians wanted to challenge itself with its first musical episode

Variety

“We don’t really want this to be easy,” says executive producer Sera Gamble of Wednesday's "All That Josh" episode. “We want to challenge ourselves and never, ever, take for granted that people are going to be interested in the show. We want to continue to woo you and promise you weird, ambitious, crazy things. This represented our philosophy about creating the show.”