The Unbreakable Kimmy Schmidt star has been filming a music-themed show in London that is being kept under wraps.