The CBS reality show's Season 32 premiere drew 3.4 million compared to 5.7 million for its Season 31 premiere in April 2019.