The latest misconduct allegation, says The Late Show host, is “the straw that groped the camel’s back.”