“There are a few people. And you would be surprised, there are a few people who we have deemed ‘not worth the trouble,’” Cohen tells AOL Lifestyle without naming names.