"He thinks I’m not Black enough. Seriously," Williams said after being told he wouldn't be a guest on the show.