Musician Kanye West told talk show host Jimmy Kimmel on Thursday night that before he expressed his support for the president and wore a Make America Great Again hat, he was warned against voicing his opinion.

“Every time I said I like Trump,” West said he was told “that I couldn’t say it out loud or my career would be over, I’d get kicked out of the black community, because blacks are, we’re supposed to have a monolithic thought; we can only … be Democrats.” Watch:

West added that putting on the MAGA hat “represented overcoming fear, and doing what you felt, no matter what anyone says and saying, ‘You can’t bully me.’ Liberals can’t bully me, news can’t bully me, the hip-hop community, they can’t bully me.”

Kimmel concluded the segment by reprimanding West for his support of Trump, to which West did not respond.