updated 05/07/2014 AT 5:00 PM ET
•originally published 05/08/2014 AT 2:00 PM ET
She’s a supermodel and a Sports Illustrated swimsuit issue cover girl – but Chrissy Teigen still has to put up with people criticizing her shape.
Teigen, 28, told PEOPLE Tuesday at Tyra Banks’s TZONE Foundation Flawsome Ball in N.Y.C. that she’s able to brush it off most of the time.
“The thing is, you don’t even want to be mad about someone calling you fat because who the f––– cares?” she said with a shrug. “Like if somebody tells me, ‘Oh, you look curvier.’ That should not be a diss. The fact is, we live in a time where that is a diss.”
It’s not just the allegedly curvy who should be left alone, she says.
“It’s horrible we can be like, ‘You look so skinny,’ and someone’s like, ‘Thank you!’ That’s horrible. That’s equally as horrible to me. So the time we live in, it’s upsetting.”
While being a famous model is the best revenge, Teigen admits the critics are hard to stomach sometimes. “It’s funny to me, but sometimes when you’re having a bad day, it’s hurtful,” she says. “You just never know.”