Losing access. That's the only thing they'd actually object to. And we know this because that's exactly the thing they got pissy over at Biden for allegedly doing. But Trump loves being on TV, and despite his whining, he'd never truly kick them out, because it means he wouldn't get that limelight.