The NFL told a federal appeals court that Southern District Judge Richard Berman overstepped his authority in vacating the suspension of New England Patriots quarterback Tom Brady for an alleged scheme to tamper with the footballs in a January playoff game.

Asking the U.S. Court of Appeals for the Second Circuit to reinstate the four-game suspension of one of the league’s star players, lawyers for the NFL said in papers filed Monday that Berman’s decision was “unfathomable” and the judge should have deferred to Commissioner Roger Goodell on a scandal they said “struck at the heart of the game’s integrity.”