Conservative U.S. Supreme Court Justice Antonin Scalia had some advice Wednesday for those who questioned his impartiality after he refused to recuse himself from a case involving his hunting buddy, Vice President Dick Cheney.

“For Pete’s sake, if you can’t trust your Supreme Court justice more than that, get a life,” Scalia said.