The “myth-making” surrounding the U.S. Supreme Court and its justices is one of the worst aspects of the job, said Justice Clarence Thomas during an appearance Thursday at the Library of Congress.

“There’s a real, decided difference between what is said about judging and what actually happens,” Thomas said in response to a question about the best and worst parts of his job. “We don’t have the time, energy, ink or bites to change or to engage in that narrative. We have work to do. We have to write opinions.”