U.S. Supreme Court Justice Samuel Alito Jr. told congressional Democrats on Wednesday that he had “nothing whatsoever to do with” his wife’s decision to fly controversial flags at their private homes and rejected calls to recuse from pending Jan. 6 cases, including former President Donald Trump’s request for immunity from criminal prosecution.

Alito sent a pair of letters to lawmakers Wednesday following days of intense scrutiny amid reporting by The New York Times that his Virginia home had briefly displayed an upside-down U.S. flag in January 2021, a symbol adopted by the “Stop the Steal” movement of Trump supporters during the Jan. 6, 2021, riot at the U.S. Capitol.