The U.S. Supreme Court on Tuesday unanimously agreed to give Secret Service agents immunity from a First Amendment lawsuit claiming they violated the free speech rights of demonstrators who were protesting a presidential visit in 2004.

Even though the protestors were restricted to an area further away from President George W. Bush than a group of Bush supporters, the Secret Service agent should not be held liable for viewpoint discrimination, the court said in a ruling by Justice Ruth Bader Ginsburg.