In a setback to the Securities and Exchange Commission, a federal appeals court on Friday overturned a rule bringing hedge funds under new supervision by the agency.

The decision by the U.S. Court of Appeals for the D.C. Circuit sent the rule — which bitterly divided the five-member SEC when it was adopted in October 2004 — back to the agency to be reviewed.