A small-town judge ordered removed from office because he has three wives says his polygamy should not be grounds for removing him from the bench.

“As long as I can do my job, why should I [be removed]?” Justice Court Judge Walter Steed asked Wednesday outside a Provo, Utah, courtroom with one of his three wives standing by his side.