Other right-wing groups are staying away, claiming the anti-government group are “bad actors” who want to “incite violence.”