Our constitution requires due process before you can force anyone to do anything. You also can't ban people from public land, because it is public. Imagine if the government created a massive park and only allowed rich people to use it. That's technically the same thing, except you are the rich people (relatively).
It's tricky.