I sometimes use 5 agents at once, but 3 work on separate tasks and the 4th is watching them by tmux and steering, and the fifth is also watching the whole team for testing quality standards. So 2 out of five are just helping me watch the other 3.
But this only works because the 3 worker agents have really separate problems, almost no connections across.