So -1 -- 5 with the comment box right? how do you account for nicer/meaner do you smooth based on average review for that person's reviews?

After doing this 16 times we have similar standards, so in practice we don't have to account for easy vs tough graders statistically. We do try to convince other partners to change their votes in borderline cases though. In the last phase we look at all the applications straddling the cutoff for the number of groups we can invite, and try to come closer to a consensus about what side of the cutoff each group should end up on.

One of your founders relayed to me that they were doing some of the application reading/judging, my concern was there. guess he was pulling my leg.

No, he was probably telling the truth. The alumni do the first pass. But (a) they just vote no or maybe, (b) each application is seen by at least 3 alumni, and isn't filtered out till it has at least 2 more nos than maybes, and (c) we look at their overall stats to make sure no one is giving all nos.

Sounds sensible. We do the same with resumes and it works well to filter the noise.

pg don't you think the alumni would be biased towards startups/people they know. Or say no to those that could potentially become their competitors in the future.

There's a recuse button if you're conflicted.