This isn't a question of rights. Most people understand in English that "can't complain" means "you can complain if you like but won't be taken seriously or regarded as a valid complaint".
Non-disparagement agreements are a common thing in business. They restrict your right to "complain". I regret the conflict between my understanding of English and that of others, but I stand by my statement.
