Yes, but on the other hand, that only prevents them from getting any new emails; they still have all your emails up to the moment you decide to change.
While I'm sure the wrong people can do nasty things with a large back catalogue of e-mails, for marketing purposes knowing what you're up to now is vastly more valuable. Which means that if Google start scaring people and they leave, their current, profitable business model is hurt.
Yes, but on the other hand, that only prevents them from getting any new emails; they still have all your emails up to the moment you decide to change.