I haven’t tested it personally but you may be able to get some of that battery life back by using the web version of Zoom in Safari. That tends to force video chat services to use hardware accelerated video codecs which are considerably easier on battery.
And that's not just for Mac's, the same can help on Linux devices. It's somewhat hilarious that running a non-native app gets you better hardware accel but here we are.