I agree, it sounds weird. I'd avoid it all together and use on-site.
Edit to add: or, as uncle-comment (?) pointed out with the Wikipedia article, on-premises software is a thing. On-prem might be a good compromise, depending on your penchant for shortening like that.
Either way "on-premises licenses" sounds weird so I'm likely to stick with "on-premise licenses" regardless. Sorry.