rCUDA is super cool! One of the issues though is for a lot of the common model frameworks are not supported and a new release has not come out a while.

Fair point. It's not obvious from the website which model frameworks does exafunction supports, or when the last exafunction release was.

Yeah, we should have a public release very soon for people to deploy internally. We will have support for all the commonly-used frameworks and different versions.

Sounds awesome, look forward to it.