Oso posted a blog post [1] about this yesterday that's quite informative. I separated posted it on HN [2], but linking here.

[1] https://www.osohq.com/post/why-llm-authorization-is-hard [2] https://news.ycombinator.com/item?id=44509936