Couldn't we get a low-res version of this info by tracking the active window using a cli tool? For linux, there are several options. Not sure about Mac.
Another approach is to run OCR on 1FPS screenshots. Everything runs locally without draining the battery like an LLM would.
Another approach is to run OCR on 1FPS screenshots. Everything runs locally without draining the battery like an LLM would.