For many applications such as talking to pdfs you can use a vectors db like pinecone

But that doesn’t work well for schematics because for of the interesting use cases you need access to the whole thing.

Here is what’s been working for us

1. Extreme compression and summarization of the data we dynamically put in the context 2. Leverage the extreme amount of world knowledge the cutting edge models have