i'm not even sure LLMs are fit for that purpose. jolt.law.harvard.edu/digest/retri... the framing of this article ("RAGs are good!") is frontloaded by a ton of writing about how specifically awful LLMs are. tldr LLMs are awful at this kind of work. amusingly i got this from an LLM proponent!

Retrieval-augmented generation (RAG): towards a promising LLM architecture for legal work?The above image is sourced from Wikimedia Commons. Generative artificial intelligence (AI)’s first encounter with the legal world was a catastrophe. After OpenAI released ChatGPT in Fall 2022 and the....jolt.law.harvard.edu