First thing I did when I got my hands on an LLM was to ask it very specific questions about things I knew very well. They still continue to get the details wrong