So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...
Contains documentation generation with Doxygen, unit tests with Google Test and a Justfile for simplified build operations. Business logic is implemented as a static library, and the GUI is ...