Inference⚡
llama.cpp
Released Oct 15, 2022
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
LLMC++LocalEfficient
Resources
Tools, frameworks, and models for local AI
1 resource found for "Efficient"
Tools, frameworks, and models for local AI
1 resource found for "Efficient"
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.