L

llama.cpp

llama.cpp b10289 — server: harden the file_glob_search directory walk (#26626) * server: don't walk Windows junctions in file_glob_search std::filesystem reports a junction as a p…

Local modelsOpen source4.5 / 5
Visit site
WA

What it's genuinely good at

  • Open source
  • Active release cadence

Where it falls apart

    Alternatives to llama.cpp

    More Local models tools

    Open source

    Ollama

    Ollama v0.32.6 — ## What's Changed - Qwen3.5 is faster on Apple GPUs: the MLX engine now uses the model's MTP head for speculative decoding automatically - `/v1/chat/completions`…