Inference stack

This is a list of large language models I run locally.

Models

  1. openai/gpt-oss-120b
  2. zai-org/GLM-5.2
  3. deepseek-ai/DeepSeek-V4-Flash
  4. prism-ml/Ternary-Bonsai-27B-gguf