Benchmark of local LLMs (Qwen 3.6, Gemma 4) vs ChatGPT and Gemini on coding tasks. Apple M5, 32GB. Methodology, raw outputs, judge prompts, scores, and charts.
-
Updated
May 25, 2026 - Jupyter Notebook
#
coding-benchmark
Here are 6 public repositories matching this topic...
AI Benchmark 知识库 — 全面收录各大 AI 公司用来测试模型性能的 Benchmark 题库完整集合
benchmark knowledge-base model-evaluation reasoning multimodal ai-benchmarks instruction-following llm long-context safety-evaluation ai-performance math-reasoning coding-benchmark benchmark-collection eval-frameworks
-
Updated
Apr 16, 2026
Saotri Bench — coding benchmark for evaluating LLM agents on multi-phase programming tasks with hidden requirements.
python benchmark machine-learning code-generation evaluation-framework ai-agents llm llm-evaluation agent-evaluation coding-benchmark
-
Updated
Feb 21, 2026 - Python
🔍 Evaluate LLM agents on multi-phase programming tasks with FluxCodeBench, focusing on hidden requirements, long-context retention, and iterative refinement.
python benchmark machine-learning code-generation evaluation-framework ai-agents llm llm-evaluation agent-evaluation coding-benchmark
-
Updated
Jun 1, 2026 - Python
Raw logs of Claude Code running on local Qwen3.5-27B (llama.cpp). Builds a Python todo app with 50 tests. Real-world performance data: 30 min, cache thrashing, 38 t/s generation.
reproducible-research wsl performance-analysis unit-tests python-todo edge-ai ai-tools ai-agent llm llama-cpp local-llm local-ai qwen ai-productivity opensource-ai ai-benchmark claude-code agentic-coding privacy-focused-ai coding-benchmark
-
Updated
Apr 14, 2026 - Python
Open benchmark harness for latest major AI models on general reasoning, coding, tool use, and long-context tasks.
-
Updated
May 5, 2026 - Python
Improve this page
Add a description, image, and links to the coding-benchmark topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the coding-benchmark topic, visit your repo's landing page and select "manage topics."