evaluating-code-models

Benchmarks code-generation models and produces functional-correctness scores for comparing their coding abilities.

When to use it

Use when evaluating code generation, testing multilingual coding or functional correctness, benchmarking for leaderboards, or assessing fill-in-the-middle capabilities.

Give it a model ID or local path and benchmark task names; it runs evaluations and saves metrics for analysis.