ModelChorusModelChorus
ChallengeChatLeaderboardBenchmarksHistoryHow it works
Terms of ServicePrivacy PolicyAPI

Copyright 2026 MeetKai Inc.

Benchmarks/GPT-5 Nano/English (US) tasks

GPT-5 Nano

5 tasks

Each row below is a single benchmark task this model was evaluated on. The Score column averages every metric the task reports (accuracy, F1, exact-match, etc.). Click a row to browse the individual questions and the model's responses.

Average
63.6
ScoreLanguageTaskMetrics
87.6English (US)
english_mgsm
english math
exact_match: 87.6sample_len: 250.0
exact_match: 87.6sample_len: 250.0
87.3English (US)
english_gsm8k
english math
exact_match: 87.3sample_len: 1319.0
exact_match: 87.3sample_len: 1319.0
61.3English (US)
english_mmlu_pro
english mmlu pro
exact_match: 61.3sample_len: 2100.0
exact_match: 61.3sample_len: 2100.0
49.4English (US)
english_belebele
english mcq
f1_macro: 49.4sample_len: 900.0
f1_macro: 49.4sample_len: 900.0
32.5English (US)
ifeval
ifeval
inst_level_loose_acc: 39.3inst_level_strict_acc: 38.5prompt_level_loose_acc: 26.6prompt_level_strict_acc: 25.7sample_len: 541.0
inst_level_loose_acc: 39.3inst_level_strict_acc: 38.5prompt_level_loose_acc: 26.6prompt_level_strict_acc: 25.7sample_len: 541.0