ModelChorusModelChorus
ChallengeChatLeaderboardSwipeBenchmarksHistory
How it worksAPITerms of ServicePrivacy Policy

Copyright 2026 MeetKai Inc.

Benchmarks/Functionary Swahili Mini/Urdu (Pakistan) tasks

Functionary Swahili Mini

5 tasks

Each row below is a single benchmark task this model was evaluated on. The Score column averages every metric the task reports (accuracy, F1, exact-match, etc.). Click a row to browse the individual questions and the model's responses.

Average
67.2
ScoreLanguageTaskMetrics
83.8Urdu (Pakistan)
urdu_facttool_qa
urdu claim
f1_macro: 83.8sample_len: 160.0
f1_macro: 83.8sample_len: 160.0
75.0Urdu (Pakistan)
urdu_factcheckbench
urdu claim
f1_macro: 75.0sample_len: 387.0
f1_macro: 75.0sample_len: 387.0
73.9Urdu (Pakistan)
urdu_bingcheck
urdu claim
f1_macro: 73.9sample_len: 102.0
f1_macro: 73.9sample_len: 102.0
72.8Urdu (Pakistan)
urdu_fake_news
urdu classification
f1_macro: 72.8sample_len: 300.0
f1_macro: 72.8sample_len: 300.0
30.4Urdu (Pakistan)
urdu_emotion_class
urdu classification
f1_macro: 30.4sample_len: 200.0
f1_macro: 30.4sample_len: 200.0