ModelChorusModelChorus
ÌpèníjàÌjíròròTábìlì OlóríFàIdanwoÌtàn
Bí ó ṣe ń ṣiṣẹAPIÀwọn Òfin IṣẹÌlànà Àṣírí

Ẹtọ akọọlẹ 2026 MeetKai Inc.

Idanwo/Functionary Swahili Large/iṣẹ́ Urdu (Pakistan)

Functionary Swahili Large

iṣẹ́ 8

Ẹsẹ̀ ọ̀rọ̀ kọ̀ọ̀kan tó wà nísàlẹ̀ jẹ́ iṣẹ́ ìdánwò ẹyọ kan tí a fi àwòkọ́ṣe yìí dán wò. Òpó Àmì-ìwọ̀n máa ń ka àpapọ̀ gbogbo ìwọ̀n tí iṣẹ́ náà ròyìn (deedee, F1, ìbámu pípé, abbl.). Tẹ ẹsẹ̀ ọ̀rọ̀ kan láti ṣàwárí àwọn ìbéèrè ẹyọ àti àwọn ìdáhùn àwòkọ́ṣe.

Àpapọ̀
59.1
Iye-àmìÈdèIṣẹ́Àwọn ìwọ̀n
79.1Urdu (Pakistan)
urdu_uquad
urdu qa
llm_judge_score: 79.1sample_len: 139.0
llm_judge_score: 79.1sample_len: 139.0
72.4Urdu (Pakistan)
urdu_factcheckbench
urdu claim
f1_macro: 72.4sample_len: 387.0
f1_macro: 72.4sample_len: 387.0
71.4Urdu (Pakistan)
urdu_fake_news
urdu classification
f1_macro: 71.4sample_len: 300.0
f1_macro: 71.4sample_len: 300.0
70.7Urdu (Pakistan)
urdu_bingcheck
urdu claim
f1_macro: 70.7sample_len: 102.0
f1_macro: 70.7sample_len: 102.0
69.0Urdu (Pakistan)
urdu_facttool_qa
urdu claim
f1_macro: 69.0sample_len: 160.0
f1_macro: 69.0sample_len: 160.0
56.7Urdu (Pakistan)
urdu_freshqa
urdu qa
llm_judge_score: 56.7sample_len: 323.0
llm_judge_score: 56.7sample_len: 323.0
31.5Urdu (Pakistan)
urdu_emotion_class
urdu classification
f1_macro: 31.5sample_len: 200.0
f1_macro: 31.5sample_len: 200.0
22.0Urdu (Pakistan)
urdu_simpleqa
urdu qa
llm_judge_score: 22.0sample_len: 200.0
llm_judge_score: 22.0sample_len: 200.0