Open dataset · 77 · 2026
Badini Kurdish AI translation test
77 everyday spoken lines in English and Duhok Badini, checked by a native speaker, with the answers of ChatGPT, Gemini and Claude and the script that scores them.
Badini Kurdish AI Translation Test 2026 (ChatGPT, Gemini, Claude)
Serdar Dilshad · 2026-11-08
What's inside
On 8 November 2026 each assistant got the same request in a new private chat with its default settings: translate the English lines into Badini, and the Badini lines into English. ChatGPT and Gemini ran on their free default models, Claude on Sonnet 5.5 (free) and Opus 5.5 (paid). Scores: chrF similarity to the reference, and a reference-free Sorani check (a fixed list of Sorani forms that flags none of the reference lines). The Badini references were first drafted with Gemini and then corrected by hand; the English lines were drafted with Claude. One run per assistant, so small differences are noise. Files: data.jsonl (lines and every answer), raw/ (the replies as returned), prompts, results.json and score.py.
Example rows
That was eight months ago.
ئەڤە بەری هەشت هەیڤان بوو.
Open your mouth.
دەڤێ خو ڤەکە.
License
CC BY 4.0: free to use, share and adapt, including commercially, if you credit Serdar Dilshad.
How to cite
Dilshad, S. (2026). Badini Kurdish AI Translation Test 2026 (ChatGPT, Gemini, Claude). https://serdardilshad.dev/en/datasets/badini-ai-test-2026
Built and run by Serdar Dilshad.
Start with your idea.
You don’t need to know the technical terms. Tell me what you want to make possible, or what isn’t working today.