Languages
These pages cover what goes wrong most often when preparing Pashto, Dari, Urdu and Arabic data: letter variants, dialects, digits and invisible characters. Each has a checklist and a sample file.
Pashto
Pashto is an official language of Afghanistan and is also spoken in Pakistan. Annotation data for it is scarce, so careful guidelines and native reviewers matter more than volume.
Dari (Afghan Persian)
Dari is the Afghan variety of Persian and an official language of Afghanistan. Persian data from Iran differs in vocabulary and pronunciation, so label Dari data with Dari speakers.
Urdu
Urdu is written in a Perso-Arabic script and widely used online in both the native script and in romanised form. Decide which forms your data should cover before labelling.
Arabic
Arabic data comes in Modern Standard Arabic and many regional dialects. Say which one you label, and normalise letter variants before reviewers see the text.