DarijaKit: open-source toolkit for Moroccan Darija on local LLMs
Researchers at Manadger Tech, a Moroccan company, released DarijaKit, an open-source Python toolkit to help developers work with Moroccan Darija on their own hardware. Local language models handle Darija unevenly because it is written in Arabic script and Arabizi, mixed with French, and spelled inconsistently. The stdlib-only tool offers spelling normalization, Arabizi-to-Arabic transliteration, script detection, and a 30-item evaluation set for benchmarking local models. It also includes a LoRA fine-tuning recipe sized for a single 12 GB GPU and works with Ollama, llama.cpp, LM Studio, and vLLM. The code is MIT licensed, and the developers invite native speakers to contribute evaluation items and spelling mappings.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in