Thoughts on human vs. automated metrics when benchmarking language models on Persian.
Placeholder post — replace with real write-up.
Topics to cover:
- Where automated metrics (BLEU/ROUGE-style scores) mislead for Persian specifically
- What the human evaluation rubric ended up looking like
- Where the models still fall down (informal register, code-switching, etc.)