Assignment · Josh Talks · Oct 2026
Akshar Bench
Can AI write India's shop posters?
A blind human evaluation of whether AI image models can put correct Hindi, Gujarati and Punjabi text on a small shop's festive poster. One missing vowel sign turns a sale into a typo, and existing text-to-image boards don't measure it.
Fixed prompts
Indian scripts plus English twin prompts
Image models compared: GPT Image 1, Gemini 2.5 Flash Image, Gemini 3.1 Flash Image
Blind rating rounds
- Problem
- Image models now make festive posters for small sellers, but nobody measures whether the Indian-script text on them is right.
- Bet
- Ask the shopkeeper's question first (which poster would you share today?), then audit the text letter by letter.
- Result
- A live rating app, results leaderboard and methodology, with quality control built in.