u/movingphoton

https://www.youtube.com/watch?v=JKCxiBghzwI

This shit is so crazy!
I keep telling them to protest about this first, this is deadly!

Many places which i absolutely hate walking because of enroachment
Will these be fixed?

Hey, there have been multiple posts asking what the use case of Sarvam is and what can they do what other frontier models do.

I had tried educating multiple times about this.
Disclaimer : I am not affiliated to Sarvam, OpenAI or anything. it seems like anyone who speaks facts and not aligned to ones opinion is called a paid bot. unfortunate.

Some context: You can skip this part if you want to jump to the very simple set of examples i tried, some folks wanted me to prove this. So here i am, but it is easier if you take written documents and try it yourself in your own languages and compare.

I do a lot of software work, and I am just like some of you here, I also assumed that frontier models work great for local languages, and I never used sarvam, and to be honest, i dont use sarvam because my work does not need it.

I had a discussion with a friend who came up to a problem regarding translating Kannada documents to English, since he was paying someone to come to his office and type it out. A common scenario for lawyers it seems who have to defend in multiple languages, even though he can speak kannada fluently, his reading is slow, and he gets it translated so that he gets to do his work faster, and explains his clients cases to the judge correctly and as accurately. You dont want your lawyer mumbling in the court

Now i suggested using openai, claude and even gemini models. To which he said bluntly he tried all and none of them worked. I did not believe him, so he told me to write something in my language and send to all models. I wrote a very simple phrase, which just said my name is x.
all of the models had trouble reading it, now for a second i doubted my handwriting to be bad, it has been atleast a decade since i had to write something in my native. I am accustomed to writing code, and recently only prompts.

So I opened Sarvam and out of curiousity tried their OCR to extract text. It worked. But their interface was quite bad.
I eventually built an agent system like claude code for the usecase my friend wanted, it would do all the orchestration and do all the work he needed, he did not have to fiddle around different sections of sarvam UI to get things done.

Now i shared this feedback with many, and i do not think people realise how poor systems are when it comes to local languages, especially "handwritten" -> this is important.

Test and Conclusion:

So i have attached just 3 examples, it took me a while to go through each word and compare and find mistakes. My reading is slow for all languages, hence the delay, and What i hope for from the community is you also share your results.
These results are easily verifiable and comparable.

Now is this a complete benchmark? -> i think its fair to say, i do not have the time to have 100+ documents compared and verified, we all lead busy lives.

But we can easily conclude sarvam performs better for sure.
My claim is not that sarvam is the best frontier model, or solves coding problems, people seem to be fixated on that.
But if you look at jobs which are specific to our country, you will find more usecases. If you look at software engineering for usecases, you will likely not find as much.

I urge community to try supported languages and share more feedback, since i cannot read all languages and neither an expert. It would also be faster.

You can also try these, and share your feedback.
Do correct me if i made any mistakes, I am human after all, and even less expertise on all languages, engineering i can handle.

Having said that, i hope you find the discussion useful

TLDR:
- ran hindi, kannada, malayalam extract text for chatgpt vs sarvam
- hindi had so many issues on chatgpt comparitively
- malayalam similar, i did not find sarvam having any issues here
- kannada - was botched by gpt, sarvam seemed fine ( i did skim through )
- sarvam performed better in all cases

TLDR TLDR

- sarvam good for OCR for indian langagues

Test Params?:
- ChatGPT 5.5 Medium on UI
- prompt used - extract text
- Sarvam on dashboard OCR / Vision

Also I realise this is a limited benchmarking. No way concluding that gpt, or similar models are bad