Integrating flutter_gemma
Hello,
In one of my apps I want to integrate flutter_gemma. In beta testing this works fine.
The question is about the scalability:
The plan is that users can download a slim version of the app from Play / AppStore, then upon approval download via direct link, a gemma model from Hugging Face. Without signing up to Hugging Face.
Did anyone tried this? Is it a scalable solution?
The alternative is to host the model on my server, however it is 4GB, and the price of the bandwitdh and storage use is higher than simply using Gemini via API so I see no reason to do it. For me, the prospect of SLMs in products, is about them being free to use.
Best,
Saar.