r/LovingOpenSourceAI

▲ 174 r/LovingOpenSourceAI+20 crossposts

I would like to share my latest open source local LLM inference tool implemented in C#. It supports models like Gemma4, Qwen3.6 with multi-modal (image, vision, audio), reasoning and function tool. It can run on Windows/MacOS/Linux and fully leverage GPU's capability. The API is completely compatible with OpenAI and Ollama interface.

Really appreciated if you can try it and give me some feedback. If you like it, it will be a big thank you if you can star it. Thank you very much!

u/fuzhongkai — 1 day ago
▲ 45 r/LovingOpenSourceAI+5 crossposts

If your GPU can run inference, it should be able to fine-tune too.

I spent the last few months building a new sparse fine-tuning method for MoE models called USAF.

The goal was simple: if your GPU can run inference on an MoE model, it should also be able to fine-tune it.

On my AMD RX 6750 XT (12 GB), I can fine-tune Qwen3-30B-A3B by training sparse expert weights and the router instead of adapters.

The project is completely open source under the Apache 2.0 license. I'm not trying to build a business, sell anything, or monetize it in any way—I just wanted to share something I built that I think is genuinely interesting.

GitHub: https://github.com/tsuyu122/usaf

u/tsuyu122 — 1 day ago
▲ 116 r/LovingOpenSourceAI+1 crossposts

Kanika "CHINA JUST LEAKED THE FUTURE OF WEB APPS. Alibaba open-sourced PageAgent and 99% of SaaS founders are sleeping on this. It's a JavaScript AI agent that lives INSIDE your webpage. Users control your entire interface with natural language." ➡️ 21k stars. you tried before?

https://x.com/KanikaBK/status/2072606006971081213

https://github.com/alibaba/page-agent

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 3 days ago
▲ 99 r/LovingOpenSourceAI+1 crossposts

Hasan "I found the OCR tool built for the LLM era. It is called olmOCR. olmOCR takes PDFs, scans, PNGs, and JPEGs and turns them into clean Markdown that models can actually understand." ➡️ worth testing on messy PDFs?

https://x.com/hasantoxr/status/2071519541851717838

https://github.com/allenai/olmocr

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 4 days ago
▲ 140 r/LovingOpenSourceAI+1 crossposts

Sharbel "Someone built a single endpoint that stacks the free tiers of 16 LLM providers behind one URL. ~1.7 billion tokens per month. It's called FreeLLMAPI." ➡️ Do you think free-tier LLM routing is helpful, or does it create too many terms/key-handling headaches?

https://x.com/sharbel/status/2070568492022079922

https://github.com/tashfeenahmed/freellmapi

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all free and low-cost ways to try LLMs posted so far on our community site, LifeHubber: https://lifehubber.com/ai/access/

Also 100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting. https://lifehubber.com/ai/resources/

u/Koala_Confused — 5 days ago
▲ 76 r/LovingOpenSourceAI+1 crossposts

Coin Bureau "🚨ANTHROPIC CEO: OPEN SOURCE AI IS GETTING DANGEROUS ➡️ Dario Amodei told lawmakers that open-source AI is moving down a “very dangerous path.” ➡️ Is this real safety concern, or big-lab gatekeeping?

https://x.com/coinbureau/status/2071330294452666695

The concern seems to be that once powerful models are released openly, access cannot really be revoked, safety layers can be removed, and misuse becomes much harder to control.

But the counterargument is obvious: open source also improves transparency, research, competition, and trust.

What do you think and why?

u/Koala_Confused — 7 days ago
▲ 22 r/LovingOpenSourceAI+1 crossposts

How To Prompt "Someone built a self-hosted AI app that scans your receipts, invoices, and PDFs and auto-extracts every detail you need for tax filing. 100% open-source and private." ➡️ useful for agents that handle financial-document intake?

https://x.com/HowToPrompt__/status/2071547896458358866

https://github.com/vas3k/TaxHacker

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 6 days ago
▲ 65 r/LovingOpenSourceAI+1 crossposts

Postulato della DRA(i)M

È solo uno scenario irreale e puramente di fantasia ma...

① I big tech (Meta, Google, Microsoft) acquistano HBM3e in volumi enormi con potere contrattuale brutale → i produttori DRAM comprimono i margini HBM3e per aggiudicarsi i contratti.

② Il margine compresso viene recuperato sul segmento consumer DDR5, dove l'acquirente è frammentato, disinformato e senza alternativa → i prezzi DDR5 vengono gonfiati oltre il giustificabile dal costo di produzione.

③ Il consumatore che vuole inferenza locale è costretto ad acquistare quantità elevate di RAM costosa per ottenere prestazioni appena accettabili → il costo dell'hardware locale supera rapidamente anni di abbonamento.

④ L'alternativa "conveniente" è già pronta, scalabile e profittevole → abbonamento mensile all'AI del big tech che ha pagato la HBM3e a prezzo scontato grazie all'obolo nascosto versato al punto ②.

Nessun patto è necessario. Il mercato oligopolistico lo fa da solo. Il risultato è identico a una collusione, con il vantaggio dell'immunità legale.

u/tamerlanOne — 8 days ago
▲ 36 r/LovingOpenSourceAI+1 crossposts

Isra "your agent can search Twitter, Reddit, YouTube, GitHub, B站, 小红书, LinkedIn, and the open web for free - zero API keys, zero billing 😳 agent-reach now supports 14+ platforms with self-healing routing. one of them dies? it switches to the next backend automatically. 42.7K stars" ➡️ you using?

https://x.com/israfill/status/2070915206130413737

https://github.com/Panniantong/Agent-Reach

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 7 days ago
▲ 23 r/LovingOpenSourceAI+1 crossposts

OpenHands ➡️ The self-hosted developer control center for coding agents and automations. Run OpenHands, Claude Code, Codex, Gemini, or any ACP-compatible agent across local, remote, and cloud backends. ➡️ Have you heard of this?

"OpenHands Agent Canvas turns your coding agents into a self-hosted, always-on engineering team. It's a developer control center for starting conversations and automating everyday tasks — like generating reports that publish to Slack or automatically decomposing GitHub issues into tasks.

It runs locally on your machine by default, but can connect to multiple “agent backends”, e.g. running agents in Docker containers, on VMs, or within your company infrastructure. You can optionally choose to run agents on OpenHands Cloud or OpenHands Enterprise infrastructure."

https://github.com/OpenHands/OpenHands

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 7 days ago
▲ 41 r/LovingOpenSourceAI+1 crossposts

Sharbel "Someone built an AI agent that searches Reddit, X, YouTube, HN, TikTok, Polymarket, and the web in parallel. Scores everything by real upvotes, real likes, and real money. Synthesizes it into one brief. In seconds. Its called /last30days. 28,700+ stars on GitHub." ➡️ is this useful for you?

https://x.com/sharbel/status/2063369348828610886

https://github.com/mvanhorn/last30days-skill

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 8 days ago
▲ 50 r/LovingOpenSourceAI+1 crossposts

Ornith "Aloha! 🌺 Meet Ornith-1.0 a family of open-source LLMs specialized for agentic coding. Spans the full parameter sizes including 9B Dense, 31B Dense, 35B MoE, and 397B MoE. It achieves state-of-the-art performance among OS models of comparable size on coding benchmarks" ➡️ trying this?

https://x.com/ornith_/status/2070148887067963854

https://huggingface.co/collections/deepreinforce-ai/ornith-10

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 10 days ago
▲ 98 r/LovingOpenSourceAI+1 crossposts

NEW "Introducing LFM2.5-230M: our smallest model yet, built to run fast anywhere (CPUs, NPUs, and GPUs) to enable agentic tasks on phones, robots, home and network automation devices." ➡️ Test the GGUF, ONNX, or MLX variants when the same local task has to move across devices?

https://x.com/liquidai/status/2070148140368318884

https://huggingface.co/LiquidAI/LFM2.5-230M

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 10 days ago
▲ 29 r/LovingOpenSourceAI+1 crossposts

Qwen "📣📣 Meet Qwen-AgentWorld — a native language world model that simulates 7 agent environments (MCP, Search, Terminal, SWE, Web, OS, Android) within a single model. Environment modeling is the training objective from day one, not a post-hoc adaptation." ➡️ Simulate before running live is nice!

https://x.com/Alibaba_Qwen/status/2069720365442719867

https://github.com/QwenLM/Qwen-AgentWorld

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 9 days ago
▲ 240 r/LovingOpenSourceAI+1 crossposts

"Apple just did something nobody expected. They turned 2 billion iPhones into local AI machines. They open-sourced coreai-models, the entire toolkit that lets you export any HuggingFace model and run it natively on iPhone, iPad and Mac with zero cloud." ➡️ Includes coding-agent skills wow

https://x.com/HowToPrompt__/status/2065007846866161906

https://github.com/apple/coreai-models

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 13 days ago
▲ 23 r/LovingOpenSourceAI+1 crossposts

"🎉nanobot v0.2.2 is here! This release is about durability for your open-source agents! 140 PRs & 21 first-time contributors. - More reliable WebUI sessions. - A much stronger Python SDK. - Broader providers, channels, search, speech, and workbench polish. - Default context window restored to 200k"

https://x.com/nanobot_project/status/2069253447644590122

https://github.com/HKUDS/nanobot

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 9 days ago
▲ 116 r/LovingOpenSourceAI+1 crossposts

Baidu "We’re open-sourcing Unlimited OCR — built to read long documents in one pass. With 3B total parameters and only 500M activated, Unlimited OCR sets new end-to-end SOTA results on OmniDocBench v1.5 and v1.6." ➡️ maybe try Unlimited-OCR on the long PDFs that usually break your OCR pipeline? :P

https://x.com/BaiduAI_News/status/2069322806748410291

https://github.com/baidu/Unlimited-OCR

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 12 days ago
▲ 24 r/LovingOpenSourceAI+3 crossposts

$42M grant for Open Source AI Builders by Sentient Foundation

Hi everyone, we at Sentient Foundation are launching an Open Source AGI Grant and Investment Program, a $42M commitment for developers, researchers, open-source maintainers, public-goods builders, and startups building or leveraging AI in the open.

Our thesis is simple: the most important technology being built right now should not end up controlled by a handful of closed platforms. A few companies are moving toward metered, revocable access to intelligence. We want to help make sure open builders have the resources to compete.

The program has two tracks:

1. Grants for public goods

For open-source maintainers, independent researchers, developers, and public-goods projects.

No equity. No lockups. No claim on your work. You keep what you build.

2. Investments for companies built to scale

For startups and teams building commercial companies around open AI technologies, using founder-friendly structures.

We’re especially interested in projects that make AI genuinely useful and accessible to people who are often skipped by the market. Examples include:

  • Local and privacy focused AI tools built for phones, laptops, and other low-cost personal devices
  • Medical, education, agriculture, elder-care, and anti-scam tools for underserved communities
  • Trust infrastructure for open models, agents, identity, verification, privacy, and decentralized compute
  • Products that are private by default and empowering rather than extractive

Projects do not need to open-source every part of their stack to qualify. What matters is that at least one essential component is open and meaningfully contributes to the project’s value and adoption.

Applications are reviewed on a rolling basis, with no cohorts and no fixed deadline.

We’re launching alongside ecosystem partners including Alibaba Cloud and Princeton University.

Happy to answer questions here. We’d especially love to hear from builders working on open models, local AI, agent infrastructure, privacy-preserving AI, evaluation, multilingual tools, and applications for communities that are usually overlooked.

u/syedshad — 11 days ago
▲ 10 r/LovingOpenSourceAI+1 crossposts

"The Nemotron 3.5 Content Safety model is a small language model (SLM) that uses Google's Gemma-3-4B-it as the base and is fine-tuned by NVIDIA on multimodal, multilingual, and reasoning-oriented content-safety datasets." ➡️ is it a good fit for agent builders who need guardrails?

https://huggingface.co/nvidia/Nemotron-3.5-Content-Safety

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 11 days ago
▲ 26 r/LovingOpenSourceAI+1 crossposts

Z.ai "Introducing GLM-5.2: Frontier Intelligence, Open Weights - Significant improvements in coding and agentic tasks - Strong long-horizon capabilities with a 1M context window" ➡️ Is this comparable to SOTA models?

https://x.com/Zai_org/status/2066938937344495629

https://huggingface.co/zai-org/GLM-5.2

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/

100+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.

u/Koala_Confused — 14 days ago