This is a question, i now recently a powerfull 8GB model came out to generate video, and i guess people here use it, but I forgot the name of the model, maybe someone here knows
(I got a 12gb card)
It's just so unrealistic, people can get off the highway, there is ramp going off leading to a traffic jam, okay... but that shouldn't mean all other traffic that should go straight should stop as well ???, in contrast, in real life, more people should skip and drive on take the other lane..
Is there a mod to fix this?
I wrote this code just as a small demo, can be used to find deathlocks in applications.
Especially within larger apps where a lot of async threads may live, the method may be valuable.
There is no big gui around it, it just generates some file output that tells the tail..
https://github.com/PGTBoos/Deathlock-logging/tree/main
If you like it leave me a star on github or so.
An observation I made while watching some YouTube videos about this year's AI trend.
The battle between the "main" giants Anthropic and OpenAI is all about renting rack space, megawatt investments, big, no huge, plans are made for data centers, like a Manhattan Project, backed (well backed, they grant them rack space, Amazon, Google, Microsoft, who have their own models as well).
On the other side,
There's DeepSeek, a cheaper model just a few months behind.
And very recently, there are the 1-bit and 1.5-bit models, which might not yet have been really optimized for Ollama, but are 10 times smaller.
----
Currently, the rat race of giants is about investing in hardware, TPUs, CUDA, and other exotic chips; rackspace, data centers, and grid power. There is clearly money to burn; the sky is the limit.
Eventually, though, companies don't make a profit by burning money; eventually, reducing costs drives the business to be cheaper than the others if one can do with less memory and fewer megawatts.
Wouldn't training a DeepSeek-level 1-bit model be eventually more profitable?
As for running a healthy business rather than a Manhattan Project?
In other words, is the investment rat race a dead end?
The whole OpenAI thing reminds me of people who tried to buy all the silver in the market.
And that will not work, there are to many alternative parties
Especially the 1-bit models have about 10 times less memory requirement and run on lower-end GPUs. Maybe the market wants to go too fast. But here's the punch: the smart money isn't on who burns the most watts. It's on who needs the fewest.
Curious how you people think about it
And so i spend 5 euro for a new esp32 😅
Its such a fun when you make things yourself.
And realize how much other system costs.
I can brake 10 more and still keep laughing.