Greg KH talks about LLM generated security reports in Linux kernel

Greg KH talks about LLM generated security reports in Linux kernel

A really good talk about how the news around Mythos and the hype that followed did not show the reality of their claims. Out of 79 reported vulnerabilities - 14 of them were not really a bug and 15 were already fixed in the latest code, only 20 something worth looking at. In that 20 "real" bugs, numerous only worked under assumption of an already malicious actor being present or an untrusted device installed.

Another key thing that he talks about is leaky bots. "Anything it tells you, it will tell someone else" - same bugs ( public or non public ) being reported by different people can cause discomfort in terms of who gets the credit for it.

youtu.be
u/trueleo8 — 11 days ago

I thought "Dimagi Naxal" was just a one off comment. But I think it's bigger than that

When i first heard about the Dimagi Naxal comment. I thought to myself that 56 Inch Chota Bandar is just salty after the whole protest debacle. But after hearing that they replaced their IT Cell leader too and the new person is suppose to take a more "moderate position" ( dunno what that really means ). Hmm that's interesting, I thought to myself. People have started Dimagi Naxal page and it's above 500k now I think. Many regular liberal people on the internet assumed that they are the "Dimagi Naxals" in this case.

I think the reality is a tiny bit different. They are very specific about this - Kiran Rijiju clarifies about this in X post as well. So who are the new dangerous minority now ?

It's the new age leftists ( who they will dub as maoists / communists ). This is really smart on their side because as I saw with my previous interactions on how much people are ready to jump and attack even the utterance on Marx, this makes us the perfect target.
You have to realize something, I am not claiming that the student leaders in jharkhand, delhi etc are communists. The BJP has figured out with the CJP protest interaction that none of their previously made tactics of disinformation will work when people are united by an Idea not a party or person. So now they are going to divide on the Idea itself by creating a scope ( dimagi naxal though intelligent have bad ideas ) and project anyone or any idea which seems inconvenient will be grouped with this new villanified leftists.

This could also mean that it will much much harder to dismantle such propaganda because the narratives and arguments will be complex. Like the narrative of Hindu-Muslim can be dismantled by giving out example of a normal Muslim person in your inner circle. But this new fight will become much harder because not only you will need to defend your goodwill agenda but you will also need to explain why that agenda is not socialist/communist. IT cell will be putting people in imaginary camps of "dangerous leftists" and the right wing will just gobble it up.

This is just a speculation but do keep an eye out.

Additional Thoughts -
- I don't think it's a new thing that they are doing, but i think it will be their main alternative way of spreading their ideology on Instagram, X, Reddit.
- This also has additional benefit of retraction. They can retract this label anytime and say that "We meant these kind of people not you"

reddit.com
u/trueleo8 — 2 months ago

AI is not useful

In my and other people's post about AI datacenters, I've noticed some defense of AI datacenters which essentially boils down to "AI is useful, there will be more AI in the future and hence the constructions are going to happen somewhere and we should accept that"

Rather than going on and on about demerits of datacenters ( which there are plenty already ). I will try to attack the AI systematically and show you that AI is not productive and what that means for cost of AI

If you do not understand how LLM works and why they are expensive. Please look at this video from computerphile ( video )

AI understands my questions
AIs do not understand your questions, the models are called generative because they try to generate based on the past training. You can find many common reasoning tasks which they fail miserably at ( The famous "How many R's in Strawberry" and "If I walked to a carwash rather than driving there to wash my car" ). They reason by generating intermediate thought and these thoughts are for guiding model to generate contradicting facts which can make them generate better responses. None of this actually solves hallucination and generalized answers. You will notice that the more specific thing you ask or try to argue with it the more flaws in their reasoning will appear.

But aren't they are automating tasks and coding ?
The probability of hallucination and lack of taste makes them very difficult for use in automation. We already have this problem with specialized hardware and machine learning algorithms, like for example self driving cars. No one can use Tesla auto-drive seriously in India. LLM's lack taste, the article and media they generate lack emotion and taste for details. People do not care for just any output, they care for an output where every decision was deliberate. I have used AI for coding as a professional coder and I think they suck a lot still. They try to solve the problem by any means possible and make hacks and unmaintainable junk. It's rarely that they blame the other people's code unless specifically asked for, hence they will not contribute to safety and betterment of the software in this way

But AI helps me do my work faster ?
Because somehow your are given the ability to chat and clarify as many times as possible it makes sense that you are able to brute force your way to a acceptable solution. If your task if of low stake and is already been absorbed by LLMs then you can have a really nice time. But if it's not you are going to suffer. Your ability to be productive with it directly depends on how less you have to pay for it, but these are subsidized beyond belief. There are lot of other ways in which they hurt productivity but I cannot cover that here without another paragraph ( here is an article )

AI is not that expensive so what's the problem ?
Most people, especially in India cannot afford their AI usage directly. The Claude Sonnet model which is available in low tier plan or for free actually is prices at 2$ input and 10$ output. If you were to pay these costs directly you will not be spending that much time using AI. Oh BTW the output tokens of model will become the input tokens immediately. So every silly question ans search may actually cost you around Rs. 100~ each. If you go for a cheaper model, you are paying less but you are also getting lower intelligence. Anthropic and OpenAI burn huge amount of money to keep their customers in their ecosystem and is the reason why any of this is possible. Recently as soon as they started charging API rates to enterprises, almost all of them are now implementing some sort of cap on how much people are allowed to spend. This directly affect usage and productivity.

They will not be spending on AI Datacenters if it was this unprofitable and bad
We assume that the people who are in-charge are smarter than us and they will be doing these things out of some great plan. Unfortunately that's not the case. The BIG Tech are out of hypergrowth ideas on how to make more money, they already have monopolies and cannot expand greatly further. They see AI as this thing which will automate human labour and simply generate them more and more profit. The datacenters that are in motion are simply being built because some tech giant has promised to pay for them, why will they pay for them? Because they believe OpenAI and Anthropic will be so so huge that they will be in every aspect of human life. Another reason is that the models have to scale in size for there to be better "reasoning". The models are getting expensive and bigger, the chinese models are distillation of these bigger models, one company is losing money for other to make a model in the first place. But this is what makes it a bubble. Everything is tracing back to these two companies which cannot generate profit and the people who use their products cannot show a return on investment without the massive subsidies. If i have to keep paying you to use my product, that's not a product.

But I think AI is still useful and we will just use how much we need it
This would have been the ideal scenario but datacenters need saturation ( a constant flow of requests ) for them to profitable. We need to use it day and night for them to turn profit on the current rates. If people started using less of it because it's not in their budget, it will get more expensive and even less people will use it then. You can see the cycle and why they ask you to do everything via AI. Chinese models only worsen this phenomena because their margins are lower.

There are lots and lots of things that are bad about AI trade and AI in general. I have not even covered the IP theft and mass crawling of the internet and how they store and use your data. How they outsource and underpay for data. But i will rest my case here.

I urge you to do your research before commenting. If you are refuting any points provide deeper reasoning or a supporting article.

u/trueleo8 — 2 months ago

We should support protests against AI datacenter

I was watching this video. It describes how enormous the water usage of these datacenters will be in reality.

Western world is raising their voice against datacenters and they're demanding for transparency. This pushes datacenter constructions to happen in countries like India where public pressure will not mount as much.

People believe that these though exploit nature does create jobs, but AI datacenters are very automated and will not create jobs for Indians. These things consume a lot of electricity and water and are a ecological disaster. Hyperscalers are spending billions so the construction companies have 0 incentives to think about future of datacenters. But I believe while the AI bubble isn't popping these things may operate for few years atleast.

We know that none of our government bodies will say anything about it so can we so anything about it right now?

u/trueleo8 — 2 months ago

Despite being cautious about LLMs, we still fucked up

I am one of the few peoples in software engineering who already were aware of the tech industry enshittification before AI trend even began. I worked my first job at a startup and the signs it beings a crazy market was visible from the start, people care for code velocity more than quality. I left my job and did not apply to any other workplace because I was burned out. Then the whole AI news froze the hiring everywhere. This pushed me towards working on my own low budget software consultancy rather than relying on market to be sane again. But me and my co-founders did not find it worth while after 6 months and had to pivot because of widespread AI psychosis hurting our margins and there is no money for innovation unless it can be turned into a SaaS product.

We pivoted into financial investment algorithms and research as means of making money for short term and have grown into a team of 5 people now. Each of us from a different background in science ( I do most of the code and they being from academic side of finance, mathematics and physics ) do theory and analysis of financial instruments.

We are subscribed to Ed since last year I think and regularly follow what he has to say. But our AI usage is not zero and here where our problem began. We are paying for our AI usage through OpenRouter which charges on a per million token basis, this is simply because we want zero data retention ( which is opt in smh ). Hence all frontier models are simply not feasible for us to pay for every month. Mostly sticking to open-weight models like deepseek v4 flash/pro and kimi k2.6 which are well under $3-4 / M.

We were using AI to fix obvious code paths, debugging functions in our main strategy and creating analysis on market data that we were gathering. Writing long python notebooks by hand is very time consuming and AIs were giving us quite a productivity boost. Their reasoning seemed quite fine for the tasks we have.

This is where I think it clouded my judgment. Because we were up against a deadline we never set up any pipeline or rule-book for checking bias. So whenever we hit a strange result, we came up with all sorts of explanations except the obvious one - that something was wrong in the code or in our assumptions about market data.

Six months into development, while I was manually refactoring parts of it, I fixed a tiny bit of code. It was in a simple data loader utility that pulled bars data from our database into the model. Before it included one extra minute of data (a <= where it should have been <), it introduces a look-ahead bias and we weren't aware of it for the past 5 months and considered it as a positive result and ran with it. This was catastrophic because all of our assumptions and work were invalidated in an instant. This loader was generated by an AI, which we copied into our program on day one. Although the code was reviewed when it was added, it's the conjunction of this code with rest of our system was not explored by anyone.

Although this may look like that the same mistake can be made by a human. It wouldn't have happened if it was being worked on without AI help. Our main codebase is really small. AI's have contextualized this part numerous times, every time I have asked it to generate a new analysis notebook or something, it goes and reads the same data loader code. It has reasoned about our code base directly when I asked it to find any obvious bugs. It loves dissecting the complicated paths but never picked up this simple error. Any human would have caught this way way sooner if they had some time debugging and reading the code thoroughly, and took time to debug and check the output.

Now that we are snapped out of this AI psychosis it is really clear it's not just about this one error. AI changes the way you think. The worse part is that the output it gives now works 90/100 times. But just because it "works" does not mean it's the right thing to use. It's worse than gambling, it's like winning every time you are betting but there is a guy puncturing holes in your back and draining your blood out to offer it to the devil.

reddit.com
u/trueleo8 — 3 months ago