Motivated by the somewhat larger in scale question https://www.reddit.com/r/google_antigravity/comments/1vqfvgo/what_is_the_feasibility_and_cost_of_selfhosting/
So apparently self-hosting frontier models puts you into the range of tens of thousands of cloud costs a month or hundreds of thousands in Hardware purchases.
But, asking as someone who has run his Google AI Pro subscription dry with a mere hobby project and limited time per day for it: What would be the realistic cost of setting up something akin to current ChatGPT/Gemini/etc offerings? What if you want it to do not only programming but be as multi-purpose as those offerings with image generation, general purpose questions, reasoning?
I've read some articles about local LLM usage. I know that I could technically get started on my old GTX 1050 Ti laptop (the newer one has integrated graphics). But I've never quite come across a full discussion of the setup and hardware costs if you don't already own it.
My intuitive guess would be that you can't beat the package offerings, if you account for recurring hardware upgrades and software maintenance (if you assign yourself some virtual hourly rate for that work). Which leaves the privacy advantage. And the ability to remove guard rails that may get in the way. The latter can be mitigated in ChatGPT by letting ChatGPT generate a prompt it considers within the guardrails and then using that for the next step, but the privacy aspect can't / is locked behind enterprise tiers.
> Dear NAME > > We’re writing to let you know that we reviewed your report (ID NUMERIC_ID). > >Here's what we found > >We decided not to take this ad down. We found that the ad doesn’t go against Google’s policies, which prohibit certain content and practices that we believe to be harmful to users and the overall online ecosystem. > >(If you have additional information that might help us reverse this decision, you can let us know by reporting this ad again within six months, or you can learn about your other options to dispute this decision.)
I have received this reply after reporting an ad. I ocassionally report ads thatr are clearly misleading, e.g. mobile game ads depicting gameplay that isn't related to the actual game, but also various misleading tech or financial ads.
It's expected that Google might not share my opinion on it. However, both links ("reporting this ad again" and "dispute the decision" are useless:
"dispute the decision" leads to https://support.google.co.uk/european-union-digital-services-act-redress-options, which gives me "site can't be reached". Note that I'm in Austria, and the UK is not in the EU anymore, so this link might just be plain outdated.
"reporting this ad again" gives me a long alphanumeric ID under "Ad or listing link (do not change if prefilled)". But in order to re-report, I'd need to actually see the AD again. It's not like I remember the ad after over a month, nor do I know which one it could me.
Is there any way to sensibly react to ad report rejections?
Edit. Habe einen spanischen Artikel darüber gefunden der mehr ins Detail geht.
Der Focus ist hier wohl sensationalistisch. Wichtigstes vergessenes Detail: Die Sache ist nicht endgültig, sondern noch in Verhandlung. Die Familie kritisiert dass alles sehr schnell, sehr eilig gewesen sei, aber nachdem sie ein Gegengutachten für die Bewertung der Grundstücke eingebracht haben (anscheinend für den Enteignungsprozess auch zwingend vorgesehen) ist es still geworden und nichts mehr mit der großen Eile. Wenn es in diesem Schritt zu keiner Einigung kommt, wird es auf eine höhere Instanz eskaliert.
Preislich klingt das Angebot wirklich seltsam; Soweit ichs verstehe sind in unmittelbarer Nähe ein großes Einkaufszentrum und Wohnbaugebiet. Ohne das Microsoftprojekt würde also in der näheren Zukunft lukrativer Verkauf für Wohn- oder Gewerbegebiet in Aussicht stehen, und nicht als billiges Agrarland. In Österreich wäre "zuerst kaufen, dann erst umwidmen" ein klassischer Fall von Korruption oder direkter Selbstbereicherung auf Kommunalebene.
Der Rest ist das klassische Problem: Großkonzerne bekommen alle möglichen Zuckerl damit sie sich ansiedeln, obwohl diese Datacenter-Projekte eigentlich keinen Mehrwert für die lokale Community bringen — kurzfristig viele Jobs fürs Bauen, danach aber vergleichsweise wenige laufende Jobs, aber hoher Resourcenverbrauch, der sich meist auch auf Lebenshaltungskosten (Strompreis, Wasserpreise) der Bevölkerung nachteilig auswirkt.
Der Enteignungsprozess an sich ist nichts, was es in Österreich nicht genauso gäbe.
I thought to make it explicit about all of them going to hell, according to the Catholic dogmatic view of treating suicide as worse than murder, and God telling Satan "it's your problem, not mine".
I also thought of hinting at people meeting their thousands of murdered clones at the gates of Heaven/Hell.
But then I thought it's probably more interesting to leave it unspecific to any particular religion and outcome.
I am getting this kind of error all the time today with the only way to recover being to start a new chat. Anyone else seeing this? The client lists itself as being updated on Jul 24th.
Motivated by the concept of false vacuum and vacuum decay. A fun way to learn about it is Kurzgesagt.
I asked ChatGPT to make a crime scene parody in 90s anime style and listed some anime titles as a reference. At least the young woman front left looks suspiciously exactly like the actual character Ran Mouri. The rest looks familiar, but also generic enough to be familiar just because of the style. I feel like I've seen them somewhere, but I can't find characters looking quite like that.
Prompts were
>Depict police trying to solve a body parts puzzle. 90s anime Style (think detective Conan, Kamikaze Kaito Jeanne, Mila Superstar).
>Make the body parts puzzle have more realistic features. It should remain looking like a literal puzzle, but also like a person, not just a mannequin. Text should be English, not Japanese. The puzzle should be on the ground, market [sic] with crayons as a steoreotypical murder crime scene.
The idea was from remembering an episode of Navy CIS, where they had to deal with a more gruesome dark-humor version of body puzzle. The dark humor was mostly from >!when they find a third collar bone and realize they have to start over.!<
I was originally thinking "alcohol" but keeping the explanation open seemed more interesting.
Sorry if this seems a bit ranty.
I have now had two real-world use-cases, where I was in a position to really judge the quality of the results with Gemini.
For the summarizing of project work, it gave superficially viable, but ultimately unusable summaries, despite attempts to prod it into the right decision, including providing my own summary as feedback. It kept emphasizing details, that were unimportant for the summary, neglecting some topics, and missattributing work listed in the reports despite my clarifications.
For the hammer drill list I wanted to ask it to assemble reviews. As a first test I asked it to list the models I've already excluded. On that it answered that my configuration doesn't exclude any Gemini models (despite the file as context). When changing the query to explicitly "hammer drill models", it came back with an incomplete list. Upon further prodding it claimed, that the file doesn't contain the information.
I keep hearing people talking about how they use Copilot at work (in Europe basically every business uses the Windows ecosystem, nonody seems to use Google Workspace). Is Copilot that much better at such tasks, or am I doing something wrong?
Previously I was mostly asking questions on subjects I didn't know anything about, so I wasn't able to understand if an answer was wrong, though I did notice answers from separate chats contradicting each other.
^(I chose Gemini for my own use, because I already need a Google subscription for my large archive of Emails and for Google Photos. Changing the AI subscription would ultimately require switching everything to the Microsoft ecosystem or pay double.)
The first thing I noticed was the power draw in the range of several 100 kW instead of ~1kW realistic. Then the impact energy of 20-25 Joules, when realistically it should be 1.5 to 5. The closer you look the worse it gets; Some text vaguely resembles German, some is just outright letter salad.
It did get the Vault-Tec aesthetic down though.
