u/opoot_

I just installed Ubuntu 24.04 and rock 6.3.3 after using windows and vulkan for a long time.

Now I wanna install Hermes and llama cpp

But llama cpp has a lot of forks so I don’t know which one to use. I know there are some that are specifically for gfx 906 which is the vega 20 gpu

I’m interested in vllm since I have two of my mi50s and tensor parallelism but I hear horror stories in how hard it is to set up

I’m planning on primarily using the llm to power a Hermes agent for general use, basic research, and if possible a dnd game.

I greatly welcome any and all suggestions no matter how basic since I think I have a lot of knowledge gaps.

Thanks everyone!

I don’t know why it happens, but everything is kinda messed up because of it. I suspect it’s the Psu but I am unsure.

Specs:
ryzen 5 3600
The rainbow wraith cooler
32 x 2 trident z diamond 3600 mt/s ddr4 ram
Asus pro ws x570 ace
2x Mi50 32gb
Psu super flower leadex III GOLD atx 3.1 1000w 80 plus gold

Help usually my posts are more structured but I gotta fix this quick I don’t want anything to get messed up with current ram prices

I got a few and I’ll put them in as I remember them, but here are some.

- The elixir of life permanently displaces the water in your body, hence why it cannot be widely shared for group immortality and why Voldemort never wanted to use it as a permanent solution.

- Avada Kedavra being extremely hard, ridiculously hard to cast, which is why Voldemort was so feared, it’s basically only him that can spam it.

- Spell chaining, where the end of a wand movement is combined into the start of another, allowing you to cast faster.

- Wards. Not a canon thing, but I love them.

Like Pettigrew from Prince of Slytherin, though I haven’t read it in a long while.

Or Lucius Malfoy, who always seems to be a good bit weaker than expected.

How do you make death eaters actually a threat rather than just goons?

Obviously the big hitters like Bellatrix, Dolohov, Rookwood, are seen as strong, but most of the rest are just grunts.

In a world where they should have the numbers disadvantage, how would they be fighting the likes of Moody, Shacklebolt, most of the Hogwarts Staff, Aurora, Hitwizard teams, etc.

I’m curious how much everyone paid for their X4, I was able to get one for 220 HKD on PingDuoDuo which is about 28 USD including shipping.

I saw the price and thought “even if it doesn’t ship, it’s not a big loss.” It arrived and it was so much better than what I expected.

I wasn’t really that interested at first because I wanted to read more webnovels that couldn’t be downloaded. But for that low of a price, why the hell not.

I flashed crossink onto it from the sd card and it works flawlessly.

Edit: Paid for the order on June 1st

I use local ai mainly for creative writing, and benchmarks are a bit iffy on that I feel like. I’d like to compare Gemma mainly to Gemini as I like their writing the best, I do know that qwen 3.6 is amazing but mostly for coding and agentic work.

I’d like to ask everyone how the new(er?) models feel to you personally rather than looking at benchmarks which they are likely optimised for.

For me, I feel like Gemma 4 31B (even q4) still falls short of 2.5 pro, I’m most familiar with 2.5 pro since I used so much of it for free on ai studio when it was a preview.

The style and prose are there but long context it still misremembers minor details.

I think it’s actually better than gpt 4.5, but tha could be personal preference since, again, I do mostly only creative writing

I’m actually interested in the S4 BECAUSE it has android, I wanna get a device that can fit in my pocket and can go online.

This is because I want to be able to read from sites like scribblehub and ao3.

If there are other methods please do let me know.

I have a boox go colour 7 (7 inch screen e-reader) that I bought specifically because my kindle couldn’t handle web browsing, I was about to get a boox palma 2 to address this issue but it seems that the s4 could solve my issue

I’m only going to be reading text on scribblehub, not comics or anything.

I’m curious as to everyone’s thoughts on the matter, I know that many people are saying that the x4 was attractive specifically for its simplicity, and I understand that.

But I’m wondering if there’s anyone else who’s in a similar boat to me and if they have any insights on this.

Of course, it is quite possible that the power it has is too low to scroll web pages effectively, but I’m not entirely sure on this matter.

Would love to hear what everyone thinks about this, I’d love to save 200 usd or so to not get the palma 2 and have to worry about babying it.

As per the title.

Colour is not necessary, I don’t care whether it has colour or not.

I’d like for it to be able to scroll decently, I want to read from sites like ao3 and scribblehub.

I currently have a boox go colour 7 and it’s perfect except I wish I could pocket it.

For that reason I’m looking at the boox palma 2 but do tell me if there are any better options.

Thanks in advance

As per the title

Such as Gemma 4 31B Q4 K S vs Gemma 4 26B A4B Q8
Or
Qwen 3.6 27B Q4 K M vs Qwen 3.6 35B A3B Q6 K

Etc

At what point is it worth switching?

My use case is mostly creative writing.

You are approached with an offer: You get $3000 USD per month for the rest of your life but you can never work for money ever again.

You keep any and all assets and money and whatever you currently have.

You CAN invest any and all money you have, including whatever you already have and what you gain from this offer.

Investing is the ONLY way you can earn money other than this offer. You cannot be employed, start a business, or offer services for money.

You can still sell things second hand, but you can only sell things second hand for at most 50% of the value that was paid for it.

The $3000 USD per month will increase to match inflation every year.

If you accept this offer, what is the minimum amount of money you’d still accept the offer at?

If you don’t accept the offer, what is the minimum amount of money required for you to accept the offer?

Edits will be posted in a separate edits section for clarification only.

=====

EDIT 1: Untaxed, you get all of it.

EDIT 2: You do lose whatever benefits your job gives you, such as insurance if it’s covered by your job.

A genie approaches you with an offer. He decides that you deserve superpowers and gives you a choice between two superpowers.

1. Invisibility. You turn completely invisible while maintaining your ability to see, hear, smell, touch, and taste.

The invisibility will be as if you weren’t there, as in: if you were standing in a place where you are not depressing anything or propping up anything, it would be impossible to tell you were there based on human sight.

You still emit heat so thermal cameras work on you.

The invisibility is based on magic so you can still see normally despite light not technically being absorbed by your eyes.

There’s no protection against people finding out about your power besides whatever precautions you take.

You can still touch things and people. And people will feel you.

Clothes do not disappear with you, nor any accessories, prosthetics, or glasses. Whatever you are holding will also be visible. You can technically make something invisible by putting it inside of your body. The “invisibility” will shield the item inside.

Edits to clarify this power will be put below in an edits section.

2. Flight.

Just as before, there are no protections protecting your power from being discovered besides whatever precautions you take yourself.

Your max speed and acceleration are whatever your max running speed and acceleration are on the ground times 5. If you run 10 meters a second on the ground, you can fly 50 meters a second in the air. Similarly, if you accelerate at 3 meters per second squared, it’s 15 in the air.

Flying also requires 5 times the calories you would expend if you were to cover the same distance at 1/5 the flying speed on the ground via walking/running.

You can carry only the same amount of weight as you can on the ground with the same effort. For example, if carrying your backpack gives you 5 tiredness on the ground (arbitrary, used to illustrate my point), then you get 5 tiredness for carrying the same backpack while flying.

The flight is magic levitation, and you can use it to amplify force exerted by flying in the direction of the force exertion.

EDIT: I accidentally sent this post before fully writing it, oops.

As per title, is there anything that works for 1.2?

A genie approaches you and makes you an offer:

You learn every human language you currently do not know, but you will forget any and all languages you currently know.

This offer does not apply to computer language.

For a language to be included in this offer, it must currently have at least 10,000 native speakers. Languages that have less than that cannot be learnt or forgotten with this.

The languages you lose cannot be relearnt.

This offer does not apply to new languages invented after you take this offer, so you will not automatically learn them, but you are also not barred from learning them manually.

Proficiency in language is defined as you knowing at least 100 words of it off the top of your head. This metric will be applied to any language you know. If you know at least 100 words of the language, you lose it. If you don’t, you gain it.

Edits to clarify will be posted in a separate section for edits later.