Two 5070ti for local AI + Hermes?

I've been toying around with a simple home server running on an old office PC in which I fitted a 2060 Super for shits and giggles. For Hermes I've been mostly using LLM models through API though.

I have some money to spend that I want to invest in a new setup. When I ask Gemini for recommendations it keeps recommending me a setup with two 5070tis. It does sound attractive because one 5090 is like 5x the cost of one 5070ti.

At the same time though, I'm not sure if it makes sense to use a gaming GPU for something like this as I won't be doing any gaming with it.

As for use cases, I want to stop using LLMs through API for most tasks. I want to build websites and apps for which I would need coding help, but probably nothing groundbreaking. I also want to build a safe local AI that my family members can use. And maybe even fool around with automated crypto trading.

So... What do you experts think? Are there better options than two 5070tis?

PS to mods: I think a flair for "help - hardware questions" would be nice?

reddit.com
u/dyna_black — 5 hours ago

Cannot get Brave Search API (paid tier) to work with Gemini models

Hi folks,

TL;DR:

  • Gemini models (3.5-flash, 3.1-pro-preview) do not work with Brave Search API on my set up.
  • It works flawlessly with ChatGPT models though, when using Native function calling.
  • Looking for advice from the community... Happy to provide screenshots and debug logs.

Here's the situation as summarized by Gemini (native web UI):

  • Environment Setup & Objective: The deployment runs ghcr.io/open-webui/open-webui:main inside a Docker container using host network mode on an Ubuntu VM managed by a Proxmox homeserver. The system routes external traffic via Cloudflared, utilizes a local sentence-transformers/all-MiniLM-L6-v2 embedding engine, and aims to get real-time Brave Search working seamlessly across both OpenAI and Gemini models.
  • Actual vs. Expected Behavior: ChatGPT models execute native tool calling and web queries perfectly. When prompting Gemini (e.g., gemini-3.5-flash or gemini-3.1-pro-preview) for live data like current sports results or weather, the model either responds that it lacks live internet access with a "No sources found" UI tag, or it hangs and returns a completely blank chat response.
  • Log Diagnostics & Vector Database Status: Backend logs confirm that the web scraping engine is fully operational. Open WebUI successfully connects to the Brave API, fetches the target web pages, processes them using the markdown header text splitter, generates vector batches, and successfully commits 18 to 49 items to the temporary ChromaDB collection (web-search-1a763...) before the payload is dropped right before transmission to Google.
  • Troubleshooting Actions Already Taken: Configuration changes included resetting custom RAG templates back to factory defaults, toggling model parameters between Native and Default function calling modes, and injecting environment variables like ENABLE_RETRIEVAL_UNSCOPED_COLLECTIONS: "True" and WEBUI_LOG_LEVEL: "DEBUG" to bypass session isolation. The issue persists exclusively when Gemini is mapped via the https://generativelanguage.googleapis.com/v1beta/openai endpoint connection.
reddit.com
u/dyna_black — 20 days ago

Pu-Erh Tea Recommendations?

Hello lovely people.

I'm looking to order Pu-Erh tea online at a reasonable price. It'll be for daily consumption so nothing too fancy. (So far I've been drinking Pu-Erh tea in tea bags by a Japanese company...)

If you have recommendations for websites that sell authentic Pu-Erh tea, I would love to hear about it.

Thanks in advance 🙏

(Sorry for the lazy post, I did take a look online myself, but frankly I have no clue how to evaluate whether a shop/product is good or not...)

reddit.com
u/dyna_black — 1 month ago

Nice lunch discovery

Kubelto in Meinohama: https://maps.app.goo.gl/Qb8bwjGdn9cL8bMk7

Just went there for the first time. 2,500JPY for a buffet lunch including two small main dishes and soft drinks.

Not sure how often they rotate the main dishes but today's were super tender chicken thigh with subtle teriyaki and shio-koji flavor and some pasta with asari in tomato sauce. The chicken was some of the best I had in a long while and the pasta taste was OK, cooked nicely al dente.

The buffet had salad, french fries (with truffle salt), hambagu, fried fish, fried chicken, pizza, curry rice, soup and a whole lot more. I didn't try everything everything, but overall it was pretty amazing. The desserts were also yummy.

2,500JPY for all this is great "cosupa"! Just wanted to share the word around because I have no clue how they can turn any profit with such a deal. I don't want them to go out of business lol.

u/dyna_black — 1 month ago
▲ 2.0k r/Eredivisie+2 crossposts

Maya Yoshida receives a guard of honour from both Japan and Iceland, as he retires from international football

u/TenaciousPenis — 1 month ago

ベントー作ってみた

朝から妻を怒らせて娘のベントー当番頼まれた。玉子焼きはチーズイン!

u/dyna_black — 2 months ago

Anyone looking to buy a gaming laptop?

I'm selling my Lenovo Legion 5 (15IA7H7, 3060 GPU). I put it up on Mercari but if someone here wants it I'd be willing to sell it cheaper.

@mods: I wasn't sure if this was allowed, it doesn't seem to be against the rules as they are now. Please feel free to remove if you wish.

Thanks!

reddit.com
u/dyna_black — 2 months ago
▲ 0 r/Steam

The new Steam Controller is around the corner and I'm excited. I'm not a good KBM player so I have been replying on a thumbstick (Maxxstick) to play FPS games.

Some games allow dual input, meaning I can use the thumbstick for 360 degree input. However for most games I have to set the stick to WASD mode; if I don't the UI will flicker back and forth showing button input and keyboard inputs.

Now with the advent of the Steam Controller I think many users can benefit from setting the trackpad as a mouse and use the stick for 360 movement in the same way. And ideally most games should allow dual input and prevent UI issues.

Do you think Valve should play a role in encouraging/incentivizing developers to implement this? I surely do. One could think of spotlight sections on such games, dedicated tags and "dual input compatible" badges.

It'll help increase exposure for devs taking the effort, and it'll probably also help the popularity of the Steam Controller (and Steam Deck of course) among FPS players.

What do y'all think? 😊

reddit.com
u/dyna_black — 2 months ago

いつも一人でやってるんだけど、ちゃんと連携がとれる友達募集中。

下手なので、それだけ許してくれれば。💗

(ってか前にも聞いたような気がして、そん時誰かが反応してくれたけど、そのポストが見つからず・・)

reddit.com
u/dyna_black — 2 months ago