u/circumcised_hobbit

I have i7-14700F processor and 16GB DDR5 RAM, I only have a 4060Ti 8GB and wanted to have more Vram.

I thought about a home server at the start but it's genuinely too complex.

I decided I should buy a 4060 16GB in the end. Could I run Qwen3.8-27B-GSQ-RCO-Q3_S decently? Do you have any Better solution rather than new GPU? Should I buy a different GPU that can fit my PC (I know nothing about PC building)?

Every single free API became unusable. I used to go for Opencode Zen, now it can't be used outside of Opencode and it's not usable in Pi. Openrouter used to be decent but the limit ends in 5mins. All the others seem bs too

I am pretty dumb in this kinda stuff so please don't blame me for it.

My llama serve kept crashing with Cublas errors on first prompt with some models, but my VRAM usage was 3000MB/8k. I chatted with sonnet 5.5 for a bit and it told me it was a CUDA version issue (and made it work by not selecting a CUDA device)... I don't know if this makes sense, please tell me if it doesn't/what problem you think there is.

I realized that the best way was to delete llama.cpp (installed with the install script) and install a clean CUDA 12 Ubuntu version.

- How do I properly uninstall llama.cpp (I don't wanna mess with Ollama files)?

- How do I install new version from .tar.gz archive without messing with system packages?

-Does my error diagnosis make sense to you? Would CUDA make generation actually faster? (I am getting 8tk/s with Qwen35B Q2 on 4060Ti 8GB due to no CUDA selected)

I was thinking about using WebUI but I have a big problem with ollama serve command. Basically I made a python script that uses Ollama API and it works damn well if I don't serve the Ollama server manually and it does all by itself If I do Ollama serve, the API calls from python are shown in the terminal but they return absolutely nothing (ex: ollama.list() returns empty) It works again if I ctrl^c the terminal window with the ollama server I figured out that the server might be starting automatically on pc startup and I break it by starting manually, but Idk how to check that I'm on Linux Mint Cinnamon

Edit: I completely killed the Ollama service then ran ollama serve, again, didn't work at all and the python API doesn't work

I want to create a complex first app

I got this idea into myself to host an AI chat platform, but I came to the conclusion that the best way is to make a website, but I do know almost nothing

So my basic idea Is having users to purchase a Key valid for a certain amount of time, they paste it in the website and It serves as an authentication.

How could I do that? my idea Is website sends API request with Authorization header->cloudflare tunnel->a backend Python script process a answer->sent back to user

but: -how can I manage multiple users? do I just make so that the Python script associates the Key to the prompt and forward It to vLLM, then also tie the answers to the response so I can trace the user back and not mix them up?

-how can I grant user support if no account Is made? what if they just lose the key? They would have no way to invalidate or regenerate It

-how do I keep the Key between sessions? just write it in local storage?

-How can I manage 2 APIs for both account creation and chats?

But mostly, AM I MISSING SOMETHING? do you think this is actually doable if a newbie puts time into It? (I am only experienced in python)I am thinking of making a beta version that Is super basic (no context, One single chat) and improve It over time Also if somone is available to help I would love it

I want to create a complex first app

I got this idea into myself to host an AI chat platform, but I came to the conclusion that the best way is to make a website, but I do know almost nothing

So my basic idea Is having users to purchase a Key valid for a certain amount of time, they paste it in the website and It serves as an authentication.

How could I do that? my idea Is website sends API request with Authorization header->cloudflare tunnel->a backend Python script process a answer->sent back to user

but: -how can I manage multiple users? do I just make so that the Python script associates the Key to the prompt and forward It to vLLM, then also tie the answers to the response so I can trace the user back and not mix them up?

-how can I grant user support if no account Is made? what if they just lose the key? They would have no way to invalidate or regenerate It

-how do I keep the Key between sessions? just write it in local storage?

-How can I manage 2 APIs for both account creation and chats?

But mostly, AM I MISSING SOMETHING? do you think this is actually doable if a newbie puts time into It? (I am only experienced in python)I am thinking of making a beta version that Is super basic (no context, One single chat) and improve It over time Also if somone is available to help I would love it

I want to create a complex first app

I got this idea into myself to host an AI chat platform, but I came to the conclusion that the best way is to make a website, but I do know almost nothing

So my basic idea Is having users to purchase a Key valid for a certain amount of time, they paste it in the website and It serves as an authentication.

How could I do that? my idea Is website sends API request with Authorization header->cloudflare tunnel->a backend Python script process a answer->sent back to user

but: -how can I manage multiple users? do I just make so that the Python script associates the Key to the prompt and forward It to vLLM, then also tie the answers to the response so I can trace the user back and not mix them up?

-how can I grant user support if no account Is made? what if they just lose the key? They would have no way to invalidate or regenerate It

-how do I keep the Key between sessions? just write it in local storage?

-How can I manage 2 APIs for both account creation and chats?

But mostly, AM I MISSING SOMETHING? do you think this is actually doable if a newbie puts time into It? (I am only experienced in python)I am thinking of making a beta version that Is super basic (no context, One single chat) and improve It over time Also if somone is available to help I would love it

Pretty simple, I tried almost anything I could find with Q4K_M and it refused any harmful test prompt I could find, does anyone know a decent versione/how fo make It work?

So I've been getting on and off this game for a year and I still haven't completed It (I know its embarassing). I used to have serious glitchiness with audio cutouts but It would sometimes Just go away. I know have switched to Linux and I am using Heroic but It is just unplayable. Gameplay audio Is decent but cutscene voices and musics are 80% cut and it's ruining my ears. Any fix?

I noticed that I am having this problem only with bluetooth headphones, not with cabled devices Also switching to different audio settings (such as home theatre) fixes It for 10-15 seconds then It goes back to being buggy

SOLVED!: connect the controller after logging in the game, if you are on Linux use bluetoothctl from terminal to connect

pretty simple I did ollama launch claude, found out its slow asf, wanted to delete It and Idk how I have no idra if its the same as normal Claude Code uninstall or if it's a Little bit of a different version. What am I supposed to do?

Very dumb question: Ive Just been to Atomium and I liked the spheres with the small screens and music and stuff. There was a specific song which I am SURE I knew before but I don't know the name. It Is a high pithced choir doing Has anyone been there recently and knows the name

So I installed a lot of games from legitimate website like FG and Steamrip and used Brave adbocker. I just found out that you can get virus from redirects of download links tho. I always used an AV (the shitty ass McAfee or Just Microsoft Defender) and most of the times I even scanned every single file with VirusTotal. AV was always on and I manually excluded important false positives from the real time protection. How likey could have I gotten a virus? Is a scan with MalwareBytes enough?

Is there any way to delete all messages from a DM for myself and empty the chat, so that It appears without any messages? I don't need to delete them for others, just for myself, just like whatsapp "clear chat" feature

It's been months I am not able to post any videos without getting more than 20views, as if I had been shadowbanned. I chatted with the support for MONTHS and they closed the chat randomly after telling they were looking into it and making me wait. Same thing happened Yesterday, my support ticket got closed with the explanation that It Is "expected behaviour". Does anyone have amy advice on how to resolve this. I went from having 4000-20k views a video to having 0-20 and It ruined my experience completely. AFTER I MADE THIS MESSAGE TO SHARE IT, THE TICKET GOT CLOSED AGAIN TELLING ME THAT "FEATURES MAY BE ROLLED OUT DIFFERENTLY" I CANT BELIEVE THIS

It's been months I am not able to post any videos without getting more than 20views, as if I had been shadowbanned. I chatted with the support for MONTHS and they closed the chat randomly after telling they were looking into it and making me wait. Same thing happened Yesterday, my support ticket got closed with the explanation that It Is "expected behaviour". Does anyone have amy advice on how to resolve this. I went from having 4000-20k views a video to having 0-20 and It ruined my experience completely.

as I said in the title, tiktok support Is basically shit. They shadowbanned me without any reason and I went from 1.5k views average to 0-2 without posting anything out of the TOS. I've asked for support center help and I have chatted with them for month without getting a real answer, they Just kept saying "we are working on It, Sorry for the waiting time" and shit. Now they closed the ticket without any reason and didnt solve my problem

I'm new on rep stuff. I stumbled on pandavault and It seems good but I have a couple of questions. -Is there any chance that my product doesn't arrive and doesn't get refunded since I'm in EU (I'm talking about border control) -Is there any agent website that accepts PayPal?

I saw It on Instagram, I Remember It clearly and I think It was kinda famous. here are the Key details:

-black teen, then his Friends arrive, he doesnt have a shirt on

-filmed outdoors, when It starts hes doing a barbecue or something like that

-very important: It says JE----JE---JE-JE-JE at the start, then the main beat drops and he starts rapping

-I think 2010s but could be ~2020 cannot find It anywhere and chatgpt couldnt help me, Im sure It was kinda famous tho

-I Remember that It was his First success and I Remember VERY CLEARLY that he got to perform to his school After It became famous

edit: found It, It was shotta flow by NLE choppa