Before I get thrashed by people for asking a seemingly stupid question. I am new to this part of A.I. All the A.I stuff I've been doing is text-to-text (mostly coding). So be gentle please.

Recently I got Qwen-Image-Edit on my A.I server. It generates images fine without downloading ComfyUI. I set it up with a simple python server and it works fine.

This leads me to ask, why should I download ComfyUI? What does it do that can't be done with just a simple python script? Is it just the ability to visually connect lines between parts of the workflow? Note that I am a software engineer, and actually prefer command line interfaces for making stuff in most cases. Is there some other benefit I am missing?

Which works better? I've been using VLLM but google and some others say for single user cases llama.cpp is better. But no one (including google) seems to be sure of why exactly that is the case.

Latency seems to be the main thing, but why? what latency? What is it that llama.cpp does that makes it better for multi-turn tasks like coding something?

- The product does something people already desire.

- It does so better than any other does it (as far as I know).

- The market is very small, and thats likely the reason no one else has really done it well yet. They overlook it for being too small. I.e. The beachhead market size is only a few million dollars in Canada.

- The product solves an impossible problem in an automated way. I.e. I could not solve it manually if you gave me months to do it. But this does it in 5 minutes. Likely to patent it.

- Once I have the patent filed, I plan to start with one customer who has agreed to work with me. I've been interviewing him a few times to figure out how he works.

- Only after that one customer is happy with it do I start looking at the next customer, targeting ones who work in the same way he does and continue slowly in that way.

- Most issues are resolved from by self testing, by putting my self in the customers shoes. I.e. doing the same tasks I know the customer does. If I get confused then I schedule another interview with the customer, with some specific questions.

Been around a while now (many years). What I've noticed is that most people really do treat each other very poorly most of the time. I realise there is likely some kind of evolutionary reason behind it. i.e. Competition for resources for example.

But aside of that. Why? Why are people such jerks to one another? They knowingly hurt each other.

Very new to stable diffusion and it looks like I am going to have to create a custom LoRa for what I am doing be cause I don't see any existing ones that do it.

So far I've tried the base Qwen image edit with unsuccessful results.

Can anyone point me in the right direction in terms of going about training a custom LoRa? I have same paired images I can use for training but not many, like a few dozen at the moment.

EDIT:

- it's image to image, basically style transfer.

- Only real images, no characters, must be photorealistic.

- Must allow fine grained control of lighting positions.

I have tried Nvidia's diffusion technique the splits an image into its various components and allows you to change the lighting, but the results were very muddy looking and very low resolution.

Mode: Qwen Image Edit 2511

How much VRAM do I need to train a really good LORA?

Recently I was legit shamed by a friend for suggesting that Short Circuit was a good movie and that I liked the actor in it (The scientist with the strong accent).

He said it was because that actor played an Indian even though he was not Indian.

However I enjoyed it, I didn't realize he was not Indian, and I thought he was genuinely entertaining and liked it.

I asked me friend about it, and he wouldn't even look at me after suggesting he was a good actor. i.e. Actors play different people, different races etc, and I legit don't understand why that's considered wrong.

NOTE: I would understand it if it was to poke fun at a particular ethnicity, but that's not what I am talking about. I mean actually playing a role that happens to be a different race, with the intent to play a role, not too make fun of some group. Most people don't read this far, and revert to shaming me, but I really question their thinking process if they don't even think about it.

Am I missing something here? why is it considered politically incorrect to play a a race other than your own in a film? .

Like Australian actors playing American roles all the time, they use an american accent, but I don't hear people freaking out about it. So what's the problem? Why is it a problem?

Looking a Qwen Image Edit 2511 as a candidate.

Likely going to buy another RTX 3090 (or RTX 4090) specifically for image editing tasks.

Curious if anyone else had experimented with local AI for image editing, what your setup is, and what you wish you had done differently?

MB: Asus ProArt Creator B850 Neo

Case: Fractal North XL

Problem:

The distance from the bottom PCIe slot to the PSU shroud does not fit anything more than a single slot GPU. 2.5 slot GPU's fit, but the airflow is almost entirely cut off because the fan is pressed up against the PSU [1].

I got around it by buying a $250 PCIe 5.0 riser cable and mounting the 2nd GPU at the top of the case, but this is very much a hack, and its pretty bad.. Considering this is a $4000 build, I don't want to have a $1200 GPU hanging by wires...

- I have 2 days left to RMA my current case, I intentionally bought a Fractal North XL under the assumption it could fit the two GPU's, but it does not.

Question:

Has anyone build a dual GPU build with this motherboard, and been able to fit two large GPUs in it without hacks? i.e. What case did you use?

Link showing the issue:
[1] https://www.reddit.com/r/pcmasterrace/comments/14bky3y/fractal_north_and_4090_distance_to_psu_shroud_for/

I want to run a low-power agentic session in "plan" mode that just searches the code base for problems, then reports them back to me in the morning.

Speed isn't as important, more so getting deep down into all the serious bugs is.

Anyone have a setup that can do that with opencode?

I am just starting out with a new business, still developing the product. Got into an argument with someone yesterday, because I felt somewhat conflicted about the current path.

Current path: I've found an area where I believe I have a clear advantage over existing solutions. I am currently persuing this path.

Alt Path: An A.I service for Canadians, I already have the server setup for my own work, but I have no obvious advantage over existing solutions. i.e. There are solutions way WAY better, the only reason I built my own is because I value privacy and don't feel comfy sending deeply personal info to some server in California.

Anyway I got in an argument with someone who kept saying I should take the Alt Path despite having no clear advantage in the market. My instincts tell me the guy didn't really understand much about business. i.e. Customer's just go for whatever is better if they can afford it. He then claimed "the real advantage is your network." I walked away saying to me self "wtf is he talking about?" Customers don't care about your network, they only care about what you're product or service does for them. Note: This guy was a freelance graphics artist, super nice guy an all, but I suspect he just doesn't think that way.

How I rank opportunities:

- Ability to innovate in that market. i.e. Can I actually produce something better than what currently exists in that market. A niche makes this far easier. (and its indeed a niche).
- Customer is reachable, likes talking to me, has money to afford it, and is suffering from a real pain.

NOTE: I get the feeling this guy didn't really understand what I was talking about. i.e. When questioned about where the advantage is in the Alt Path vs the Current one, I think he more so interpreted as "How do I have an advantage over him", because he seemed offended. (Which is the completely wrong interpretation) I was in fact just bouncing ideas off him, not fighting him.

Anyway, if any business folks would like to offer advice, I will listen.

My A.I basically says that's its just his perspective. i.e. For HIM its the network that matters, but I am not a graphic designer doing freelance work, I am developing a new innovative product.

Why the Graphic Designer Perspective Differs

You mentioned he's a freelance graphics artist. This is key.

• Creative Freelancers often succeed based on:
  • Personal relationships.
  • Portfolio quality (subjective).
  • Word-of-mouth.
  • Low overhead, high touch.
• Product Founders succeed based on:
  • Scalable value.
  • Technical or economic moats.
  • Product-market fit.
  • Unit economics.

But reliable I mean there are no catastrophic error that effectively end the session.

I.e. no 400 errors about malformed JSON.

I don't mean perfect code.

Current I am using the VScode Continue plugin with vLLM on the back with 48gb vram and Qwen 3.6 27b

But any context greater than 19k results in instability, crashes on the backend due to malformed JSON.

Single steam benchmarks (club-3090)

model:

qwen3.6-27b-autoround-int4

BEFORE:

1x3090

*Their default script recipe for single 3090'*s (4-bit quant and 4-bit kv cache, mtp=2)

NARRATIVE decode_TPS: mean = 53 std = 0.6

CODE decode_TPS: mean = 62 std= 1.4

AFTER:

2x3090

Their default script recipe for dual 3090's (4-bit quant and 8-bit kv cache, mpt=3)

NARRATIVE decode_TPS: mean= 94 std= 1.3

CODE decode_TPS: mean= 120 std= 2.1

This is running without NVLink, on a 8x/8x motherboard, for some reason P2P was automatically enabled (no driver hack needed), Tensor parallelism = 2

I am truly shocked that I got almost linear scaling in performance. I still get odd parsing errors in my quality tests when editing large code files in Agent mode (VSCode), (but not the same ones as before), for some reason forcing the model to use CLI editing tools is much more reliable than whatever VSCode is doing with the Agent. I am going to likely move to their 8-bit weight model recipe as well.

>500 Failed to parse tool call arguments as JSON: [json.exception.parse_error.101] parse error at line 1, column 64: syntax error while parsing value - invalid string: missing closing quote; last read

That's the error that's been haunting me. But I don't really know the cause, it only seems to occur when the context has grown very large, like a very long vibe coding session.

I'm cases where ram is limited I've seen a preference for increasing kvcache precision instead of the weight precision.

I.e. 8bit kvcache but only 4bit weights.

But I can't seem to find a solid explanation as to why?

this site is terrible and I'll never order anything from it again.

https://preview.redd.it/bxtseq53cy2h1.png?width=609&format=png&auto=webp&s=f9798f671bceaea75a2d46a586df256b124a5a3d

https://preview.redd.it/mfvpj384cy2h1.png?width=538&format=png&auto=webp&s=999fc8b8e6f3c23f376a793ed98170df9d3ae33e

You're product labels are misleading, I ordered 2x16GB ram, then I get an email saying its only 1x16GB. So I go to cancel the order because its wrong, but the site if full of bugs and broken. I can't even cancel the wrong order, and when I do try, the page that is supposed to show the date I have to return it, and that doesn't work either.

So yeah does this mean almost $400 is now gone? No support, no answer from the seller.. wtf?

Considering my dual RTX 3090 build, I read that the communication between cards will limit the inference speed, but I can't find any actual benchmarks showing this. i.e. NVLink is assumed to help, but I'd love to see data that supports this.

Has anyone seen benchmarks comparing dual RTX 3090's with and without NVLink for AI inference? (Say with a 30b LLM model?)

About to buy one of these things for a local LLM build.

Curious what people have / or are currently paying for a used one in the Canadian market? i.e. Canadian dollars.

I ask because the asking prices are often inflated, and I don't want to overpay (obviously).

Thank you, you very kind people!