A recent ComfyUI update has included the two new HiDream templates mentioned in the title. I should welcome responses to the following questions.

1. The general pros and cons of HiDream.
2. Use of multiple reference images. How best to organise? How many? How to integrate with textual instructions?
3. Is the use of multiple reference images implemented for other visual AI models?

Conversion from Parallel to CrossView - 'AI slopped' 2D image

https://preview.redd.it/g5kgpv56p70h1.png?width=1488&format=png&auto=webp&s=1530df4e12d96fbaa9c6da7b7daf2b7bf4c45aef

Image conversion to stereo pair.

The Subgraph facility offers uncluttered workspaces, and that is most welcome.

One gripe arises. Sometimes, user-alterable parameters (e.g. steps, and cfg) are hidden along with the spaghetti. That's understandable when the workflow designer is convinced that their chosen parameters are optimal, and doesn't wish to confuse neophyte users.

However, when one wishes to explore the effects of parameter alterations it can be a tiresome task searching for relevant nodes within a massive tangle.

Reasonable middle ground could be offered by bringing commonly altered parameter specifications to the open display. These could be assembled within a node for this specific purpose, instead of displaying individual sampling nodes, etc.

https://preview.redd.it/6swqgtms5tzg1.png?width=1536&format=png&auto=webp&s=4283439752729809e9293c317838e386d148b5dc

https://preview.redd.it/7jpb74g09qzg1.png?width=1536&format=png&auto=webp&s=a7bbe6429559eada3f7a34518e0d4e733bea13f3

At present local-use Comfyui offers only two Chroma-variant workflow templates.

"Chroma1 Radiance Text to Image" and "Chroma: Text to image"

Each works well.

I've looked elsewhere and came across only one Image→Image workflow. This was overly elaborate and had a nightmare set of custom nodes. I couldn't work out how to reduce it to simplicity.

Can anyone suggest simple modifications to the template examples? Would that also involve a different Chroma variant? Else, can an Image→Text LLM be inserted in the flow?

Guidance would be appreciated?

At present local-use Comfyui offers only two Chroma workflows templates.

"Chroma1 Radiance Text to Image" and "Chroma: Text to image"

Each works well.

I've looked elsewhere and came across only one Image→Image workflow. This was overly elaborate and had a nightmare set of custom nodes. I couldn't work out how to reduce it to simplicity.

Can anyone suggest simple modifications to the template examples? Would that also involve a different Chroma variant? Else, can an Image→Text LLM be inserted to replace the current text input box?

Guidance would be appreciated?

Multimodal embedding models supplement existing AI base models and distilled/refined models. They are used for extending the scope (knowledge-base and internal reasoning) of extant models.

Apparently, embedding models appeal to some business/institutional users as the next best thing to horrendously expensive ab intio AI model construction and the still very costly distillation/refinement of pre-existing models. The process enables detailed local, perhaps proprietary, information to be used by models initially indiscriminately trained on anything the makers could get their hands upon. The pharmaceutical industry is a big player in this sphere.

An open-source example of this genre is Nomic Embed Multimodal 7B. It, and similar, are said to be compatible with mid-range domestic devices with 16+ GB VRAM and, say, 64 GB RAM (maybe less).

How does this type of tool compare in capabilities and ease of use to other low-cost ways, e.g. LoRas, to beef-up local AI uses?

Multimodal embedding models supplement existing AI base models and distilled/refined models. They are means for extending the scope (knowledge-base and internal reasoning) of extant models.

Apparently, embedding models appeal to some business/institutional users as the next best thing to horrendously expensive ab intio AI model construction and the still very costly distillation/refinement of pre-existing models. The process enables detailed local, perhaps proprietary, information to be used by models initially indiscriminately trained on anything the makers could get their hands upon. The pharmaceutical industry is a big player in this sphere.

Multimodal embedding may encompass text, images, and data in other formats. It has similarity to using LoRas to direct AI attention along specified lines.

From 'conversation' with the 'Perplexity' AI, I am led to believe suitable free software for offline use, in the context of tools like Comfyui, exists and easily interdigitates with familiar open-source models (base and distilled). It is compatible with higher-end laptop specifications such as 16+ GB VRAM and 64 GB RAM.

With respect to image generation/processing, does embedding offer advantages over LoRa creation? That's concerning creation/set-up time, useable extension of AI versatility, and as an aid to generated visual character/scenery persistence? Does it extend to local AI video generation?