u/worthyybabyy

A common texture issue with AI-generated 3D models is when nearly all the model is correct, but there's a small area that needs work. Perhaps a jacket is the wrong color on one sleeve, a metal panel has a bizarre artifact or a minor surface detail is incorrect.
It's not worth rebuilding the texture just to correct that one patch of the patch when it can affect other places that were already good.
The Magic Brush workflow in Tripo AI caught my attention, so that's why I was interested in it. Rather than rebuilding the entire material, you can brush over a particular area of the model and regenerate just that selected area. Tripo AI currently has two modes: Gen to create a new material/detail based on a prompt, and Paint to adjust colors or textures more directly.
I would rather do the workflow as: create the base texture once, mark the problem areas, and then make corrections in the areas that need them, rather than starting over again and over again.
I'd still look at the transition around the edited area though, as sometimes blending may require another pass.
Anyone else using Magic Brush for small fixes? I wonder what the results will be in regard to seams and detailed patterns.

Just looking at character consistency a bit closer and the reference images do seem to be a contributor that is just as important as the 3D generator itself.
If there are items of clothing, lighting or hairstyles that differ between the front and side view, the AI must determine which one is correct. I would make the references sort of like a character turnaround sheet: same pose, same outfit, same scale, clean background and the same lighting on every angle.
I have been looking into this method and one of the services I am interested in is Tripo AI, which has the ability to create 3D from multiple views. It has the following limitations with its current API documentation: References can be made to the front, left, back or right, it needs a minimum of 2 images, and the front image must be provided. It also suggests the same object should be kept under constant lighting.
I would aim to begin with a clean front and side view and then work up to the back and opposite side when there is something in the character that needs to be inferred and not left to chance.
The problem appears to be the largest one is to provide AI with many appealing images that are not in harmony.
Have you noticed any notable differences in proportion or clothing details in characters created using Tripo AI when using multiple viewpoints?

I want to take a normal picture, convert it to a 3D model, make some changes, add some texture to it, and then bring it into Blender or a game engine.
What I missed is everything I've got after taking the photo in 3D. While it's helpful to get a mesh, it's not quite enough control to improve it - I want to be able to refine the generated mesh rather than use it as the final model.
I've been considering this for a while now since it has a workflow for taking a photo and creating a structured 3D model, and then the created asset can be edited further. In addition, Tripo provides support for texturing and local texture changes like Magic Brush.
If I wanted to do some very deep geometry edits I would probably export out of the generator and edit it in Blender myself, because I think they would not be able to do that in the generator. Tripo AI also converts/exports models to various formats such as FBX, OBJ, STL, GLTF, USDZ or 3MF, depending on the model.
If you are using photo-to-3D for real world projects, what is your typical level of mesh/Texture cleanup before it's usable?

I am having the same issue with an image to 3D workflow as you are: One reference photo is not enough. You may have captured a nice shot of a character, or prop, but then you have to figure out what the side, and back, should look like.
That's where a multi-view input comes in helpful.
I've been studying the workflow in Tripo AI that can generate multi-view 3D. Rather than using a single image, you can give a number of views of the same object that the geometry has more information to work from. Tripo AI provides support for the front, left, back and right reference positions in the API workflow, which requires at least two images, with the front one included.
The key seems to be maintaining consistency of those references. The model should be less conflicting if it is similar scale, has similar lighting, is oriented the same way, and has similar proportions. When there are crucial details that do not appear in a single angle, Tripo AI also suggests using multiple angles.
When used for characters, vehicles or asymmetric props, this is more feasible than trying to describe the whole thing with one image.
Has anybody performed a comparison between single image and multi-view results on the same model?