My local workflow for turning SDXL character generations into game-ready 3D assets
Hey everyone,
I generate a lot of character concepts in SDXL, but I was getting frustrated with how hard it is to get a clean 3D mesh locally without paying for cloud APIs or wrestling with heavy ComfyUI 3D nodes.
I spent the last few months engineering a custom local pipeline to automate the jump from 2D to 3D. Here is how the workflow operates under the hood to survive on a 10GB VRAM footprint:
The 2D Generation: Standard SDXL prompt for a character concept sheet (T-pose or A-pose works best).
The 3D Base Mesh: I feed the image into a custom local VRAM hoister I built that wraps around the 3D diffusion models, keeping the memory spikes under 10GB.
Automated Cleanup: The engine automatically runs an adaptive decimation pass to crunch the high-poly AI geometry down, and calculates clean XAtlas UVs.
Zero-VRAM 4K Texturing: It uses OpenCV Laplacian math and Real-ESRGAN to synthesize 4K PBR maps directly from the 2D image data.
This entire pipeline took me 4 months to finally get it close to where I want it.
My main questions I have are:
What features would some of you want to see added to a local tool like this?
If this was readily available, what would you pay for a local 2D to 3D Pipeline?
If anyone else has attempted this prior to me, what roadblocks or hurdles did you encounter?
Is there a current gap in the market for Local tools like this?
Right now I have a live Demo of this for others to try, so far only compatible with NVIDIA GPUs.