Game assets, with AI...

Say, I want to convert a nice 1920's Bowman life-steam loc into my game. How could we do this? Well first check if someone else did it and is willing to share the model, if not I've to find my own workflow.

According to internet, there are a lot of different routes, generating amazing models, so let's find a process with the least amount of effort.

The goal

Generating multiple assets, considering 3 goals:

1. Going close to reverse-engineering. I want to have an accurate model in CAD. But I'll not add screws rivets etc. 'Only' the outside shell should be accurate, including textures.
2. The asset should be able to be shown, like on SketchFab platform. Preferably with animations, exploded views. So it might be used as a demonstration model.
3. The asset should be useable within movies & games. Basically downgrading the SketchFab model further, changing 4K textures into 1K (mobile platform) or 2K (pc like games)

The subject is an original Bowman life steam locomotive I own. Unfortunately it's not working, needs some soldering etc. Well, that's something during retirement. The nice thing about this: I can measure everything, which will help a lot. For now it should take less effort, getting a 'virtual working' locomotive.

Basically 2 sources: one nice looking loc and my own.

1. CAD

Just do it your selves, by measuring every part & detail and model this in CAD. Well I was hoping, this is not necessary.. So I started creating a first simplified CAD object. And use this as input for some of the methods bellow.

2. AI: Image → 3d model

Well that would be great, if that would work...

• Method 1: Give a (free) AI 3D-generator from one single photo.
• Method 2: Give a (free) AI 3D-generator a simplified CAD model + one single photo.
• Method 2: Give a (payed) AI 3D-generator a simplified CAD model + 4 photo's.
• Method 4: Claude merge...

3. Telemetry: Photo's → 3d model

So let's try telemetry. Basically taking a bunch of photo's from different angles and let the pc calculate the 3d model. This is proven technology. But it does not work so well with shining object. So let's create a hobby-grade light box, to eliminate reflections.

• Method 1: MeshRoom
• Method 2: RealityScan

4. 3D scanning

Okay, I know already this is very difficult. Having an very old 3d scanner (XBOX Connect first version), it was already difficult to install software on windows 11. I've used this device before, scanning some people heads. Well, that's working. But trying to scan this train, well, I could upload a black picture, but you get the idea.

Should I buy a 800 or 2000 euro scanner? Well those will work better then mine, but the results are still scanned meshes, having issue's with shining surfaces and still need rework in CAD/Blender anyway. Secondly the quality for generating textures are not great either.

5. Hybrid

Let's say a bit of me and Claude combined, while using Blender. Currently an acceptable workflow, is loading the simplified CAD model in blender, give Claude access to all photo's created and workout every section by prompts. It's also time consuming...

• Claude will recreate textures in Blender, so these are still lines of code, telling Blender what to do.
• I should have create more shapes inside CAD, since (not accurate) modeling takes more time writing prompt, then just draw this.
• Overall Claude is quite helpful of changing many things, like changing colors and adding real small missing details.

Conclusion:

I think this approach will result in the best results so far.

---

So still need to finalize the Bowman and having some other projects to generate. To be continued!