Rodin - 3D model Generation

Join us to witness one of the most advanced 3D model generation AI technologies ever - Rodin, a controllable large-scale generative model for creating high-quality 3D assets!

With just a few words or a picture, Rodin transforms your imagination into realistic CG-friendly 3D models with photorealistic material rendering! This project implements Rodin's generative function calls based on API requests, so you can easily transform your imagination into Unity-supported mesh and material assets, preview them in real-time, and use them as a basis to start your great creations!

Follow us on twitter @deemosTech to learn more about Rodin.

Rodin add-on for Unity

Introduction

The Rodin add-on for Unity is a powerful integration tool that supports most of the functions available on Rodin's webpage, allowing users to access image-based generation capabilities directly within the Unity environment. It enables users to replace target images, adjust generation settings, utilize ControlNet with selected objects, and choose between automatic and manual generation modes—all while maintaining a seamless workflow between Unity and the Rodin web interface through the convenient floating window functionality.

Overview

The Rodin Bridge for Unity integrates Rodin's powerful AI-based 3D generation capabilities directly into your Unity. This integration consists of two main components:

Installation

Requirements

• Unity 2023.x or later

Step-by-step Instruction

1. Unzip the .zip file to any where you like.
2. Open Unity 2023.x or later project and go to "Window" -> "Package Manager".
3. Click on the "+" button and select "Install package from disk...", then select the "package.json" file in the unzipped folder.
4. Wait for the package to be imported and click on the "Rodin" Tab in the "Tools" section, and you should see the plugin window.

Basic Usage

The Rodin add-on integrates most Rodin's generation functions directly in Blender. Operation requires interaction in both Blender and the Rodin webpage.

Single Image Generation

1. Click 'Remove' and 'Load Image' to replace the default image with the image you want to generate the 3D asset with.
2. Choose 'None' in ControlNet options and choose 'One Click' for the fastest generation experience. The rest of the settings are identical to those on Rodin webpage.
3. Once they are adjusted, click 'Submit' to begin the process.

The Rodin webpage will automatically appear if not already open. On the Rodin webpage, activate the floating window using the toggle switch.

You can monitor the generation process in the floating window. The generated asset will be automatically imported into Unity scene.

You can also import featured assets or generated assets by hovering on the target asset and press the emerged 'Export' button.

Advanced Functions

ControlNet:

To enable ControlNet, select an object in scene and choose your desired ControlNet mode. You can then adjust ControlNet settings as needed (identical to Rodin webpage settings).

Multiview Mode:

You can use 'Load Image' to add more images as the input for generation. Rodin will automatically process them as the input for multi-view generation.

Generation Mode:

You can choose between One Click mode and Manual mode.

One Click: Process runs without step-by-step guidance.

Manual: Requires step-by-step operation in the floating window. The process is identical to that on Rodin webpage.