Unity updates AI game tools service Unity Muse
Unity’s original overview video of Unity Muse, its AI tools platform for games artists and developers. The AI model used in text-to-PBR-material service Texture has just been updated.
Unity has updated Unity Muse, its new AI tools platform, rolling out a new AI model in Texture, its text-to-PBR-material service.
The new model generates common environment material types with greater details and color consistency, and now generates 16-bit heightmaps by default.
Unity Muse: generate games art assets from text prompts and sketches
Launched last year, Unity Muse is a set of AI services for game artists and developers.
Current capabilities include Chat, which lets users type in natural language queries to search Unity documentation, with the system also generating sample code.
There are also two generative AI systems for creating content from text prompts or source images: Texture, for generating PBR materials, and Sprite, for generating 2D sprites.
Upcoming features include synthesis of animation and in-game character behavior trees.
PBR materials generated from the text prompt ‘paving stones’ by the original (left) and new (right) AI models for Unity Muse’s Texture system.
New AI model in Texture generates more detailed environment materials
Unity has now updated Texture, rolling out a new AI model for texture generation, Photo-Real-Unity-Texture-2.
Like its predecessor, Photo-Real-Unity-Texture-1, it’s a custom version of Stable Diffusion, “trained entirely on data and images that Unity owns or has licensed”.
You can read more about how it was created this blog post: Unity doesn’t specify exactly what training set was used, but says that it “[did] not comprise any data scraped from the internet”.
The update focuses on “improving material types that commonly occur in games”, including wood, bricks, concrete, leather, metals, gravel and soil, with the new model generating texture maps with greater detail and color consistency.
In addition, generated heightmaps are now 16-bit by default.
You can see before-and-after comparisons of generated materials in Unity’s blog post.
Price, release date and FAQs
Unity Muse is a subscription service. It is currently in early access, and costs $30/month. On its full release in Spring 2024, Unity will introduce additional credit-based pricing.
By default, Unity collects user data to help train AI models, but according to the online FAQs, you can opt out of sharing content data.
Read more about Unity Muse’s new Texture AI model on Unity’s blog
Have your say on this story by following CG Channel on Facebook, Instagram and X (formerly Twitter). As well as being able to comment on stories, followers of our social media accounts can see videos we don’t post on the site itself, including making-ofs for the latest VFX movies, animations, games cinematics and motion graphics projects.