Text2Materials Demo | NVIDIA Research at #SIGGRAPH2023

This Text2Materials demo showcases how artists can use text or image prompts to generate custom textured materials — such as fabric, wood and stone — faster and with finer creative control.

This set of AI models will facilitate iterative creating and editing of materials, enabling companies to offer new tools that’ll help artists rapidly refine a 3D object’s appearance until they achieve the desired result.

In the demo, NVIDIA researchers experiment with a living-room scene, like an interior designer assisted by AI might do in any 3D rendering application. In this case, researchers use NVIDIA Omniverse USD Composer — a reference application for scene assembly and composition using Universal Scene Description, known as #OpenUSD — to add a brick-textured wall, to create and modify fabric choices for the sofa and throw pillows, and to incorporate an abstract animal design in a specific area of the wall.

NVIDIA researchers won the Best in Show award at SIGGRAPH’s Real-Time Live event with a demo of generative AI models that can help artists rapidly iterate on 3D scenes.

These capabilities will be coming to NVIDIA Picasso, enabling enterprises, software creators and service providers to create custom generative AI models for materials, developed using their own fully licensed data.

Join the NVIDIA Developer Program

Read and subscribe to the NVIDIA Technical Blog

#siggraph2023 #NVIDIAResearch #generativeAI #genai