Getting started with AI in Unity
Whether you’re just getting started with Unity or want to experiment with AI-driven workflows, Unity AI tools help you create game-ready assets, assist coding workflows, and integrate machine learning models directly into your projects.
Unity AI includes three major areas:
- Generators: Create game assets using text-based prompts or reference input. You can generate spritesA 2D graphic objects. If you are used to working in 3D, Sprites are essentially just standard textures but there are special techniques for combining and managing sprite textures for efficiency and convenience during development. More info
See in Glossary, textures, materials, sounds, animations, and terrainThe landscape in your scene. A Terrain GameObject adds a large flat plane to your scene and you can use the Terrain’s Inspector window to create a detailed landscape. More info
See in Glossary layers. Generators use machine learning models to interpret your prompts and produce assets that you can use directly or refine further. For more information, refer to the Generators documentation.
- Assistant: A built-in, AI-powered coding assistant available in the Unity Editor. It supports three modes of operation for handling queries and tasks:
/ask, /run, and /code. Assistant provides contextual help directly where you work. For more information, refer to the Assistant documentation.
- Inference Engine: Integrate your own trained machine learning models into Unity projects and run them at runtime. For more information, refer to the Inference Engine documentation.
Additional resources