docs.unity3d.com
Search Results for

    Show / Hide Table of Contents

    ML-Agents Toolkit Glossary

    • Academy - Singleton object which controls timing, reset, and training/inference settings of the environment.
    • Action - The carrying-out of a decision on the part of an agent within the environment.
    • Agent - Unity Component which produces observations and takes actions in the environment. Agents actions are determined by decisions produced by a Policy.
    • Decision - The specification produced by a Policy for an action to be carried out given an observation.
    • Editor - The Unity Editor, which may include any pane (e.g. Hierarchy, Scene, Inspector).
    • Environment - The Unity scene which contains Agents.
    • Experience - Corresponds to a tuple of [Agent observations, actions, rewards] of a single Agent obtained after a Step.
    • External Coordinator - ML-Agents class responsible for communication with outside processes (in this case, the Python API).
    • FixedUpdate - Unity method called each time the game engine is stepped. ML-Agents logic should be placed here.
    • Frame - An instance of rendering the main camera for the display. Corresponds to each Update call of the game engine.
    • Observation - Partial information describing the state of the environment available to a given agent. (e.g. Vector, Visual)
    • Policy - The decision-making mechanism for producing decisions from observations, typically a neural network model.
    • Reward - Signal provided at every step used to indicate desirability of an agent’s action within the current state of the environment.
    • State - The underlying properties of the environment (including all agents within it) at a given time.
    • Step - Corresponds to an atomic change of the engine that happens between Agent decisions.
    • Trainer - Python class which is responsible for training a given group of Agents.
    • Update - Unity function called each time a frame is rendered. ML-Agents logic should not be placed here.
    In This Article
    Back to top
    Copyright © 2025 Unity Technologies — Trademarks and terms of use
    • Legal
    • Privacy Policy
    • Cookie Policy
    • Do Not Sell or Share My Personal Information
    • Your Privacy Choices (Cookie Settings)