EXPLORE / 06

Terms index

Specialized AI and software-development terms with concise explanations

Entity records

4676 records · 95/117

  1. 3761

    Zero-Sum Game

    Game model where one party's gain equals the other's loss, common in competitive games

    Website pending
  2. 3762

    Intrinsic Motivation

    Behavior driven by internal psychological states like curiosity, rather than external rewards

    Website pending
  3. 3763

    Jacobian Matrix

    Matrix of first-order partial derivatives describing local linear approximation, used for computing transformation volume elements

    Website pending
  4. 3764

    Normalizing Flow

    A generative model that maps simple distributions to complex target distributions via invertible transformations

    Website pending
  5. 3765

    Neural ODE

    Treats neural networks as continuous-time dynamical systems, describing hidden state changes via differential equations

    Website pending
  6. 3766

    Task Decomposition

    The process of breaking down complex problems into independently solvable sub-problems.

    Website pending
  7. 3767

    Iterated Amplification

    A technique training AI by recursively decomposing tasks and amplifying human judgment.

    Website pending
  8. 3768

    Open Source

    Software licensing model that allows source code to be viewed, modified, and distributed

    Website pending
  9. 3769

    Sparse Reward

    An environment characteristic where feedback is provided only upon task completion or rarely, making exploration difficult.

    Website pending
  10. 3770

    Intrinsic Reward

    A non-environmental reward signal driven by the agent's internal state uncertainty or novelty.

    Website pending
  11. 3771

    Random Network Distillation (RND)

    An exploration method generating intrinsic rewards by minimizing the difference between a target random network and a predictor network.

    Website pending
  12. 3772

    Cross-Domain Transfer

    Applying knowledge learned in one domain or task to a different but related domain or task.

    Website pending
  13. 3773

    Energy-Based Model

    A generative framework that assigns an energy score to data points rather than explicitly modeling probability distributions.

    Website pending
  14. 3774

    Offline Learning

    Method of training policies using historical data without real-time environment interaction

    Website pending
  15. 3775

    Model-Based RL

    Reinforcement learning approach that learns environment dynamics to aid decision-making and planning

    Website pending
  16. 3776

    Batch Size

    The number of samples used in one iteration of parameter update.

    Website pending
  17. 3777

    Gradient Noise Scale

    A statistical measure quantifying the difference between mini-batch gradient estimates and full-data gradients.

    Website pending
  18. 3778

    Long-term AI Safety

    Research field focusing on existential risks posed by future superintelligence

    Website pending
  19. 3779

    Computational Complexity

    A theoretical measure of resources (time, space) required to solve a specific problem

    Website pending
  20. 3780

    Robust Classification

    The ability of a model to maintain accurate predictions despite input perturbations or noise

    Website pending
  21. 3781

    Exploration

    The process where an agent tries new actions to discover unknown states or rewards.

    Website pending
  22. 3782

    MARL

    A method where multiple agents learn policies via trial-and-error in a shared environment.

    Website pending
  23. 3783

    Neuron Interaction

    The mechanism of signal transmission and collaboration between nodes in a neural network

    Website pending
  24. 3784

    Capped-Profit Company

    A corporate form that allows profit-making but caps returns or directs surplus to social good

    Website pending
  25. 3785

    Mode Coverage

    The ability of a generative model to cover all major modes in the data distribution.

    Website pending
  26. 3786

    Energy-Based Model (EBM)

    A generative model that defines a data distribution via an energy function.

    Website pending
  27. 3787

    Next Token Prediction

    Task of predicting the probability distribution of the next discrete unit based on preceding sequences.

    Website pending
  28. 3788

    Adversarial Perturbation

    Carefully crafted small noise added to inputs to mislead model outputs

    Website pending
  29. 3789

    Generative Modeling

    Machine learning method that learns data distributions to generate new samples.

    Website pending
  30. 3790

    Sparse Attention

    A mechanism that computes attention only between selected positions to reduce complexity.

    Website pending
  31. 3791

    Collective Action Problem

    A situation where individual rational choices lead to suboptimal group outcomes.

    Website pending
  32. 3792

    Supercomputing

    High-performance computing systems for massive complex tasks

    Website pending
  33. 3793

    Co-adaptation

    The process where multiple entities mutually adjust their behaviors during interaction to optimize performance

    Website pending
  34. 3794

    Emergence

    Properties or behaviors arising from complex systems that are not present in individual components

    Website pending
  35. 3795

    Adversarial Attack

    Techniques that use small perturbations to mislead ML models into making incorrect predictions.

    Website pending
  36. 3796

    Sim-to-Real Transfer

    The process of applying models trained in computer simulations directly to robots in the physical world.

    Website pending
  37. 3797

    Automatic Domain Randomization

    A training technique that improves policy robustness by progressively expanding the distribution of simulation environment parameters.

    Website pending
  38. 3798

    Model Weights

    Parameters obtained after neural network training that determine specific model behavior

    Website pending
  39. 3799

    Staged Release

    Strategy of gradually releasing model capabilities or weights to assess risks and refine safety measures

    Website pending
  40. 3800

    Safety Constraints

    Hard conditions limiting agent behavior to prevent harm or rule violations.

    Website pending