HyperSkill User's Guide
  • Overview
    • System Requirements
    • Create a HyperSkill Account
    • Quick Start Guide
  • Virtual Entities (VX)
    • Public Virtual Entities
    • Import Virtual Object (VO) from HyperSkill Desktop
    • Edit Virtual Objects
    • VX Publisher
      • Import Model as Virtual Object (VO)
      • Import Model as Virtual Person (VP)
      • Import Model as Virtual Space (VS)
      • Special Considerations
    • Export Model from SolidWorks
    • Export your Virtual Object to a QR Code (Hololens)
    • Special Virtual Objects
      • Train
      • Digital Caliper
      • Blur
      • Crossbow
      • Picture Frame
      • Drone
      • Painting
        • Setup
        • Spray Painting
        • Pen
      • Timer Display
  • Media Upload
  • Authoring a Simulation
    • Object Browser
    • Inspector
      • General
      • Description
      • Grab Mechanics
        • Basic
        • Slider
        • Rotator
        • Dragger
        • Grabber
        • Climbable
      • Customizable
      • Player
    • Scene Layout
      • Asset Movement Tools
      • Skybox
      • Set Spawn Position
      • Show Axis
      • Assets
    • State Machine
      • Scenario Flow
        • State Machine Interface
        • State Actions
        • Attributes
          • Default Attributes
        • Transitions
          • Use
          • Snap
          • Proximity
          • Collide
          • Utterance
          • Use Release
          • Conditions
      • Rules
      • Triggers
        • Collide
        • Conversation Update
        • Grab
        • Proximity
        • Rejected Intent
        • Snap
        • Voice Intent
        • Ungrab
        • Unsnap
        • Use
        • Use Release
        • Wait
      • Conditions
        • Simulation Condition
        • Account Condition / User Attributes
      • Actions
        • How to Author the State Machine
        • Add Feedback Log
        • Add a Follow Camera
        • AI Chat
          • How to Author the Chat Box in a simulation
        • Animation Controller
        • Animation State Transition
        • Camera
        • Change Character Prompt
        • Checklist
        • Display Image
        • Display Message
        • End Timer
        • Go To Sim
        • Highlight
        • IK Solver
        • Leaderboard
        • Lighting Settings
        • Look At
        • Microphone
        • Open Link
        • Particle Controller
        • Play Animation
        • Play Audio
        • Play Video
        • Quiz
        • Reset Chat
        • Rotate
        • Run Agent
        • Set Attribute
        • Show Feedback Log
        • Spatial Audio
        • Spawner
        • Speak
        • Start Timer
        • Switch Virtual Assistant
        • Transition Effect
        • Translate
        • VCode Function
        • Wait
    • Object Groups
    • Paths
    • Wires
      • Wire Builder Interface Description
    • Simulation Settings
      • Experience Settings
        • Microphone
        • Player
        • Documents
        • Virtual Assistant
        • Conversational AI
        • Wires
        • Pin Code Multiplayer Overrides
        • Experts
      • Authoring Settings
        • Desktop
        • VR
    • SimGenie
    • Simulation Templates
    • Save States
  • Experience a Simulation
    • User Interface
    • Controls
    • Multiplayer
  • AI
    • Natural Conversations
    • Large Language Models & Data Privacy
    • AI Chat
      • How to Author AI Chat
      • SimKB
      • Edit Mode
      • Test Mode
    • Agents
      • How to Author an Agent
      • Edit Mode
      • Test Mode
    • PDF Question Answering
    • Review Mode
    • Settings
    • Conversational AI
      • Helpful Terminology for Conversational AI
        • Multi-expert dialog
        • Natural Language Understanding
        • Experts
          • List of experts developed so far
            • HM Graph Expert - Deployed
            • Key Phrase Expert - Deployed
            • Catch All Expert - Deployed
            • Azure PDF Expert - Standalone
            • Gaze Expert - Standalone
            • Knowledge Graph Expert - Standalone
  • Mixed/Augmented Reality
    • Create a Mixed Reality experience
    • Spatial Anchors
  • Publish
    • Playlist
    • LMS Integration
    • Embed Mode
  • Insights and Analytics
    • Logging Attributes
      • Detailed Event Table
      • Detailed Attributes Table
  • Web Portal
    • Simulation / Virtual Object Browser
    • Organizations
    • Settings
  • Subscriptions
  • Skillful
    • FAQ
  • Archived
    • Wires
Powered by GitBook
On this page
  1. AI
  2. Conversational AI
  3. Helpful Terminology for Conversational AI

Natural Language Understanding

PreviousMulti-expert dialogNextExperts

Last updated 1 year ago

In order to process and understand user speech, HyperSkill utilizes a variety of natural language understanding techniques. Depending on the user license, authors can create simulations using the following NLU engines:

  • Key Phrase

  • GPT

  • Riva

The Key Phrase engine is a tool that helps identify certain phrases, called "intents", that the user may say. These intents are used to move the conversation forward in a simulation. The Key Phrase engine is available to all users and is typically used when there is not a lot of user data available. As more examples of what users might say are added, the Key Phrase engine becomes more accurate.

GPT is another tool that uses artificial intelligence to understand what users are saying. GPT is recommended for simulations with little data and can achieve high accuracy with only a few example utterances. However, using GPT can become costly if it is used too much. Therefore, access to GPT is only granted on a per-user basis and there is a limit on the amount of times GPT can be used in a given month. When the author of a simulation selects GPT as the NLU engine, they extend GPT access to any users experiencing the sim. When the experience user says or types something, this counts as one use of GPT. When the maximum number of uses allowed for the month is reached, HyperSkill switches from GPT to Key Phrase automatically. The GPT limit per month will depend on the license type used for HyperSkill. For more information on how to access and use GPT, please contact the SimInsights team.

Riva is a speech engine created by Nvidia that allows the use of custom-trained neural network models in simulations. These models can achieve even higher accuracy than GPT but require a large amount of data to train. Because of this, we recommend using Riva only when enough data has been collected. If you want to use Riva, you can contact the SimInsights team for help.

To change the engine in use, you can enter a simulation in edit mode and click on the Settings tab, then scroll to the Natural Language Understanding section. You can only select models you have access to. For example, in the image below, only Key Phrase is selectable.