HyperSkill User's Guide
  • Overview
    • System Requirements
    • Create a HyperSkill Account
    • Quick Start Guide
  • Virtual Entities (VX)
    • Public Virtual Entities
    • Import Virtual Object (VO) from HyperSkill Desktop
    • Edit Virtual Objects
    • VX Publisher
      • Import Model as Virtual Object (VO)
      • Import Model as Virtual Person (VP)
      • Import Model as Virtual Space (VS)
      • Special Considerations
    • Export Model from SolidWorks
    • Export your Virtual Object to a QR Code (Hololens)
    • Special Virtual Objects
      • Train
      • Digital Caliper
      • Blur
      • Crossbow
      • Picture Frame
      • Drone
      • Painting
        • Setup
        • Spray Painting
        • Pen
      • Timer Display
  • Media Upload
  • Authoring a Simulation
    • Object Browser
    • Inspector
      • General
      • Description
      • Grab Mechanics
        • Basic
        • Slider
        • Rotator
        • Dragger
        • Grabber
        • Climbable
      • Customizable
      • Player
    • Scene Layout
      • Asset Movement Tools
      • Skybox
      • Set Spawn Position
      • Show Axis
      • Assets
    • State Machine
      • Scenario Flow
        • State Machine Interface
        • State Actions
        • Attributes
          • Default Attributes
        • Transitions
          • Use
          • Snap
          • Proximity
          • Collide
          • Utterance
          • Use Release
          • Conditions
      • Rules
      • Triggers
        • Collide
        • Conversation Update
        • Grab
        • Proximity
        • Rejected Intent
        • Snap
        • Voice Intent
        • Ungrab
        • Unsnap
        • Use
        • Use Release
        • Wait
      • Conditions
        • Simulation Condition
        • Account Condition / User Attributes
      • Actions
        • How to Author the State Machine
        • Add Feedback Log
        • Add a Follow Camera
        • AI Chat
          • How to Author the Chat Box in a simulation
        • Animation Controller
        • Animation State Transition
        • Camera
        • Change Character Prompt
        • Checklist
        • Display Image
        • Display Message
        • End Timer
        • Go To Sim
        • Highlight
        • IK Solver
        • Leaderboard
        • Lighting Settings
        • Look At
        • Microphone
        • Open Link
        • Particle Controller
        • Play Animation
        • Play Audio
        • Play Video
        • Quiz
        • Reset Chat
        • Rotate
        • Run Agent
        • Set Attribute
        • Show Feedback Log
        • Spatial Audio
        • Spawner
        • Speak
        • Start Timer
        • Switch Virtual Assistant
        • Transition Effect
        • Translate
        • VCode Function
        • Wait
    • Object Groups
    • Paths
    • Wires
      • Wire Builder Interface Description
    • Simulation Settings
      • Experience Settings
        • Microphone
        • Player
        • Documents
        • Virtual Assistant
        • Conversational AI
        • Wires
        • Pin Code Multiplayer Overrides
        • Experts
      • Authoring Settings
        • Desktop
        • VR
    • SimGenie
    • Simulation Templates
    • Save States
  • Experience a Simulation
    • User Interface
    • Controls
    • Multiplayer
  • AI
    • Natural Conversations
    • Large Language Models & Data Privacy
    • AI Chat
      • How to Author AI Chat
      • SimKB
      • Edit Mode
      • Test Mode
    • Agents
      • How to Author an Agent
      • Edit Mode
      • Test Mode
    • PDF Question Answering
    • Review Mode
    • Settings
    • Conversational AI
      • Helpful Terminology for Conversational AI
        • Multi-expert dialog
        • Natural Language Understanding
        • Experts
          • List of experts developed so far
            • HM Graph Expert - Deployed
            • Key Phrase Expert - Deployed
            • Catch All Expert - Deployed
            • Azure PDF Expert - Standalone
            • Gaze Expert - Standalone
            • Knowledge Graph Expert - Standalone
  • Mixed/Augmented Reality
    • Create a Mixed Reality experience
    • Spatial Anchors
  • Publish
    • Playlist
    • LMS Integration
    • Embed Mode
  • Insights and Analytics
    • Logging Attributes
      • Detailed Event Table
      • Detailed Attributes Table
  • Web Portal
    • Simulation / Virtual Object Browser
    • Organizations
    • Settings
  • Subscriptions
  • Skillful
    • FAQ
  • Archived
    • Wires
Powered by GitBook
On this page

AI

Overview

HyperSkill offers a variety of AI features to make your VR/AR/Web/Desktop learning experiences more interactive and engaging. This section will explain how each feature works and how you can use it effectively.

1. Natural Conversations

  • Speech-to-Text Transcription (ASR):

    • Automatically capture and record spoken dialogue within your simulations

    • Analyze trainee communication during role-playing or presentations

  • Text-to-Speech Generation (TTS):

    • Create realistic narration for your virtual persons

    • Virtual persons can guide learners, deliver instructions, or react to choices

  • Interactive Learning with Natural Language Processing (NLP):

    • Design simulations that respond to specific user prompts

    • Learners can ask questions to virtual characters, triggering pre-recorded responses or branching dialogues

    • Example: A virtual factory worker can answer specific questions about equipment based on learner inquiries

3. Advanced Roleplaying with GPT-4/Gemini Pro (AI Chat)

  • Lifelike Roleplaying Partners:

    • Create AI-powered characters that engage in open-ended conversations with learners using GPT-4/Gemini Pro

    • Characters can answer questions, provide feedback on performance, or react realistically to various situations and speech

4. In-depth Analysis with GPT-4/Gemini Pro (Agents)

  • Learner Behavior Analysis:

    • Analyze learner interactions with AI characters using GPT-4/Gemini Pro's analysis capabilities.

    • Identify areas for improvement and personalize learning paths based on performance data.

By incorporating these AI features, you can create dynamic and engaging learning experiences that cater to different learning styles. These features are designed to be user-friendly and integrate seamlessly within your HyperSkill authoring workflow.

PreviousMultiplayerNextNatural Conversations

Last updated 10 months ago