Gaze Expert - Standalone

The GazeExpert demonstrates our ability to combine multimodal cues in conversational interactions. In the case of the gaze expert, the user's gaze tracking is used to identify which virtual objects/persons the user is looking towards. A conical gaze tracking system is used in our current implementation. This ability is used to performs behaviors such as

• Answering questions like “what is that”

• Tracking if use is paying attention to the right objects in a scene. In training applications, this has been used to provide feedback to the user when they are not paying attention to the relevant objects.