Creating Touchless HMIs Using Computer Vision for Gesture Interaction

On-Demand Webinar

Touchscreens are everywhere in public spaces, from grocery store express checkouts to airline check-in counters. As COVID-19 has made people hesitant to touch public surfaces, which can act as vectors for the virus, you may wish to embrace contactless user interfaces for your customer-facing products. In this engineering-focused webinar, we’ll offer technical insight on how to emulate the touch experience via computer vision and gesture technology, and explain best practices to incorporate AirTouch into multimodal interfaces.

Topics will include:

  • Designing gesture-based applications with the Qt framework
  • Creating, training and detecting your own custom gestures
  • Using a depth-sensor interface to control an HMI without touching the screen
  • Leveraging natural gesture control for intelligent monitoring and activity detection

Optimizing Usability and Human-Robot Interaction (HRI) in Medical Robotics

On-Demand Webinar

From elder companionship and assistance to exoskeleton rehabilitation to autonomous surgery, robotics is playing a key role in emerging healthcare technology. These new applications demand a seamless interaction between the robot and the user, requiring new models that both improve the utility and mitigate the inherent risks. 

This webinar will discuss the state of the art relative to UX/UI where a human is supervising a cobotic cell or a platoon of multi-functional robots perform a variety of tasks, streaming data back to the supervisor, prioritizing process steps, assisting in decision making etc. 

We’ll discuss a use case for coordinated motion of multiple robotic arms in surgical robotics. In this use case, the surgeon works at a console, commanding one or more robotic arms. The motion control system is responsible for moving the surgical tool precisely while maintaining constraints, such as remote center of motion at the insertion point and collision avoidance with the other robotic arms and obstacles in the environment. We'll discuss how this motion control is achieved in real time while minimizing the task load on the surgeon.

In addition, we’ll cover several examples as a guide to building an intuitive and easy communication system with the robot through speech, gestures, voice and facial recognition.

Discussion topics include: 

  • Evolving design principles
  • Improving ease of use during the design process
  • Managing multimodal interfaces, including haptic feedback
  • Achieving precision motion control
Subscribe to