Martin Ciupa, Nicole Tedesco and Mostafa Ghobadi, calvIO Inc., USA

This paper describes an innovative computer system framework supporting robot automation programming, by a gesture controlled “show and tell” process, whereby human experts describe their goals of a process to be learned, and demonstrate via positional sensors(such as Microsoft Kinect or Leap Motion) the actions necessary to achieve those goals. These inputs are collected and optimized by the robot mentoring process, interpreted back to the human expert for confirmation feedback and/or subsequent fine tuning. This framework, is a pedagogical model, modelled on a professional human process needed to mentor others. We have applied this concept in an innovative way to mentor robots with gesture control and machine learning.

AI, Automation; Robotics; Deep Learning; Really Useful Machine Learning