I have been working on improving the training demos of using AR technology for training new operators .
Here is a demo android app which augments 3D animations of work instructions over the printed OMS sheets.
It has touch and speech based interaction, which is quite useful for porting it to HMDs like Google Glass, Epson Moverio etc.
Another demo is using the Vuzix wrap 920AR for radiator assembly training, along with Kinect for gesture and speech recognition.
1) 3D Reconstruction of real objects and environments
Application to be used in reverse engineering and factory layout planning .
Toolkits used:- PCL, Kinect SDK, Skanect, Meshlab.
2) Loader Visibility Enhancement:-
An application to stitch video from 4 cameras and identify and remove loader arms and display the resulted video to the user to enhance is view.
Toolkits used:- OpenCV, Matlab
An application to overlay step-by-step 3D virtual animations over the real machine parts using AR HMDs, Kinect .
Toolkits used:- OsgART, 3Ds Max, Kinect SDK.
Languages:- C++, C#
An application using MS kinect to navigate inside virtual environment using simple body gestures.
Toolkits used:- Kinect SDK, OpenSceneGraph, Seimens Classic Jack,
Languages:- C#, C++
An application which used microsoft kinect to track hands and simulate touch events over projected surfaces.
Toolkits used: Kinect SDK
An application which has a gesture login (hand wave) and speech command interaction to navigate all through the menu. A special Hand position recognition is also used to identify the control the user is working on.
Toolkits used:- Kinect SDK, Microsoft Speech SDK