Augmented Reality Interface in E2LP

Challenge

img1aInteractions with screens have become an indispensable standard. However, the "all digital" is sometimes realized at the expense of the proximity of the tangible world and the underuse of the richness and complementarity of our senses.


The use of augmented reality coupled with multimodal interaction tools enables to harmoniously combine our skills in the real world complemented by the flexibility provided by the virtual world.

The System

Equipped with a touchscreen replacing traditional magnifying lamps the first prototype developed for the education of electronics operates by using a camera mounted on an articulated arm with sensors to locate itself in space.

The augmented reality software contained in the mini-pc controlling the system receives the position from the arm and, together with the frames coming from the camera, calculates in real time the position, rotation and scale of the electronic board in view, and tracks it.

The software is able then to overlay on the image of the board and its components, through the touchscreen, all kinds of useful information: technical documentation of a component, its location on the board, the sequence of an exercise etc.

 

img2   img3   img4

A haptic pen, used as a pointer and providing additional information via vibrotactile and thermal sensations, complements this system.

 

Applications

The versatility and scalability of this system allowsits use in fieldssuch as Higher Education, ProfessionalTraining or the Industry 4.0.

 

AUGMENTED REALITY INTERFACE: User guide

 

img5

Margarita Anastassova
This email address is being protected from spambots. You need JavaScript enabled to view it.

FlorentSouvestre
This email address is being protected from spambots. You need JavaScript enabled to view it.

img7

Jorge R. López
This email address is being protected from spambots. You need JavaScript enabled to view it.

Enara Artetxe
This email address is being protected from spambots. You need JavaScript enabled to view it.