The Project

Ficha de Projecto

Name

Overview

Name

HTPDIR - HUMAN TRACKING AND PERCEPTION IN DYNAMIC IMMERSIVE ROOMS

Overview

The potential of immersive reality systems and its broad range of application are well known. Despite the numerous systems available, there are currently no solutions that map static and dynamic obstacles in the physical space, and thereby users have to circulate in empty rooms or perform interaction with the immersive system in a very limited space.

On the other hand, the tracking of the users restricts to the user's head (or hands through the use of controllers), or when members and hands are also tracked, users need to stand in front of the RGB-D sensors -D (or other sensors) in a limited space.

The motion tracking of the entire body in larger areas is usually solved using tags, with optical or radiofrequency modulation, placed at several points of the body, and using high frequency sensors to capture these tags. This leads to systems with low flexibility and extremely expensive.

In this project it is proposed to develop a low cost system based on multiple RGB-D sensors (> = 4), providing simultaneously the tracking of the full body of the user at any point of the physical space (areas of tens of m ^ 2 ) considering unstructured and dynamic environments, gesture recognition for a more natural interaction with the immersive environment, as well as the interaction with the real world from the immersive world.

This system finds a broad range of applications in many areas, namely, shopping area (real estate development, allowing to show final finishing/decoration in spaces), education (space simulation in classrooms, museums, showrooms), training in simulation (accident simulation, police training, social training).

The possibility of adapting any space to a new dynamic virtual world, where the user can move within it, opens up a whole new range.

AREAS OF EXPERTISE

Business
VR technology has advanced to the stage where it has a high degree of realism and efficiency. Some companies use virtual reality to help with data analysis and forecasting trends in order to gain an edge over their competitors. They like the fact that they can use this to test drive a product in the early stages of development but without any additional costs.
Construction
Virtual reality can be extremely useful in the construction industry, which is often known as having a very high amount of inefficiency and low profit margins. By using a virtual environment, an organization can not only render the resulting structure in 3D but also experience them as they would in the real world.
Education
Education is another area which has adopted virtual reality for teaching and learning situations. The advantage of this is that it enables large groups of students to interact with each other as well as within a three dimensional environment.
Engineering
Virtual reality engineering includes the use of 3D modeling tools and visualization techniques as part of the design process. This technology enables engineers to view their project in 3D and gain a greater understanding of how it works. Plus they can spot any flaws or potential risks before implementation.
Entertainment and Heritage
These environments enable members of the public to engage with the exhibits in ways which were previously forbidden or unknown. In some cases they can interact with the exhibits by means of an input device such as a data glove. An example of this is a historical building which can be viewed at different angles.
Fashion
Fashion is not something that immediately comes to mind when thinking about virtual reality but nevertheless, it is used by the fashion industry in a variety of ways: VR software for building virtual fashion stores, 3D avatars to help with clothes design, etc.
Healthcare
One of the advantages of this technology is that it allows healthcare professionals to learn new skills as well as to refresh existing ones in a safe environment. It is used alongside other medical tests such as X-rays, scans and blood tests to help determine the cause of a particular medical condition.
Programming Languages
Enter Visual Programming Language. This programming language aids the building of virtual reality experiences. VPL is described as a “post-symbolic” programming language, which is taken to mean programs are ‘written’ by means other than letters, numbers and other written characters.
Scientific Visualization
Scientific visualization is used as a means of communicating abstract concepts to an audience. The audience can interact with these images, for example, viewing a molecular structure at different angles. VR enables scientists to demonstrate full immersive environments in which they visualize research theories or discuss large datasets.

CO-PROMOTION

Collaborative assignments

The development of this project it is only possible due to a coordinated collaborative effort between institution hereby mentioned. Together with the qualified people and the latest harware and softare it is possible to reach out the best results.

SKETCHPIXEL

SketchPixel Multimedia & Visual Effects operates in the multimedia sector. We offer our customers the most advanced technological solutions for communication, presentation products and services, through the use of tools such as our 3D TV, the Augmented Reality technology and, our interactive and holographic layers that can be used in any type of surface. That said, our aim is to provide our clients with innovative solutions capable of meeting their needs through a total commitment to quality. Our goal is to bring technology to people's daily life in an interactive mode.

Instituto Politécnico de Tomar

...

Instituto de Sistemas e Robótica

...