Register now After registration you will be able to apply for this opportunity online.
Holographic AI Guidance App in MR
Reading text manuals to set up and manipulate devices takes a lot of time and is not intuitive when it comes to 3D instruction. Despite the advent of Mixed Reality (MR) devices, 3D instruction is still limited and expensive to set up. In this project, we will develop an app, an adaptive 3D hand guidance system that projects instructional 3D hand poses in MR devices with pre-recorded instructional videos using MR devices.
Keywords: Mixed Reality, Augmented Reality, Virtual Reality, AI, AI Guidance, 3D Guidance and Computer Vision
Qualifications:
- Experience in Python or C++/C#.
- Interest in Mixed Reality.
- Interest in Machine Learning and Computer Vision.
- Experience in Unity is a plus.
In this project, the students will
1. Collect instruction videos using the existing recording app
2. Develop an app that takes hand pose inputs and shows possible hand poses to guide a user by calculating the similarity scores between hand inputs and pre-recorded hand poses.
3. Explore methods to guide hand adaptively, for example, filtering methods, K-Nearest Neighbor (KNN) or Dynamic Time Warping (DTW)
Qualifications:
- Experience in Python or C++/C#.
- Interest in Mixed Reality.
- Interest in Machine Learning and Computer Vision.
- Experience in Unity is a plus.
In this project, the students will 1. Collect instruction videos using the existing recording app 2. Develop an app that takes hand pose inputs and shows possible hand poses to guide a user by calculating the similarity scores between hand inputs and pre-recorded hand poses. 3. Explore methods to guide hand adaptively, for example, filtering methods, K-Nearest Neighbor (KNN) or Dynamic Time Warping (DTW)
Implement an app and algorithms that can guide 3D hand pose
Implement an app and algorithms that can guide 3D hand pose
Please send an email with your CV and transcript to apply for this opportunity.
Taein Kwon taein.kwon@inf.ethz.ch
Please send an email with your CV and transcript to apply for this opportunity.