Prototype for AR Avatars on the Magic Leap 2
Prototyped AR avatars to apply for funding from Snapdragon Spaces. Involved using SOTA pose-recognition models as well as low-level game engines on Android. Final prototype used Mediapipe, Pytorch (C++), and Stereokit. Involved the development of custom algorithms for keypoint depth estimation and IK. Also ported h.264 video streaming code to the Magic Leap device, and patched cling (the C++ interpreter) to work on the Magic Leap.