Tools for Meta's Codec Avatars

Meta Reality Labs is at the forefront of avatar technology, developing systems that bridge social media experiences with immersive VR environments. My role involved advancing both consumer-facing avatar features and research-grade tools for next-generation avatar systems.

• Worked across Instagram's stylized avatar pipeline with clothing customization
• Developed 3D Gaussian Splatting tools for photorealistic VR avatars
• Built research visualization systems for parametric avatar manipulation

The project encompassed multiple cutting-edge technologies, from traditional 3D graphics to novel neural rendering techniques, requiring expertise in computer vision, real-time graphics, and research tooling.

• Python and Unity development for cross-platform avatar systems
• Multi-camera sensor fusion for high-fidelity avatar capture
• Research notebook extensions for interactive 3D visualization
• C++ performance optimization for real-time avatar processing

My work progressed through four distinct phases, each building upon previous achievements while exploring new frontiers in avatar technology.

• Phase 1: Enhanced Instagram's stylized avatar system with advanced clothing customization tools
• Phase 2: Developed 3D Gaussian Splatting avatar pipelines in Python and Unity for VR applications
• Phase 3: Extended research notebooks with interactive 3D avatar visualization and parametric manipulation

The final phases focused on performance optimization and advanced capture systems for next-generation avatar experiences.

• Phase 4: Optimized C++ tools for real-time avatar processing and manipulation
• Pipeline Enhancement: Improved 3D Gaussian avatar generation workflows
• Sensor Fusion: Developed multi-camera stream processing for enhanced avatar capture fidelity