The Best and Worst of the camera API on Quest

Link to Ball tracking game included ⚽

Discover the true potential and hidden challenges with Meta’s camera API through an insightful interview with XR developer Christoph Springer. The Passthrough Camera API provides access to the forward-facing cameras on the Quest 3 and Quest 3S for the purpose of supporting Computer Vision and Machine Learning and gives us a glimpse of the opportunities unlocked by AR glasses powered by AI. From practical limitations to exciting and unexplored applications, Christoph shares his learnings from creating some of the most compelling and thoughtful experiences available today, including Ballee, a ball-tracking game you can try for free right now.

Before getting into the interview, I wanted to quickly introduce you to today’s sponsor Gracia AI. Gracia AI is the only app that allows you to experience Gaussian Splatting volumetric videos on a standalone headset, either in VR or MR.

It is a truly impressive experience and I recommend you to try it out right now on your Quest or PC-powered headset.