🥽 Meta Passthrough Camera API

I’ve been experimenting with Meta’s Passthrough Camera API — check out my attempt here 👀.

The code is available here. It uses Unity Sentis to run a YOLOv8 model for real-time object detection.

The API also works with Meta’s Spatial SDK. For example, Meta Spatial Scanner uses ML Kit for object detection, and you can hook it up to an AWS server running a LLaMA model for more advanced vision-based interactions.

It’s exciting to see how XR, ML, and real-world passthrough can blend together — the possibilities are huge! 🚀