Using a screen capture from the [Vision Pro] which views both the passthrough hand and the virtual hand, we can see how many frames it takes between when the passthrough hand moves and when the virtual hand moves. […] we found this to be about 3.5 frames. At the capture rate of 30 FPS, that’s 116.7ms. Then we add to that Vision Pro’s known passthrough latency of about 11ms, for the final result of 127.7ms of photon to hand-tracking latency. […] Using a similar test, we found Quest 3’s hand-tracking latency to be around 70ms on Quest OS v63.
An important point here: latency and accuracy of hand-tracking are two different things. In many cases, they may even have an inverse relationship. If you optimize your hand-tracking algorithm for speed, you may give up some accuracy. And if you optimize it for accuracy, you may give up some speed. As of now we don’t have a good measure of hand-tracking accuracy for either headset, outside of a gut feeling.
that’s really high latency for Apple, definitely not made for gaming
of course I wish the Quest 3 had more accurate hand tracking, but I usually use the controllers anyways
Using hand tracking vs controller for gaming is a night and day difference. But that the Quest is actually faster is not what I would’ve guessed. The interesting bit is that the camera itself has a higher latency:
The article makes the point that that makes the tracking feel even faster on Quest, because the image is slower.