What They Say
Scientists at Stanford have developed a “foveated” compression system that works in conjunction with gaze tracking to deliver two streams of video data at lower resolutions for non-foveal and higher for the fovea with a latency of just 14ms from eye movement to the generated image. This is in contrast to the typical range of 45-81 milliseconds plus network communication.
The team’s approach includes time for eye-tracking (~1.5 ms), encoding and decoding video (~5 ms), HDMI video output (~3.5 ms), and physical transition of the LCD (~4 ms)
The linked article explains the background behind foveated displays.
Original Article: Luke Hsiao, Brooke Krajancich, Philip Levis, Gordon Wetzstein, and Keith Winstein. 2022. Towards retina-quality VR video streaming: 15ms could save you 80% of your bandwidth. SIGCOMM Comput. Commun. Rev. 52, 1 (January 2022), 10–19.
What We Think
One of my favourite XR companies is Varjo and since I met the firm first, it was always highlighted the low latency of its technology. It would be interesting to see how the firm’s pipeline compares. (BR)
