So I saw this Forbes Article....

And I sat on it..... then today....
thx ppr

Forbes.com  "

Eye Tracking Has The Potential To Completely Change AR And VR"

Patrick Moorhead , CONTRIBUTORI write about disruptive companies, technologies and usage models.  Opinions expressed by Forbes Contributors are their own.

techtoday.in.ua

Eye Tracking Technology

Note: Moor Insights & Strategy Analyst Anshel Sag made significant contributions to this blog.

AR and VR are still in the growth phase of development with billions of R&D and content money being poured in annually. A lot of that money is being invested in technologies to improve the experience as the current experience is, well, rough. There is a multitude of technologies that can help the immersive technology industry to move forward with AR and VR. Some of those technologies have to do with the display or wireless communications to make the experience better than it is today. However, one of the most promising technologies that have the potential of helping to solve many problems at once is eye tracking. Eye tracking has the promise of helping to not only help solve human interface problems with AR and VR but also to improve the overall visual quality of AR and VR experiences.  If you want to a deep dive now, please feel free to read our whitepaper (free/no sign up) here.

Eye tracking used today

Eye tracking already exists in many applications today in both consumer and enterprise markets with some of the most publicly-facing implementations being eye tracking for eSports gaming. Companies like Acer, Dell’s Alienware, and MSI have adopted eye-tracking technologies in notebooks and monitors to give eSports viewers the ability to see what professional eSports players are looking at while competing. These technologies eventually waterfall into the final consumer products that can help gamers better understand their behavior and interface with their computers.

Foveated rendering

The use of eye tracking in AR and VR has lots of benefits with one of the first being foveated rendering. As the resolutions of XR (AR, VR, MR) displays continue to increase to add to the realism, there will be a need to not render the entire volume of the pixels on display and only to render what the user sees. Otherwise, having 8K and 16K displays in VR headsets will be virtually impossible to be driven by nearly any GPU in the market in the foreseeable future.

IPD (interpupillary distance)

In addition to foveated rendering, eye position is crucial for AR and VR because the eye position will determine how sharp someone perceives the image on display, regardless of resolution. Eye position includes measurements like IPD (interpupillary distance) which determines how far apart someone’s eyes are from one another, a crucial measurement in ensuring that everyone gets the best possible image quality.

*****************************************************

United States Patent Application 20180176551 Viswanathan; P. Selvan ; et al. June 21, 2018

Applicant: Microvision, Inc.

Devices and Methods for Providing Foveated Scanning Laser Image Projection with Depth Mapping

FIELD

[0001] The present disclosure generally relates to depth mapping, and more particularly relates to depth mapping with scanning laser projectors.

BACKGROUND

[0002] In scanning laser projectors, images are projected by scanning laser light into a pattern, with individual pixels generated by modulating light from laser light sources as a scanning mirror scans the modulated light in the pattern. Depth mapping sensors have been developed to generate 3D maps of surfaces, where the 3D maps describe the variations in depth over the surface.

[0003] Past attempts to combine scanning laser projectors with depth mapping has been constrained by various limitations. For example, past attempts have been limited to providing depth mapping with specific resolutions. Additionally, past attempts to combine laser projection and depth sensing have been constrained by power limitations.

[0004] Furthermore, some previous methods of combing depth mapping and laser projection have had limited flexibility. As such, there remains a need for improved devices to combine scanning laser projectors with depth mapping. And there remains a need for improved devices and methods for depth mapping, and in particular a need for depth mapping and laser projection with improved flexibility.

Abstract

Devices and methods are described herein for providing foveated image projection.