Researchers Make a Leap With 360 Degree AR Holographic Automotive Display

Researchers from the Universities of Cambridge, Oxford and University College London have developed an advanced augmented reality (AR) holographic system that projects 4K video using LiDAR point clouds, specifically designed for automotive head-up displays. This technology significantly enhances road safety by displaying real-time, 3D holographic images that align with real-world objects in both size and distance, providing drivers with a comprehensive view of potential road hazards.

Optical setup for the CGH generation from LiDAR point cloud data. a) The principle of LCoS is based on the alignment of liquid crystals. b) The assembly of the SLM consists of optoelectronic components. Scale bar: 1 cm. The inset shows the LCoD panel. Inset scale bar: 5 mm. c) Optical projection system showing a 4K SLM, a He-Ne laser, an aspheric lens (L1), a focusing lens (L2), polarizers (P1-2), a half-wave plate (HW), and a beam splitter (BS). d) Developed holographic projection setup to display 3D floating images in 4K. e) Resolution chart targets: lines, checkerboard, Secchi Disk, yin yang, and Siemens star to calibrate the device. f) Computer-Generated Holograms of the resolution targets. Dashed lines show analyzed regions. g) Replay field results of the resolution targets. h) Intensity-to-distance plots of the original targets, the CGH-generated targets, and the replay field results
in a comparison of the selected projected regions (dashed regions). (Source: Advanced Optical Materials)

The system utilizes light detection and ranging (LiDAR) data, transformed into detailed 3D images, and leverages GPU-accelerated computing to create holograms faster than traditional CPU processing. This offers an augmented view of the road, maintaining the driver’s focus and significantly reducing the risk of accidents due to human error.

Unlike existing 2D heads-up displays that project onto a small part of the windshield, this technology keeps the driver’s eyes focused on the road. The 3D projections provide information about hazards from any angle in the driver’s field of view without being distracting or overwhelming.

Depth information of the holography setup to recreate 360° floating 3D objects in the replay field. a) Point Cloud extracted data with a separation algorithm which was post-processed into a CGH and an intensity profile in the replay field result. Each point had an intensity value assigned. b) The optical focusing lenses were reduced to virtual Fresnel lenses as part of the post-processing algorithm. The virtual Fresnel lenses were introduced at a focal length of f = 50 mm and f = 75 mm. c) LiDAR object rotations with depth information as pixel intensity and depth information of the object to be displayed to the driver as a 360°-rotated fully assessable obstacle. The rotation process is shown at 0° and 30°. d) 3D object rotation of the extracted LiDAR object and its corresponding replay field result: LiDAR truck presented at 0°, intensity map of the LiDAR object, replay field result; 3D object rotation around the y-axis, LiDAR image of the truck rotated at 30°; and replay field result. (Source: Advanced Optical Materials)

The researchers used LiDAR to capture extremely detailed scans with up to 400,000 data points for a single object. Specialized data processing techniques extract only the most essential information to generate the holograms in real-time. This allows for a 360-degree assessment of potential obstacles on busy, constantly changing streets.

The data collected can also be stored and shared via the cloud to create a crowd-sourced platform that provides real-time hazard awareness for all vehicles passing through an area.

The researchers are now collaborating with Google to test the system in actual vehicles, with road trials potentially beginning in 2024. The team aims to develop an inclusive system to improve safety for all road users.

Reference

J. Skirnewskaja, Y. Montelongo, J. Sha, P. Wilkes, T. D. Wilkinson, Accelerated Augmented Reality Holographic 4k Video Projections Based on Lidar Point Clouds for Automotive Head-Up Displays. Adv. Optical Mater. 2023, 2301772. https://doi.org/10.1002/adom.202301772

Researchers Make a Leap With 360 Degree AR Holographic Automotive Display

Reference

EU Awards $9.5 Million to HoloSurge for Pioneering Holographic Surgery Tech

Smartphone Displays: Battleground State

Swave Photonics Unveils World’s First 3D Holographic Display for XR Smart Glasses

The BMW i4 Upgrade: Less Knobs, More Central Display

Reference

Related Posts

EU Awards $9.5 Million to HoloSurge for Pioneering Holographic Surgery Tech

Smartphone Displays: Battleground State

Swave Photonics Unveils World’s First 3D Holographic Display for XR Smart Glasses

The BMW i4 Upgrade: Less Knobs, More Central Display