Metasurface wavefront control for high-performance user-natural augmented reality waveguide glasses

Metasurface-integrated silicon nitride waveguides for holography with full polarization control

Here, a silicon-based metasurface integrated on a silicon nitride (SiNx) waveguide is proposed, enabling continuous control of light's phase and polarization. By utilizing resonant phase, geometric phase, and detour phase with fixed inter-unit spacing, the metasurface achieves full phase coverage under arbitrary polarization states while reducing design complexity. We demonstrate hologram images of letters under four polarization states: x-, y-, right circular, and left elliptical polarizations, achieving phase control with the same amplitude in corresponding polarizations. The results provide more possibilities for generating complex free space light fields via on-chip devices.

An achromatic metasurface waveguide for augmented reality displays

Augmented reality (AR) displays are emerging as the next generation of interactive platform, providing deeper human-digital interactions and immersive experiences beyond traditional flat-panel displays. Diffractive waveguide is a promising optical combiner technology for AR owing to its potential for the slimmest geometry and lightest weight. However, severe chromatic aberration of diffractive coupler has constrained widespread adoption of diffractive waveguide. Wavelength-dependent light deflection, caused by dispersion in both in-coupling and out-coupling processes, results in limited full-color field of view (FOV) and nonuniform optical responses in color and angular domains. Here we introduce an innovative full-color AR system that overcomes this long-standing challenge of chromatic aberration using a combination of inverse-designed metasurface couplers and a high refractive index waveguide. The optimized metasurface couplers demonstrate true achromatic behavior across the maximum FOV supported by the waveguide (exceeding 45°). Our AR prototype based on the designed metasurface waveguide, exhibits superior color accuracy and uniformity. This unique achromatic metasurface waveguide technology is expected to advance the development of visually compelling experience in compact AR display systems.

Tandem achromatic metasurface for waveguide coupling in full-color AR displays

Waveguide coupling design is one of the most challenging topics in augmented reality (AR) near-eye displays (NED). The primary challenge stems from the necessity to simultaneously address two competing factors: the overall volume of the AR system and the occurrence of chromatic aberration. To address this issue, what we believe to be a novel tandem trilayer achromatic metasurface is specifically designed for waveguide coupling in AR NEDs, capable of achieving an achromatic effect in a nanometer-thin layer. By analyzing the influence of unit structure parameters on the phase delay of input electromagnetic waves, the optimal parameters are determined and the tandem trilayer achromatic metasurface structure is established. Simulation results show that the incident light can be deflected by 45°, 46°, and 45° at wavelengths of 440 nm ∼ 470 nm, 520 nm ∼ 550 nm, and 620 nm ∼ 660 nm, respectively. The angular deviation error of the three primary colors is maintained lower than 1° in the AR waveguide, ensuring a satisfactory achromatic effect. This design provides a new solution for developing ultra-thin and compact optical systems for full-color AR NEDs.

Framework for optimizing AR waveguide in-coupler architectures

Waveguide displays have been shown to exhibit multiple interactions of light at the in-coupler diffractive surface, leading to light loss. Any losses at the in-coupler set a fundamental upper limit on the full-system efficiency. Furthermore, these losses vary spatially across the beam for each field, significantly decreasing the displayed image quality. We present a framework for alleviating the losses based on irradiance, efficiency, and MTF maps. We then derive and quantify the innate tradeoff between the in-coupling efficiency and the achievable modulation transfer function (MTF) characterizing image quality. Applying the framework, we show a new in-coupler architecture that mitigates the efficiency vs image quality tradeoff. In the example architecture, we demonstrate a computation speed that is 2,000 times faster than that of a commercial non-sequential ray tracer, enabling faster optimization and more thorough exploration of the parameter space. Results show that with this architecture, the in-coupling efficiency still meets the fundamental limit, while the MTF achieves the diffraction limit up to and including 30 cycles/deg, equivalent to 20/20 vision.

Ultracompact polarization multiplexing meta-combiner for augmented reality display

Augmented reality (AR) display, as a next-generation innovative technology, is revolutionizing the ways of perceiving and communicating by overlaying virtual images onto real-world scenes. However, the current AR devices are often bulky and cumbersome, posing challenges for long-term wearability. Metasurfaces have flexible capabilities of manipulating light waves at subwavelength scales, making them as ideal candidates for replacing traditional optical elements in AR display devices. In this work, we propose and fabricate what we believe is a novel reflective polarization multiplexing gradient metasurface based on propagation phase principle to replace the optical combiner element in traditional AR display devices. Our designed metasurface exhibits different polarization modulations for reflected and transmitted light, enabling efficient deflection of reflected light while minimizing the impact on transmitted light. This work reveals the significant potential of metasurfaces in next-generation optical display systems and provides a reliable theoretical foundation for future integrated waveguide schemes, driving the development of next-generation optical display products towards lightweight and comfortable.

Hyperspectral screen-image-synthesis meter with scattering-noise suppression

The screen image synthesis (SIS) meter was originally proposed as a high-speed measurement tool, which fused the measured data from multiple sample-rotational angles to produce a whole-field measurement result. However, it suffered from stray light noise and lacked the capability of spectrum measurement. In this study, we propose an SIS system embedded with a snapshot hyperspectral technology, which was based on a dispersion image of the sparse sampling screen (SSS). When a photo was captured, it was transformed and calibrated to hyperspectral data at a specific sample-rotational angle. After the hyperspectral data in all sample-rotational angles were captured, an SIS image-fusion process was then applied to get the whole field hyperspectral data. By applying SSS to the SIS meter, we not only create a screen image synthesis hyperspectral meter but also effectively address the issue of stray-light noise. In the experiment, we analyze its correctness by comparing the hyperspectral value with a one-dimensional spectrum goniometer (ODSG). We also show the 2D color temperature coefficient distribution and compare it with the ODSG. Experimental results also demonstrate the feasibility in terms of both spectrum distribution meter and color coefficient temperature distribution meter.

Augmented and virtual reality in spine surgery

Augmented Reality (AR) and Virtual Reality (VR) have developed unprecedentedly in recent years, providing interesting opportunities for medical applications. Their integration into clinical assessment, surgical workflow, and training has shown tremendous potential to improve daily life activity in spine surgery. The paper explores the utilization of VR and AR in spine surgery, with their applications, benefits, challenges, and forthcoming prospects.

Do you have a good all-around view? Evaluation of a decision-making skills diagnostic tool using 360° videos and head-mounted displays in elite youth soccer

Elite youth players' decision-making skills are considered important predictors of adult performance in soccer. The presentation of 360° videos in head-mounted displays offers new potential for the diagnostic of these skills in talent development programs. This study evaluated a new diagnostic tool using soccer-specific 360° videos for assessing decision-making skills in youth academy (YA) players. The evaluation consisted of players' subjective feedback as well as the analysis of diagnostic and prognostic validity. It was hypothesized that high-level YA players achieve better diagnostic results than regional-level players, and U19 outperform U17 players. Moreover, YA players' diagnostic results should be positively associated with future adult performance level. During the 2018/19 season, N = 48 youth players participated in the diagnostic procedures (split-half reliability r = .78). Participants were shown 54 videos which terminated when the central midfielder received a teammate's pass. Participants were then asked how to best continue playing. The subjective evaluation explored YA players' experiences with the diagnostic tool via quantitative ratings (e.g., "How exciting was the task?", "How involved did you feel in the game situation?") and additional interviews. Diagnostic validity was examined in a balanced cross-sectional 2 × 2-design (performance level x age group) and prognostic validity in a 3-year prospective design. Sensitivity and case-by-case analyses completed the evaluation. The YA players provided positive quantitative ratings regarding their experienced immersion into the environment. Players' qualitative feedback indicated general acceptance of the diagnostic tool as well as it offered recommendations for improvements. Confirming the diagnostic validity, ANOVA revealed significant main effects for performance level (p < .001, η2 = .29) and age group (p < .01, η2 = .14). Contributing to the prognostic validity, the diagnostic results discriminated between YA players achieving a higher and a lower adult performance level ("League 1-4" vs. "League 5 or below") in adulthood (p < .05; d = 0.80). A ROC curve and the AUC showed that the correct assignment to the adult performance levels is possible with a 71% probability. YA players with a high decision-making accuracy had a six times higher chance of playing in "League 1-4". The results demonstrated empirical evidence for the new diagnostic tool in terms of YA players' acceptance and validity coefficients exceeding effect sizes of former studies. The technology provides opportunities to test soccer-specific situations demanding an all-around view that were not testable in former experimental settings. Further technological advancements will enable the realization of improvements recommended by the players. Nonetheless, case-by-case analyses suggest caution in using such a diagnostic as a selection tool in talent development programs.

Metasurfaces integrated with a single-mode waveguide array for off-chip wavefront shaping

Integration of metasurfaces and SOI (silicon-on-insulator) chips can leverage the advantages of both metamaterials and silicon photonics, enabling novel light shaping functionalities in planar, compact devices that are compatible with CMOS (complementary metal-oxide-semiconductor) production. To facilitate light extraction from a two-dimensional metasurface vertically into free space, the established approach is to use a wide waveguide. However, the multi-modal feature of such wide waveguides can render the device vulnerable to mode distortion. Here, we propose a different approach, where an array of narrow, single-mode waveguides is used instead of a wide, multi-mode waveguide. This approach tolerates nano-scatterers with a relatively high scattering efficiency, for example Si nanopillars that are in direct contact with the waveguides. Two example devices are designed and numerically studied as demonstrations: the first being a beam deflector that deflects light into the same direction regardless of the direction of input light, and the second being a light-focusing metalens. This work shows a straightforward approach of metasurface-SOI chip integration, which could be useful for emerging applications such as metalens arrays and neural probes that require off-chip light shaping from relatively small metasurfaces.

Sparse holographic imaging for an integrated augmented reality near-eye display

Diffraction is the main physical effect involved in the imaging process of holographic displays. In the application of near-eye displays, it generates physical limits that constrain the field of view of the devices. In this contribution, we evaluate experimentally an alternative approach for a holographic display based mainly on refraction. This unconventional imaging process, based on sparse aperture imaging, could lead to integrated near-eye displays through retinal projection, with a larger field of view. We introduce for this evaluation an in-house holographic printer that allows the recording of holographic pixel distributions at a microscopic scale. We show how these microholograms can encode angular information that overcomes the diffraction limit and could alleviate the space bandwidth constraint usually associated with conventional display design.

Design of single-layer color echelle grating optical waveguide for augmented-reality display

We proposed a single-layer color echelle grating combined optical waveguide structure for an augmented-reality display. In this structure, we used echelle gratings with super-wavelength periodic scale as in-coupling, relay, and out-coupling elements. The combined propagation of three light beams in the waveguide was realized by overlapping different high diffraction orders of the RGB three primary colors, and deflection of the beam direction between gratings was achieved by conical diffraction generated by the inclined grating. Using the vector diffraction theory, the structural parameters and tolerance ranges of the three types of gratings were optimized, rendering average diffraction efficiencies of the three primary colors of the in-coupling, relay, and out-coupling gratings greater than 74%, 21%, and 35%, respectively. As a result, we obtained dual-channel one-dimensional pupil dilation of the original image and a field-of-view angle of h18.9° × v36.87°.