Method and system for tracking eye movement in conjunction with a light scanning projector
An eye tracking system includes a pair of glasses including two frames and a light scanning projector coupled to the pair of glasses and operable to scan a beam of light. The eye tracking system also includes an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector. ... Magic Leap Inc
Depth sensing techniques for virtual, augmented, and mixed reality systems
A system and method for operating a sensor which has at least two modes of operation. The sensor may be provided with a sequence of common operation steps which are included in both a first sequence of operation steps which define a first mode of operation and a second sequence of operation steps which define a second mode of operation. ... Magic Leap Inc
Accumulation and confidence assignment of iris codes
Systems and methods pertaining to iris recognition are disclosed. A system is disclosed comprising an iris imager configured to acquire an iris image, and a processor configured to receive a first plurality of iris images from the iris imager, generate a first plurality of iris codes corresponding to the first plurality of iris images, generate a distribution metric corresponding to an iris cell location, generate a first composite iris code using the distribution metric, and generate a first match value using the first composite iris code and a first stored iris code.. ... Magic Leap Inc
Wearable display device utilizing a composite field of view
A wearable display device suitable for use in an augmented reality environment is disclosed. The wearable display device can include a projector configured to project light through diffractive optical elements that then distributed the light to multiple display regions. ... Magic Leap Inc
Method and system for waveguide projector with wide field of view
A waveguide display disposed in glasses includes a first pupil expander assembly operable to project a first image defined by a first field of view and a second pupil expander assembly disposed adjacent the first pupil expander assembly and operable to project a second image defined by a second field of view different from the first field of view.. . ... Magic Leap Inc
Depth based foveated rendering for display systems
Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. ... Magic Leap Inc
Eye-imaging apparatus using diffractive optical elements
Examples of eye-imaging apparatus using diffractive optical elements are provided. For example, an optical device comprises a substrate having a proximal surface and a distal surface, a first coupling optical element disposed on one of the proximal and distal surfaces of the substrate, and a second coupling optical element disposed on one of the proximal and distal surfaces of the substrate and offset from the first coupling optical element. ... Magic Leap Inc
Method and system for fiber scanning projector
A fiber scanning projector includes a piezoelectric element and a scanning fiber mechanically coupled to the piezoelectric element. The fiber scanning projector also includes an optical assembly section operable to receive light from the scanning fiber. ... Magic Leap Inc
Dynamic field of view variable focus display system
An augmented reality (ar) device is described with a display system configured to adjust an apparent distance between a user of the ar device and virtual content presented by the ar device. The ar device includes a first tunable lens that change shape in order to affect the position of the virtual content. ... Magic Leap Inc
Stacked waveguides having different diffraction gratings for combined field of view
In one aspect, an optical device comprises a plurality of waveguides formed over one another and having formed thereon respective diffraction gratings, wherein the respective diffraction gratings are configured to diffract visible light incident thereon into respective waveguides, such that visible light diffracted into the respective waveguides propagates therewithin. The respective diffraction gratings are configured to diffract the visible light into the respective waveguides within respective field of views (fovs) with respect to layer normal directions of the respective waveguides. ... Magic Leap Inc
Light projector using an acousto-optical control device
An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. ... Magic Leap Inc
Technique for recording augmented reality data
Disclosed is an improved approach for generated recordings from augmented reality systems from the perspective of a camera within the system. Instead of re-using rendered virtual content from the perspective of the user's eyes for ar recordings, additional virtual content is rendered from an additional perspective specifically for the ar recording. ... Magic Leap Inc
A computer implemented method for warping virtual content from two sources includes a first source generating first virtual content based on a first pose. The method also includes a second source generating second virtual content based on a second pose. ... Magic Leap Inc
A computer implemented method for warping multi-field color virtual content for sequential projection includes obtaining first and second color fields having different first and second colors. The method also includes determining a first time for projection of a warped first color field. ... Magic Leap Inc
A computer implemented method for warping virtual content includes generating warped virtual content by transforming source virtual content. The method also includes determining whether a memory location corresponding to an x, y location of the warped virtual content in an output frame of reference is occupied by pre-existing virtual content. ... Magic Leap Inc
Systems and methods for estimating a layout of a room are disclosed. The room layout can comprise the location of a floor, one or more walls, and a ceiling. ... Magic Leap Inc
In some embodiments, a display device includes one or more waveguides having a vapor deposited light absorbing film on edges of the waveguide to mitigate ghost images. In some embodiments, the film is formed directly on the edge of the waveguide by a vapor deposition, such as an evaporative deposition process. ... Magic Leap Inc
An imaging system includes a light source configured to produce a plurality of spatially separated light beams. The system also includes an injection optical system configured to modify the plurality of beams, such that respective pupils formed by beams of the plurality exiting from the injection optical system are spatially separated from each other. ... Magic Leap Inc
A fiber scanning system can have optimized performance by substantially matching the natural frequencies of the fiber scanning system's actuator and fiber optic scanning element. By matching the natural frequencies, the fiber scanning system can increase the maximum distance that the tip of the fiber optic scanning element may be driven relative to a resting position. ... Magic Leap Inc
A system for displaying virtual content to a user includes at least one light source to multiplex a plurality of light beams to display a respective plurality of light patterns associated with one or more frames of image data. The system also includes a plurality of waveguides to receive the plurality of light beams and to direct the plurality of light beams toward an exit pupil, wherein the plurality of waveguides are stacked along an optical axis of the user. ... Magic Leap Inc
Example display devices include a waveguide configured to propagate visible light under total internal reflection in a direction parallel to a major surface of the waveguide. The waveguide has formed thereon an outcoupling element configured to outcouple a portion of the visible light in a direction normal to the major surface of the waveguide. ... Magic Leap Inc
A wearable augmented reality head-mounted display system can be configured to pass light from the world forward a wearer wearing the head-mounted system into an eye of the wearer. The head-mounted display system can include an optical display that is configured to output light to form an image. ... Magic Leap Inc
Methods and systems for triggering presentation of virtual content based on sensor information. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergences. ... Magic Leap Inc
An eyepiece unit for projecting an image to an eye of a viewer includes an eyepiece having a world side and a viewer side opposite the world side. The eyepiece unit also includes a polarizer disposed adjacent the world side of the eyepiece. ... Magic Leap Inc
An eyepiece unit with optical filters includes a set of waveguide layers including a first waveguide layer and a second waveguide layer. The first waveguide layer is disposed in a first lateral plane and includes a first incoupling diffractive element disposed at a first lateral position, a first waveguide, and a first outcoupling diffractive element. ... Magic Leap Inc
Metasurfaces provide compact optical elements in head-mounted display systems to, e.g., incouple light into or outcouple light out of a waveguide. The metasurfaces may be formed by a plurality of repeating unit cells, each unit cell comprising two sets or more of nanobeams elongated in crossing directions: one or more first nanobeams elongated in a first direction and a plurality of second nanobeams elongated in a second direction. ... Magic Leap Inc
Antireflection coatings for metasurfaces are described herein. In some embodiments, the metasurface may include a substrate, a plurality of nanostructures thereon, and an antireflection coating disposed over the nanostructures. ... Magic Leap Inc
To enable shared user experiences using augmented reality systems, shared reference points must be provided to have consistent placement (position and orientation) of virtual objects. Furthermore, the position and orientation (pose) of the users must be determinable with respect to the same shared reference points. ... Magic Leap Inc
An eyepiece waveguide for an augmented reality. The eyepiece waveguide can include a transparent substrate with an input coupler region, first and second orthogonal pupil expander (ope) regions, and an exit pupil expander (epe) region. ... Magic Leap Inc
One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.. . ... Magic Leap Inc
This disclosure is directed to an image sensor. The image sensor includes a two-dimensional pixel array divided into a plurality of blocks, each of the plurality of blocks comprising pixels arranged in at least two different rows and two different columns, and a shutter mechanism that exposes the plurality of blocks sequentially, with all pixels in each block being exposed synchronously.. ... Magic Leap Inc
A wearable device can present virtual content to the wearer for many applications in a healthcare setting. The wearer may be a patient or a healthcare provider (hcp). ... Magic Leap Inc
A virtual or augmented reality headset is provided having a frame, a pair of virtual or augmented reality eyepieces, and an interpupillary distance adjustment mechanism. The frame includes opposing arm members and a bridge positioned intermediate the opposing arm members. ... Magic Leap Inc
Embodiments of a wearable device can include a head-mounted display (hmd) which can be configured to display virtual content. While the user is interacting with visual or audible virtual content, the user of the wearable may encounter a triggering event such as, for example, an emergency condition or an unsafe condition, detecting one or more triggering objects in an environment, or determining characteristics of the user's environment (e.g., home or office). ... Magic Leap Inc
An optical device includes a waveguide including an in-coupling optical element configured to in-couple light into the waveguide, a light distributing element configured to receive light from the in-coupling optical element and distribute light at a selected wavelength, and an out-coupling optical element configured to receive light from the light distributing element and out-couple light out of the waveguide. The out-coupling optical element includes a first region configured to out-couple light at a first depth plane based on a lens function of the first region and a second region configured to out-couple light at a second depth plane based on a different lens function of the second region.. ... Magic Leap Inc
Plasma etching processes for forming patterns in high refractive index glass substrates, such as for use as waveguides, are provided herein. The substrates may be formed of glass having a refractive index of greater than or equal to about 1.65 and having less than about 50 wt % sio2. ... Magic Leap Inc
Provided are methods, systems, and computer-program products for determining one or more settings of a content capture device. In some examples, to determine the one or more settings, luma values of pixels of an image from the content capture device may be identified. ... Magic Leap Inc
An augmented reality display system is configured to use fiducial markers to align 3d content with real objects. The augmented reality display system can optionally include a depth sensor configured to detect a location of a real object. ... Magic Leap Inc
An optical device includes variable optical material that alters at least one of: incident ambient light, spectral content of incident ambient light or direction of incident ambient light through the optical device in response to a stimulus provided by the device. The device can sense intensity and/or spectral characteristics of ambient light and provide appropriate stimulus to various portions of the optical device to activate the variable optical material and alter at least one of: incident ambient light, spectral content of incident ambient light or direction of incident ambient light.. ... Magic Leap Inc
Described are optical fibers and scanning fiber displays comprising optical fibers. The disclosed optical fibers include a plurality of mass adjustment regions, such as gas-filled regions, positioned between a central waveguiding element and an outer periphery for reducing a mass of the optical fiber as compared to an optical fiber lacking the plurality of mass adjustment regions.. ... Magic Leap Inc
A multi-element fiber scanner for scanning electromagnetic imaging radiation includes a base having a base plane and a longitudinal axis orthogonal to the base plane and a first fiber link passing through the base in a direction parallel to the longitudinal axis. The first fiber link is operatively coupled to at least one electromagnetic radiation source. ... Magic Leap Inc
An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first waveguide includes a first diffractive optical element (doe) coupled thereto and disposed at a lateral position. ... Magic Leap Inc
A fiber optic element of a fiber scanning system includes a motion actuator having longitudinal side members, an internal orifice, a first support region, a central region, and a second support region. The fiber optic element also includes a first fiber optic cable passing through the internal orifice and having a first fiber joint as well as a second fiber optic cable passing through the internal orifice. ... Magic Leap Inc
A method of fabricating a variable diameter fiber includes providing a fiber optic cable, focusing a laser beam at a predetermined location inside the fiber optic cable, and creating a damage site at the predetermined location. The method also includes focusing the laser beam at a series of additional predetermined locations inside the fiber optic cable and creating a plurality of additional damage sites at the additional predetermined locations. ... Magic Leap Inc
A method for adjusting transmitter output power (ptx) comprises sensing, by a proximity sensor communicatively coupled to a transmitting device, whether an object is proximate to the transmitting device. The method further comprises analyzing an image from a camera to determine whether the transmitting device is proximate to a portion of a human body, when the proximity sensor senses the object proximate to the transmitting device. ... Magic Leap Inc
Disclosed is an improved diffraction structure for 3d display systems. The improved diffraction structure includes an intermediate layer that resides between a waveguide substrate and a top grating surface. ... Magic Leap Inc
Soft-imprint alignment processes for patterning liquid crystal polymer layers via contact with a reusable alignment template are described herein. An example soft-imprint alignment process includes contacting a liquid crystal polymer layer with a reusable alignment template that has a desired surface alignment pattern such that the liquid crystal molecules of the liquid crystal polymer are aligned to the surface alignment pattern via chemical, steric, or other intermolecular interaction. ... Magic Leap Inc
Examples of diffractive devices comprise a cholesteric liquid crystal (clc) layer comprising a plurality of chiral structures, wherein each chiral structure comprises a plurality of liquid crystal molecules that extend in a layer depth direction by at least a helical pitch and are successively rotated in a first rotation direction. Arrangements of the liquid crystal molecules of the chiral structures vary periodically in a lateral direction perpendicular to the layer depth direction to provide a diffraction grating. ... Magic Leap Inc
Various embodiments of a user-wearable device can comprise a frame configured to mount on a user. The device can include a display attached to the frame and configured to direct virtual images to an eye of the user. ... Magic Leap Inc
Systems and methods for capturing audio which can be used in applications such as virtual reality, augmented reality, and mixed reality systems. Some systems may include a plurality of distributed monitoring devices in an environment, each having a microphone and a location tracking unit. ... Magic Leap Inc
A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. ... Magic Leap Inc
A projector assembly includes a light emitting diode (led) array, wherein the led array has an array axis, wherein the led array includes a plurality of leds arranged along the array axis, and wherein the plurality of leds are individually addressable. The projector assembly includes a rotatable actuator supporting the led array, wherein the rotatable actuator has a rotation axis, and wherein the rotation axis and the array axis are parallel. ... Magic Leap Inc
The present invention comprises a foveated imaging system capable of capturing a wide field of view image and a foveated image, where the foveated image is a controllable region of interest of the wide field of view image.. . ... Magic Leap Inc
A method and system for increasing dynamic digitized wavefront resolution, i.e., the density of output beamlets, can include receiving a single collimated source light beam and producing multiple output beamlets spatially offset when out-coupled from a waveguide. The multiple output beamlets can be obtained by offsetting and replicating a collimated source light beam. ... Magic Leap Inc
An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. ... Magic Leap Inc
A two-dimensional waveguide light multiplexer is described herein that can efficiently multiplex and distribute a light signal in two dimensions. An example of a two-dimensional waveguide light multiplexer can include a waveguide, a first diffraction grating, and a second diffraction grating disposed above the first diffraction grating and arranged such that the grating direction of the first diffraction grating is perpendicular to the grating direction of the second diffraction grating. ... Magic Leap Inc
The present disclosure relates to display systems and, more particularly, to augmented reality display systems. A diffraction grating includes a plurality of different diffracting zones having a periodically repeating lateral dimension corresponding to a grating period adapted for light diffraction. ... Magic Leap Inc
An optical device includes a liquid crystal layer having a first plurality of liquid crystal molecules arranged in a first pattern and a second plurality of liquid crystal molecules arranged in a second pattern. The first and the second pattern are separated from each other by a distance of about 20 nm and about 100 nm along a longitudinal or a transverse axis of the liquid crystal layer. ... Magic Leap Inc
An optical device includes a stack of multiple grating structures, each of which includes a plurality of sublayers of liquid crystal material. Each sublayer of liquid crystal material includes laterally extending repeating units, each formed of a plurality of liquid crystal molecules. ... Magic Leap Inc
Systems and methods for synthesizing an image of the face by a head-mounted device (hmd) are disclosed. The hmd may not be able to observe a portion of the face. ... Magic Leap Inc
Systems and methods for cuboid detection and keypoint localization in images are disclosed. In one aspect, a deep cuboid detector can be used for simultaneous cuboid detection and keypoint localization in monocular images. ... Magic Leap Inc
Embodiments of the present disclosure provide for implementing a mixed reality system with less power. In some examples, a passive state of the mixed reality system can have a gpu render predictable content that does not need to be processed by a cpu. ... Magic Leap Inc
In various embodiments, a wearable component configured to be worn on a head of a user is disclosed. The wearable component can comprise a wearable support and an electronic component coupled to or disposed within the wearable support. ... Magic Leap Inc
A wearable ophthalmic device is disclosed. The device may include an outward facing head-mounted light field camera to receive light from a user's surroundings and to generate numerical light field image data. ... Magic Leap Inc
In a stacked waveguide assembly, the waveguides can comprise color filters, distributed filters, and/or switch materials. Examples of color filters include dyes, tints, or stains. ... Magic Leap Inc
This disclosure describes a head-mounted display with a display assembly configured to display content to most or all of a user's field of view. The display assembly can be configured to display content in far-peripheral regions of the user's field of view differently than content upon which a user can focus. ... Magic Leap Inc
An imaging lens includes one or more lens elements configured to receive and focus light in a first wavelength range reflected off of one or more first objects onto an image plane, and to receive and focus light in a second wavelength range reflected off of one or more second objects onto the image plane. The imaging lens further includes an aperture stop and a filter positioned at the aperture stop. ... Magic Leap Inc
A method of tracking movement of an eye of a user includes directing a light beam at the eye. The eye may reflect a portion of the light beam. ... Magic Leap Inc
Architectures are provided for expanding the exit pupil of systems including one or more waveguides. Various embodiments include a display device including one or more waveguides. ... Magic Leap Inc
An image display system includes an optical subsystem configured to emit a first light beam and a second light beam, wherein the first light beam illuminates a first portion of a composite field of view and the second beam illuminates a second portion of the composite field of view. A scanning mirror is positioned to intercept and reflect the first light beam and the second light beam. ... Magic Leap Inc
An improved method, system, and apparatus is provided to implement a general architecture for robot systems. A mode execution module is provided to universally execute execution modes on different robotic system. ... Magic Leap Inc
The present invention comprises a compact optical see-through head-mounted display capable of combining, a see-through image path with a virtual image path such that the opaqueness of the see-through image path can be modulated and the virtual image occludes parts of the see-through image and vice versa.. . ... Magic Leap Inc
A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. ... Magic Leap Inc
A method for determining a distance to a target object includes transmitting light pulses to illuminate the target object and sensing, in a first region of a light-sensitive pixel array, light provided from an optical feedback device that receives a portion of the transmitted light pulses. The feedback optical device includes a preset reference depth. ... Magic Leap Inc
Systems and methods for efficient implementation of a convolutional layer of a convolutional neural network are disclosed. In one aspect, weight values of kernels in a kernel stack of a convolutional layer can be reordered into a tile layout with tiles of runnels. ... Magic Leap Inc
Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a spatial light modulator operatively coupled to an image source for projecting light associated with one or more frames of image data, and a variable focus element (vfe) for varying a focus of the projected light such that a first frame of image data is focused at a first depth plane, and a second frame of image data is focused at a second depth plane, and wherein a distance between the first depth plane and the second depth plane is fixed.. ... Magic Leap Inc
A method of generating a surface model of a physical environment includes obtaining an image of the physical environment. The method also includes generating a planar polygon mesh from at least the image. ... Magic Leap Inc
A method of fabricating non-uniform gratings includes implanting different densities of ions into corresponding areas of a substrate, patterning, e.g., by lithography, a resist layer on the substrate, etching the substrate with the patterned resist layer, and then removing the resist layer from the substrate, leaving the substrate with at least one grating having non-uniform characteristics associated with the different densities of ions implanted in the areas. The method can further include using the substrate having the grating as a mold to fabricate a corresponding grating having corresponding non-uniform characteristics, e.g., by nanoimprint lithography.. ... Magic Leap Inc
A time of flight based depth detection system is disclosed that includes a projector configured to sequentially emit multiple complementary illumination patterns. A sensor of the depth detection system is configured to capture the light from the illumination patterns reflecting off objects within the sensor's field of view. ... Magic Leap Inc
Systems and methods for eye image segmentation and image quality estimation are disclosed. In one aspect, after receiving an eye image, a device such as an augmented reality device can process the eye image using a convolutional neural network with a merged architecture to generate both a segmented eye image and a quality estimation of the eye image. ... Magic Leap Inc
Systems and methods for generating a face model for a user of a head-mounted device are disclosed. The head-mounted device can include one or more eye cameras configured to image the face of the user while the user is putting the device on or taking the device off. ... Magic Leap Inc
A system for calibrating alignment of magnetic and optical sensors in a virtual reality (vr) or augmented reality (ar) device. The system can include a controller, a waveform generator, and an electrical driver. ... Magic Leap Inc
In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.. . ... Magic Leap Inc
An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. ... Magic Leap Inc
A spatialized audio system includes a sensor to detect a head pose of a listener. The system also includes a processor to render audio data in first and second stages. ... Magic Leap Inc
A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. ... Magic Leap Inc
A head worn imaging system includes a light source configured to generate a light beam. The system also includes a light guiding optical element having a thickness between 0.1 and 1.5 mm and configured to propagate at least a portion of the light beam by total internal reflection. ... Magic Leap Inc
A virtual or augmented reality display system that controls a display using control information included with the virtual or augmented reality imagery that is intended to be shown on the display. The control information can be used to specify one of multiple possible display depth planes. ... Magic Leap Inc
Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. ... Magic Leap Inc
A device includes an input coupling grating having a first grating structure characterized by a first set of grating parameters. The input coupling grating is configured to receive light from a light source. ... Magic Leap Inc
A method of manufacturing a waveguide having a combination of a binary grating structure and a blazed grating structure includes cutting a substrate off-axis, depositing a first layer on the substrate, and depositing a resist layer on the first layer. The resist layer includes a pattern. ... Magic Leap Inc
A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. ... Magic Leap Inc
A head-mounted augmented reality (ar) device can include a hardware processor programmed to receive different types of sensor data from a plurality of sensors (e.g., an inertial measurement unit, an outward-facing camera, a depth sensing camera, an eye imaging camera, or a microphone); and determining an event of a plurality of events using the different types of sensor data and a hydra neural network (e.g., face recognition, visual search, gesture identification, semantic segmentation, object detection, lighting detection, simultaneous localization and mapping, relocalization).. . ... Magic Leap Inc
A thermal monitoring and dissipation system for use with an optical device is described. The optical device includes the following: a frame defining a pair of eye openings and including a pair of arms configured to extend over the ears of a user of the optical device; a temperature monitoring system configured to monitor a distribution of heat within the frame; a display assembly configured to display content to a user of the optical device; and a processor configured to receive temperature data from the temperature monitoring system and to adjust an output of the display assembly based on variation in the distribution of heat within the frame.. ... Magic Leap Inc
An artifact mitigation system includes a projector assembly, a set of imaging optics optically coupled to the projector assembly, and an eyepiece optically coupled to the set of imaging optics. The eyepiece includes an incoupling interface. ... Magic Leap Inc
An eyepiece for projecting an image to an eye of a viewer includes a waveguide configured to propagate light in a first wavelength range, and a grating coupled to a back surface of the waveguide. The grating is configured to diffract a first portion of the light propagating in the waveguide out of a plane of the waveguide toward a first direction, and to diffract a second portion of the light propagating in the waveguide out of the plane of the waveguide toward a second direction opposite to the first direction. ... Magic Leap Inc
An eyepiece and waveguide for viewing a projected image in a virtual reality and augmented reality imaging and visualization system. The waveguide may include a substrate for guiding light. ... Magic Leap Inc
An augmented reality (ar) device can be configured to monitor ambient audio data. The ar device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. ... Magic Leap Inc
A method for displaying virtual content to a user, the method includes determining an accommodation of the user's eyes. The method also includes delivering, through a first waveguide of a stack of waveguides, light rays having a first wavefront curvature based at least in part on the determined accommodation, wherein the first wavefront curvature corresponds to a focal distance of the determined accommodation. ... Magic Leap Inc
Augmented reality systems and methods for automatically repositioning a virtual object with respect to a destination object in a three-dimensional (3d) environment of a user are disclosed. The systems and methods can automatically attach the target virtual object to the destination object and re-orient the target virtual object based on the affordances of the virtual object or the destination object. ... Magic Leap Inc
A system for displaying virtual content to a user includes at least one light source to multiplex a plurality of light beams to display a respective plurality of light patterns associated with one or more frames of image data. The system also includes a plurality of waveguides to receive the plurality of light beams and to direct the plurality of light beams toward an exit pupil, wherein the plurality of waveguides are stacked along an optical axis of the user. ... Magic Leap Inc
A fixed-distance display system includes a light source configured to generate a light beam. The system also includes a light guiding optical element configured to propagate at least a portion of the light beam by total internal reflection. ... Magic Leap Inc
A dual source spatialized audio system includes a general audio system and a personal audio system. The general system includes a general audio processor and general speakers to produce general sound. ... Magic Leap Inc
Systems and methods for securely exchanging cryptographically signed records are disclosed. In one aspect, after receiving a content request, a sender device can send a record to a receiver device (e.g., an agent device) making the request. ... Magic Leap Inc
A method of operating a virtual image generation system comprises allowing an end user to interact with a three-dimensional environment comprising at least one virtual object, presenting a stimulus to the end user in the context of the three-dimensional environment, sensing at least one biometric parameter of the end user in response to the presentation of the stimulus to the end user, generating biometric data for each of the sensed biometric parameter(s), determining if the end user is in at least one specific emotional state based on the biometric data for the each of the sensed biometric parameter(s), and performing an action discernible to the end user to facilitate a current objective at least partially based on if it is determined that the end user is in the specific emotional state(s).. . ... Magic Leap Inc
Examples of systems and methods for determining a limbic boundary of an iris of an eye are provided. Properties of the corneal bulge can be computed from eye images. ... Magic Leap Inc
Systems and methods for iris authentication are disclosed. In one aspect, a deep neural network (dnn) with a triplet network architecture can be trained to learn an embedding (e.g., another dnn) that maps from the higher dimensional eye image space to a lower dimensional embedding space. ... Magic Leap Inc
An improved headset is provided to selectively distribute the weight of the headset while securely registering the headset comfortably on a wearer's head. The headset comprises one or more compliant arms and a frame to selectively distribute the weight of the headset and secure the headset to the wearer's head without the need for straps or leavers. ... Magic Leap Inc
Methods and devices for estimating position of a device within a 3d environment are described. Embodiments of the methods include sequentially receiving multiple image segments forming an image representing a field of view (fov) comprising a portion of the environment. ... Magic Leap Inc
An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.. ... Magic Leap Inc
In some embodiments, a display system comprising a head-mountable, augmented reality display is configured to perform a neurological analysis and to provide a perception aid based on an environmental trigger associated with the neurological condition. Performing the neurological analysis may include determining a reaction to a stimulus by receiving data from the one or more inwardly-directed sensors; and identifying a neurological condition associated with the reaction. ... Magic Leap Inc
A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. ... Magic Leap Inc
An augmented reality device (ard) can present virtual content which can provide enhanced experiences with the user's physical environment. For example, the ard can detect a linkage between a person in the fov of the ard and a physical object (e.g., a document presented by the person) or detect linkages between the documents. ... Magic Leap Inc
Examples of systems and methods for a wearable system to automatically select or filter available user interface interactions or virtual objects are disclosed. The wearable system can select a group of virtual objects for user interaction based on contextual information associated with the user, the user's environment, physical or virtual objects in the user's environment, or the user's physiological or psychological state.. ... Magic Leap Inc
A method for generating inputs for a neural network based on an image includes receiving the image, identifying a position within the image, and identifying a subset of the image at the position. The subset of the image is defined by a first set of corners. ... Magic Leap Inc
This invention concerns an ergonomic optical see-through head mounted display device with an eyeglass appearance. The see-through head-mounted display device consists of a transparent, freeform waveguide prism for viewing a displayed virtual image, a see-through compensation lens for enabling proper viewing of a real-world scene when combined together with the prism, and a miniature image display unit for supplying display content. ... Magic Leap Inc
In a stacked waveguide assembly, the waveguides can comprise color filters, distributed filters, and/or switch materials. Examples of color filters include dyes, tints, or stains. ... Magic Leap Inc
A stacked waveguide assembly can have multiple waveguide stacks. Each waveguide stack can include a plurality of waveguides, where a first waveguide stack may be associated with a first subcolor of each of three different colors, and a second waveguide stack may be associated with a second subcolor of each of the three different colors. ... Magic Leap Inc
Augmented reality systems and methods for user health analysis. Methods for user health analysis may include collecting data for an initial prediction model and continuing to collect additional data based on one or more data criteria. ... Magic Leap Inc
Architectures are provided for selectively outputting light for forming images, the light having different wavelengths and being outputted with low levels of crosstalk. In some embodiments, light is incoupled into a waveguide and deflected to propagate in different directions, depending on wavelength. ... Magic Leap Inc
An optical system comprises an optically transmissive substrate comprising a metasurface which comprises a grating comprising a plurality of unit cells. Each unit cell comprises a laterally-elongated first nanobeam having a first width; and a laterally-elongated second nanobeam spaced apart from the first nanobeam by a gap, the second nanobeam having a second width larger than the first width. ... Magic Leap Inc
A wearable device can have a field of view through which a user can perceive real or virtual objects. The device can display a visual aura representing contextual information associated with an object that is outside the user's field of view. ... Magic Leap Inc
Head-mounted augmented reality (ar) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (em) tracking system can track head or body pose. ... Magic Leap Inc
An augmented reality display system includes a pair of variable focus lens elements that sandwich a waveguide stack. One of the lens elements is positioned between the waveguide stack and a user's eye to correct for refractive errors in the focusing of light projected from the waveguide stack to that eye. ... Magic Leap Inc
An augmented reality system includes a light source configured to generate a virtual light beam. The system also includes a light guiding optical element having an entry portion, an exit portion, and a surface having a diverter disposed adjacent thereto. ... Magic Leap Inc
A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. ... Magic Leap Inc
Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. ... Magic Leap Inc
Methods and systems are disclosed for presenting virtual objects on a limited number of depth planes using, e.g., an augmented reality display system. A farthest one of the depth planes is within a mismatch tolerance of optical infinity. ... Magic Leap Inc
A virtual image generation system and method of operating same are provided. A left synthetic image and a right synthetic image of a three-dimensional scene are rendered respectively from a first left focal center and a first right focal center relative to a first viewpoint. ... Magic Leap Inc
An augmented reality system and method of operating the same is provided. An end user is allowed to visualize direct light from a three-dimensional scene in an ambient environment, generating virtual image data from the point of the view of the end user. ... Magic Leap Inc
The present disclosure provides an improved approach to implement structure learning of neural networks by exploiting correlations in the data/problem the networks aim to solve. A greedy approach is described that finds bottlenecks of information gain from the bottom convolutional layers all the way to the fully connected layers. ... Magic Leap Inc
A depth sensing system includes a sensor having first and second sensor pixels to receive light from a surface. The system also includes a filter to allow transmission of full spectrum light to the first sensor pixel and visible light to the second sensor pixel while preventing transmission of infrared light to the second sensor pixel. ... Magic Leap Inc
Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an initial eye image obtained by an image capture device; adjusting a level of blue light exposed to an eye associated with the initial eye image; receiving an adjustment eye image of the eye exposed to the adjusted level of blue light; detecting a change in a pupillary response of the adjustment eye image relative to the initial eye image; determining that the detected change in the pupillary response passes a biometric application threshold; and utilizing eye images or the detected change in the pupillary response for a biometric application.. ... Magic Leap Inc
Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.. ... Magic Leap Inc
In some embodiments, eye tracking is used on an ar or vr display system to determine if a user of the display system is blinking or otherwise cannot see. In response, current drain or power usage of a display associated with the display system may be reduced, for example, by dimming or turning off a light source associated with the display, or by configuring a graphics driver to skip a designated number of frames or reduce a refresh rate for a designated period of time.. ... Magic Leap Inc
Systems and methods are provided for selectively incoupling light having different wavelengths into one of a plurality of waveguides. The systems and methods provided for selectively incoupling light having different wavelengths into one of a plurality of waveguides comprise a switching device comprising switchable reflective elements that can be configured to redirect incoming light towards an incoupling element associated with one of a plurality of waveguides.. ... Magic Leap Inc
In some embodiments, optical systems with a reflector and a lens proximate a light output opening of the reflector provide light output with high spatial uniformity and high efficiency. The reflectors are shaped to provide substantially angularly uniform light output and the lens is configured to transform this angularly uniform light output into spatially uniform light output. ... Magic Leap Inc
An imaging system includes a light source configured to generate a light beam. The system also includes first and second light guiding optical elements having respective first and second entry portions, and configured to propagate at least respective first and second portions of the light beam by total internal reflection. ... Magic Leap Inc
In some embodiments, a display system is provided. The display system comprises a plurality of light pipes and a plurality of light sources configured to emit light into the light pipes. ... Magic Leap Inc
In some embodiments, an interconnect electrical connects a light emitter to wiring on a substrate. The interconnect may be deposited by 3d printing and lays flat on the light emitter and substrate. ... Magic Leap Inc
In some embodiments, a polarizing beam splitter is provided. The beam splitter may comprise an optically transmissive spacer having first and second opposing faces, with a first polarizer on the first opposing face and a second polarizer on the second opposing face. ... Magic Leap Inc
Methods and systems for reductions in switching between depth planes of a multi-depth plane display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. ... Magic Leap Inc
A hearing aid comprises a sensor configured for detecting a focus of an end user on a real sound source, a microphone assembly configured for converting sounds into electrical signals, a speaker configured for converting the electrical signals into sounds, and a control subsystem configured for modifying the direction and/or distance of a greatest sensitivity of the microphone assembly based on detected focus. A virtual image generation system comprises memory storing a three-dimensional scene, a sensor configured for detecting a focus of the end user on a sound source, a speaker configured for conveying sounds to the end user, and a control subsystem configured for causing the speaker to preferentially convey a sound originating from the sound source in response to detection of the focus, and for rendering image frames of the scene, and a display subsystem configured for sequentially displaying the image frames to the end user.. ... Magic Leap Inc
Apparatuses and methods for displaying a 3-d representation of an object are described. Apparatuses can include a rotatable structure, motor, and multiple light field sub-displays disposed on the rotatable structure. ... Magic Leap Inc
A method of atlas packing includes receiving a three-dimensional (3d) mesh that includes a plurality of triangles representing surfaces of one or more objects; for each respective triangle, determining a normal of the respective triangle, and categorizing the respective triangle into one of six directions along positive and negative of x-, y-, and z-directions; categorizing triangles in each respective direction into one or more layers orthogonal to the respective direction; for each respective layer, identifying one or more connected components; projecting each respective connected component onto a plane orthogonal to the respective direction to obtain a corresponding projected two-dimensional (2d) connected component; cutting the projected 2d connected component into one or more sub-components; packing the bounding boxes of all sub-components into one or more atlases; and for each respective triangle of each sub-component, copying a texture of a corresponding triangle of the 3d mesh to the respective triangle.. . ... Magic Leap Inc
Images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across the depth planes may vary based on color. ... Magic Leap Inc
A display subsystem for a virtual image generation system for use by an end user comprises a display, an optical fiber having a polarization-maintaining (pm) transmission fiber section and a non-pm scanning fiber section, a light source configured for injecting a linearly polarized light beam into the transmission fiber section, such that the linearly polarized light beam is emitted from the scanning fiber section, a mechanical scanning drive assembly in which the scanning fiber section is affixed, wherein the mechanical scanning drive assembly is configured for displacing the scanning optical fiber section is order to scan the emitted light beam, and a display configured for receiving the scanned light beam and generating an image to the end user.. . ... Magic Leap Inc
A display system comprises a wearable display device for displaying augmented reality content. The display device comprises a display area comprising light redirecting features that are configured to direct light to a user. ... Magic Leap Inc
Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image set selection can include comparing a determined image quality metric with an image quality threshold to identify an eye image passing an image quality threshold, and selecting, from a plurality of eye images, a set of eye images that passes the image quality threshold.. ... Magic Leap Inc
Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image combination can include assigning an eye pose region of a plurality of eye pose regions to each eye image and determining a representation of an eye pose in each eye image. ... Magic Leap Inc