Structured light projector with solid optical spacer element
The disclosed structured light projector may include (1) a light source having a light-emitting side that emits light, (2) a solid optical spacer element having a first side securely coupled to the light-emitting side of the light source, and (3) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack includes (a) a light-receiving side securely coupled to a second side of the solid optical spacer element opposite the first side, and (b) a light-emitting side opposite the light-receiving side that emits structured light in response to the light received from the light-emitting side of the light source via the solid optical spacer element. Various other devices and methods are also disclosed.
Latest Meta Platforms Technologies, LLC Patents:
- Gaze-based user interface with assistant features for smart glasses in immersive reality applications
- Systems and methods for dynamic image processing and segmentation
- Antenna for wearable electronic devices
- Reverse pass-through glasses for augmented reality and virtual reality devices
- Activating a snap point in an artificial reality environment
This application claims priority to U.S. application Ser. No. 16/408,968, filed May 10, 2019, the disclosure of which is incorporated, in its entirety, by this reference.
BACKGROUND OF THE INVENTIONA structured light projector can be used to measure distance from the projector itself to other objects or surfaces. For example, a camera associated with the projector can capture an image of the light that is reflected back from an object or surface and then map the object or surface based on the reflection. In some cases, the structured light projector may include one or more diffractive optical elements through which the projected light passes in order to illuminate a particular field of view.
The accompanying drawings illustrate a number of exemplary embodiments and are a part of the specification. Together with the following description, these drawings demonstrate and explain various principles of the instant disclosure.
Throughout the drawings, identical reference characters and descriptions indicate similar, but not necessarily identical, elements. While the exemplary embodiments described herein are susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and will be described in detail herein. However, the exemplary embodiments described herein are not intended to be limited to the particular forms disclosed. Rather, the instant disclosure covers all modifications, equivalents, and alternatives falling within the scope of the appended claims.
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTSStructured light projectors, which, as the name indicates, project structured light (e.g., light patterns of dots, lines, or other geometric shapes) into a surrounding local environment, are typically employed to measure distances from a device incorporating the projector to various objects or surfaces in the environment. To measure those distances, a camera associated with the projector may be employed to capture an image of the portion of the structured light that is reflected toward the camera, and a processor may then analyze that image to ascertain or “map” the surfaces that are illuminated by the structured light.
In many conventional structured light projectors, a laser light source may be employed to generate light that may then pass through one or more diffractive optical elements (DOES) of a DOE stack, which may diffract the laser light to generate structured light that illuminates a particular field of view (FOV) of the surrounding environment. To facilitate efficient use of the DOE stack, the DOE stack is placed a significant distance (e.g., over half of the overall length of the projector) from the laser light source to the DOE stack so that a significant portion of the side of the DOE stack receiving the laser light is illuminated.
The present disclosure is generally directed to structured light projectors and associated methods that employ a solid optical spacer element that substantially bridges the length between the light source and the DOE stack. As will be explained in greater detail below, embodiments of the instant disclosure may provide additional mechanical stability to the structured light projector, as well as reduce or eliminate the amount of air space within the projector that may serve as an undesirable source of humidity and other contamination that may possibly lead to optical inaccuracy and/or operational hazards.
Features from any of the embodiments described herein may be used in combination with one another in accordance with the general principles described herein. These and other embodiments, features, and advantages will be more fully understood upon reading the following detailed description in conjunction with the accompanying drawings and claims.
The following will provide, with reference to
In the example of
In operation, in at least some embodiments, light source 120 may generate and emit light 130 toward DOE stack 110 via solid optical spacer element 140, instead of via an air-filled space. In some examples, as described in greater detail below, light source 120 may employ one or more light sources or devices (e.g., one or more infrared or visible-light lasers, such as Class 3R or Class 4 lasers) to generate emitted light 130. Additionally, if multiple such devices are used, such devices may be activated simultaneous, or at varying times, and with constant or varying levels of intensity or duty cycle. Light source 120, in some embodiments, may also include one or more additional optical components (e.g., a lightguide, a collimator, and/or the like) to further condition the light generated by light source 120 to produce emitted light 130. In some embodiments, a controller 160 (e.g., a hardware processor or controller, or a processor that executes one or more instructions of firmware, software, or the like) may control the operation of light source 120, including any light-emitting devices included therein.
DOE stack 110, in at least some examples, may receive emitted light 130 via solid optical spacer element 140 and project structured light 150 into the surrounding environment based on the received emitted light 130. In various embodiments, DOE stack 110 may include one or more DOEs that may generate a light pattern (e.g., dots, lines, or other geometric shapes) using emitted light 130 to produce structured light 150. Also, in some examples, multiple DOEs may be implemented within DOE stack 110 (e.g., to provide a large field of view (FOV) of the surrounding environment that is illuminated with structured light 150). In some embodiments, DOE stack 110 may include one or more additional optical components (e.g., a collimator) that conditions emitted light 130 for use by one or more other DOEs of DOE stack 110 to produce the desired structured light 150. In some embodiments, the DOE closest to solid optical spacer element 140 may be a collimator so that light received via solid optical spacer element 140 may be substantially collimated in preparation for the remaining DOEs of DOE stack 110 to generate structured light 150. Moreover, in some examples, two or more of the optical elements of DOE stack 110 may be substantially adjacent to each other, such that very little or no free-space or air-space region is present between the optical elements.
Also included in structured light projector 100 between light source 120 and DOE stack 110 may reside solid optical spacer element 140. In some embodiments, provides a solid monolithic optical medium (e.g., glass, silicon, etc.) that transfers emitted light 130 from light source 120 to DOE stack 110. As described in greater detail below, such medium may provide both the optical path between light source 120 and DOE stack 110 as well as the structural means (e.g., contact surfaces and so on) by which light source 120 and DOE stack 110 are mechanically coupled together to form a stable structure. In other examples, solid optical spacer element 140 may include a spacer housing in which an optical material (e.g., an optical polymer) has been injected, such that the optical material provides the optical path between light source 120 and DOE stack 110, while the spacer housing provides the mechanical means by which light source 120 and DOE stack 110 are coupled together to perform a stable structure.
As indicated in
In each of the embodiments described above, controller 160 may activate light source 120 (e.g., to produce light pulses for emitted light 130) to generate structured light 150. In addition, in some examples, controller 160 may control an image capture device (e.g., a camera) to detect the portion of structured light 150 reflected from a local environment and to analyze that reflected light to map the local environment. An example of such a system is described in greater detail below in conjunction with
As discussed above, DOE stack 110 may include one or more DOEs 200. In some embodiments, DOEs 200 may include other types of optical elements not depicted in
In some examples, each DOE 200 of DOE stack 110 may include a different micro-structured surface such that a first DOE 200 generates a first light pattern based on the received emitted light 130, and a second DOE 200 (e.g., adjoining a top surface of first DOE 200) generates structured light 150 based on the first light pattern. Further, in such embodiments, first DOE 200 may provide a particular FOV for the first light pattern, while second DOE 200 may further broaden the resulting FOV to yield the FOV exhibited by structured light 150. DOEs 200 may be manufactured using, for example, without limitation, injection compression molding, nano-imprinting (e.g., using one or more etchants), or nano-replication.
Also, versions of a solid optical spacer element (e.g., serving as solid optical spacer element 140 of
In some examples, injected optical polymer 344 may be silicon, although other injectable optical materials may be employed in other embodiments. In some cases, injected optical polymer 344 may provide an index of refraction that is greater than that of air, which may result in a longer overall distance between VCSEL 322 and DOE stack 110. This longer distance may cause a more precise light pattern for structured light 150, possibly resulting in less sensitivity of overall mapping system to the particular local environment in which the system is being employed. In other examples, a relatively low refractive index (e.g., less than or equal to one) may be employed to maintain or reduce the overall distance between VCSEL 322 and DOE stack 110.
In
Consequently, in structured light projectors 600, 700, and 800 of
In each of
In structured light projector 400 of
With respect to structured light projector 500 of
In structured light projectors 300, 400, and 500 of
Embodiments of structured light projectors 600, 700, and 800 of
At step 920, the light received at the first side of the solid optical spacer element may be delivered through a second side of the solid optical spacer element opposite the first side to a light-receiving side of a DOE stack (e.g., DOE stack 110) including one or more DOEs (e.g., DOEs 200). In some embodiments, the second side may be mechanically coupled directly (e.g., at the spacer housing 342 or unitary optical element 640) to the light receiving side of the DOE stack.
At step 930, structured light (e.g., structured light 150) may be emitted from a light-emitting side of the DOE stack opposite the light-receiving side in response to the light received at the light-receiving side of the DOE stack.
At step 1020, a second side of the solid optical spacer element opposite the first side may be securely coupled to a light-receiving side of a DOE stack (e.g., DOE stack 110), where the light source, the solid optical spacer element, and the DOE stack form at least a portion of a structured light projector (e.g., structured light projector 100, 300, 400, 500, 600, 700, or 800) that emits structured light (e.g., structured light 150) from a light-emitting side of the DOE stack opposite the light-receiving side in response to light emitted from the light-emitting side of the light source. In some embodiments, the light source, the solid optical spacer element, and the DOE stack may be coupled together by way of fasteners (e.g., screws, clamps, or the like), an adhesive, or other means.
As discussed above in conjunction with
Example 1: A structured light projector that may include (1) a light source having a light-emitting side that emits light, (2) a solid optical spacer element having a first side securely coupled to the light-emitting side of the light source, and (3) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack includes (a) a light-receiving side securely coupled to a second side of the solid optical spacer element opposite the first side, and (b) a light-emitting side opposite the light-receiving side that emits structured light in response to light received from the light-emitting side of the light source via the solid optical spacer element.
Example 2: The structured light projector of Example 1, where the solid optical spacer element may include (1) a spacer housing that mechanically couples the light-emitting side of the light source to the light-receiving side of the DOE stack, and (2) an injected optical polymer residing within the spacer housing that delivers the light emitted from the light source to the light-receiving side of the DOE stack.
Example 3: The structured light projector of Example 2, where the injected optical polymer may include silicon.
Example 4: The structured light projector of Example 1, where the solid optical spacer element may include a unitary optical element that (1) mechanically couples the light-emitting side of the light source to the light-receiving side of the DOE stack, and (2) delivers the light emitted from the light source to the light-receiving side of the DOE stack.
Example 5: The structured light projector of any one of Examples 1-4, where the light source may include (1) a light-emitting device, and (2) a submount, where the light-emitting device is mounted to the submount.
Example 6: The structured light projector of Example 5, where the light-emitting device may be a vertical-cavity surface-emitting laser (VCSEL).
Example 7: The structured light projector of Example 5, where (1) the submount may include a recessed region in which the light-emitting device is mounted, and (2) the solid optical spacer element may contact the submount at a surface external to the recessed region.
Example 8: The structured light projector of Example 7, where the recessed region may define an air gap between a light-emitting surface of the light-emitting device and the first side of the solid optical spacer element.
Example 9: The structured light projector of Example 7, further including an optical element that may bridge a space between a light-emitting surface of the light-emitting device and the first side of the solid optical spacer element.
Example 10: The structured light projector of Example 9, where the optical element may include a microlens.
Example 11: The structured light projector of Example 7, where the first side of the solid optical spacer element may contact a light-emitting surface of the light-emitting device.
Example 12: The structured light projector of any one of Examples 1-4, where the DOE stack may include a collimating optical element that defines the light-receiving side of the DOE stack.
Example 13: The structured light projector of any one of Examples 1-4, further including at least one mechanical fastener that may securely couple the light source, the solid optical spacer element, and the DOE stack together.
Example 14: The structured light projector of any one of Examples 1-4, where the light source, the solid optical spacer element, and the DOE stack may be secured together using an adhesive.
Example 15: A method of generating structured light that may include (1) emitting, from a light-emitting side of a light source, light toward a first side of a solid optical spacer element, where the light-emitting side is mechanically coupled directly to the first side of the solid optical spacer element, (2) delivering, by the solid optical spacer element, the light received at the first side through a second side of the solid optical spacer element opposite the first side to a light-receiving side of a diffractive optical element (DOE) stack including one or more DOEs, where the second side is mechanically coupled directly to the light-receiving side of the DOE stack, and (3) emitting, from a light-emitting side of the DOE stack opposite the light-receiving side, structured light in response to the light received at the light-receiving side.
Example 16: The method of Example 15, where the light emitted from the light-emitting side of the light source may cross an air gap before reaching the first side of the solid optical spacer element.
Example 17: The method of Example 15, where light emitted from the light-emitting side of the light source may pass to the first side of the solid optical spacer element via a microlens.
Example 18: A method of manufacturing a structured light projector that may include (1) securely coupling a first side of a solid optical spacer element to a light-emitting side of a light source, and (2) securely coupling a second side of the solid optical spacer element opposite the first side to a light-receiving side of a diffractive optical element (DOE) stack including one or more DOEs, where the light source, the solid optical spacer element, and the DOE stack form at least a portion of a structured light projector that emits structured light from a light-emitting side of the DOE stack opposite the light-receiving side in response to light emitted from the light-emitting side of the light source.
Example 19: The method of Example 18, where the solid optical space element may include (1) a spacer housing that mechanically couples the light-emitting side of the light source to the light-receiving side of the DOE stack, and (2) an injected optical polymer residing within the spacer housing that delivers the light emitted from the light source to the light-receiving side of the DOE stack.
Example 20: The method of Example 18, where the solid optical spacer element may include a unitary optical element that (1) mechanically couples the light-emitting side of the light source to the light-receiving side of the DOE stack, and (2) delivers the light emitted from the light source to the light-receiving side of the DOE stack.
In some embodiments, local area imaging assembly 1201 may determine depth and/or surface information for objects within local area 1202 in a variety of ways. For example, local area imaging assembly 1201 may be utilized in a simultaneous localization and mapping (SLAM) tracking system to identify and/or map features of local area 1202 and/or to identify a location, orientation, and/or movement of HMD 1100 and/or other objects (e.g., hand-held controllers, users, etc.) in local area 1202. In some examples, illumination source 1104 may emit a structured light pattern (e.g., structured light 150, such as a symmetric and/or quasi-random dot pattern, a grid pattern, horizontal bars, etc.) into local area 1202. In these examples, local area imaging assembly 1201 may determine the depth and/or surface information based on triangulation or perceived deformation of the emitted pattern. More specifically, in at least some examples, the depth and/or surface information may be determined by capturing received light 1203 reflected from local area 1202 using imaging device 1102 and calculating the depth from local area imaging assembly 1201 to multiple points in local area 1202 (e.g., using trigonometry) based on the appearance of received light 1203 at imaging device 1102, the orientation of illumination source 1104 and imaging device 1102, and the distance between illumination source 1104 and imaging device 1102.
In some examples, information collected by local area imaging assembly 1201 may be used as part of an image and/or video (e.g., an artificial reality image and/or video) displayed to a user wearing HMD 1100. In one example, shown in
In at least one embodiment, a head-mounted display system including HMD 1100 may additionally or alternatively include controller tracking features (e.g., constellation tracking). For example, in addition to determining features of local area 1202, local area imaging assembly 1201 may track a position, orientation, and/or movement of one or more controller devices, such as hand-held controllers, that are utilized by a user for interacting with HMD 1100 and/or local area 1202.
Aside from the embodiments of
In some examples, the term “controller” generally refers to any type or form of hardware-implemented processing unit that may include hardware logic for performing various control functions, or that may be capable of interpreting and/or executing computer-readable instructions to perform such functions. Examples of controllers may include, without limitation, physical processors, such as microprocessors, microcontrollers, Central Processing Units (CPUs), Field-Programmable Gate Arrays (FPGAs) that implement softcore processors, Application-Specific Integrated Circuits (ASICs), portions of one or more of the same, variations or combinations of one or more of the same, or any other suitable physical processor.
Embodiments of the instant disclosure may include or be implemented in conjunction with an artificial reality system. Artificial reality is a form of reality that has been adjusted in some manner before presentation to a user, which may include, e.g., a virtual reality (VR), an augmented reality (AR), a mixed reality (MR), a hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include completely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, haptic feedback, or some combination thereof, any of which may be presented in a single channel or in multiple channels (such as stereo video that produces a three-dimensional effect to the viewer). Additionally, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, e.g., create content in an artificial reality and/or are otherwise used in (e.g., perform activities in) an artificial reality.
Artificial reality systems may be implemented in a variety of different form factors and configurations. Some artificial reality systems may be designed to work without near-eye displays (NEDs), an example of which is AR system 1300 in
Turning to
As shown, AR system 1300 may not necessarily include a NED positioned in front of a user's eyes. AR systems without NEDs may take a variety of forms, such as head bands, hats, hair bands, belts, watches, wrist bands, ankle bands, rings, neckbands, necklaces, chest bands, eyewear frames, and/or any other suitable type or form of apparatus. While AR system 1300 may not include a NED, AR system 1300 may include other types of screens or visual feedback devices (e.g., a display screen integrated into a side of frame 1302).
The embodiments discussed in this disclosure may also be implemented in AR systems that include one or more NEDs. For example, as shown in
In some embodiments, AR system 1400 may include one or more sensors, such as sensor 1440. Sensor 1440 may generate measurement signals in response to motion of AR system 1400 and may be located on substantially any portion of frame 1410. Sensor 1440 may include a position sensor, an inertial measurement unit (IMU), a depth camera assembly, or any combination thereof. In some embodiments, AR system 1400 may or may not include sensor 1440 or may include more than one sensor. In embodiments in which sensor 1440 includes an IMU, the IMU may generate calibration data based on measurement signals from sensor 1440. Examples of sensor 1440 may include, without limitation, accelerometers, gyroscopes, magnetometers, other suitable types of sensors that detect motion, sensors used for error correction of the IMU, or some combination thereof.
AR system 1400 may also include a microphone array with a plurality of acoustic sensors 1420(A)-1420(J), referred to collectively as acoustic sensors 1420. Acoustic sensors 1420 may be transducers that detect air pressure variations induced by sound waves. Each acoustic sensor 1420 may be configured to detect sound and convert the detected sound into an electronic format (e.g., an analog or digital format). The microphone array in
The configuration of acoustic sensors 1420 of the microphone array may vary. While AR system 1400 is shown in
Acoustic sensors 1420(A) and 1420(B) may be positioned on different parts of the user's ear, such as behind the pinna or within the auricle or fossa. Or, there may be additional acoustic sensors on or surrounding the ear in addition to acoustic sensors 1420 inside the ear canal. Having an acoustic sensor positioned next to an ear canal of a user may enable the microphone array to collect information on how sounds arrive at the ear canal. By positioning at least two of acoustic sensors 1420 on either side of a user's head (e.g., as binaural microphones), AR device 1400 may simulate binaural hearing and capture a 3D stereo sound field around about a user's head. In some embodiments, acoustic sensors 1420(A) and 1420(B) may be connected to AR system 1400 via a wired connection, and in other embodiments, the acoustic sensors 1420(A) and 1420(B) may be connected to AR system 1400 via a wireless connection (e.g., a Bluetooth connection). In still other embodiments, acoustic sensors 1420(A) and 1420(B) may not be used at all in conjunction with AR system 1400.
Acoustic sensors 1420 on frame 1410 may be positioned along the length of the temples, across the bridge, above or below display devices 1415(A) and 1415(B), or some combination thereof. Acoustic sensors 1420 may be oriented such that the microphone array is able to detect sounds in a wide range of directions surrounding the user wearing the AR system 1400. In some embodiments, an optimization process may be performed during manufacturing of AR system 1400 to determine relative positioning of each acoustic sensor 1420 in the microphone array.
AR system 1400 may further include or be connected to an external device (e.g., a paired device), such as neckband 1405. As shown, neckband 1405 may be coupled to eyewear device 1402 via one or more connectors 1430. Connectors 1430 may be wired or wireless connectors and may include electrical and/or non-electrical (e.g., structural) components. In some cases, eyewear device 1402 and neckband 1405 may operate independently without any wired or wireless connection between them. While
Pairing external devices, such as neckband 1405, with AR eyewear devices may enable the eyewear devices to achieve the form factor of a pair of glasses while still providing sufficient battery and computation power for expanded capabilities. Some or all of the battery power, computational resources, and/or additional features of AR system 1400 may be provided by a paired device or shared between a paired device and an eyewear device, thus reducing the weight, heat profile, and form factor of the eyewear device overall while still retaining desired functionality. For example, neckband 1405 may allow components that would otherwise be included on an eyewear device to be included in neckband 1405 since users may tolerate a heavier weight load on their shoulders than they would tolerate on their heads. Neckband 1405 may also have a larger surface area over which to diffuse and disperse heat to the ambient environment. Thus, neckband 1405 may allow for greater battery and computation capacity than might otherwise have been possible on a stand-alone eyewear device. Since weight carried in neckband 1405 may be less invasive to a user than weight carried in eyewear device 1402, a user may tolerate wearing a lighter eyewear device and carrying or wearing the paired device for greater lengths of time than a user would tolerate wearing a heavy standalone eyewear device, thereby enabling an artificial reality environment to be incorporated more fully into a user's day-to-day activities.
Neckband 1405 may be communicatively coupled with eyewear device 1402 and/or to other devices. The other devices may provide certain functions (e.g., tracking, localizing, depth mapping, processing, storage, etc.) to AR system 1400. In the embodiment of
Acoustic sensors 1420(I) and 1420(J) of neckband 1405 may be configured to detect sound and convert the detected sound into an electronic format (analog or digital). In the embodiment of
Controller 1425 of neckband 1405 may process information generated by the sensors on neckband 1405 and/or AR system 1400. For example, controller 1425 may process information from the microphone array that describes sounds detected by the microphone array. For each detected sound, controller 1425 may perform a DoA estimation to estimate a direction from which the detected sound arrived at the microphone array. As the microphone array detects sounds, controller 1425 may populate an audio data set with the information. In embodiments in which AR system 1400 includes an inertial measurement unit, controller 1425 may compute all inertial and spatial calculations from the IMU located on eyewear device 1402. Connector 1430 may convey information between AR system 1400 and neckband 1405 and between AR system 1400 and controller 1425. The information may be in the form of optical data, electrical data, wireless data, or any other transmittable data form. Moving the processing of information generated by AR system 1400 to neckband 1405 may reduce weight and heat in eyewear device 1402, making it more comfortable to the user.
Power source 1435 in neckband 1405 may provide power to eyewear device 1402 and/or to neckband 1405. Power source 1435 may include, without limitation, lithium ion batteries, lithium-polymer batteries, primary lithium batteries, alkaline batteries, or any other form of power storage. In some cases, power source 1435 may be a wired power source. Including power source 1435 on neckband 1405 instead of on eyewear device 1402 may help better distribute the weight and heat generated by power source 1435.
As noted, some artificial reality systems may, instead of blending an artificial reality with actual reality, substantially replace one or more of a user's sensory perceptions of the real world with a virtual experience. One example of this type of system is a head-worn display system, such as VR system 1500 in
Artificial reality systems may include a variety of types of visual feedback mechanisms. For example, display devices in AR system 1400 and/or VR system 1500 may include one or more liquid crystal displays (LCDs), light emitting diode (LED) displays, organic LED (OLED) displays, and/or any other suitable type of display screen. Artificial reality systems may include a single display screen for both eyes or may provide a display screen for each eye, which may allow for additional flexibility for varifocal adjustments or for correcting a user's refractive error. Some artificial reality systems may also include optical subsystems having one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, adjustable liquid lenses, etc.) through which a user may view a display screen.
In addition to or instead of using display screens, some artificial reality systems may include one or more projection systems. For example, display devices in AR system 1400 and/or VR system 1500 may include micro-LED projectors that project light (using, e.g., a waveguide) into display devices, such as clear combiner lenses that allow ambient light to pass through. The display devices may refract the projected light toward a user's pupil and may enable a user to simultaneously view both artificial reality content and the real world. Artificial reality systems may also be configured with any other suitable type or form of image projection system.
Artificial reality systems may also include various types of computer vision components and subsystems. For example, AR system 1300, AR system 1400, and/or VR system 1500 may include one or more optical sensors such as two-dimensional (2D) or three-dimensional (3D) cameras, time-of-flight depth sensors, single-beam or sweeping laser rangefinders, 3D LiDAR sensors, and/or any other suitable type or form of optical sensor. An artificial reality system may process data from one or more of these sensors to identify a location of a user, to map the real world, to provide a user with context about real-world surroundings, and/or to perform a variety of other functions.
Artificial reality systems may also include one or more input and/or output audio transducers. In the examples shown in
While not shown in
By providing haptic sensations, audible content, and/or visual content, artificial reality systems may create an entire virtual experience or enhance a user's real-world experience in a variety of contexts and environments. For instance, artificial reality systems may assist or extend a user's perception, memory, or cognition within a particular environment. Some systems may enhance a user's interactions with other people in the real world or may enable more immersive interactions with other people in a virtual world. Artificial reality systems may also be used for educational purposes (e.g., for teaching or training in schools, hospitals, government organizations, military organizations, business enterprises, etc.), entertainment purposes (e.g., for playing video games, listening to music, watching video content, etc.), and/or for accessibility purposes (e.g., as hearing aids, visuals aids, etc.). The embodiments disclosed herein may enable or enhance a user's artificial reality experience in one or more of these contexts and environments and/or in other contexts and environments.
The process parameters and sequence of the steps described and/or illustrated herein are given by way of example only and can be varied as desired. For example, while the steps illustrated and/or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the order illustrated or discussed. The various exemplary methods described and/or illustrated herein may also omit one or more of the steps described or illustrated herein or include additional steps in addition to those disclosed.
The preceding description has been provided to enable others skilled in the art to best utilize various aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or to be limited to any precise form disclosed. Many modifications and variations are possible without departing from the spirit and scope of the instant disclosure. The embodiments disclosed herein should be considered in all respects illustrative and not restrictive. Reference should be made to the appended claims and their equivalents in determining the scope of the instant disclosure.
Unless otherwise noted, the terms “connected to” and “coupled to” (and their derivatives), as used in the specification and claims, are to be construed as permitting both direct and indirect (i.e., via other elements or components) connection. In addition, the terms “a” or “an,” as used in the specification and claims, are to be construed as meaning “at least one of.” Finally, for ease of use, the terms “including” and “having” (and their derivatives), as used in the specification and claims, are interchangeable with and have the same meaning as the word “comprising.”
Claims
1. A structured light projector comprising:
- a light source having a light-emitting surface configured to emit light;
- a lens element coupled to and in contact with the light-emitting surface of the light source such that no gap is present between the light-emitting surface of the light source and the lens element;
- a unitary optical element coupled to and in contact with the lens element such that no gap is present between the lens element and the unitary optical element; and
- a diffractive optical element (DOE) stack comprising one or more DOEs, wherein the DOE stack is coupled to and in contact with the unitary optical element opposite the lens element and wherein the DOE stack is configured to emit structured light originating from the light source.
2. The structured light projector of claim 1, wherein the light source comprises:
- a light-emitting device; and
- a submount, wherein the light-emitting device is mounted to the submount.
3. The structured light projector of claim 2, wherein the light-emitting device comprises a vertical-cavity surface-emitting laser (VCSEL).
4. The structured light projector of claim 2, wherein:
- the submount comprises a recessed region in which the light-emitting device is mounted; and
- the unitary optical element contacts the submount at a surface external to the recessed region.
5. The structured light projector of claim 1, wherein the DOE stack comprises a collimating optical element that defines a light-receiving side of the DOE stack.
6. The structured light projector of claim 1, further comprising:
- at least one mechanical fastener that securely couples the light source, the unitary optical element, and the DOE stack together.
7. The structured light projector of claim 1, wherein the light source, the unitary optical element, and the DOE stack are secured together using an adhesive.
8. The structured light projector of claim 1, wherein the unitary optical element comprises a single continuous block of optical material.
9. The structured light projector of claim 8, wherein the optical material comprises glass.
10. The structured light projector of claim 8, wherein the optical material comprises a polymer.
11. The structured light projector of claim 10, wherein the polymer comprises an injected optical polymer.
12. The structured light projector of claim 11, wherein the injected optical polymer comprises a dielectric material.
13. A method of fabricating a structured light projector, the method comprising:
- coupling a lens element to and in contact with a light-emitting surface of a light source such that no gap is present between the light-emitting surface of the light source and the lens element;
- coupling a unitary optical element to and in contact with the lens element such that no gap is present between the lens element and the unitary optical element; and
- coupling a diffractive optical element (DOE) stack including one or more DOEs to and in contact with the unitary optical element, wherein the DOE stack is configured to emit structured light originating from the light source.
14. An artificial reality system comprising:
- a structured light projector comprising:
- a light source having a light-emitting surface that is configured to emit light;
- a lens element coupled to, and in contact with, the light-emitting surface of the light source such that no gap is present between the light-emitting surface of the light source and the lens element;
- a unitary optical element coupled to and in contact with the lens element such that no gap is present between the lens element and the unitary optical element; a diffractive optical element (DOE) stack comprising one or more DOEs, wherein the DOE stack is coupled to and in contact with the unitary optical element opposite the lens element and wherein the DOE stack is configured to emit structured light originating from the light source;
- an optical sensor that receives at least a portion of the structured light that is reflected by a local area;
- a processor that determines depth information of the local area based on the portion of the structured light received by the optical sensor; and
- a display that displays information based on the depth information.
15. The artificial reality system of claim 14, wherein the display comprises a near-eye display.
16. The artificial reality system of claim 14, wherein the light source, the unitary optical element, and the DOE stack are secured together using an adhesive.
17. The artificial reality system of claim 14, further comprising a mechanical fastener that securely couples the light source, the unitary optical element, and the DOE stack together.
18. The artificial reality system of claim 14, wherein the unitary optical element comprises a single continuous block of optical material.
19. The artificial reality system of claim 18, wherein the optical material comprises glass.
20. The artificial reality system of claim 18, wherein the optical material comprises a polymer.
7519287 | April 14, 2009 | Mok |
11262644 | March 1, 2022 | Sullivan |
11333895 | May 17, 2022 | Ginzburg |
20020054558 | May 9, 2002 | Freeman |
20050013562 | January 20, 2005 | Tatehata et al. |
20050063071 | March 24, 2005 | Wang et al. |
20090160965 | June 25, 2009 | Sorek et al. |
20100202725 | August 12, 2010 | Popovich et al. |
20110188054 | August 4, 2011 | Petronius et al. |
20160178915 | June 23, 2016 | Mor et al. |
20160197452 | July 7, 2016 | Mor |
20160238855 | August 18, 2016 | Kriman |
20170075205 | March 16, 2017 | Kriman et al. |
20170309685 | October 26, 2017 | Heimgartner et al. |
20180063390 | March 1, 2018 | Trail |
20190041656 | February 7, 2019 | Ahmed et al. |
20190086776 | March 21, 2019 | Hsiao et al. |
20190302596 | October 3, 2019 | Shulepova |
20190310541 | October 10, 2019 | Zhang |
20190317390 | October 17, 2019 | Lee et al. |
20200025985 | January 23, 2020 | Teissier |
20200026165 | January 23, 2020 | Fu |
20200033710 | January 30, 2020 | Ma et al. |
20200319474 | October 8, 2020 | Ma |
20200355929 | November 12, 2020 | Zhang |
20210286189 | September 16, 2021 | Ghosh |
Type: Grant
Filed: Feb 25, 2022
Date of Patent: Jun 20, 2023
Assignee: Meta Platforms Technologies, LLC (Menlo Park, CA)
Inventors: Mark Timothy Sullivan (Mountain View, CA), Jonatan Ginzburg (San Jose, CA)
Primary Examiner: Magda Cruz
Application Number: 17/680,432
International Classification: G03B 21/14 (20060101); G02B 27/42 (20060101); G02B 27/09 (20060101);