Abstract: A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.

Abstract: A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.

Abstract: A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.

Abstract: Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Abstract: A nightvision system includes an underlying device that provides output light in a first spectrum. A transparent optical device transmits light in the first spectrum from the underlying device through the transparent optical device. The transparent optical device includes an active area of a semiconductor chip. The active area includes active elements that cause the underlying device to detect light from the underlying device and transparent regions formed in the active area which are transparent to the light in the first spectrum to allow light in the first spectrum to pass through from the underlying device to a user. An image processor processes feature maps produced using light detected by the first plurality of active elements. The image processor determines at least one of location, heading, elevation, or speed of the nightvision system or location of objects detected by the first plurality of active elements.

Abstract: Technology described herein is directed to mitigating avatar display disruption, in an artificial reality environment, resulting from losses in user tracking. The technology can use an artificial reality device to continually determine contextual characteristics of the user that can correspond to placements of one or more portions of the user's body with respect to another portion thereof and/or one or more real-world objects. A user state, corresponding to a contextual characteristic occurring at a time of an interruption in the tracking, can define a bodily configuration of the user that can be with respect to the one or more real-world objects when the interruption occurs. The technology can, according to an avatar pose assigned to the user state, animate the avatar to the assigned pose when the interruption occurs and immediately reinitiate animation from that pose upon regaining tracking of the user's pose.

Abstract: Aspects of the present disclosure are directed to a VC/XR connection system that can establish and administer an XR space for a video call. The VC/XR connection system allows users to easily transition from a typical video call experience to the XR space, simply by putting on her artificial reality device. The VC/XR connection system can identify calendared video call events, establish corresponding XR spaces, and create a link between the video call and the XR space. Invitees to the video call that don an artificial reality device can be automatically taken into the XR space. The XR space can A) connect to the video call as a call participant, allowing the video call participants to see into the XR space and B) show a feed of the video call in the XR space, allowing users in the XR space to see the video call participants.

Abstract: A nightvision system includes an underlying device that provides output light in a first spectrum. A transparent optical device transmits light in the first spectrum from the underlying device through the transparent optical device. The transparent optical device includes an active area of a semiconductor chip. The active area includes active elements that cause the underlying device to detect light from the underlying device and transparent regions formed in the active area which are transparent to the light in the first spectrum to allow light in the first spectrum to pass through from the underlying device to a user. An image processor processes images produced using light detected by the first plurality of active elements. An autofocus mechanism coupled to the image processor focuses the input light into the underlying device based on image processing performed by the image processor.

Abstract: In some implementations, the disclosed systems and methods can capture visual frames and an object manager can recognize a visual signal within the captured visual frames, such as a QR code. In some implementations, the disclosed systems and methods can participate in a private conference within a session.

Abstract: A nightvision system includes an underlying device that provides output light in a first spectrum. A transparent optical device transmits light in the first spectrum from the underlying device through the transparent optical device. The transparent optical device includes an active area of a semiconductor chip. The active area includes active elements that cause the underlying device to detect light from the underlying device and transparent regions formed in the active area which are transparent to the light in the first spectrum to allow light in the first spectrum to pass through from the underlying device to a user. An image processor processes brightness maps produced using light detected by the first plurality of active elements. An illuminator coupled to the image processor inputs light into the underlying device based on image processing performed by the image processor.

Abstract: A nightvision system includes an underlying device that provides output light in a first spectrum. A transparent optical device transmits light in the first spectrum from the underlying device through the transparent optical device. The transparent optical device includes an active area of a semiconductor chip. The active area includes active elements that cause the underlying device to detect light from the underlying device and transparent regions formed in the active area which are transparent to the light in the first spectrum to allow light in the first spectrum to pass through from the underlying device to a user. An image processor processes brightness maps produced using light detected by the first plurality of active elements. A tunable filter array coupled to the image processor filters at least a portion of the input light into the underlying device the underlying device based on brightness map processing.

Abstract: Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Abstract: Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Abstract: A nightvision system includes an underlying device that provides output light in a first spectrum. A transparent optical device transmits light in the first spectrum from the underlying device through the transparent optical device. The transparent optical device includes an active area of a semiconductor chip. The active area includes active elements that cause the underlying device to detect light from the underlying device and transparent regions formed in the active area which are transparent to the light in the first spectrum to allow light in the first spectrum to pass through from the underlying device to a user. An image processor processes images produced using light detected by the first plurality of active elements. An autofocus mechanism coupled to the image processor focuses the input light into the underlying device based on image processing performed by the image processor.

Abstract: Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Abstract: Aspects of the present disclosure are directed to a VC/XR connection system that can establish and administer an XR space for a video call. The VC/XR connection system allows users to easily transition from a typical video call experience to the XR space, simply by putting on her artificial reality device. The VC/XR connection system can identify calendared video call events, establish corresponding XR spaces, and create a link between the video call and the XR space. Invitees to the video call that don an artificial reality device can be automatically taken into the XR space. The XR space can A) connect to the video call as a call participant, allowing the video call participants to see into the XR space and B) show a feed of the video call in the XR space, allowing users in the XR space to see the video call participants.

Abstract: Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Abstract: Aspects of the present disclosure are directed to a mapping communication system that creates a 3D model of a real-world space and places a virtual camera in the 3D model. As the mapping communication system detects changes in the space, it can provide scan updates to keep the 3D model close to a live representation of the space. Further aspects of the present disclosure are directed to traveling a user to an artificial reality (XR) environment using an intent configured XR link. Yet further aspects of the present disclosure are directed to improving audio latency by performing audio processing off-headset for artificial reality (XR) experiences.

Abstract: A night vision optical device includes an underlying device configured to be sensitive to light in a first spectrum, and to provide output light based on absorbing light in the first spectrum. The night vision optical device further includes a stacked device overlapping the underlying device. The stacked device includes one or more openings formed in the underlying device to form one or more transparent regions which are transparent to the light in the first spectrum to allow light in the first spectrum to pass through to the underlying device. The stacked device is sensitive to light in a second spectrum. The stacked device outputs light in the first spectrum to the underlying device as a result of absorbing light in the second spectrum. Thus, the underlying device outputs light based both on light passing through the transparent regions and on light output by the stacked device.

Abstract: Aspects of the present disclosure are directed to virtual interaction modes for social and group communication. Additional aspects of the present disclosure are directed to automated controls for connecting a trigger performed in an artificial reality environment to an action on a personal computing device. Further aspects of the present disclosure are directed to providing versions of person virtual objects in an artificial reality environment and contextual breakpoints to switch between them. Yet further aspects of the present disclosure are directed to extending a mouse for artificial reality environment input.