Abstract: Methods and systems for remote rendering of extended reality (XR) objects are described herein. A server may receive an image of a physical environment. The image may include different views of the physical environment around a client device. The server may render at least one surface of a virtual object based on the different views of the physical environment. The at least one surface may include a reflection of another object of the physical environment from a view point of the client device at the time the image was taken. The server may generate graphics including the rendered at least one surface. The server may send the generated graphics to the client device to enable display of a computer generated environment on the client device. The computer generated environment may include the at least one virtual object with an appearance of a reflective surface.

Abstract: Aspects of the disclosure relate to various systems and techniques that provide for a method and apparatus for transmitting speech as text to a remote server and converting the text stream back to speech for delivery to a remote application. For example, a person, through workspace virtualization, is accessing a remote application that accepts speech as its input. The user, using a microphone, would speak into the microphone where the speech would be converted into text with a local speech-to-text converter. The text version of speech is sent to a remote server, which converts the text back to speech using a remote server based text-to-speech converter where the reconstructed speech is usable as input to a remote application or device.

Abstract: Methods and systems for remote rendering of extended reality (XR) objects are described herein. A server may receive an image of a physical environment. The image may include different views of the physical environment around a client device. The server may render at least one surface of a virtual object based on the different views of the physical environment. The at least one surface may include a reflection of another object of the physical environment from a view point of the client device at the time the image was taken. The server may generate graphics including the rendered at least one surface. The server may send the generated graphics to the client device to enable display of a computer generated environment on the client device. The computer generated environment may include the at least one virtual object with an appearance of a reflective surface.

Abstract: Aspects of the disclosure relate to various systems and techniques that provide for a method and apparatus for transmitting speech as text to a remote server and converting the text stream back to speech for delivery to a remote application. For example, a person, through workspace virtualization, is accessing a remote application that accepts speech as its input. The user, using a microphone, would speak into the microphone where the speech would be converted into text with a local speech-to-text converter. The text version of speech is sent to a remote server, which converts the text back to speech using a remote server based text-to-speech converter where the reconstructed speech is usable as input to a remote application or device.

Abstract: An important aspect of augmented reality (AR) is that digital information, such as rendered images of AR scenes and objects, are integrated with the user's view of the real world in real time. However, transmitting large images over the network may negatively impact the real time aspect of the AR experience. Methods and systems for dynamic image compression based on perceived viewing distance are described herein. In some implementations, image compression of streaming AR content is based on real world distances of AR objects relative to a user or client device. In some implementations, image compression of streaming AR content is based on relative depth information. In some implementations, image compression of streaming AR content is based on a type of information or content associated with an AR object. The dynamic image compression based on perceived viewing distance provided by the systems and methods disclosed herein may also be applied to video codecs.

Abstract: A computer system is provided. The computer system includes a memory, a network interface, a user interface, and at least one processor. The at least one processor is configured to detect a location identifier via the network interface; identify map data associated with the location identifier, the map data being descriptive of a physical environment; identify at least one target location in the map data, the at least one target location being associated with an augmented reality (AR) console including one or more user interface controls, the at least one target location identifying at least one target position within the physical environment; and overlay the at least one target position, as presented via the user interface, with the AR console.

Abstract: Systems and methods for rendering an Augmented Reality (“AR”) object. The methods comprise: drawing a first bitmap of a first AR object rendered by a server on a display of a client device; selecting/focusing on a second AR object or a part of the first AR object shown on the display; communicating a request for the second AR object or the part of the first AR object from the client device to the server; obtaining, by the server, an object file for the second AR object or part of the first AR object; providing the object file to the client device; locally rendering, by the client device, the second AR object or part of the first AR object as a second bitmap; superimposing the second bitmap on the first bitmap to generate a third bitmap; and drawing the third bitmap on the display of the client device.

Abstract: Systems and methods for rendering an Augmented Reality (“AR”) object. The methods comprise: drawing a first bitmap of a first AR object rendered by a server on a display of a client device; selecting/focusing on a second AR object or a part of the first AR object shown on the display; communicating a request for the second AR object or the part of the first AR object from the client device to the server; obtaining, by the server, an object file for the second AR object or part of the first AR object; providing the object file to the client device; locally rendering, by the client device, the second AR object or part of the first AR object as a second bitmap; superimposing the second bitmap on the first bitmap to generate a third bitmap; and drawing the third bitmap on the display of the client device.

Abstract: Systems and methods for rendering an Augmented Reality (“AR”) object. The methods comprise: drawing a first bitmap of a first AR object rendered by a server on a display of a client device; selecting/focusing on a second AR object or a part of the first AR object shown on the display; communicating a request for the second AR object or the part of the first AR object from the client device to the server; obtaining, by the server, an object file for the second AR object or part of the first AR object; providing the object file to the client device; locally rendering, by the client device, the second AR object or part of the first AR object as a second bitmap; superimposing the second bitmap on the first bitmap to generate a third bitmap; and drawing the third bitmap on the display of the client device.