Abstract: Methods and systems described herein facilitate virtual interactions between users that more closely resemble their in-person counterparts. In particular, the methods and systems simulate in-person interactions in virtual environments through the use of complex spatial algorithms. For example, in some embodiments, the methods and systems provide avatar-based video conferencing systems in which avatars are connected by video/voice chat to any avatar based on one or more criteria.

Abstract: Described herein is a computer implemented method including: displaying a design including a first design element; detecting an initiate record animation event; receiving animation definition input creating an original path between an initial position and a final position, the animation definition input drawing the original path at original traversal speeds; generating animation data based on the animation definition input, the animation data including data that allows both the original path and the original traversal speeds to be reproduced; and associating the animation data with the first design element.

Abstract: The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor.

Abstract: In an approach to improve virtual Reality (VR) integrated development environment (IDE) embodiments create an integrated view of a developed code during integration testing based on received artificial intelligent enabled IDE, and execute a test case simulation during the integrated visualization of the developed code in a virtual reality environment. Further, embodiments create a visualization of the developed code based on one or more test results from the test case simulation in the VR environment and a selected code from the developed code with respect to an entire application landscape, and identify one or more problematic areas based on one or more types of defect and criticality of the defect in the developed code. Additionally, embodiments, display the visualization of the selected code, and apply one or more identified solutions to the one or more identified problematic areas in the developed code.

Abstract: A spatial indexing system receives a sequence of images depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Abstract: According to one embodiment, a plurality of spatial publishing objects (SPOs) is provided in a multidimensional space in a user interface. Each of the plurality of spatial publishing objects is associated with digital media data from at least one digital media source. The user interface has a field for the digital media data. A user is provided via the user interface with a user presence that is optionally capable of being represented in the user interface relative to the plurality of spatial publishing objects. The digital media data associated with the at least one spatial publishing object are combined to generate a media output corresponding to the combined digital media data.

Abstract: A method of dynamically displaying a three-dimensional image object in a volumetric display apparatus is provided. The method includes rotating a display plate about an axis to display a volumetric three-dimensional image; displaying a first three-dimensional image of a first three-dimensional image object according to first coordinates in a first image coordinate system in the volumetric display region; sensing a position or a movement of an external real-world object within a sensing zone; and displaying a second three-dimensional image of a second three-dimensional image object according to second coordinates in a second image coordinate system in the volumetric display region. The second three-dimensional image object is obtained by reorienting the first three-dimensional image object from an initial orientation to a target orientation; and the reorientation is correlated with a position or the movement of the external real-world object.

Abstract: Disclosed are a method and system for providing privacy in a virtual space. The method of providing privacy in a virtual space includes setting a privacy distance for guaranteeing a personal space of a user agent in a virtual space, and filtering information exposable to the user agent in the virtual space based on the privacy distance.

Abstract: A method for updating a gaze direction for a transmitter avatar in a receiver headset is provided. The method includes verifying, in a receiver device, that a visual tracking of a transmitter avatar is active in a transmitter device, and adjusting, in the receiver device, a gaze direction of the transmitter avatar to a fixation point. Adjusting the gaze direction of the transmitter avatar comprises estimating a coordinate of the fixation point in a receiver frame at a later time, and rotating, in the receiver device, two eyeballs of the transmitter avatar to a point in a direction of the fixation point. A headset, a memory in the headset storing instructions, and a processor configured to execute the instructions to perform the above method, are also provided.

Abstract: A method for generating a three-dimensional model of a head including at least a portion of a face, comprising: obtaining a distance image of the head using a distance-measuring device having an imaging position, the distance image comprising for each of a two-dimensional array of distance pixels, a respective distance value indicating a distance from the measuring position to a corresponding point in a field of view of the distance-measuring device, the distance image including a face portion corresponding to the at least a portion of a face; estimating the position, relative to the imaging position, of a longitudinal axis of the model of the head based on the at least one dimension; based on the longitudinal axis, generating the three dimensional model of the head based on the position of the longitudinal axis.

Abstract: Methods and apparatus for alternating computing environments for viewing graphical displays is provided. The computing environments may include a 3D environment and a 2D environment. Methods may include monitoring a user interaction with an extended reality (“XR”) headset. In parallel with the monitoring of the user interaction, methods may include running a machine learning (“ML”) prediction algorithm to predict an opportunity to generate a graphical display, the graphical display may be a selectable icon. In response to a selection of the selectable icon, information may be displayed relating to the graphical display. In response to the ML prediction algorithm predicting the opportunity, methods and apparatus may include displaying the graphical display in the 3D environment.

Abstract: Projection methods and systems are disclosed in this disclosure. In an implementation, a method includes: A first device that displays first content, detects a first gesture operation, and recognizes the detected first gesture operation, where the first gesture operation is a continuous and moving gesture operation; a second device detects the first gesture operation, and recognizes the detected first gesture operation, where the second device establishes a communication connection to the first device; if recognizing that the first gesture operation is a projecting gesture, the first device projects, to the second device, the first content displayed by the first device; and if recognizing that the first gesture operation is a projected gesture, the second device receives the first content projected by the first device, and displays the first content on the second device.

Abstract: Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within the three-dimensional virtual environment. The system and methods provided include those for: (1) using zones in a three-dimensional virtual environment for limiting audio and video, (2) access control using zones, (3) access control of the three-dimensional virtual environment itself, and (4) controlling user connections in a three dimensional virtual environment.

Abstract: A switchable autostereoscopic display comprises: an array of pixels lined with a view altering lens stack; a switchable liquid crystal layer arranged between the array of pixels and the view altering lens stack; a main linear grid of elongate electrodes; a first sub-grid of electrodes arranged parallel to and between the array of pixels and the main linear grid of elongate electrodes, wherein the first sub-grid is spaced apart from the main linear grid; a second sub-grid of electrodes arranged parallel to and spaced apart from the first sub-grid and parallel to the main linear grid to provide a capacitive touch location sensor and wherein the elongate electrodes, each having a width g, of the main linear grid are arranged at a pitch p and wherein the ratio g/p is at least 0.75.

Abstract: A user device for rendering images of a virtual environment includes display. A browser application to establish a connection to a server for receiving streaming image data to render views of a virtual environment as a first layer of a display. Control commands initiated by a user on the user device are transmitted to the server. In response, the user device receives updated streaming image data for updating the displayed first layer. Upon detecting an occurrence of a predetermined event related to the virtual world/control commands, the user device transmits a request with a corresponding event identifier to a content management system (CMS), wherein the browser application and CMS maintain corresponding lists of event identifiers. The CMS then transmits to the user device additional display information external to the virtual environment, which the user device renders as a second partially-transparent layer overlaying the first layer.

Abstract: A system and a method of creating, hosting, and accessing a VR project is described. Media files are imported into a software application running on a system and details of interaction between the media files are provided. The media files are processed based on the details of interaction for creation of the VR project. The VR project may include multiple versions of media files prepared based on configurations of user devices requiring access to the VR project. A user device may place a request to a server hosting the VR project. The server may identify an optimal version of media files for the user device, based on configurations of the user device. The optimal version of the media files along with a corresponding VRXF file including details of interactions between the media files is transmitted to the user device, for delivering a best VR experience of the VR project.

Abstract: Aspects of the present disclosure relate to virtual reality (VR) based commerce experience enhancement. A set of user data associated with a user can be received. A session of a VR commerce environment can be initiated with the user. A set of products to include in the VR commerce environment can be selected based on the set of user data. A position and orientation of each of the products of the set of products within the VR commerce environment can be determined based on the set of user data. The set of products can be displayed within the VR commerce environment according to the determined position and orientation of each product of the set of products.

Abstract: A system displays summaries of relationships of a selected data asset with other data assets at a limited number of levels upstream and downstream from the selected data asset in rows above and below the selected data asset. In each row, data assets are arranged in order of usage, with most used data asset displayed directly above or below the selected data asset. The user views grandparent-level data assets of a parent-level data asset that is directly above the selected data asset. The system includes a carousal feature to further navigate the lineage data upstream or downstream. By selecting a new data asset in the parent row, the user can view grandparent-level data assets of the newly selected data asset. The user can view multiple upstream or downstream levels arranged in respective rows displayed above or below the selected data asset. The system can analyze data from any application.

Abstract: Method of creating shared AR session based on a gesture starts with server receiving observed motion data from first device associated with first user. First device generating observed motion data based on an analysis of data stream comprising images of second user performing a gesture. Second user being associated with second device. Server receiving from second device captured motion data that corresponds to the gesture. Captured motion data being recorded by a sensor included in second device. Server determines whether there is a match between observed motion data from first device and captured motion data from second device. In response to determining that there is the match, server generates shared AR session between first device and second device and causes shared AR session to be displayed by first device and second device. Other embodiments are described herein.

Abstract: The present disclosure generally relates to account recovery. An example method includes, at a computer system in communication with a display generation component and one or more input devices: performing a recovery contact set up process including providing a notification to a contact; after performing the recovery contact set up process, receiving, via the one or more input devices, a request to initiate an account recovery process; in response to the request to initiate the account recovery process and without providing a request to the contact, displaying, via the display generation component, a recovery code interface for receiving a set of recovery credentials; while displaying of the recovery code interface, receiving the set of recovery credentials; in accordance with a determination that the recovery credentials are valid, performing a recovery function; and in accordance with a determination that the recovery credentials are not valid, forgoing performing the recovery function.

Abstract: Disclosed is a system and associated methods for improving interactions with three-dimensional (“3D”) objects in a 3D space by dynamically defining the positioning of the handles used to control the interactions with the camera and/or the 3D objects. The system analyzes the positioning of different constructs that form the 3D objects. From the analysis, the system defines handles at different dynamically determined positions about the 3D objects. The system applies an edit from a first dynamically determined position about a particular 3D object in response to a user interaction with a first handle defined at the first dynamically determined position, and applies the edit from a second dynamically determined position about the particular 3D object in response to a user interaction with a second handle defined at the second dynamically determined position.

Abstract: Virtual environment arrangement and configuration techniques are described. In one example, virtualization techniques are employed to generate a virtual environment as implemented via a virtual reality platform by one or more computing devices. The virtual environment includes virtual stores arranged along virtual streets. Virtual digital content is included in the stores, such as to initiate conversion of a good or service represented by the content. Configuration of the virtual environment is based on user, provider, and/or machine learning inputs.

Abstract: A host device having a first processor executes an application via the first processor. The host device determines a state of the application. A scenegraph is generated corresponding to the state of the application, and the scenegraph is presented to a remote device having a display and a second processor. The remote device is configured to, in response to receiving the scenegraph, render to the display a view corresponding to the scenegraph, without executing the application via the second processor.

Abstract: A surgical hub for use with a surgical system in a surgical procedure performed in an operating room is disclosed. The surgical hub comprises a control circuit configured to generate a first image of a surgical site from a real-time imaging source, receive a second image of the surgical site from a non-real-time image source, align the first image and the second image, generate a representation of the surgical site based on the first image and the second image as aligned, display the representation on a display screen, receive a first user selection to overlay hidden structures on the representation, receive a second user selection to manipulate the representation, and adjust the representation based on the second user selection.

Abstract: A computer implemented networking system and method for content-creating, sharing, and archiving, includes maintaining profiles for a plurality of users each having an account that stores and displays user-authored content posts, and generating, for each user profile, a virtual space (e.g. building or house) displayed via a UI, and including a main area and a plurality of sub-areas each being associated with a respective category, and wherein the main area provides navigation to the sub-areas. The approach includes generating the user-authored content posts for each of the users via posting templates that prompt a user to input and organize various content based upon the template guidance for the respective category. A prompting tool operates within the virtual space for each profile by displaying prompts within each of the sub-areas and related to the respective category and includes a prioritized list of user tasks.

Abstract: In accordance with some embodiments, an exemplary process for initializing members of a shared enhanced reality setting is described. In accordance with some embodiments, an exemplary process for forming a private sub-space and example features of the private sub-space is described.

Abstract: An electronic device includes a memory; and a processor configured to: store metadata received from a plurality of data sources, respectively, in the memory; obtain first information corresponding to a preset attribute from among attribute information comprised in first metadata received from a first data source from among the plurality of data sources; obtain second information corresponding to the preset attribute from among attribute information comprised in second metadata received from a second data source; and map, based on the first metadata and the second metadata being identified as metadata on a content based on a similarity between the first information and the second information, an integrated metadata generated based on the first metadata and the second metadata to the content and store the integrated metadata generated based on the first metadata and the second metadata in the memory.

Abstract: Provided is a technique in which, in arranging a virtual object with respect to a real space, a user has less trouble, usability is good, and the object is suitably placeable. A head mounted display apparatus (HMD apparatus) according to one embodiment has a function of arranging and displaying the virtual object in a space based on an operation by a user. The HMD apparatus displays, on a display surface, a grid including a plurality of points for supporting an operation of the virtual object, and disposes and displays, according to an operation includes designation of a target virtual object and designation of a first point at an arrangement destination, the target virtual object at the position of the first point.

Abstract: A design analysis engine analyzes a CAD assembly to generate a topological model. The topological model is a graph of nodes coupled together via a set of edges. Each node represents a different CAD model in the CAD assembly and each edge represents a different connection between two such CAD models. The design analysis engine also analyzes the CAD assembly to generate a data model corresponding to the topological model. The data model is a structured dataset that includes component entries and connection entries. A component entry includes design data associated with a CAD model in the CAD assembly and a connection entry includes design data associated with a physical or logical connection between two or more such CAD models. A user interacts with the topological model to navigate the CAD assembly, obtain CAD model data, and initiate automatically-performed design tasks.

Abstract: An exemplary method includes a proximity detection system that accesses information associated with a virtual location marker positioned in relation to a geographic area. The information defines a location-based field of view (“LFOV”) that extends directionally from the virtual location marker. The proximity detection system further tracks a location of a mobile computing device at the geographic area and determines, based on the information associated with the virtual location marker and the location of the mobile computing device, that the mobile computing device has entered the LFOV that extends directionally from the virtual location marker.

Abstract: A surgical visualization system is disclosed that comprises a control circuit configured to receive pre-operative imaging data associated with an organ, receive first intraoperative imaging data indicative of a structured light pattern on a surface of the organ, generate a three-dimensional digital representation of the organ based on the pre-operative imaging data and the first intraoperative imaging data, display the three-dimensional digital representation of the organ on a display screen, receive second intraoperative imaging data indicative of a plurality of spectral light waves penetrating the organ, intraoperatively identify a structure below the surface of the organ based on the second intraoperative imaging data, generate a three-dimensional digital representation of the structure below the surface of the organ, and overlay the three-dimensional digital representation of the structure with the three-dimensional digital representation of the organ on the display screen.

Abstract: A virtual fabrication environment for semiconductor device fabrication that includes an analytics module for performing key parameter identification, process model calibration and variability analysis is discussed.

Abstract: The present application provides a comparison method and a modeling method for a chip product, a device and a storage medium. According to the method, the chip product is modeled by using a neural network based on a slice sequence of the chip product in advance to obtain a three-dimensional stereoscopic model. When the chip products are compared, a comparison feature is acquired responsive to an operation of a user. For each chip product, a comparison result corresponding to the comparison feature is acquired from the three-dimensional stereoscopic model corresponding to each chip product. Then, the comparison result corresponding to each chip product is displayed.

Abstract: A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.

Abstract: An image display method includes: displaying a first image having a first image surface on a display surface in a three-dimensional fashion; in response to a reception of an instruction of rotating the first image around an axis different from any axis in the display surface, rotating the first image around a first imaginary axis, the first imaginary axis being vertical to the first image surface and different from an axis vertical to the display surface; and displaying the rotated first image.

Abstract: Networking is one of the key aspects of events, but virtual events pose a huge limitation, as attendees don't really get an opportunity to have one on one discussions with each another. The users of current video calling solutions unsuccessfully trying to extend the use of these products to casual social get together and the current video calling solutions that have no dimension of space and are not tailored to emulate the dynamics of real-life social settings. The current invention belongs broadly to natural communication flow in video call solutions, highly interactive, aiming to create as similar an experience as possible to their physical counterparts.

Abstract: A 3D display system and a 3D display method are provided. The 3D display system includes a 3D display, a memory and one or more processors. The memory records a plurality of modules, and the processor accesses and executes the modules recorded by the memory. The modules include a bridge interface module and a 3D display service module. When an application is executed by the processor, the bridge interface module creates a virtual extend screen, and moves the application to the virtual extend screen. The bridge interface module obtains a 2D content frame of the application from the virtual extend screen by a screenshot function. The 3D display service module converts the 2D content frame into a 3D format frame by communicating with a third-party software development kit, and provides the 3D format frame to the 3D display for displaying.

Abstract: A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a plan view map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a plan view map, or by using a joystick or other peripheral device.

Abstract: There is provided an image display apparatus that enables an intuitive operation even when a detection target is not able to be inserted into a first space in which a three-dimensional object is visually recognized. A position of a detection target is detected, and a display position of a pointer displayed by a display unit is moved on a basis of a position of the detection target that exists within a second space not overlapping the first space which is a space in which the three-dimensional object is displayed among the position of the detected detection target.

Abstract: Methods and systems for improved integration of an overhead representation (e.g., a map) with a street view representation. A user interface with at least two regions is output for display to a user. One region includes an overhead representation of an area and an interactive control overlaid onto the overhead representation. Another region includes a street view perspective that has a point of view corresponding to a position and directional orientation of the interactive control. Information about a user input that adjusts the interactive control is received and the street view perspective is updated to track the control as it is adjusted. The field of view of the street view perspective may be reflected in the appearance of the interactive control. Additionally, the street view perspective may follow the location of a marker as it is moved around the overhead representation.

Abstract: An orthogonal or multi-dimensional fabric user interface is described herein. A remote server executes an operating system that stores content in a multi-dimensional fabric. Multiple users can access a common virtual space to view content that is stored in the multi-dimensional fabric at a specific location and time. The users request the specific location and time. The remote server accesses the multi-dimensional fabric to anchor content within the common virtual space based on the specific location and time. In this way, multiple users experience location and time driven content together.

Abstract: A method for analyzing and displaying surveillance video including: capturing, using a first video camera, a first plurality of video frames of a first area at a first time; analyzing the first plurality of video frames or linking to one or more alarms received; determining a first activity of interest within one or more first video frames of the first plurality of video frames; generating a first activity of interest video clip from the one or more first video frames; and displaying the first activity of interest video clip within a first carousel on a display device, wherein the first activity of interest video clip is configured to rotate around a first axis within the first carousel on the display device.

Abstract: Various implementations disclosed herein include devices, systems, and methods for indicating a distance to a selectable portion of a virtual surface. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes displaying a graphical environment that includes a virtual surface, wherein at least a portion of the virtual surface is selectable. In some implementations, the method includes determining a distance between a collider object and the selectable portion of the virtual surface. In some implementations, the method includes displaying a depth indicator in association with the collider object. In some implementations, a visual property of the depth indicator is selected based on the distance between the collider object and the selectable portion of the virtual surface.

Abstract: A method is provided for displaying an application icon. A terminal displays a first screen, where the first screen includes an icon of a first application, and an icon of the cloned application of the first application is hidden. The terminal receives a first operation performed by a user on the icon of the first application, and displays the hidden icon of the cloned application of the first application in response to the first operation, where the icon of the cloned application of the first application and the icon of the first application are simultaneously displayed on the first screen, and the first screen is included on a home screen of the terminal.

Abstract: Examples of wearable devices that can present to a user of the display device an audible or visual representation of an audio file comprising a plurality of stem tracks that represent different audio content of the audio file are described. Systems and methods are described that determine the pose of the user; generate, based on the pose of the user, an audio mix of at least one of the plurality of stem tracks of the audio file; generate, based on the pose of the user and the audio mix, a visualization of the audio mix; communicate an audio signal representative of the audio mix to the speaker; and communicate a visual signal representative of the visualization of the audio mix to the display.

Abstract: Disclosed are a method, a system and a device for displaying a geometry in an editor, and a medium, which are applied to the technical field of two-dimensional/three-dimensional modeling. The method for displaying a geometry in an editor comprises: determining a Boolean operation and a plurality of geometries in a space window (102); calculating the plurality of geometries in the space window according to the Boolean operation, so as to obtain a composite geometry in the space window (104); creating a plurality of objects in the resource list, wherein the plurality of objects respectively correspond to the composite geometry and the plurality of geometries that are calculated to obtain the composite geometry, and setting objects corresponding to the plurality of geometries as sub-nodes of an object corresponding to the composite geometry; and returning to the step of determining a Boolean operation and a plurality of geometries in the space window.

Abstract: Computer-implemented method of positioning a set of objects on a user interface on a surface of a three-dimensional structure, each member of the set of the objects having a size in two dimensions. Objects are assigned to a respective one of a plurality of subsets of objects based on object characteristics. Each subset is assigned to a respective two-dimensional portion of predetermined size. For each subset having an unpositioned object, object occupancy in the portion is identified and unpositioned objects are allocated to a position within the portion on the basis of object dimension and unoccupied space. The two-dimensional portions are positioned based on a specification and each object position is mapped within the portions to a three-dimensional coordinate. Responsive to input, positioning of the plurality of two-dimensional portions is modified, and each allocated object position is mapped to a new three-dimensional coordinate within the modified portion positions.

Abstract: A head-mounted device may have a left display and a right display that provide respective left and right images. Left and right optical combiner systems may be configured to pass real-world light to left and right eye boxes while directing the left and right images respectively to the left and right eye boxes. Misalignment of the left and right images with respect to the left and right eye boxes may be detected using gaze tracking systems, using cameras such as front-facing cameras in conjunction with a database of known real-world object properties, using visual inertial odometry systems formed from cameras and inertial measurement units, or using one or more sensors in a portable head-mounted device case or other item with a receptacle configured to receive a head-mounted device. Compensating adjustments may be made to the images based on the measured misalignment.

Abstract: The present disclosure provides an image processing method, an image processing device, and a display device. The image processing method includes: acquiring image data including display data of all of pixels of an image; and performing, on the display data of each of the pixels, operations of: determining Euclidean distances from the display data of the pixel to the display data of a first pure color, the display data of a second pure color, and the display data of a third pure color in a set color space; and replacing the display data of the pixel with one of the display data of the first pure color, the display data of the second pure color and the display data of the third pure color according to the determined Euclidean distances and a preset rule.