Abstract: Aspects of the present disclosure relate to virtual reality (VR) based commerce experience enhancement. A set of user data associated with a user can be received. A session of a VR commerce environment can be initiated with the user. A set of products to include in the VR commerce environment can be selected based on the set of user data. A position and orientation of each of the products of the set of products within the VR commerce environment can be determined based on the set of user data. The set of products can be displayed within the VR commerce environment according to the determined position and orientation of each product of the set of products.

Abstract: A system displays summaries of relationships of a selected data asset with other data assets at a limited number of levels upstream and downstream from the selected data asset in rows above and below the selected data asset. In each row, data assets are arranged in order of usage, with most used data asset displayed directly above or below the selected data asset. The user views grandparent-level data assets of a parent-level data asset that is directly above the selected data asset. The system includes a carousal feature to further navigate the lineage data upstream or downstream. By selecting a new data asset in the parent row, the user can view grandparent-level data assets of the newly selected data asset. The user can view multiple upstream or downstream levels arranged in respective rows displayed above or below the selected data asset. The system can analyze data from any application.

Abstract: Method of creating shared AR session based on a gesture starts with server receiving observed motion data from first device associated with first user. First device generating observed motion data based on an analysis of data stream comprising images of second user performing a gesture. Second user being associated with second device. Server receiving from second device captured motion data that corresponds to the gesture. Captured motion data being recorded by a sensor included in second device. Server determines whether there is a match between observed motion data from first device and captured motion data from second device. In response to determining that there is the match, server generates shared AR session between first device and second device and causes shared AR session to be displayed by first device and second device. Other embodiments are described herein.

Abstract: The present disclosure generally relates to account recovery. An example method includes, at a computer system in communication with a display generation component and one or more input devices: performing a recovery contact set up process including providing a notification to a contact; after performing the recovery contact set up process, receiving, via the one or more input devices, a request to initiate an account recovery process; in response to the request to initiate the account recovery process and without providing a request to the contact, displaying, via the display generation component, a recovery code interface for receiving a set of recovery credentials; while displaying of the recovery code interface, receiving the set of recovery credentials; in accordance with a determination that the recovery credentials are valid, performing a recovery function; and in accordance with a determination that the recovery credentials are not valid, forgoing performing the recovery function.

Abstract: Disclosed is a system and associated methods for improving interactions with three-dimensional (“3D”) objects in a 3D space by dynamically defining the positioning of the handles used to control the interactions with the camera and/or the 3D objects. The system analyzes the positioning of different constructs that form the 3D objects. From the analysis, the system defines handles at different dynamically determined positions about the 3D objects. The system applies an edit from a first dynamically determined position about a particular 3D object in response to a user interaction with a first handle defined at the first dynamically determined position, and applies the edit from a second dynamically determined position about the particular 3D object in response to a user interaction with a second handle defined at the second dynamically determined position.

Abstract: Virtual environment arrangement and configuration techniques are described. In one example, virtualization techniques are employed to generate a virtual environment as implemented via a virtual reality platform by one or more computing devices. The virtual environment includes virtual stores arranged along virtual streets. Virtual digital content is included in the stores, such as to initiate conversion of a good or service represented by the content. Configuration of the virtual environment is based on user, provider, and/or machine learning inputs.

Abstract: A host device having a first processor executes an application via the first processor. The host device determines a state of the application. A scenegraph is generated corresponding to the state of the application, and the scenegraph is presented to a remote device having a display and a second processor. The remote device is configured to, in response to receiving the scenegraph, render to the display a view corresponding to the scenegraph, without executing the application via the second processor.

Abstract: A surgical hub for use with a surgical system in a surgical procedure performed in an operating room is disclosed. The surgical hub comprises a control circuit configured to generate a first image of a surgical site from a real-time imaging source, receive a second image of the surgical site from a non-real-time image source, align the first image and the second image, generate a representation of the surgical site based on the first image and the second image as aligned, display the representation on a display screen, receive a first user selection to overlay hidden structures on the representation, receive a second user selection to manipulate the representation, and adjust the representation based on the second user selection.

Abstract: A computer implemented networking system and method for content-creating, sharing, and archiving, includes maintaining profiles for a plurality of users each having an account that stores and displays user-authored content posts, and generating, for each user profile, a virtual space (e.g. building or house) displayed via a UI, and including a main area and a plurality of sub-areas each being associated with a respective category, and wherein the main area provides navigation to the sub-areas. The approach includes generating the user-authored content posts for each of the users via posting templates that prompt a user to input and organize various content based upon the template guidance for the respective category. A prompting tool operates within the virtual space for each profile by displaying prompts within each of the sub-areas and related to the respective category and includes a prioritized list of user tasks.

Abstract: In accordance with some embodiments, an exemplary process for initializing members of a shared enhanced reality setting is described. In accordance with some embodiments, an exemplary process for forming a private sub-space and example features of the private sub-space is described.

Abstract: An electronic device includes a memory; and a processor configured to: store metadata received from a plurality of data sources, respectively, in the memory; obtain first information corresponding to a preset attribute from among attribute information comprised in first metadata received from a first data source from among the plurality of data sources; obtain second information corresponding to the preset attribute from among attribute information comprised in second metadata received from a second data source; and map, based on the first metadata and the second metadata being identified as metadata on a content based on a similarity between the first information and the second information, an integrated metadata generated based on the first metadata and the second metadata to the content and store the integrated metadata generated based on the first metadata and the second metadata in the memory.

Abstract: Provided is a technique in which, in arranging a virtual object with respect to a real space, a user has less trouble, usability is good, and the object is suitably placeable. A head mounted display apparatus (HMD apparatus) according to one embodiment has a function of arranging and displaying the virtual object in a space based on an operation by a user. The HMD apparatus displays, on a display surface, a grid including a plurality of points for supporting an operation of the virtual object, and disposes and displays, according to an operation includes designation of a target virtual object and designation of a first point at an arrangement destination, the target virtual object at the position of the first point.

Abstract: A design analysis engine analyzes a CAD assembly to generate a topological model. The topological model is a graph of nodes coupled together via a set of edges. Each node represents a different CAD model in the CAD assembly and each edge represents a different connection between two such CAD models. The design analysis engine also analyzes the CAD assembly to generate a data model corresponding to the topological model. The data model is a structured dataset that includes component entries and connection entries. A component entry includes design data associated with a CAD model in the CAD assembly and a connection entry includes design data associated with a physical or logical connection between two or more such CAD models. A user interacts with the topological model to navigate the CAD assembly, obtain CAD model data, and initiate automatically-performed design tasks.

Abstract: An exemplary method includes a proximity detection system that accesses information associated with a virtual location marker positioned in relation to a geographic area. The information defines a location-based field of view (“LFOV”) that extends directionally from the virtual location marker. The proximity detection system further tracks a location of a mobile computing device at the geographic area and determines, based on the information associated with the virtual location marker and the location of the mobile computing device, that the mobile computing device has entered the LFOV that extends directionally from the virtual location marker.

Abstract: A surgical visualization system is disclosed that comprises a control circuit configured to receive pre-operative imaging data associated with an organ, receive first intraoperative imaging data indicative of a structured light pattern on a surface of the organ, generate a three-dimensional digital representation of the organ based on the pre-operative imaging data and the first intraoperative imaging data, display the three-dimensional digital representation of the organ on a display screen, receive second intraoperative imaging data indicative of a plurality of spectral light waves penetrating the organ, intraoperatively identify a structure below the surface of the organ based on the second intraoperative imaging data, generate a three-dimensional digital representation of the structure below the surface of the organ, and overlay the three-dimensional digital representation of the structure with the three-dimensional digital representation of the organ on the display screen.

Abstract: A virtual fabrication environment for semiconductor device fabrication that includes an analytics module for performing key parameter identification, process model calibration and variability analysis is discussed.

Abstract: The present application provides a comparison method and a modeling method for a chip product, a device and a storage medium. According to the method, the chip product is modeled by using a neural network based on a slice sequence of the chip product in advance to obtain a three-dimensional stereoscopic model. When the chip products are compared, a comparison feature is acquired responsive to an operation of a user. For each chip product, a comparison result corresponding to the comparison feature is acquired from the three-dimensional stereoscopic model corresponding to each chip product. Then, the comparison result corresponding to each chip product is displayed.

Abstract: A 3D display system and a 3D display method are provided. The 3D display system includes a 3D display, a memory and one or more processors. The memory records a plurality of modules, and the processor accesses and executes the modules recorded by the memory. The modules include a bridge interface module and a 3D display service module. When an application is executed by the processor, the bridge interface module creates a virtual extend screen, and moves the application to the virtual extend screen. The bridge interface module obtains a 2D content frame of the application from the virtual extend screen by a screenshot function. The 3D display service module converts the 2D content frame into a 3D format frame by communicating with a third-party software development kit, and provides the 3D format frame to the 3D display for displaying.

Abstract: A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.

Abstract: An image display method includes: displaying a first image having a first image surface on a display surface in a three-dimensional fashion; in response to a reception of an instruction of rotating the first image around an axis different from any axis in the display surface, rotating the first image around a first imaginary axis, the first imaginary axis being vertical to the first image surface and different from an axis vertical to the display surface; and displaying the rotated first image.

Abstract: Networking is one of the key aspects of events, but virtual events pose a huge limitation, as attendees don't really get an opportunity to have one on one discussions with each another. The users of current video calling solutions unsuccessfully trying to extend the use of these products to casual social get together and the current video calling solutions that have no dimension of space and are not tailored to emulate the dynamics of real-life social settings. The current invention belongs broadly to natural communication flow in video call solutions, highly interactive, aiming to create as similar an experience as possible to their physical counterparts.

Abstract: A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a plan view map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a plan view map, or by using a joystick or other peripheral device.

Abstract: There is provided an image display apparatus that enables an intuitive operation even when a detection target is not able to be inserted into a first space in which a three-dimensional object is visually recognized. A position of a detection target is detected, and a display position of a pointer displayed by a display unit is moved on a basis of a position of the detection target that exists within a second space not overlapping the first space which is a space in which the three-dimensional object is displayed among the position of the detected detection target.

Abstract: Methods and systems for improved integration of an overhead representation (e.g., a map) with a street view representation. A user interface with at least two regions is output for display to a user. One region includes an overhead representation of an area and an interactive control overlaid onto the overhead representation. Another region includes a street view perspective that has a point of view corresponding to a position and directional orientation of the interactive control. Information about a user input that adjusts the interactive control is received and the street view perspective is updated to track the control as it is adjusted. The field of view of the street view perspective may be reflected in the appearance of the interactive control. Additionally, the street view perspective may follow the location of a marker as it is moved around the overhead representation.

Abstract: An orthogonal or multi-dimensional fabric user interface is described herein. A remote server executes an operating system that stores content in a multi-dimensional fabric. Multiple users can access a common virtual space to view content that is stored in the multi-dimensional fabric at a specific location and time. The users request the specific location and time. The remote server accesses the multi-dimensional fabric to anchor content within the common virtual space based on the specific location and time. In this way, multiple users experience location and time driven content together.

Abstract: A method for analyzing and displaying surveillance video including: capturing, using a first video camera, a first plurality of video frames of a first area at a first time; analyzing the first plurality of video frames or linking to one or more alarms received; determining a first activity of interest within one or more first video frames of the first plurality of video frames; generating a first activity of interest video clip from the one or more first video frames; and displaying the first activity of interest video clip within a first carousel on a display device, wherein the first activity of interest video clip is configured to rotate around a first axis within the first carousel on the display device.

Abstract: Various implementations disclosed herein include devices, systems, and methods for indicating a distance to a selectable portion of a virtual surface. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes displaying a graphical environment that includes a virtual surface, wherein at least a portion of the virtual surface is selectable. In some implementations, the method includes determining a distance between a collider object and the selectable portion of the virtual surface. In some implementations, the method includes displaying a depth indicator in association with the collider object. In some implementations, a visual property of the depth indicator is selected based on the distance between the collider object and the selectable portion of the virtual surface.

Abstract: Examples of wearable devices that can present to a user of the display device an audible or visual representation of an audio file comprising a plurality of stem tracks that represent different audio content of the audio file are described. Systems and methods are described that determine the pose of the user; generate, based on the pose of the user, an audio mix of at least one of the plurality of stem tracks of the audio file; generate, based on the pose of the user and the audio mix, a visualization of the audio mix; communicate an audio signal representative of the audio mix to the speaker; and communicate a visual signal representative of the visualization of the audio mix to the display.

Abstract: A method is provided for displaying an application icon. A terminal displays a first screen, where the first screen includes an icon of a first application, and an icon of the cloned application of the first application is hidden. The terminal receives a first operation performed by a user on the icon of the first application, and displays the hidden icon of the cloned application of the first application in response to the first operation, where the icon of the cloned application of the first application and the icon of the first application are simultaneously displayed on the first screen, and the first screen is included on a home screen of the terminal.

Abstract: Disclosed are a method, a system and a device for displaying a geometry in an editor, and a medium, which are applied to the technical field of two-dimensional/three-dimensional modeling. The method for displaying a geometry in an editor comprises: determining a Boolean operation and a plurality of geometries in a space window (102); calculating the plurality of geometries in the space window according to the Boolean operation, so as to obtain a composite geometry in the space window (104); creating a plurality of objects in the resource list, wherein the plurality of objects respectively correspond to the composite geometry and the plurality of geometries that are calculated to obtain the composite geometry, and setting objects corresponding to the plurality of geometries as sub-nodes of an object corresponding to the composite geometry; and returning to the step of determining a Boolean operation and a plurality of geometries in the space window.

Abstract: Computer-implemented method of positioning a set of objects on a user interface on a surface of a three-dimensional structure, each member of the set of the objects having a size in two dimensions. Objects are assigned to a respective one of a plurality of subsets of objects based on object characteristics. Each subset is assigned to a respective two-dimensional portion of predetermined size. For each subset having an unpositioned object, object occupancy in the portion is identified and unpositioned objects are allocated to a position within the portion on the basis of object dimension and unoccupied space. The two-dimensional portions are positioned based on a specification and each object position is mapped within the portions to a three-dimensional coordinate. Responsive to input, positioning of the plurality of two-dimensional portions is modified, and each allocated object position is mapped to a new three-dimensional coordinate within the modified portion positions.

Abstract: A head-mounted device may have a left display and a right display that provide respective left and right images. Left and right optical combiner systems may be configured to pass real-world light to left and right eye boxes while directing the left and right images respectively to the left and right eye boxes. Misalignment of the left and right images with respect to the left and right eye boxes may be detected using gaze tracking systems, using cameras such as front-facing cameras in conjunction with a database of known real-world object properties, using visual inertial odometry systems formed from cameras and inertial measurement units, or using one or more sensors in a portable head-mounted device case or other item with a receptacle configured to receive a head-mounted device. Compensating adjustments may be made to the images based on the measured misalignment.

Abstract: The present disclosure provides an image processing method, an image processing device, and a display device. The image processing method includes: acquiring image data including display data of all of pixels of an image; and performing, on the display data of each of the pixels, operations of: determining Euclidean distances from the display data of the pixel to the display data of a first pure color, the display data of a second pure color, and the display data of a third pure color in a set color space; and replacing the display data of the pixel with one of the display data of the first pure color, the display data of the second pure color and the display data of the third pure color according to the determined Euclidean distances and a preset rule.

Abstract: The effective dimensionality of multivariate data can be reduced while minimizing loss of fidelity to primary calculations of interest. The reduced dimensionality may simplify analysis and make it more computationally efficient as a result of the simplification. Boundaries along a subset of dimensions may be identified and used to effectively reduce the dimensionality of the data according to those boundaries.

Abstract: An editing system and associated methods execute a workflow involving a sequence of two-dimensional/three-dimensional (“2D/3D”) data manipulations and/or associated operations to 2D/3D data of different formats by calling functions of different applications that are compatible with the changing format of the 2D/3D data throughout the workflow. The system determines that the 2D/3D data provided as input to a first workflow node is in a first format, and executes the first node by invoking a function of a first application that implements the operations associated with the first node on the 2D/3D data in the first format. Execution of the first node converts the 2D/3D data to a different second format that is passed to a second workflow node. The system executes a second workflow node by invoking a function of a second application that implements the operations associated with the second node on the 2D/3D data in the second format.

Abstract: A control method of controlling an information processing apparatus includes displaying an image corresponding to one section of a plurality of sections of a predetermined operation for another apparatus, which is different from the information processing apparatus, in a predetermined display area, displaying a plurality of thumbnails corresponding to the plurality of sections, and in a case where a user selects a thumbnail from the plurality of thumbnails, controlling in such a manner that an image corresponding to a section of the plurality of sections corresponding to the selected thumbnail is displayed in the predetermined display area, wherein information that represents a section number of a corresponding section of the plurality of sections is added to the plurality of thumbnails.

Abstract: Technologies are described for generating visualizations that graphically represent an item being exposed to extreme environmental conditions while en route to a destination. An exemplary visualization may include a still graphic that shows a symbol of a detected environmental condition positioned adjacent to and/or superimposed over a graphic that represents the item. Another exemplary visualization may include an animation that includes a sequence of frames that, when sequentially displayed at a particular frame rate, animate the item being subjected to the detected environmental condition. Various implementations include receiving measurements of the environmental conditions that the item is exposed to from sensors that are proximate to the item while it is en route to the destination. Then, when thresholds are reached for specific environmental conditions (e.g., temperature, acceleration, etc.

Abstract: Methods and systems described herein facilitate virtual interactions between users that more closely resemble their in-person counterparts. In particular, the methods and systems simulate in-person interactions in virtual environments through the use of complex spatial algorithms. For example, in some embodiments, the methods and systems provide avatar-based video conferencing systems in which avatars are connected by video/voice chat to any avatar based on one or more criteria.

Abstract: A human-machine interface involves plural spatially-coherent visual presentation surfaces at least some of which are movable by a person. Plural windows or portholes into a virtual space, at least some of which are handheld and movable, are provided by using handheld and other display devices. Aspects of multi-dimensional spatiality of the moveable window (e.g., relative to another window) are determined and used to generate images. As one example, the moveable window can present a first person perspective “porthole” view into the virtual space, this porthole view changing based on aspects of the moveable window's spatiality in multi-dimensional space relative to a stationary window. A display can present an image of a virtual space, and an additional, moveable display can present an additional image of the same virtual space.

Abstract: A computer-implemented system and method for analyzing clusters of coded documents is provided. Clusters of documents are displayed and at least a portion of the documents are each associated with a classification code. A representation of each document is provided based on the associated classification code or an absence of the associated classification code. A search query with search terms is received. Each search term is associated with one of the classification codes. Those documents that satisfy the search query are identified and the representations of the identified documents are changed based on the classification codes associated with the search terms. The change in representation provides an indication of agreement between the classification code of such document and the classification codes of the search terms, or an indication of disagreement between the classification code of the document and the classification codes of the search terms.

Abstract: A methodology is described that provides access to augmented reality components maintained by a messaging server system directly from a third party resource, without having to first launch an associated messaging client (either a stand-alone app or a web-based version of the app). The technical problem of invoking an augmented reality component maintained by the messaging server system directly from a third party app is addressed by permitting third party app developers to include a deep link that references the identification of a desired augmented reality component into their third party resource. The deep link invoked from a third party resource causes activation of the messaging client, loading the augmented reality component represented by the identification referenced in the deep link, and activating, from the messaging client, a camera of the computer device that is executing the third party resource.

Abstract: A method for three dimensional visualization and manipulation of downhole data. A measured signal is received a downhole environment and a three dimensional virtualization of the measured signal is generated. A stereographic viewer displays the three dimensional virtualization of the measured signal. The three dimensional virtualization can be manipulated in response to an input from a user, thereby creating a manipulated three dimensional virtualization. The stereographic viewer can display the manipulated three dimensional virtualization.

Abstract: There is provided an information processing apparatus including a display section which displays, as a first layout state, an object group including a plurality of objects arranged in a first direction, a detection section which detects an operation input that is input to the display section, and a control section which, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, changes the first layout state into a second layout state in which tire respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.

Abstract: A structural analysis computing device may generate a proposed insurance claim and/or generate a proposed insurance quote for an object pictured in a three-dimensional (3D) image. The structural analysis computing device may be coupled to a drone configured to capture exterior images of the object. The structural analysis computing device may include a memory, a user interface, an object sensor configured to capture the 3D image, and a processor in communication with the memory and the object sensor. The processor may access the 3D image including the object, and analyze the 3D images to identify features of the object—such as by inputting the 3D image into a trained machine learning or pattern recognition program. The processor may generate a proposed claim form for a damaged object and/or a proposed quote for an uninsured object, and display the form to a user for their review and/or approval.

Abstract: According to one embodiment, a plurality of spatial publishing objects (SPOs) is provided in a multidimensional space in a user interface. Each of the plurality of spatial publishing objects is associated with digital media data from at least one digital media source. The user interface has a field for the digital media data. A user is provided via the user interface with a user presence that is optionally capable of being represented in the user interface relative to the plurality of spatial publishing objects. The digital media data associated with the at least one spatial publishing object are combined to generate a media output corresponding to the combined digital media data.

Abstract: Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.

Abstract: Disclosed are embodiments for employing off board sensors to augment data used by a ground based autonomous vehicle. In some aspects, the off-board sensors may be positioned on another autonomous vehicle, such as an aerial autonomous vehicle (AAV). The disclosed embodiments determine uncertainty scores associated with ground regions. The uncertainty scores indicate a need to reimage the ground regions. An AAV may be tasked to reimage a region having a relatively high uncertainty score, depending on a cost associated with the tasking.

Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments an encoding method comprises obtaining information of a region (63) for overlaying at least a part of an omnidirectional video (61), information of a current viewport (62) in the omnidirectional video (61), and information of an overlaying method to determine whether to overlay a part of the current viewport (62) or the whole current viewport (62) by the overlaying region (63). The method may further comprise encoding information of the overlaying region (63), the current viewport (62) and the overlaying method.

Abstract: A VR sickness reduction system, a head-mounted display, a VR sickness reduction system, and a program are provided that may reduce VR sickness. An HMD includes a display section positioned in front of a user when the head-mounted display is mounted on the user. A rocking section may rock a head of the user on which the HMD is mounted. An entertainment apparatus causes the display section to display a moving image representing a state viewed from a point of view. The entertainment apparatus controls rocking of the rocking section depending on an acceleration status of the point of view in the moving image displayed on the display section.

Abstract: A computer-implemented improved system for producing studio quality e-commerce product videos displaying a 3D rendering created from a 3D model of a product that includes generally the steps of uploading a 3D model of the consumer product onto a computer or an online platform; selecting product features for highlighting in the video; rotating the 3D model to identify selected features; providing text to highlight portions of the video and the selected features; selecting and providing musical accompaniment for the video; and, creating a timeline to establish the sequence of individual portions of the video whereupon the 3D rendered video is then automatically generated for the vendor's e-commerce product page and various social platforms.