Abstract: A document creation method, and a device and a storage medium are provided. The method comprises: in an editing interface of the current document, calling an operation panel according to a trigger event, and displaying the operation panel; displaying a creation control of a reference object in the operation panel; and in response to an operation of a user for the creation control, creating a new reference object, and establishing a reference relationship between the current document and the reference object.

Abstract: Disclosed is a system 1000 for determining a virtual representation of at least part of an environment 800 that is navigable by a ship 700. The system has at least one beacon 101, 102, 201, 202, 301, 302, 401-403 remote from the ship. The or each beacon comprises at least one sensor 411-415 for sensing surroundings information representative of at least part of the environment, a transmitter 420, and a controller 430 connected to the at least one sensor and configured to cause the surroundings information to be transmitted via the transmitter. The system also comprises a control centre 500 remote from the ship. The control centre comprises a receiver 520 configured to receive the surroundings information, and a control unit 530 connected to the receiver and configured to determine a virtual representation of at least part of the environment based on the surroundings information. The virtual representation may comprise a topographical map, such as a LIDAR map.

Abstract: Systems and methods for dynamic content item display can include a dynamic carousel interface. The dynamic carousel interface can provide a plurality of content items for display in a carousel that can be navigated through to provide the different content items for display. The dynamic carousel interface can include dynamic resizing of display containers, which can be paired with dynamic masking to provide at least a portion of more content items at one time.

Abstract: A system includes a user device that can be used by a user to enter a virtual environment and at least one processor coupled to the user device. The processor is configured to record a plurality of real-world data interactions performed by the user and determine a real-world behavior of the user based on the recorded data interactions. The processor receives a request by the user to perform a data interaction in the virtual environment. The processor verifies whether the requested data interaction is in accordance with the recorded real-world behavior of the user. When the requested data interaction is not in accordance with the real-world behavior of the user, the processor verifies the data interaction in the real-world environment and allows the user to perform the data interaction in the virtual environment upon successful verification of the data interaction.

Abstract: The technology disclosed herein includes a controller or device that provides multi-dimensional hand interaction with the digital world by delivering physical sensations to the palm and the fingertips. The device translates motion from the hand and fingers to control of a computer device, while simultaneously receiving signals to display haptic sensations. The device is “controller-held” around a user's hand, holding onto hand anatomy at key locations. In some embodiments, the device has one-handed engagement and disengagement. In some embodiments, the device may be used as a game controller, incorporating WebVR electronics and software, wireless communication, power-harvesting electronics, inertial measurements unit electronics including additional inputs for camera-based IMU supplementation, battery recharging electronic and internal communication protocol support electronics.

Abstract: Disclosed is an interface and/or system for presenting three-dimensional (“3D”) graphical user interface (“GUI”) elements to improve user interactions with a device. The system determines a first angle from which to render a 3D GUI. The system receives 3D images that are linked to the 3D GUI elements. The system generates the 3D GUI elements by rendering each of the 3D images from a first render position that aligns with the first angle. The system detects an input that changes the first angle to a second angle, and updates a visualization of the 3D GUI elements by rendering each of the 3D images from a second render position that aligns with the second angle.

Abstract: Continuous and non-episodic user sessions in a virtual world are facilitated by providing a virtual service center with alternative virtual experiences selected to retain user presence in the virtual world. The virtual service center is associated with a mobile network operator (MNO) of a telecommunications network and is provided to enable resolution or fulfillment of network service issues indicated by users. The alternative virtual experiences are selected and users driven thereto to continuously engage users in the virtual world outside of the immediate context of their service issues and resolution thereof.

Abstract: A system for generating and displaying a three-dimensional representation is configured to provide a template for selection by a user with the template corresponding to a program for generating the three-dimensional representation for display relative to a corresponding three-dimensional environment. The system accesses characteristic data associated with determining at least one variable characteristic of an appearance of the three-dimensional representation and generates the three-dimensional representation. An appearance of the three-dimensional representation includes at least one variable characteristic that is determined by reference to the accessed characteristic data. The three-dimensional representation is then able to be displayed relative to the corresponding three-dimensional environment, which may be virtual (VR) or real-world (AR).

Abstract: Generating and storing product media can be resource intensive processes. Some systems and methods disclosed herein relate to rapidly and/or automatically generating a three-dimensional (3D) composite model to help improve the generation of product media and/or to help reduce product media storage requirements. The 3D composite model may correspond to a product bundle. According to an embodiment, an indication of items associated with a product bundle is obtained. Pre-existing 3D models corresponding to the items are then obtained and used to generate a 3D composite model. The 3D composite model includes representations of the items and may be implemented to provide product media depicting the product bundle.

Abstract: The present disclosure generates a digital twin of the interior of a vehicle to initiate and track maintenance issues. In one aspect, the digital twin is formed using multiple captured images of the interior of the vehicle where multiple components in those images are identified using a machine learning (ML) model. The components identified by the ML model are then mapped to a model (e.g., a 3D model) of the components that lists their location in the vehicle and an identifier (e.g., a part number or serial number). In this manner, the digital twin can identify, using the identifiers, the various components in the images captured by a camera.

Abstract: The method for virtual interaction with a three-dimensional indoor room includes: generating a virtual room model, generating a virtual room visual representation, providing the room data to a display device, receiving a virtual object selection, rendering an updated virtual room visual representation based on the virtual object, and providing the updated virtual room visual representation to the display device. The method can optionally include updating virtual room S700. A system for virtual interaction with a three-dimensional indoor room includes: a backend platform and a front end application.

Abstract: The invention provides a content provisioning system. A mobile device has a mobile device processor. The mobile device mobile device has communication interface connected to the mobile device processor and a first resource device communication interface and under the control of the mobile device processor to receive first content transmitted by the first resource device transmitter The mobile device mobile device has a mobile device output device connected to the mobile device processor and under control of the mobile device processor capable of providing an output that can be sensed by a user.

Abstract: Techniques for inferring whether an event is occurring in 3D space based on 2D image data and for maintaining a camera's calibration are disclosed. An image of an environment is accessed. Input is received, where the input includes a 2D rule imposed against a ground plane. The 2D rule includes conditions indicative of an event. A bounding box is generated and encompasses a detected object. A point within the bounding box is projected from a 2D-space image plane of the image into 3D space to generate a 3D-space point. Based on the 3D-space point, a 3D-space ground contact point is generated. That 3D-space ground contact point is reprojected onto the ground plane of the image to generate a synthesized 2D ground contact point. A location of the synthesized 2D ground contact point is determined to satisfy the conditions.

Abstract: An interactive illumination apparatus and methods and systems for executing functions of the interactive illumination apparatus are disclosed. The interactive illumination apparatus includes a housing, a light emitting device arranged on a first end of the housing, a first button on the housing configured to detect a first input, a touch input device on the housing configured to receive a touch input from a user, and a battery in the housing. The light emitting device may be configured to generate a first illumination based on the first input. The light emitting unit may be configured to generate a second illumination based on the touch input.

Abstract: A location is mapped to identify a number of zones, and content items are identified for assignment to the zones. Selection of a zone for each content item may be received from the user, or content items may be assigned to zones automatically as described above. Identifiers of each content item and indicators of the selected zone for each content item are then stored as an AR display configuration associated with the location. In response to detecting that the AR display device is being used at the location, the AR display configuration is retrieved and resolved on the AR display device.

Abstract: Disclosed herein are systems and techniques for centralized data retention and deletion. Data can be ingested from multiple external data sources and saved internally for use to process data modification (e.g., deletion) requests via a data processing pipeline, which may apply eligibility checks and modification logic to determine the appropriate modifications to the relevant data items to comply with the data modification request. Various user interfaces may be generated to provide a user with oversight of the data processing pipeline and the data modifications. The user may review and trigger the modification of data stored at the external data sources and/or internally.

Abstract: A method of generating a user interface includes obtaining input data indicative of respective positions of a plurality of elements within an input plane and generating a model of a surface of a three-dimensional structure. The surface has circular symmetry and includes two curved polar caps and a curved equatorial belt, wherein a curvature of each of the polar caps is greater than a curvature of the equatorial belt. The method includes mapping the elements to respective positions on the model, and determining a position and orientation of a virtual camera, wherein the determined position of the virtual camera is exterior to the model. The method includes determining a field of view of the virtual camera containing a concave interior portion of the model, and rendering a projection of the model corresponding to the determined field of view and comprising elements mapped to positions on the concave interior portion.

Abstract: A spoiler prevention system and method on streaming applications and other interactive platforms whereby hen the spoiler prevention system is active, spouses, friends, or other groups having multiple members, will not be able to watch new episodes of selected programs unless both parties are present at the location that the program is being viewed which may be determined by two separate codes entered by the parties, or that a computing device belonging to both parties is in proximity with one another or a streaming device, or by the parties logging into the mobile application on their computing devices.

Abstract: A light field display system is implemented in a consumer device to present the user of the consumer device with holographic content, providing the user with an immersive operational experience. The system generates and presents holographic content for the user. The system receives a command from the user. In some embodiments, the presented holographic content may comprise a holographic user interface that is used by the system to receive the commands from the user. Subsequently, the system recognizes the received commands, determines one or more computational commands for execution by the system, and executes the determined computational command.

Abstract: An information management method collects log information of one or more home electrical apparatuses corresponding to service providers. Display screen data is generated which indicates a status of the log information. The display screen data includes groups of information which each contain information on an apparatus, a service provider corresponding to the apparatus, and log information output from the apparatus. Provision of the log information of each group is individually selectable. The display screen data is provided via a network to a display terminal that performs access to a server device. Information is received from the display terminal, which indicates that selection on whether or not provision of the log information is performed. Provision of the log information is not performed on the selected group when a determination is made that refusal of provision of the log information on the selected group is performed.

Abstract: A system is disclosed for rending clothing on a two-dimensional image. The system may include a processor or a computer-readable storage medium storing executable instructions thereon. In response to the processor executing the executable instructions, the processor may be configured to receive at least one depth frame of a photography subject. The processor can generate a virtual avatar based on the at least one depth frame, wherein the virtual avatar may include a digital three-dimensional mesh. The processor can receive a digital three-dimensional model of an article of clothing. The processor can manipulate the digital three-dimensional model of the article of clothing to fit on the virtual avatar, render the digital three-dimensional model of the article of clothing into a two-dimensional image, or overlay the two-dimensional image onto a two-dimensional version of the at least one depth frame.

Abstract: A method and system for inputting a user rating in an electronically-presented space is disclosed. A user may position icons, which represent items for rating, in the electronically-presented space. For example, the user may position, using a mouse, the icons on a 2-D area on a display screen in order to rate the icons. Responsive to the positioning, the system may identify the positions of the icons, such as the positions of the icon within the 2-D area on the display screen, in order to determine the rating, such as a relative rating or an absolute rating. In this way, the method and system disclose a straightforward and simple way for users to input user preference in the electronically-presented space.

Abstract: Techniques described herein enable a user to interact with an automated assistant and obtain relevant output from the automated assistant without requiring arduous typed input to be provided by the user and/or without requiring the user to provide spoken input that could cause privacy concerns (e.g., if other individuals are nearby). The assistant application can operate in multiple different image conversation modes in which the assistant application is responsive to various objects in a field of view of the camera. The image conversation modes can be suggested to the user when a particular object is detected in the field of view of the camera. When the user selects an image conversation mode, the assistant application can thereafter provide output, for presentation, that is based on the selected image conversation mode and that is based on object(s) captured by image(s) of the camera.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images.

Abstract: Computer systems and corresponding methods are provided for computer assisted research in a network are provided that generate interface screens that include a map view of a plurality of selectable objects disposed in a nuclear arrangement in segmented rings about a first level object. The computing device is configured to receive selections of the displayed objects and expand the display to include additional segmented levels all surrounding the first level object.

Abstract: A method of initializing the layout of one or more robotic arms controllable by an input object, comprising: entering a paused mode, in which control of movement of the robotic arms by the input object is paused; measuring an input object initialization layout, defined by the layout of at least one segment of the input object; actuating at least a portion of the robotic arms to match the input object initialization layout; and entering a controlled mode, in which movements of the input object control the robotic arms.

Abstract: A haptic rendering device and corresponding method allows to render a haptic effect described by metadata comprising, for at least one haptic channel, information representative of a geometric model, and information representative of an element of the geometric model where to apply the haptic feedback, and wherein an associated haptic file comprises the haptic signal to be applied. A file format for carrying the required information is provided.

Abstract: A facial model reconstruction method and apparatus, and a medium and a device are provided. The facial model reconstruction method comprises: determining an anchor point of a three-dimensional special effect element to be attached on a face; determining an attachment point on a three-dimensional facial model to which the three-dimensional special effect element is to be attached, wherein the three-dimensional facial model corresponds to the face; attaching the anchor point to the attachment point in a way that the anchor point overlaps the attachment point; and moving the anchor point to a center of a world coordinate system of the three-dimensional facial model, and binding the 3D special effect element with the 3D facial model.

Abstract: A device is configured to receive a user input from a user device indicating a first gesture performed by a user in a real-world environment and to identify a first token within a gesture map corresponding with the first gesture. The device is further configured to identify a second gesture performed by an avatar within a virtual environment that is associated with the user and to identify a second token within the gesture map corresponding with the second gesture. The device is further configured to combine the first token and the second token to generate an authentication token and to verify an identity of the user based on the authentication token.

Abstract: A method, apparatus and device including: displaying a map of the virtual scene; displaying at least one marker based on a position marking instruction for a virtual resource in the virtual scene; controlling the target marker to move in the map with the execution of a dragging operation based on the dragging operation for the target marker in at least one marker; and marking the target marker at a current position of the target marker in the map based on a release instruction for the dragging operation.

Abstract: The wireless communication quality visualization device 10 includes condition setting means 11 which sets measurement condition that can identify a target whose communication quality is measured, and extraction condition that can identify data to be displayed in data on communication quality collected according to the measurement condition, and display data generation means 12 which generates display data for displaying spatial and temporal communication quality based on the data extracted according to the extraction condition.

Abstract: A system for viewing at a client device a series of three-dimensional virtual views over the Internet of a volume visualization dataset contained on centralized databases employs a transmitter for securely sending volume visualization dataset from a remote location to the centralized database, more than one central data storage medium containing the volume visualization dataset, and a plurality of servers in communication with the centralized databases to create virtual views based on client requests. A resource manager load balances the servers, a security device controls communications between the client device and server and the resource manager and central storage medium. Physically secured sites house the components. A web application accepts at the remote location user requests for a virtual view of the volume visualization dataset, transmits the request to the servers, receives the resulting virtual view from the servers, and displays the resulting virtual view to the remote user.

Abstract: A computer-implemented system and method for analyzing clusters of coded documents is provided. Clusters of documents are displayed and at least a portion of the documents are each associated with a classification code. A representation of each document is provided based on the associated classification code or an absence of the associated classification code. A search query with search terms is received. Each search term is associated with one of the classification codes. Those documents that satisfy the search query are identified and the representations of the identified documents are changed based on the classification codes associated with the search terms. The change in representation provides an indication of agreement between the classification code of such document and the classification codes of the search terms, or an indication of disagreement between the classification code of the document and the classification codes of the search terms.

Abstract: A controller of a device is configured to selectively display a plurality of screens. In response to a particular arranging operation to arrange a particular icon assigned with a particular process on a screen the controller displays the particular icon in accordance with the arranging operation an arrangement target area of the screen.

Abstract: According to one embodiment, a method, computer system, and computer program product for cloud service brokerage. The embodiment may include receiving a data set and user defined contextual parameters relating to a machine learning (ML) problem of a user to be performed on the data set. The embodiment may include identifying a resource requirement of the ML problem and available resources. The embodiment may include enabling user configuration of the contextual parameters in an interactive augmented reality (AR) view. The embodiment may include identifying a set of clusters upon which to execute computing tasks of the ML problem. The set of clusters is identified out of the available resources. The embodiment may include implementing a ML evaluation process to determine an optimized load distribution model for execution of the computing tasks within the set of clusters. The embodiment may include implementing the optimized load distribution model.

Abstract: Methods, systems, and computer programs are presented for managing the sensory stimulus generated by a head mounted display (HMD). One method includes identifying a game state of a game being executed for a current session by a computer for display on a head mounted display (HMD) for a user. Then, determining a game intensity value for said game state based on user intensity feedback received from one or more prior gaming sessions by users. The user intensity feedback describes levels of sensory stimulus obtained from the users during user play of the game via an HMD of the respective users, and the determined game intensity value is calculated by analysis of the levels of sensory stimulus received from the users. Processing the game intensity value to cause a higher rendering priority to a viewpoint of the user's gaze than regions outside of the viewpoint. The viewpoint is a portion of the display of the HMD.

Abstract: A pen state detection circuit is incorporated in electronic equipment having a touch sensor of a capacitive system made of planarly disposed multiple sensor electrodes. The pen state detection circuit is configured to perform acquiring, from the touch sensor, signal distribution indicating a change in capacitance associated with approach of a pen-side electrode included in an electronic pen, and estimating a state of the electronic pen according to an input-output model. In the input-output model features relating to the acquired signal distribution are input and a state quantity of the electronic pen is output. The pen state detection circuit is configured to be capable of setting an input-output model that is different depending on a change in an outer shape of the electronic pen or the electronic equipment.

Abstract: A methodology is described that provides access to augmented reality components maintained by a messaging server system directly from a third party resource, without having to first launch an associated messaging client (either a stand-alone app or a web-based version of the app). The technical problem of invoking an augmented reality component maintained by the messaging server system directly from a third party app is addressed by permitting third party app developers to include a deep link that references the identification of a desired augmented reality component into their third party resource. The deep link invoked from a third party resource causes activation of the messaging client, loading the augmented reality component represented by the identification referenced in the deep link, and activating, from the messaging client, a camera of the computer device that is executing the third party resource.

Abstract: An advertisement display system 1 acquires coordinates of the avatar and a size of the avatar in the virtual reality space and calculates a movement speed of the avatar by dividing a coordinate change amount per unit time of the avatar in the virtual reality space by a reference amount in accordance with the size of the avatar. In addition, the system 1 determines whether a point of view of the avatar in the virtual reality space is set to a first-person point of view or a third-person point of view. Furthermore, the system 1 performs control to differentiate, when an avatar is moving in the virtual reality space, a position where advertising is to be displayed in the virtual reality space with respect to the user operating the avatar in accordance with the movement speed of the avatar and the point of view of the avatar.

Abstract: A method for generating and updating a three-dimensional representation of a surgical site based on imaging data from an imaging system is disclosed. The method comprises the steps of generating a first image of the surgical site based on structured electromagnetic radiation emitted from the imaging system, receiving a second image of the surgical site, aligning the first image and the second image, generating a three-dimensional representation of the surgical site based on the first image and the second image as aligned, displaying the three-dimensional representation on a display screen, receiving a user selection to manipulate the three-dimensional representation, and updating the three-dimensional representation as displayed on the display screen from a first state to a second state according to the received user selection.

Abstract: Disclosed are three-dimensional (“3D”) graphical user interface (“GUI”) elements for improving user interactions with a digital environment or a device by simplifying access to different data, functionality, and operations of the digital environment or the device. A 3D GUI element may include first visual information at a first position and second visual information at a second position within the 3D space represented by the 3D GUI element. In response to first input directed to the first visual information, the 3D GUI or system may perform a first action that is mapped to the first input and the first visual information within the 3D GUI element. In response to second input directed to the second visual information, the 3D GUI or system may perform a second action that is mapped to the second input and the second visual information within the 3D GUI element.

Abstract: In some embodiments, a layer-partitioned virtual world system includes at least one server computing device, a plurality of third-party software engines, and one or more client devices. The server computing device includes at least one processor and memory storing a base layer including a persistent virtual world system that includes a plurality of virtual objects, the base layer supporting a plurality of virtual world layers providing further functionality to the persistent virtual world system through a plurality of applications. The plurality of third-party software engines are hosted on corresponding third-party server computing devices communicatively coupled to the at least one server computing device via a network and providing services to the plurality of applications. The one or more client devices receive and display composited virtual frames corresponding to the base layer and further functionalities of one or more of the virtual world layers.

Abstract: An electronic device is provided. The electronic device includes a display and a processor, wherein the processor may be configured to confirm an air pointer initiation event of a stylus pen, display, on the display, an air pointer of the stylus pen on the basis of display rotation information and information of at least one application running on the electronic device, confirm, once a selection event is received from the stylus pen, first location information among a plurality of location information about the air pointer, calculated according to the motion of the selection event, confirm, on the basis of the information of the at least one application running on the electronic device, a function object set in an area of the display that comprises the first location information, and perform a function of the function object, corresponding to the selection event.

Abstract: Methods and systems described herein facilitate virtual interactions between users that more closely resemble their in-person counterparts. In particular, the methods and systems simulate in-person interactions in virtual environments through the use of complex spatial algorithms. For example, in some embodiments, the methods and systems provide avatar-based video conferencing systems in which avatars are connected by video/voice chat to any avatar based on one or more criteria.

Abstract: Described herein is a computer implemented method including: displaying a design including a first design element; detecting an initiate record animation event; receiving animation definition input creating an original path between an initial position and a final position, the animation definition input drawing the original path at original traversal speeds; generating animation data based on the animation definition input, the animation data including data that allows both the original path and the original traversal speeds to be reproduced; and associating the animation data with the first design element.

Abstract: The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor.

Abstract: In an approach to improve virtual Reality (VR) integrated development environment (IDE) embodiments create an integrated view of a developed code during integration testing based on received artificial intelligent enabled IDE, and execute a test case simulation during the integrated visualization of the developed code in a virtual reality environment. Further, embodiments create a visualization of the developed code based on one or more test results from the test case simulation in the VR environment and a selected code from the developed code with respect to an entire application landscape, and identify one or more problematic areas based on one or more types of defect and criticality of the defect in the developed code. Additionally, embodiments, display the visualization of the selected code, and apply one or more identified solutions to the one or more identified problematic areas in the developed code.

Abstract: A spatial indexing system receives a sequence of images depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Abstract: According to one embodiment, a plurality of spatial publishing objects (SPOs) is provided in a multidimensional space in a user interface. Each of the plurality of spatial publishing objects is associated with digital media data from at least one digital media source. The user interface has a field for the digital media data. A user is provided via the user interface with a user presence that is optionally capable of being represented in the user interface relative to the plurality of spatial publishing objects. The digital media data associated with the at least one spatial publishing object are combined to generate a media output corresponding to the combined digital media data.