Abstract: The technology disclosed relates to a method of realistic rendering of a real object as a virtual object in a virtual space using an offset in the position of the hand in a three-dimensional (3D) sensory space. An offset between expected positions of the eye(s) of a wearer of a head mounted device and a sensor attached to the head mounted device for sensing a position of at least one hand in a three-dimensional (3D) sensory space is determined. A position of the hand in the three-dimensional (3D) sensory space can be sensed using a sensor. The sensed position of the hand can be transformed by the offset into a re-rendered position of the hand as would appear to the wearer of the head mounted device if the wearer were looking at the actual hand. The re-rendered hand can be depicted to the wearer of the head mounted device.

Abstract: This disclosure is directed to a method and apparatus for displaying an expression in a virtual scene. The method includes: displaying a virtual scene; displaying an expression selection region at a first target position in the virtual scene in response to a drag operation on an expression addition icon; and displaying the first target expression in the virtual scene in response to a selection operation on a first target expression in a plurality of first candidate expressions.

Abstract: A live camera feed may be analyzed to determine the identify of an object, and augmented reality overlay data may be determined based on that identity. The overlay data may include one or more tags that are each associated with a respective location on the object. The live camera feed may be presented on a display screen with the tags being positioned as the respective location.

Abstract: A medical image processing apparatus includes the following. A processor is configured to: acquire a medical image obtained by capturing an image of an observation target; detect a region of interest from the medical image; and cause a display to display report information and the medical image, the report information reporting that the region of interest has been detected. A screen displayed on the display has a first region in which the medical image is displayed, and a second region provided outside the first region. The second region is divided into four regions by using line segments passing through a center of the first region, and a detected location of the region of interest is reported by displaying the report information in one of the four regions.

Abstract: There are disclosed a method, apparatus, electronic device, and medium for rendering. The method for rendering comprises: determining colors of predetermined areas on a target object, the number of predetermined areas being at least a predetermined number, which is greater than 1; determining a target color superimposed to a target position according to the color of each predetermined area; superimposing the target color at the target position.

Abstract: A tag characterizing a portion of a multi-view interactive digital media representation (MVIDMR) may be determined by applying a grammar to natural language data. The MVIDMR may include images of an object and may be navigable in one or more dimensions. An object model location for the tag identifying a location within a three-dimensional object model may be determined by applying the grammar to the natural language data. The tag may then be applied to the MVIDMR by associating it with two or more of the images at positions determined based on the object model location.

Abstract: Systems and methods are provided for rendering hair. The systems and methods include receiving hair spline data comprising coordinates of a plurality of hair strands; selecting a first hair strand of the plurality of hair strands; retrieving coordinates of the first hair strand; identifying based on the respective coordinates of the plurality of hair strands a second hair strand that is adjacent to the first hair strand; storing a reference to the second hair strand in association with the coordinates of the first hair strand; and generating one or more additional hair strands between the first hair strand and the second hair strand based on the coordinates of the first hair strand and the reference to the second hair strand.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. Input data is received from a first device that is indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device. The virtual content item may comprise one or more media objects. Based on receiving the input data, the second device is caused to present the one or more media objects overlaid on the real-world environment that is visible to the second user via the second device.

Abstract: A method for arranging clothing patterns implemented on a computing device is provided. The method comprise: determining sewing relationships between clothing patterns to be transformed into a digital garment on a 3D avatar; performing iterations to process the clothing patterns, each of the iterations comprising: selecting one or more clothing patterns to be processed in the iteration from the clothing patterns based on the sewing relationships; and arranging the one or more clothing patterns to warp around the 3D avatar; and generating the digital garment that is worn on the 3D avatar by sewing the arranged clothing patterns corresponding to the iterations based on the sewing relationships.

Abstract: A mirror assembly (100) comprising: a reflective portion (110) configured to reflect incident light; a display unit (120) arranged to overlap the reflective portion, wherein the display unit is configured to display at least one of a visual element and a blurred effect element; and a control unit (130). The control unit (130) is configured to: receive instruction to display a visual element or instruction to display a blurred effect element; determine, based on the received instruction, a blur region for the visual element or a motion trajectory of the blurred effect element, wherein the blur region or the blurred effect element is larger than a display resolution of the display unit; and control the display unit to display the visual element with the determined blur region or to display the blurred effect element in the determined motion trajectory in a field of view of a user.

Abstract: An expert system processes communication data to extract entities and topics. The expert system generates relationship graphs and relationship scores between the entities and topics. The system can identify entities that are expert in a given topic. The expert system uses a knowledge engine to provide different services and applications.

Abstract: Various implementations disclosed herein include devices, systems, and methods for providing situational awareness for HMD users. Some implementations involve providing a CGR experience to a first user wearing an HMD in a physical environment. Audio data or image data is obtained from a sensor at the physical environment during the CGR experience and an emotional state or direction of attention of a second person other than the first user is detected based on the audio data or image data. A notification or other change is provided in the CGR experience based on detecting the emotional state or direction of attention of the second person.

Abstract: An alternate reality, such as virtual reality or augmented reality, environment can experience optimized performance with a data system arranged with an interaction device connected to a virtual reality assembly. Base content and user content can respectively be downloaded and stored to a local data storage of the virtual reality assembly. The content may be utilized to proactively generate comprehensive content that consists of merged aspects of the base content and the user content. The comprehensive content can then be executed to create an immersive digital reality conveyed to a user via the interaction device.

Abstract: A method and system of operating a vehicle includes a first sensor generating first sensor data for an object comprising a first bounding box from a first sensor. The first sensor data comprising a first confidence score. A second sensor generates second sensor data for the object comprising a second bounding box from a second sensor different than the second sensor. The second sensor data comprises a second confidence score. A bounding box circuit is programmed to generate a third confidence score for the object based on the first sensor data and the second sensor data and utilize the first sensor data, the second sensor data and the third confidence score to control operation of a vehicle system.

Abstract: The disclosure notably relates to a three-dimensional (3D) model. The data structure includes one delegated data object. The one delegate data object includes input parameters specific to a type of the delegated data object, and at least one operator specific to the type of the delegated data object for generating an output topology. The data structure also includes an output topology generated by the operator.

Abstract: A method of generating a custom three-dimensional model of a bone is disclosed. A 2D image of the bone is obtained and an orientation and scale of the 2D image are aligned to a pre-determined coordinate system. Based on the 2D image, a representative bone is identified from a library of representative bones that are aligned to the pre-determined coordinate system. Based on the 2D image, an ideal view of a 3D model of the representative bone is selected. Modifications may be made to the 3D model by using additional representative bones from the library. A custom three-dimensional model of the bone is thereby generated.

Abstract: Systems, apparatuses and methods may provide a way to monitor, by a process monitor, one or more processing factors of one or more client devices hosting one or more user sessions. More particularly, the systems, apparatuses and methods may provide a way to generate, responsively, a scene generation plan based on one or more of a digital representation of an N dimensional space or at least one of the one or more processing factors, and generate, by a global scene generator, a global scene common to the one or more client devices based on the digital representation of the space. The systems, apparatuses and methods may further provide for performing, by a local scene generator, at least a portion of the global illumination based on one or more of the scene generation plan, or application parameters.

Abstract: The present disclosure describes techniques for generating content based on rhythm. The techniques comprises acquiring a plurality of images comprising an object with movements in the plurality of images; determining whether at least one portion of the at least one part of the object in a first image aligns with a target image overlaid on the first image and whether the at least one portion aligns with the target image at a time proximate to a first rhythmic point of a playback of a selected piece of music; segmenting the at least one part of the object from the first image in response to determining that the at least one portion aligns with the target image at the time proximate to the first rhythmic point of the playback of the selected piece of music; and generating a first overlay based on the at least one part of the object.

Abstract: The technology disclosed relates to a method of realistic rendering of a real object as a virtual object in a virtual space using an offset in the position of the hand in a three-dimensional (3D) sensory space. An offset between expected positions of the eye(s) of a wearer of a head mounted device and a sensor attached to the head mounted device for sensing a position of at least one hand in a three-dimensional (3D) sensory space is determined. A position of the hand in the three-dimensional (3D) sensory space can be sensed using a sensor. The sensed position of the hand can be transformed by the offset into a re-rendered position of the hand as would appear to the wearer of the head mounted device if the wearer were looking at the actual hand. The re-rendered hand can be depicted to the wearer of the head mounted device.

Abstract: An embodiment for creating an avatar of an online viewer during a live video broadcast is provided. The embodiment may include receiving a number of in-person viewers at an event. The embodiment may also include identifying a number of online viewers watching the event remotely. The embodiment may further include in response to determining the number of in-person viewers at the event is below a threshold, identifying a location of the in-person viewers at the event. The embodiment may also include analyzing reactions of the online viewers to scenarios of the event. The embodiment may further include creating an avatar for each of the online viewers. The embodiment may also include populating each empty seat at the event with the created avatar for each online viewer. The embodiment may further include displaying the created avatars occupying the empty seats to the online viewers.