Abstract: The present disclosure describes techniques for generating content based on rhythm. The techniques comprises acquiring a plurality of images comprising an object with movements in the plurality of images; determining whether at least one portion of the at least one part of the object in a first image aligns with a target image overlaid on the first image and whether the at least one portion aligns with the target image at a time proximate to a first rhythmic point of a playback of a selected piece of music; segmenting the at least one part of the object from the first image in response to determining that the at least one portion aligns with the target image at the time proximate to the first rhythmic point of the playback of the selected piece of music; and generating a first overlay based on the at least one part of the object.

Abstract: The technology disclosed relates to a method of realistic rendering of a real object as a virtual object in a virtual space using an offset in the position of the hand in a three-dimensional (3D) sensory space. An offset between expected positions of the eye(s) of a wearer of a head mounted device and a sensor attached to the head mounted device for sensing a position of at least one hand in a three-dimensional (3D) sensory space is determined. A position of the hand in the three-dimensional (3D) sensory space can be sensed using a sensor. The sensed position of the hand can be transformed by the offset into a re-rendered position of the hand as would appear to the wearer of the head mounted device if the wearer were looking at the actual hand. The re-rendered hand can be depicted to the wearer of the head mounted device.

Abstract: An embodiment for creating an avatar of an online viewer during a live video broadcast is provided. The embodiment may include receiving a number of in-person viewers at an event. The embodiment may also include identifying a number of online viewers watching the event remotely. The embodiment may further include in response to determining the number of in-person viewers at the event is below a threshold, identifying a location of the in-person viewers at the event. The embodiment may also include analyzing reactions of the online viewers to scenarios of the event. The embodiment may further include creating an avatar for each of the online viewers. The embodiment may also include populating each empty seat at the event with the created avatar for each online viewer. The embodiment may further include displaying the created avatars occupying the empty seats to the online viewers.

Abstract: A simulation object identity recognition method includes displaying, by an electronic device, a simulation object, determining, by the electronic device, whether the simulation object is valid, and notifying by the electronic device, a user of a determining result to improve a user alertness and to avoid disclosing personal information by the user under inducement of an invalid simulation object.

Abstract: A medical image processing apparatus includes the following. A processor is configured to: acquire a medical image obtained by capturing an image of an observation target; detect a region of interest from the medical image; and cause a display to display report information and the medical image, the report information reporting that the region of interest has been detected. A screen displayed on the display has a first region in which the medical image is displayed, and a second region provided outside the first region. The second region is divided into four regions by using line segments passing through a center of the first region, and a detected location of the region of interest is reported by displaying the report information in one of the four regions.

Abstract: Systems, methods and software are provided for aiding in positioning of objects in a surgical environment. A tracker is rigidly affixed to a surgical object. A camera has a field of view and senses positions of the tracker in the field of view. Controller(s) provide a zone positioned within the field of view at a location that is static relative to the field of view such that the zone is located independent of the sensed positions of the tracker. The zone defines a range of acceptable positions for the tracker relative to a position of the camera. Controller(s) acquire positions of the tracker as the surgical object is moved throughout a range of motion and enable evaluation of the positions of the tracker throughout the range of motion relative to the zone to aid in positioning of one or more of: the camera, the tracker, or the surgical object.

Abstract: A feedback processing module includes a memory configured to store feedback received from an encoder. The feedback includes parameters associated with encoded graphics content generated by a graphics engine. The feedback processing module also includes a processor configured to generate configuration information for the graphics engine based on the feedback. The graphics engine is configured to execute a workload based on the configuration information. In some cases, the feedback processing module is also configured to receive feedback from a decoder that is used to decode the graphics content that is encoded by the encoder and generate the configuration information based on the feedback received from the decoder.

Abstract: Various implementations disclosed herein include devices, systems, and methods for modifying an environment based on sound. In some implementations, a device includes one or more processors, a display and a non-transitory memory. In some implementations, a method includes displaying a computer graphics environment that includes an object. In some implementations, the method includes detecting, via an audio sensor, a sound from a physical environment of the device. In some implementations, the sound is associated with one or more audio characteristics. In some implementations, the method includes modifying a visual property of the object based on the one or more audio characteristics of the sound.

Abstract: According to various embodiments, component information may be identified for each input image of an object. The component information may indicate a portion of the input image in which a particular component of the object is depicted. A viewpoint may be determined for each input image that indicates a camera pose for the input image relative to the object. A three-dimensional skeleton of the object may be determined based on the viewpoints and the component information. A multi-view panel corresponding to the designated component of the object that is navigable in three dimensions and that the portions of the input images in which the designated component of the object is depicted may be stored on a storage device.

Abstract: Systems and methods are provided for rendering hair. The systems and methods include receiving hair spline data comprising coordinates of a plurality of hair strands; selecting a first hair strand of the plurality of hair strands; retrieving coordinates of the first hair strand; identifying based on the respective coordinates of the plurality of hair strands a second hair strand that is adjacent to the first hair strand; storing a reference to the second hair strand in association with the coordinates of the first hair strand; and generating one or more additional hair strands between the first hair strand and the second hair strand based on the coordinates of the first hair strand and the reference to the second hair strand.

Abstract: Techniques for occluding displayable content on a portable electronic device. An EDM device of the portable electronic device may capture a world distance map comprising a plurality of distances to a plurality of points. A camera of the portable electronic device may capture a camera image containing the plurality of points. A geospatial position of a GNSS receiver may be detected. A geospatial position of the camera may be calculated based on the geospatial position of the GNSS receiver. An angle sensor may detect an orientation of the camera. A model image may be generated based on a 3D model, the orientation of the camera, and the geospatial position of the camera. The model image and/or the camera image may be occluded based on the world distance map and the 3D model. A superimposed image comprising the camera image and the model image may be generated and displayed.

Abstract: An image processing method and a device, where the image processing method is performed by a terminal having a digital zoom function, and the method includes determining a target zoom magnification based on a selection input of a user, collecting a to-be-processed image, and processing the to-be-processed image using a target super-resolution convolutional neural network model to obtain a processed image corresponding to the target zoom magnification, where the target super-resolution convolutional neural network model is obtained by training a super-resolution convolutional neural network model using a high-definition training image, a low-definition training image, and a mask image.

Abstract: Systems and methods provide for efficiently and accurately determining a simplified path that conforms to the geometry of an original path by simultaneously minimizing the deviation from the original path and reducing the number of anchor points in the simplified path. A simplified path may be iteratively generated by updating parametric values and anchor points for candidate simplified paths at epochs. A deviation in distance between points on the original path and corresponding points on candidate paths may be iteratively decreased to ensure that the resulting simplified path follows the geometry of the original path to a predetermined threshold. Continuity constrains can also be applied to ensure smoothness of the simplified path.

Abstract: A system for sharing settings for modifying images is described. In an example embodiment, an image-modification application may display an image and editing elements in a user interface programed to edit image-adjustment settings that affect aspects of the image on the user interface. The image-modification application may receive user inputs modifying the editing elements and, in response, modify image-adjustment settings and apply the modified image-adjustment settings to the visual aspects of the image. In some embodiments, the image-modification application may receive a first user input requesting to export a settings file including the modified image-adjustment settings, generate the settings file based on the modified image-adjustment settings, and export the settings file.

Abstract: Techniques for augmenting a reality captured by an image capture device are disclosed. In one example, a system includes an image capture device that generates a two-dimensional frame at a local pose. The system further includes a computation engine executing on one or more processors that queries, based on an estimated pose prior, a reference database of three-dimensional mapping information to obtain an estimated view of the three-dimensional mapping information at the estimated pose prior. The computation engine processes the estimated view at the estimated pose prior to generate semantically segmented sub-views of the estimated view. The computation engine correlates, based on at least one of the semantically segmented sub-views of the estimated view, the estimated view to the two-dimensional frame. Based on the correlation, the computation engine generates and outputs data for augmenting a reality represented in at least one frame captured by the image capture device.

Abstract: Described is a system for learning object labels for control of an autonomous platform. Pseudo-task optimization is performed to identify an optimal pseudo-task for each source model of one or more source models. An initial target network is trained using the optimal pseudo-task. Source image components are extracted from source models, and an attribute dictionary of attributes is generated from the source image components. Using zero-shot attribution distillation, the unlabeled target data is aligned with the source models similar to the unlabeled target data. The unlabeled target data are mapped onto attributes in the attribute dictionary. A new target network is generated from the mapping, and the new target network is used to assign an object label to an object in the unlabeled target data. The autonomous platform is controlled based on the object label.

Abstract: A bar is displayed in a second region. Display of the bar starts in a longest state when an undetected state in which a region of interest is not detected transitions to a detected state in which the region of interest is detected, and display in the longest state is maintained until the detected state transitions to the undetected state. When the detected state transitions to the undetected state, the bar is reduced in length over time. When a predetermined time elapses, the length of the bar becomes 0, and the bar disappears. In addition, in a case where the undetected state transitions to the detected state before the bar disappears, the length of the bar returns to the longest.

Abstract: An unmanned aerial vehicle (UAV) may couple to a sensor payload device that includes cameras, radar, lidar, and/or other sensors. The UAV, coupled to the sensor payload device, may fly within the airspace of and/or around a property and capture images and/or sensor measurements of the property. The images and sensor measurements may be certified so that they may be verified as unaltered by viewers. A 3D representation of the property may be generated, and defects in the property may be detected by comparing the 3D representation to media depicting property defects. A report identifying the defects may be generated.

Abstract: The present invention relates to a method for color visualization and separation of a natural and medical image comprising pixels defined by color pixel vector a=[a1a2, a3] in a Cartesian color space (e.g. RGB), where the color pixel vector is represented by a pure quaternion q=+a1i+a2j+a3k with i,j, k satisfying: i2=j2=k2=ijk=?1, ij=?ji=k,jk=?kj=i, ki=?ik=j and the image is decomposed into q+ and q using the orthogonal 2D planes split concept according to: (formula (I)) wherein/and g are pure unit quaternions or f and g describe interactively determined or computed colors (s1, s2). The method allows not only visualizing and separating certain colors in a digital image in a rapid fashion, but also permits a flexible definition pertinent to the kind of colors that can be visualized or separated by defining the corresponding decompositions by means of pure unit quaternions/and g. Colors s1, s2 can be defined manually or computed automatically from the image.

Abstract: A medical image processing apparatus according to embodiments includes processing circuitry. The processing circuitry acquires three-dimensional medical image data in which a structure of a subject is rendered. The processing circuitry sets an eye point and an eye direction in the three-dimensional medical image data, generates two-dimensional first medical image data from the three-dimensional medical image data, and generates two-dimensional second medical image data in which display manners differ between a first portion on the opposite side to the eye point side in the eye direction of the structure rendered in the two-dimensional first medical image data and a second portion on the eye point side of the structure rendered in the two-dimensional first medical image data. The processing circuitry displays a medical image represented by the second medical image data on a display.