Abstract: To enable you to take animations in a virtual space, an animation production method comprising: placing a first and second objects and a virtual camera in a virtual space; controlling an action of the first object in response to an operation from the first user; controlling an action of the second object in response to an operation from the second user; and controlling the camera in response to an operation from the first or second user or the second user to shoot the first and second objects.

Abstract: Ray tracing hardware accelerators supporting motion blur and moving/deforming geometry are disclosed. For example, dynamic objects in an acceleration data structure are encoded with temporal and spatial information. The hardware includes circuitry that test ray intersections against moving/deforming geometry by applying such temporal and spatial information. Such circuitry accelerates the visibility sampling of moving geometry, including rigid body motion and object deformation, and its associated moving bounding volumes to a performance similar to that of the visibility sampling of static geometry.

Abstract: Systems and methods for image-based guidance for facilitating navigation of tubular networks. A region of interest in three-dimensional image data may first be segmented. An endoscopic instrument may be detected in two-dimensional intraoperative image data of the region of interest. A centerline of the detected endoscopic instrument may then be determined. The endoscopic instrument and the centerline may be backprojected to generate a three-dimensional backprojected volume. A device path of the endoscopic instrument may be generated based at least in part on the three-dimensional backprojected volume and the three-dimensional image data.

Abstract: Systems, devices and processes and described herein to improve the generation of video content in video production systems. In general, the systems, devices and processes facilitate the incorporation of remotely generated user telestration inputs into output video streams generated by the video production systems. In one embodiment user telestration inputs are received at a control device. Minimum capture shapes corresponding to the user telestration inputs are then determined and images corresponding to the minimum capture shape are captured. The captured images are then transmitted from the control device to the video access point device. At the video access point device the captured images can then be combined with previously captured and transmitted images and overlaid with a selected input video stream. The video input stream with the overlaid image can then be transmitted as an output video stream.

Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to discover, select, explore, and manipulate objects within the modeled worlds used to generate video content. The RVE system may implement methods that allow users to view and explore in more detail the features, components, and/or accessories of selected objects that are being manipulated and explored. The RVE system may also implement methods that allow users to interact with interfaces of selected objects or interfaces of components of selected objects.

Abstract: An apparatus for configuring an avatar responsive to a content having at least one of a video and an audio signal includes an authoring unit configured to detect one or more events in a content comprising at least one of a video and an audio signal, categorise one or more of the detected events, and generate an event track for the content, the event track comprising one or more of the categorised events associated with a respective time; a selecting unit configured to select a configuration of an avatar to correspond to a respective categorised event of the event track; and an output generator configured to generate control data to configure an avatar in response to a selected configuration.

Abstract: The present disclosure is directed to systems and methods for providing improved tools (e.g., user interfaces) that can be used for managing access permissions to cloud or other network resources. In general, the systems and methods include providing a user interface that can function in at least two modes which together can provide an improved user experience for intuitively and effectively developing code. As an example, the two interface modes can include a builder mode in which the user interface includes one or more interactive elements that enable a user to modularly build a set of computer-readable code that controls access permissions to one or more computing resources and an editor mode in which the user interface allows the user to directly edit the set of computer-readable code.

Abstract: A method, system, and computer program product to manage a network comprising a plurality of interconnected components are described. The method includes obtaining a set of all the components that are part of the network over time, and identifying one or more repeating patterns of components among the set of all the components as corresponding lower-level definitions to generate a hierarchical set of all the components. The method also includes obtaining time-varying information regarding topology and operational values within the network, and creating a representation of the network at a set of times based on the hierarchical set of all the components and the time-varying information.

Abstract: Various implementations disclosed herein include devices, systems, and methods for selectively applying a tool and/or a rig to a skeleton of an object based on an upcoming motion. In some implementations, a method includes obtaining, from a memory location, a response characteristic to be exhibited by an object while displaying the object in a computer graphics environment. A tool is selected that allows the object to be manipulated to exhibit the response characteristic in the computer graphics environment. The tool is associated with a skeleton of the object. A manipulation of the object is displayed within the computer graphics environment in accordance with the response characteristic after associating the tool with the skeleton of the object.

Abstract: A location-based augmented-reality system to generate and cause display of augmented-reality content that includes three-dimensional typography, based on a perspective, and location of a client device.

Abstract: Techniques described herein take character glyphs as input and generate a text-on-a-path text object that includes the character glyphs arranged in a determined order along a path. For instance, a method described herein includes accessing character glyphs in input data. The method further includes determining an order for the character glyphs based on relative positions and orientations of the character glyphs in the input data. The method further includes generating a path for the character glyphs, based on the order, and associating the path with the character glyphs. Further, the method includes generating a text object that includes the set of character glyphs arranged in the order along the path.

Abstract: An electronic chip, a chip assembly, a computing device, and a method are described. The electronic chip comprises a plurality of processing cores and at least one hardware interface coupled to at least one of the one or more processing cores. At least one processing core implements a game engine and/or a simulation engine and one or more processing cores implements an artificial intelligence engine, whereby implementations are on-chip implementations in hardware by dedicated electronic circuitry. The one or more game and/or simulation engines perform tasks on sensory data, generating data sets that are processed through machine learning algorithms by the hardwired artificial intelligence engine. The data sets processed by the hardwired artificial intelligence engine include at least contextual data and target data, wherein combining both data and processing by dedicated hardware results in enhanced machine learning processing.

Abstract: A method of network-based media processing (NBMP) can include receiving a function description of a media processing function from a function repository at a workflow manager in an NBMP system. The function description can include a configuration descriptor providing configuration information of parameters for the media processing function. The parameters can have logical relationships represented by a parameter representation graph constructed according to a set of rules. The media processing function can be instantiated as a media processing task that is part of a workflow. The media processing task can be configured based on the configuration information of the parameters in the configuration descriptor.

Abstract: Embodiments of the present invention provide a position-based dynamics approach for simulating objects using a set of points and constraints, applied as equations that restrict the relative motion of bodies. Forces are applied to the points to move them, and the constraints ensure that the points will not move in a way that is inconsistent with rules of the simulation. The present invention improves upon existing PBD approaches by using regularized constraints that directly correspond to well-defined energy potentials, and which can advantageously be solved independent of time step and iteration count.

Abstract: The present disclosure provides an image warping method and an image warping device, including: obtaining an image or a video; identifying at least one target portion of a to-be-warped portrait in the image or the video; and performing a warping process on the target portion using a preset warping algorithm, where the warping process includes one or more of the following processes: enlarging, narrowing down, or shifting. In this way, a portrait in the image or the video can be beautified automatically, without a manual beautification of the image from a user, making the beautification more intelligent and simpler, thereby improving the user experience. Moreover, according to the method of the present disclosure, a warping process can be performed on an image or a video online in real time, or performed on a stored image or a stored video offline, allowing the image warping method to be more widely used.

Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.

Abstract: Systems and methods for reconstructing a motion-compensated magnetic resonance image are presented. In certain implementations, a computer-implemented method is provided. The method may include a plurality of operations, including receiving a set of k-space data from a magnetic resonance imaging device, dividing the set of k-space data into a plurality of groups, performing a plurality of initialization operations, performing a first iterative process until a first criteria for the first iterative process is achieved for a current scale of motion estimation, performing a second iterative process until a second criteria for the second iterative process is achieved, and outputting a motion-compensated magnetic resonance image reconstructed in accordance with a predetermined scale of motion estimation.

Abstract: A retrieval device includes one or more processors. The processors acquire trajectory information indicating a movement trajectory of a target in time-series images. The processors acquire situation information indicating a peripheral situation of the target in the time-series images. The processors acquire a retrieval query containing a movement trajectory and a peripheral situation. The processors retrieve an image matching with the retrieval query among images contained in the time-series images based on the trajectory information and the situation information.

Abstract: A state control method includes detecting an operation execution event used for requesting to operate on a first object in a first application. The method also includes determining whether a next node of a current node of the first object in a hybrid state machine is a first state node or a first behavior-tree node. Nodes in the hybrid state machine includes at least a state node and a behavior-tree node, and a state change relationship exists among the nodes in the hybrid state machine. The method further includes, when it is determined that the next node is the first state node, performing on the first object an operation in a first state corresponding to the first state node; and, when it is determined that the next node is the first behavior-tree node, performing on the first object an operation in a first behavior-tree corresponding to the first behavior-tree node.

Abstract: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.

Abstract: A system to track orientations of parts of a user based on both images and inertial measurement units (IMUs). For example, the system receives images showing a portion of the user wearing sensor modules. The system receives a first set of orientation measurements generated by the sensor modules attached to some parts of the user. The system determines the second set of orientation measurements of one or more features of the portion of the user from the images. The system provides the first set of orientation measurements and the second set of orientation measurements as input to an artificial neural network that is configured to predict orientation measurements of the one or more other parts of the user that would be measured by additional sensor modules if the additional sensor modules were to be attached to the other parts of the user.

Abstract: An analysis system analyzes a state of a person and includes a terminal configured to be worn on the person's body. The terminal includes an acceleration sensor, a storage unit, and a processing unit. The processing unit determines whether each value contained in the time series data is in a first state in which the value is equal to or greater than the threshold or in a second state in which the value is less than the threshold. The processing unit also determines a duration which is a period of time during which the first state continues. The processing unit quantifies a brain state of the person on the basis of the duration.

Abstract: Motion retargeting with kinematic constraints is implemented in a digital medium environment. Generally, the described techniques provide for retargeting motion data from a source motion sequence to a target visual object. Accordingly, the described techniques position a target visual object in a defined visual environment to identify kinematic constraints of the target object relative to the visual environment. Further, the described techniques utilize an iterative optimization process that fine tunes the conformance of retargeted motion of a target object to the identified kinematic constraints.

Abstract: A method of and system for recreating a real world pose or aligning a real world object in a virtual space, the method including: prompting a user to successively place a device at a plurality of positions/alignments associated with a plurality of physical points associated with a body of the user, a body of another, or an object; capturing the plurality of positions/alignments with respect to a real world frame of reference; translating the plurality of positions/alignments with respect to the real world frame of reference to a frame of reference in virtual space; and recreating a pose of the body of the user, a pose of the body of the other, or an alignment of the object in the virtual space using the translated plurality of positions/alignments.

Abstract: A system and method for providing a dynamic comparative network health analysis of a network environment, the method comprising: obtaining dynamic and static network environment parameters of a plurality of network environments; creating network environment profiles of each network environment of the plurality of network environments based on the dynamic and static network environment parameters; performing comparative analysis of network environment profiles of a first network environment of the plurality of network environments with network environment profiles of a second network environment of the plurality of network environments to generate a comparative analysis; based on the comparative analysis, determining whether to reconfigure the first network environment or create a new network environment; if it is determined to reconfigure the first network environment, generating a remedial plan for the first network environment; if it is determined to create a new network environment, generating a new plan f

Abstract: Computer-implemented design tool functions are described herein for automatically performing edits across different portions of one or more design layouts. According to an example, a method includes causing a display device to display a design interface used to edit a design layout, which includes at least a first frame and a second frame. The method includes receiving first input to initiate a multi-edit mode in the design interface and receiving second input to perform a first operation to edit a first node in the first frame. The method further includes identifying, based at least in part on the second input, a second node in the second frame and corresponding to the first node in the first frame. In this example, the method includes performing, based at least in part on the second input, the first operation to edit the first node in the first frame and a second operation to edit the second node in the second frame.

Abstract: Provided is a device including: a controller configured to obtain illumination information about illumination around the device, determine, based on the illumination information, a thickness of an outline of an object included in content reproduced by the device, and perform image processing on the content such that the outline of the object is represented as having the determined thickness; and a display displaying the content on which the image processing is performed.

Abstract: A method and system for providing a hybrid block and text-based programming environment. The hybrid block and text-based programming environment provides a software development tool suitable for users of different programming skill levels to write and understand code. The hybrid programming environment enables a user to view and edit source code through multiple graphical representative displays of the source code in a manner not previously achievable. Each of the graphical representative displays is linked to a particular programming view that has a unique set of rules related to the functionality of the displayed graphical elements to enable the more comprehensive functionality. The graphical representative displays provide a tool to educate novice programmers as they become more proficient and assist in the transition between block-based and textual representations.

Abstract: In an embodiment there is provided a user interface device for interfacing a user with a computer, the computer comprising at least one processor to generate instructions for display of a graphical environment of a virtual reality simulation. The user interface device includes a sensor for detecting activation and/or a sensor for detecting proximity of a body part of the user (e.g., hand). At least partially based on detection by one of these sensors, a transition between virtual reality states is triggered.

Abstract: Processes for reviewing and editing a computer-generated animation are provided. In one example process, multiple images representing segments of a computer-generated animation may be displayed. In response to a selection of one or more of the images, geometry data associated with the corresponding segment(s) of computer-generated animation may be accessed. An editable geometric representation of the selected segment(s) of computer-generated animation may be displayed based on the accessed geometry data. In some examples, previously rendered representations and/or geometric representations of the same or other segments of the computer-generated animation may be concurrently displayed adjacent to, overlaid with, or in any other desired manner with the displayed geometric representation of the selected segment(s) of computer-generated animation.

Abstract: Disclosed herein is a motion modeling method and device using a virtual joint sphere. The motion modeling method using the virtual joint sphere includes (a) modeling a 3D virtual character, wherein the 3D virtual character sets a virtual joint sphere for each body part; and (b) forming a trajectory for a motion of a target body part of the 3D virtual character as a specific motion is performed on a surface of the virtual joint sphere assigned to the target body part, when reconstructing the motion of the 3D virtual character according to the specific motion.

Abstract: To reduce a burden on a user in editing tree structure data with a text editor. When a selection range is designated on an edit screen, a node selection unit of a tree structure data editing device selects one or more node IDs in the tree structure data, based on the position of the selection range. When a paste target for the selection range is designated on the edit screen, a connection target determination unit determines a connection target node ID in the tree structure data, based on the position of the paste target. A tree structure data editing unit edits the tree structure data such that the node or nodes identified by the one or more node IDs is/are connected to the node identified by the connection target node ID. A conversion unit convers the tree structure data edited by the tree structure data editing unit into text data. A display control unit updates the edit screen displayed, based on the text data converted by the conversion unit.

Abstract: A technique is described for clustering graphics objects in a graphic artwork based on affine variance. Geometry data associated with an input set of graphics objects can be processed to identify pairs of graphics objects that are affine variants of each other. The identified affine variants can then be clustered into one or more affine groups. Similar graphics objects in a given affine group can then be represented using a base geometry and a corresponding transformation matrix. Accordingly, the overall geometric complexity of the graphic artwork can be simplified thereby providing various benefits such as reducing file size and improving rendering performance.

Abstract: Embodiments of the present application disclose a method and an apparatus for controlling placement of a virtual character and a storage medium. The method includes: receiving a first instruction in a virtual reality (VR) scene, the first instruction indicating moving a virtual character from a first position by a designated movement; determining a second position by the designated movement from the first position in response to the first instruction; removing the virtual character from the first position; and placing the virtual character at the second position, the virtual character not appearing between the first position and the second position after being removed from the first position.

Abstract: Examples of systems, devices, and methods as described in this disclosure include a shoulder motion measurement system comprising a mounting device comprising a receptacle configured to hold an electronic device at a fixed orientation relative to a scapula of a patient, wherein the mounting device comprises one or more structures configured for handling by a user when aligning the shoulder motion measurement system against the patient.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

Abstract: A system including: a plurality of sensor modules having inertial measurement units and attached to different parts of a user (e.g., head, hands, arms) to measure their orientations; a plurality of optical marks attached to the user; a camera attached to the user; and a computing device configured to correct an accumulated error by detecting the optical marks in an image generated by the camera and identifying mismatches in directions of the optical marks (or the sensors, or parts of the users) as measured and/or calculated based on the image and the corresponding directions of the optical marks (or the sensors, or parts of the users) as measured and/or calculated from the orientation measurements generated by the sensor modules.

Abstract: The present invention allows to estimate a continuous surface that defines a boundary surface of an object using image data, even if the image data was acquired by an imaging method in which image information on the boundary surface of the object is limited. An image processing apparatus according to the present invention includes a calculating unit that calculates a brightness gradient of a voxel group constituting volume data which represents a reconstructed image, and an estimating unit that estimates by using the brightness gradient a continuous surface which defines a boundary surface of an object corresponding to the volume data.

Abstract: Method for providing content search interface in electronic device including executing content on screen; displaying first graphic user interface (GUI) including a first object indicating starting point of content, second object indicating ending point of content, and third object indicating point of playback of content, wherein first object and second object are near each other and third object is displayed on curved path connecting first object and second object; in response to receiving first user input on first GUI, moving third object on curved path; in response to receiving second user input, displaying second GUI forming angle within selected range on curved path, wherein second GUI comprises plurality of discrete labels representing different speeds or rates at which third object moves on curved path; and in response to receiving third gesture input on second GUI while content is executed, changing speed at which third object moves on curved path.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.

Abstract: A computer system is used to host a virtual reality universe process in which multiple avatars are independently controlled in response to client input. The host provides coordinated motion information for defining coordinated movement between designated portions of multiple avatars, and an application responsive to detect conditions triggering a coordinated movement sequence between two or more avatars. During coordinated movement, user commands for controlling avatar movement may be in part used normally and in part ignored or otherwise processed to cause the involved avatars to respond in part to respective client input and in part to predefined coordinated movement information. Thus, users may be assisted with executing coordinated movement between multiple avatars.

Abstract: A posture determination method applicable to an electronic system including an image capturing device is provided. The image capturing device is set up corresponding to a target. The posture determination method includes: acquiring a plurality of consecutive images captured by the image capturing device; performing a motion detection on the consecutive images; determining whether an image content of the consecutive images is static after a movement according to a detection result of the motion detection; and determining a posture of the target when the image content is static after the movement. In addition, the electronic system and a non-transitory computer-readable recording medium using the method are also provided.

Abstract: An embodiment provides a mobile application that animates change information in a way that specifically indicates a change in workflow information for various users. This animation of change information permits users, which are often busy healthcare professionals, to be quickly apprised of relevant changes to workflow status. The mobile application also allows users to communicate change information, e.g., for updating the status of a workflow item, which may then be propagated throughout a network, including mobile devices.

Abstract: The present disclosure relates to methods, apparatus or systems for formatting of backward compatible immersive video streams. At least one legacy rectangular video is captured from an immersive video obtained from a source (82). A set of camera control data are used to determine which parts of the immersive video will constitute legacy videos (84). These part are removed from the immersive video (83) and every prepared videos are packaged in a stream (85). The structure from the stream is a container. Information data about the location and size of removed parts may be added in the stream.

Abstract: An embodiment provides a mobile application that animates change information in a way that specifically indicates a change in workflow information for various users. This animation of change information permits users, which are often busy healthcare professionals, to be quickly apprised of relevant changes to workflow status. The mobile application also allows users to communicate change information, e.g., for updating the status of a workflow item, which may then be propagated throughout a network, including mobile devices.

Abstract: According to one aspect of the invention, there is provided a method for assisting object control, comprising the steps of: specifying, in a real-world coordinate system, a control vector corresponding to a gesture or manipulation performed by a user; determining an object indicated by the control vector as a target object to be controlled by the gesture or manipulation performed by the user; performing mapping for specifying a control coordinate point corresponding to a magnitude or direction of the control vector in a target object reference coordinate system defined on the basis of a characteristic of the target object; and determining a control command to be applied to the target object, with reference to the control coordinate point specified by the mapping.

Abstract: A method, a device, and a non-transitory storage medium are described in which a machine learning-based device placement and configuration service is provided. The machine learning-based device placement and configuration system uses regression models calculated from installation and performance data. The regression model includes data associated with sites at which video cameras were previously installed and tested for detection accuracy levels possibly associated with a service area. With these generated models, information about the physical space, and desired performance criteria, designers optimize camera number, camera placement, and geo-location camera parameters. The device placement and configuration service may find an optimal camera placement and geo-location camera parameter set which satisfy certain criteria. The geo-location parameters include position, height, heading, pitch, and roll.

Abstract: Apparatus and method for using light fields for virtual visualization and virtual navigation.

Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.

Abstract: An audiovisual media composition system is provided for creating photographs, videos, and live streams of one or more assets sourced from different geographic locations. The audiovisual media composition system may include an media parsing component, transposition component, communication component, interface aspects, and/or additional components and features. A method for creating photographs, videos, and live streams of one or more assets sourced from different geographic locations using the audiovisual media composition system is also provided.