Abstract: Systems, computer-implemented methods, and computer program products for transforming a source distribution to a target distribution. A system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a sampling component that receives a source distribution having a source sample and a target distribution having a target sample. The computer executable components can further comprise an optimizer component that employs a neural network to find a critic that dynamically discriminates between the source sample and the target sample, while constraining a gradient of the neural network. The computer executable components can further comprise a morphing component that generates a first product distribution by morphing the source distribution along the gradient of the neural network to the target distribution.

Abstract: Mental state data is collected as a person interacts with a game played on a machine. The mental state data includes facial data, where the facial data includes facial regions or facial landmarks. The mental state data can include physiological data and actigraphy data. The mental state data is analyzed to produce mental state information. Mental state data and/or mental state information can be shared across a social network or a gaming community. The affect of the person interacting with the game can be represented to the social network or gaming community in the form of an avatar. Recommendations based on the affect resulting from the analysis can be made to the person interacting with the game. Mental states are analyzed locally or via a web services. Based on the results of the analysis, the game with which the person is interacting is modified.

Abstract: A method and apparatus are disclosed for generating an avatar in an augmented reality environment on a computing device, associating that avatar with a particular physical location, configuring the avatar to perform certain actions, configuring access rights for the avatar, and then storing the state of the avatar. At a later time, the user of another computing device visits the same physical location, views the physical location through the computing device, and the avatar is inserted into the image on the display of computing device and then performs the actions previously specified.

Abstract: Free space machine interface and control can be facilitated by predictive entities useful in interpreting a control object's position and/or motion (including objects having one or more articulating members, i.e., humans and/or animals and/or machines). Predictive entities can be driven using motion information captured using image information or the equivalents. Predictive information can be improved applying techniques for correlating with information from observations.

Abstract: An information processing device includes: a memory; and a processor coupled to the memory and configured to: estimate a first position of a first joint in a two-dimensional plane based on a color image, and estimate a first positional relationship between the first joint and a second joint coupled to the first joint via a portion in the two-dimensional plane; estimate a second position of the first joint in the two-dimensional plane based on a depth image indicating respective depths of the first joint and the second joint, and estimate a second positional relationship between the first joint and the second joint in a three-dimensional space; and estimate a third position of the first joint in the two-dimensional plane and posture of the portion in the three-dimensional space based on the first position, the first positional relationship the second position, and the second positional relationship.

Abstract: A data input device having inertial sensor units, one or more touch input devices, a microcontroller configured to collect sensor data from the inertial sensors and the one or more touch input devices and process the sensor data to generate processed sensor data, and a wireless transceiver configured to transmit the processed sensor data to a host computer. A method can include: receiving sensor data from a handheld device; calculating hand movement characteristics in three dimensional space based on the sensor data; calculating the position and orientation of the components of the handheld device; identifying positions and movements of one or more fingers of a user manipulating the handheld device; identifying a gesture from the positions and movements of one or more fingers of a user manipulating the handheld device; identifying a recognized gesture corresponding to the identified gesture; and dispatching an event notifying the gesture to an application.

Abstract: Techniques are disclosed that allow animators to easily share and reuse character poses such as gestures, expressions, and mouth shapes. When starting on a new shot, an animator often wants a character to have the same pose exactly as the end of the previous shot. According to various embodiments, an animator can easily set up these hookup poses by animator copying a pose directly from a clip of prerecorded media. In one aspect, a pose at the current playhead of the playback tool is copied into a software buffer of an animation tool and then pasted into a character. Thus, the animator may copy a pose exactly as he/she is seeing visually. In various aspects, animators can choose a pose from an entire inventory of available animated videos. This provides a more efficient method for selecting a pose since the user can easily choose and pick a pose from a large inventory of animated videos and bring in a desired pose in a matter of a few mouse clicks.

Abstract: A face is detected and identified within an acquired digital image. One or more features of the face is/are extracted from the digital image, including two independent eyes or subsets of features of each of the two eyes, or lips or partial lips or one or more other mouth features and one or both eyes, or both. A model including multiple shape parameters is applied to the two independent eyes or subsets of features of each of the two eyes, and/or to the lips or partial lips or one or more other mouth features and one or both eyes. One or more similarities between the one or more features of the face and a library of reference feature sets is/are determined. A probable facial expression is identified based on the determining of the one or more similarities.

Abstract: An image processing system includes first circuitry that controls display of an image of a space including one or more materials on a first display, and second circuitry which controls display of an image of each of the materials on a second display, controls specifying of each of the materials in the space, and controls specifying of illumination information and material information associated with a specified material. The second circuitry controls display of the image of the materials based on a specified illumination information, material information, and a relative positional relationship of a light fixture, a display surface of the second display, and a viewer.

Abstract: Systems and methods are provided for assembling and displaying a visual ensemble of musical performances that were created and uploaded from one or more locations that are remote from a host of the network, a director or other administrator reviewing submissions for selection and assembly, or perhaps merely remote from one or more other submissions received over a computer network. The assembled performances include a plurality of submissions, the submissions including performances created and uploaded at one or more locations remote from the location of the director for the assembly and display over the computer network. Systems and methods are also included for mapping one performance against another performance qualitatively, quantitatively, in real-time, or some combination thereof, enabling a musician, or a reviewer of performances, in the assessment of one performance relative to another performance.

Abstract: A system to control the interaction between a user-interface of a teleoperated surgical system and an input device of the teleoperated surgical system, the system comprising a first master controller communicatively coupled to the teleoperated surgical system, a feedback control communicatively coupled to the first master controller, and a display device communicatively coupled to the teleoperated surgical system and configured to display the user interface. The feedback control is configured to restrict the movement of the first master controller based on a state of the user interface changing from a previous state.

Abstract: Plural individual sensor assemblies are engaged with respective parts of a person's body. Each assembly may include accelerometers, magnetometers, and gyroscopes. Sensor data is fused together to get the orientation at each body location. To simplify, the body is assumed to consist of rigid bars of known length connected with ball joints so that once the relative orientations of all bars are given by the respective assemblies, body pose can be computed. Then the body pose is translated as a virtual body into a virtual world either by a ray cast method that anchors a foot of the virtual body to the ground assuming infinite gravity and infinite friction and then translating the other body parts to make the ground contact point fixed, or by implementing an approximate dynamics physics engine on the virtual body. The technique may be used in VR location-based entertainment and for motion capture.

Abstract: A computer-implemented method and system for neural network-based recognition of trade workers present on industrial sites is presented.

Abstract: An animation system and method generates predictive models that are deployed in animations, such as an animation associated with a video game, to predict outcomes resulting from events occurring in the animation, such as interactions between two or more objects in the animation. These predictive models may be generated based at least in part on training data that is generated by running the animation, such as playing a video game, generating parameter values associated with events in the animation, and determining an outcome of the events. The training data may be used to generate predictive models, such as by using machine learning algorithms. The predictive models may then be deployed in the animation, such as in a video game, to make real time or near real-time predictions of outcomes based at least in part on events in the animation.

Abstract: Embodiments of the present disclosure disclose an image compositing method and apparatus, used for harmoniously obtaining and displaying a simulation object composited with an accessory, so that a user has desirable experience and visual enjoyment. The apparatus obtains first data of a skeletal model of a simulation object and skeleton data of an accessory to be composited to the simulation object and determines, based on the first data and the skeleton data of the accessory, a target skeleton that is on the skeletal model and that corresponds to the accessory. The apparatus copies first target data of the target skeleton from the first data and adjusts the first target data of the target skeleton based on preconfigured offset data of the target skeleton to obtain first adjusted data. Finally the apparatus performs shading based on the first adjusted data and the first data to obtain the simulation object composited with the accessory.

Abstract: Operating a touch-screen device includes displaying at least a portion of a keyboard on a touch-screen, detecting a touch on the touch-screen, and detecting movement of the touch on the touch-screen. Operating the touch-screen device also includes moving the displayed keyboard in response to the detected movement of the touch on the touch-screen, detecting a release of the touch from the touch-screen, and assigning a character according to a final location of the touch relative to a location of the displayed keyboard.

Abstract: Techniques are provided for optimizing display processing of layers below a dim layer by a display system. Because the dim layer may partially obstruct, conceal, or otherwise impact a user view of layers below the dim layer, resource-saving techniques may be used in the processing the layers below the dim layer. While these techniques may impact visual quality, a user is unlikely to notice visual artifacts or other reductions in quality in the modified layers below the dim layer. For example, when a dim layer is to be displayed, a GPU can render layers below the dim layer at a lower resolution. Furthermore, the GPU can increase a compression ratio for layers below the dim layer. The low-resolution layers can be scaled-up to an original resolution and the compressed layers can be uncompressed in the display pipeline for display underneath the dim layer.

Abstract: A method, a system and a terminal for identity authentication, and a computer readable storage medium are provided. The method for identity authentication includes: acquiring a facial image of a person to be authenticated, and determining from the facial image facial feature information of the person to be authenticated; determining a suspected object using a face authentication platform according to the facial feature information of the person to be authenticated; acquiring a human body image of the person to be authenticated, and determining from the human body image a plurality of skeleton key points of the person to be authenticated; converting the skeleton key points into feature data; and recognizing an identity of the person to be authenticated according to the feature data of the person to be authenticated and information of the suspected object.

Abstract: A method for of playing an animation image, the method including: obtaining a plurality of images; displaying a first image of the plurality of images; detecting a first event as a trigger to play the animation image for a first object of the first image; and playing the animation image for the first object using the plurality of images.

Abstract: Objects in a virtual space may be non-traversable such that traversal by characters of the virtual space through such objects is not permitted by the physics of the virtual space. Objects may be relocated during interactive gameplay. A navigation map of the virtual space is updated interactively, e.g. after an object has been relocated, by determining which regions are traversable or non-traversable, the boundaries of these regions, and which boundaries separate adjacent traversable regions. The updated navigation map may be queried on behalf of a non-player character in the virtual space, e.g. to determine where to go and/or how to get there.

Abstract: An example of an information processing device generates a game field for each of a plurality of game stages. The information processing device executes a game process of controlling a player object in response to an operation by a user in a game stage for which the game field has been generated. The information processing device determines whether the user has cleared or failed to clear the game stage. In response to a determination that the user has cleared the game stage, the information processing device starts the game process for a next game stage while maintaining a state of the player object at the time of clearing. On the other hand, in response to a determination that the user has failed to clear the game stage, the information processing device starts the game process for a next game stage.

Abstract: An example of an information processing apparatus places, as a component object to be used for collision detection, a slope object having a unit portion in a virtual space. An image representing the virtual space in which the component object is placed is generated. The information processing apparatus places a first slope object having one unit portion in the virtual space, based on a first instruction of the user. The unit portion has a first portion and a second portion. The first portion has a first side and a second side that form an interior angle being an acute angle. The information processing apparatus places a second slope object in the virtual space. The second slope object has a continuous unit portion in which a plurality of the unit portions are connected such that a plurality of the first sides thereof are connected to form a single side.

Abstract: According to various aspects, just-in-time system bandwidth changes may be implemented in hardware to optimize power consumption and performance in an electronic device. More particularly, in a periodic system associated with an electronic device, a bandwidth for a next frame may be configured during a current frame via software operating on the electronic device. Hardware associated with the periodic system may issue a bandwidth change request for the next frame when a current time reaches a bandwidth increase threshold in response to actual processing time associated with the current frame finishing prior to the bandwidth increase threshold, which may be defined relative to a timer deadline that defines when the next frame starts to process.

Abstract: In one aspect, a method for operating a virtual agent will be described. An interaction context is obtained. An agent state is determined based on the obtained interaction context. The agent state indicates an activity of the virtual agent. The emotion of the virtual agent is updated based on the obtained interaction context, the determined agent state and/or a personality of the virtual agent. One or more behaviors are selected. Each behavior involves or indicates a change in an appearance of the virtual agent or generation of audio. Various embodiments relate to devices, servers, software and systems arranged to implement one or more of the above operations.

Abstract: A computer-implemented method includes: displaying, by a computer device, video content on a display of the computer device; determining, by the computer device, a moving object in the video content; and controlling, by the computer device, a plurality of microbots to move, on the display, over locations of the object in the video content.

Abstract: In an embodiment, an image reception system is communicatively coupled to an image analysis system and is configured to receive a digital image and analyze the pixels of the digital image to determine one or more regions in the digital image. For each region in the one or more regions in the digital image, the image analysis system recognizes the content in the region. A document creation system communicatively coupled to the image analysis system is configured to create a digital document based on the recognized content for the one or more regions. In some embodiments, the image analysis system is further configured to analyze the digital image to detect one or more of the following: region markers, tables, headers.

Abstract: An embodiment provides a mobile application that animates change information in a way that specifically indicates a change in workflow information for various users. This animation of change information permits users, which are often busy healthcare professionals, to be quickly apprised of relevant changes to workflow status. The mobile application also allows users to communicate change information, e.g., for updating the status of a workflow item, which may then be propagated throughout a network, including mobile devices.

Abstract: A fluid is modeled as a set of discrete particles. Each of the particles is associated with one or more properties, and a spatial distance comprising a smoothing length over which the one or more properties are to be smoothed. A corresponding trajectory is simulated for each of the particles. The corresponding trajectory is used to formulate a first solution for simulating transport within the fluid. A first predicted error is determined for the first solution. An iterative adjustment is performed to at least one of: a quantity of particles, the smoothing length, or the one or more corresponding properties, to formulate a second solution for simulating transport with the fluid, and a second predicted error is determined for the second solution, until the second predicted error is within a predefined boundary.

Abstract: In a vehicle control device, a target motion estimation unit estimates a motion for a target area representing an area where no other vehicle is traveling on a lane in the future based on motions of other vehicles traveling on the lane to which a course is to be changed. A control amount setting unit sets a control amount of an own vehicle required in order to make the motion of the target area and a motion of the own vehicle match. A motion control unit controls the motion of the own vehicle according to the set control amount.

Abstract: An application system for the creation, deployment, and management of applications is provided. A system for creating, sharing and managing an application may include a visual editing environment that enables a developer to create and edit code controlling an application and a code execution engine that operates on the code created in the visual editing environment to control execution of at least one hardware infrastructure element that enables the utilization of the application. The editor and the code execution engine provide for the creation, delivery, and editing of the application during runtime of the application on computing devices, such that a plurality of end users using different devices can simultaneously experience the same behavior of the application during its creation and editing.

Abstract: A robotic agent swarm system having first robotic luminaire agents, and at least one control processor. Each agent has a suspension configured to hold the agent against an architectural surface, which includes a holonomic operational area; at least one propulsion motor configured to enable holonomic movement of the agent different locations on the architectural surface; a communication system configured to communicate with at least one other agent; a power supply operatively connected to the at least one propulsion motor and the communication system; and a light source oriented to illuminate a region around the architectural surface. The control processor is operatively associated with the agents and configured to transmit operating instructions, via at least one of the agent's respective communication system. The operating instructions include instructions for operating one or more agent's respective propulsion motor to move the agent holonomically within the holonomic operational area.

Abstract: A method operates virtual reality spectacles involves displaying a virtual object, arranged in virtual surroundings, by the virtual reality spectacles from a first observation position that is prescribed within the virtual surroundings. A position symbol is displayed at a position within the virtual surroundings that corresponds to a second observation position prescribed within the virtual surroundings. The displayed position symbol is selected as soon as a predetermined selection action has been sensed. The virtual object is displayed from the second observation position as soon as a predetermined confirmation action for the selected position symbol has been sensed.

Abstract: A method and corresponding apparatus to model objects includes detecting an overlapping area between first and second objects each comprising particles. The method and corresponding apparatus also calculate, in the overlapping area, an action force between the first and the second objects. The method and corresponding apparatus model the first object and the second object based on the action force.

Abstract: The present specification relates to a display device and a method of controlling therefor. According to one embodiment of the present specification, a method of controlling a display device may include the steps of displaying a video image and a timeline interface corresponding to the video image, setting frames of which correlation is greater than a predetermined ratio among a plurality of frames included in the video image as a first frame group, setting a first point and a second point on the timeline interface based on the first frame group, setting a first panorama section between the set first point and the second point and displaying a first panorama interface corresponding to the first panorama section.

Abstract: The present disclosure provides a method and a system of moving a character in an online game. The method includes: receiving, by a first client, a movement instruction for a specified character, where the movement instruction includes a destination grid, acquiring a game map including a marked dynamic blocking grid, where the marked dynamic blocking grid is a dynamic blocking grid on which a game character exists, establishing an optimal path from a current start grid on which the specified character is located to the destination grid specified in the movement instruction without traveling through the marked dynamic blocking grid, generating movement information including the specified character and the optimal path, and sending the movement information to a server; and receiving, by the server, the movement information sent by the first client, and sending the movement information to all clients except the first client by group messaging.

Abstract: A system including: two arm modules each having an inertial measurement unit and attached to an upper arm of a user to measure the current orientations of the upper arms of the user; a head module having an inertial measurement unit and attached to the head of the user to measure the current orientation of the head; and a computing device coupled to the arm modules and the head module to calculate, based on the current orientations of the upper arms and the current orientation of the head, the current orientation of the torso of the user.

Abstract: One embodiment of the invention disclosed herein provides techniques for processing an evaluation graph associated with a three-dimensional animation scene. An evaluation management system retrieves a first plurality of nodes from a memory. The evaluation management system determines that a first node included in the first plurality of nodes depends on a first output generated by a second node that also is included in the first plurality of nodes. The evaluation management system generates a third node corresponding to the first node and a fourth node corresponding to the second node. The evaluation management system generates an evaluation graph that includes the third node, the fourth node, and an indication that the third node depends on the fourth node. The evaluation management system schedules the third node for evaluation after the fourth node has been evaluated.

Abstract: Methods and systems for controlling physical toys using a physics engine are described. In an embodiment, a physics engine within an interactive software experience is used to model the motion of a virtual object in a virtual environment. The output of this modelling is then imposed on a physical toy which corresponds to the virtual object such that the motion of the physical toy in the real world more closely matches the motion of the virtual object in the virtual environment. In various examples, the modelling is imposed through control signals which are generated based on output of the physics engine and used to control actuators within the physical toy to change the motion of at least a part of the toy.

Abstract: Techniques for smoothing curves used in computer animation are disclosed. In one embodiment, a smoothing application determines a number of tangents to a curve in response to a modification to a knot or the addition of a new knot, by first determining phantom tangents at knots that are neighbors of each knot that is processed. The smoothing application then (1) determines a length of each side of the tangent at each knot being processed as 1/N times the x-axis distance to a neighboring knot on the same side, (2) determines initial angles of the tangent at each knot being processed by pointing a tip of each side of the tangent at a near tip of a previously determined phantom tangent on the same side, and (3) reconciles the initial angles determined for the tangent at each knot being processed by taking a weighted sum of those initial angles.

Abstract: Various systems, methods and computer program products are disclosed which provide fingertip tactile feedback from virtual objects. In various embodiments, a wearable haptic thimble is disclosed. The wearable haptic thimble is configured for use with a virtual reality (or augmented reality) system, and may include: an attachment mechanism for engaging a finger of a user; and at least one contact pad coupled with the attachment mechanism, the at least one contact pad configured to deliver tactile sensations to the finger of the user to provide a tactile representation of virtual reality (or augmented reality) in the virtual reality (or augmented reality) system.

Abstract: A system including a plurality sensor modules, each having an inertial measurement unit and attached to a portion of a user (e.g., upper arm, hand, and/or head) to measure the current orientation of the corresponding portion of the user. A computing device coupled to the sensor modules is configured to identify a type of the current pose of the user, compute a front facing direction of the torso of the user from the sensor measurements, select a torso leaning model based on the pose type, project onto a vertical plane the lengthwise directions of the arms of the user as tracked by the sensor modules attached to the upper arms of the user, and calculate a torso leaning angle from the projected lengthwise directions of the arms.

Abstract: A system in which attributes are transferred between generations of characters in an interactive software experience is described. In an embodiment, data identifying one or more hardware attributes for a virtual entity are determined based on a physical user device associated with that virtual entity. One or more virtual attributes for the virtual entity are accessed and one or more behaviors of the virtual entity within the interactive software experience are modified based on a combination of the hardware and virtual attributes.

Abstract: A computer-implemented method includes: displaying, by a computer device, video content on a display of the computer device; determining, by the computer device, a moving object in the video content; and controlling, by the computer device, a plurality of microbots to move, on the display, over locations of the object in the video content.

Abstract: A robot arm that can be suitably used in aerial vehicles and an unmanned aerial vehicle equipped with the robot arm. The robot arm includes: an arm unit includes a plurality of joints; arm controlling means for controlling driving of the joints; and a displacement detector configured to detect a change of a position and inclination of the arm unit. The arm unit has a base end connected to the aerial vehicle. At least a leading end of the arm unit is exposed to an outside of the aerial vehicle. When the displacement detector has detected a position error that is an unexpected change of the position or inclination of the arm unit, the arm unit controlling means is configured to cause the joints to absorb the position error so as to prevent the position error from being transmitted to a side of the leading end of the arm unit.

Abstract: In one embodiment, a dynamic effects subsystem automatically generates a dynamic effects animation. A graphical user interface enables an animator to sketch applied energies that influence graphical objects. Each applied energy includes flow particles that are associated with velocity fields. Over time, a dynamic effects engine moves the flow particles and the associated velocity fields along a overall direction associated with the applied energy. To generate each frame included in the dynamic effects animation, the dynamic effect engine computes samples of the graphical objects, computes the influences of the velocity fields on the samples, and updates the positions of the samples based on the influences of the velocity fields. Notably, the applied energies and the flow particles enable the animator to effectively and interactively control the automated animation operations of the dynamic effects engine.

Abstract: A technology is described for simulating communication expressions detected in speech data using virtual objects. An example method may include receiving speech data for a virtual object configured to simulate communication expressions provided by the speech data. The speech data may be analyzed for an indicator of a communication expression and communication mark data that includes an expression tag representing the communication expression may be generated. The speech data and the communication mark data may be transmitted to a simulation client to enable synchronization of an animated expression for the virtual object with the speech data using the expression tag in the communication mark data.

Abstract: A 2D camera is used to create a 3D full body image. A camera takes 3 or more 2D images, an accelerometer is used to calculate camera position, and a CPU is employed to construct a 3D body model. This may be performed in a non-controlled environment and by the user alone. An automatic segmentation of the 2D images creates special information for 3D model reconstruction. Once the 3D model measurements are extracted, the user has the option to further specify measurements. In one embodiment, the 3D model is shared via cloud and social media, and also used to assist in shopping while ensuring accurate measurements for the user. In another embodiment, the digital model of products designed for the target consumer body is automatically adjusted and shown as a 3D image on the user's body. The 3D model may be shared with businesses for manufacturing using 3D morphology.

Abstract: The invention relates to a method and system for automatically identifying video content within source video and transmitting the video content to an electronic mail client. The transmitted video content can be streaming video, video files, and/or other medium derived from the source video. An enhanced electronic mail client is also disclosed.

Abstract: An application system for the creation, deployment, and management of applications is provided. A system for creating, sharing and managing an application may include a visual editing environment that enables a developer to create and edit code controlling an application and a code execution engine that operates on the code created in the visual editing environment to control execution of at least one hardware infrastructure element that enables the utilization of the application. The editor and the code execution engine provide for the creation, delivery, and editing of the application during runtime of the application on computing devices, such that a plurality of end users using different devices can simultaneously experience the same behavior of the application during its creation and editing.

Abstract: Various embodiments of the present disclosure can include systems, methods, and non-transitory computer readable media configured to receive at least one database query to be executed. At least one computation graph corresponding to the at least one database query is generated. The computation graph is transformed to an optimized computation graph. The respective portions of the optimized computation graph are distributed to a plurality of distributed computing systems for execution. A result for the at least one database query is provided.