Abstract: Dynamically customized animatable 3D models of virtual characters (“avatars”) in electronic messaging are provided. Users of instant messaging are represented dynamically by customized animatable 3D models of a corresponding virtual character. An example method comprises receiving input from a mobile device user, the input being an audio stream and/or an image/video stream; and based on an animatable 3D model and the streams, automatically generating a dynamically customized animatable 3D model corresponding to the user, including performing dynamic conversion of the input into an expression stream and corresponding time information. The example method includes generating a link to the expression stream and corresponding time information, for transmission in an instant message, and causing display of the customized animatable 3D model. Link generation and causing display is performed automatically or in response to user action.

Abstract: The disclosure provides an approach for simulating three-dimensional (3D) virtual environments using generalized collision objects. In one aspect, the generalized collision object includes a shape specifying the boundary of the generalized collision object, a shape velocity specifying how the generalized collision object moves and evolves through space, and a material velocity specifying how the material being simulated moves at the boundary of the generalized collision object. Taking the shape, shape velocity, and material velocity as inputs, a simulation application determines source and sink boundary conditions to apply in a simulation based on a difference between components of the shape velocity and the material velocity that are normal to the boundary of the generalized collision object. The simulation application then performs the simulation of the 3D virtual environment while enforcing velocity boundary conditions using the material velocity and the determined source and sink boundary conditions.

Abstract: A facial feature detecting apparatus includes a feature sensor configured to acquire information on facial features of a subject; a feature detecting unit configured to detect the facial features of the subject from the information acquired by the feature sensor; a three-dimensional coordinates calculating unit configured to calculate three-dimensional coordinates of the facial features of the subject; and a feature position estimating unit configured to estimate first three-dimensional coordinates of a first facial feature from second three-dimensional coordinates of a second facial feature of the detected facial features, on a basis that the first facial feature and the second facial feature are located at bilaterally symmetrical positions.

Abstract: Methods and systems for assigning a data center to service a request from a user account include receiving a login request to a cloud gaming server. The login request is examined to identify a user account. A use history of the cloud gaming server is examined to identify a data center. The user account is assigned to the data center to start a session of streaming game play at a server within the data center. The data center is identified without performing a connection testing operation.

Abstract: An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.

Abstract: Systems and methods for integrating graphic animation technologies with fantasy sports contest applications are provided. This invention enables a fantasy sports contest application to depict plays in various sporting events using graphic animation. The fantasy sports contest application may combine graphical representation of real-life elements such as, for example, player facial features, with default elements such as, for example, a generic player body, to create realistic graphic video. The fantasy sports contest application may provide links to animated videos for depicting plays on contest screens in which information associated with the plays may be displayed. The fantasy sports contest application may play the animated video for a user in response to the user selecting such a link. In some embodiment of the present invention, the fantasy sports contest application may also customize animated video based on user-supplied setup information.

Abstract: Some examples relate generally to computer architecture software for information security and, in some more particular aspects, to tree-based snapshots and detecting malware therein.

Abstract: A method is performed at a computing device coupled with a display. The method includes displaying a graphical user interface on the display and analyzing a natural language input, received from a user, to identify a portion of the natural language input corresponding to a first phrase that includes a first term. The method further includes receiving, from the user, a second input that modifies the first term in the first phrase. In response to receiving the second input, the computing device updates a second phrase based on the second input. In response to updating the second phrase based on the second input, the computing device displays, on the graphical user interface, an updated natural language expression that comprises the modified first phrase and the updated second phrase and displays an updated data visualization representing the updated natural language expression.

Abstract: Systems and methods for facilitating virtual collaboration between users within virtual environments are disclosed. A plurality of users access a collaborative virtual environment system at various times using interface devices to establish an asynchronous virtual collaboration session in which users collaborate in real-time and/or asynchronously. To enable asynchronous collaboration, data from virtual collaboration session is stored and presented to later users, including user movements and interactions with the environment, user annotation, and audio communications or comments. Other users may then access the data at a later time, and later user interactions, annotations, and audio may likewise be stored for further review by other users.

Abstract: A tile instructional system for presenting a linear growth problem and for allowing the linear growth problem to be solved comprises an input tray having at least a first tile and a second tile. The first tile has a first marking and the second tile has a second marking. Each of the first tile and the second tile is configured to selectively expand in accordance with its respective marking. The system includes a tile bed comprising a plurality of tile slots. Each of the plurality of tile slots is configured to receive a tile. The linear growth problem is solvable by situating in the tile bed at least one of the first tile and the second tile and by causing each tile situated in the tile bed to expand in accordance with its respective marking to fill the tile bed.

Abstract: There is provided a system and method for creating a digital puppet show by animating a digital puppet using gestures and sound. The method includes presenting the digital puppet to a user on a display. The method further includes receiving motion data corresponding to a gesture, using a camera, from the user, translating the motion data into digital data using a motion tracking algorithm, and animating the digital puppet, on the display, using the digital data. The method can further include receiving audio data from the user using a microphone and playing the audio data, using a speaker, while animating the digital puppet on the display to create the digital puppet show.

Abstract: Methods and systems are provided for enhancing design collaboration using design-based feedback. In embodiments, an indication to provide feedback in accordance with a graphical design element within a document is received. Text-based feedback related to the graphical design element within the document is obtained, and design-based feedback that manipulates the graphical design element within the document is obtained. Thereafter, a feedback indicator is generated that indicates the text-based feedback and the design-based feedback related to the graphical design element. The feedback indicator is provided (e.g., to a server) for presentation (e.g., via a user device) to one or more collaborators of the document such that the document with the text-based feedback and the design-based feedback is viewable to the one or more collaborators.

Abstract: Implementations of the subject technology provide a framework to support creating user interfaces (UI) and animations within the UIs. The subject technology receives first information related to an animation, the first information including an initial state, a destination state, and an animation function. The subject technology generates a copy of the destination state, the copy of the destination state comprising a record for the animation based at least in part on the first information related to the animation and further information related to the animation function. The subject technology updates a value related to an intermediate state of the animation in the copy of the destination state, the intermediate state being between the initial state and the destination state. Further, the subject technology provides the copy of the destination state that includes the value related to the intermediate state for rendering the animation.

Abstract: A method for operating an operating system which generates and displays a graphical user interface. The graphical user interface includes a first representation with a front side representation of a planar graphical object. An operating action for the graphical object is detected and a transition animation is generated and displayed. Following the transition animation, a second representation with a rear side representation of the graphical object is displayed, the transition animation includes a rotation, shown in perspective, of the graphical object about an axis, and the rear side representation of the graphical object assuming a smaller area than the front side representation. The second representation also includes an information region, and the representation of the graphical object is made smaller during the transition animation. Also disclosed is an operating system having a control unit, a display surface, and a detection unit.

Abstract: A method and an apparatus for pattern recognition is provided in the present invention, applied to the field of artificial intelligence. The method includes: acquiring a two-dimensional image of a target object and a two-dimensional feature of the target object according to the two-dimensional image of the target object; and acquiring a three-dimensional image of the target object and a three-dimensional feature of the target object according to the three-dimensional image of the target object; identifying the target object according to the two-dimensional feature and the three-dimensional feature of the target object. The method can reduce restrictions on acquiring the image of the target object, for example, reduce the restrictions on the image of the target object in terms of postures, lighting, expressions, make-up and occlusion, thereby improving an accuracy of recognizing the target object and improving a recognition rate and reducing recognition time at the same time.

Abstract: Described is a system, method, and computer program product that substantially advances the art of animating Lip Sync in 3D computer animated characters by automatically producing data from a Phoneme Transcription of a dialog audio file, which data results in Lip Sync animation that is more realistic, smooth, and aesthetically pleasing than that produced by current Phoneme-Target Lip Sync systems. This Invention works by converting a Phoneme Transcription of a recorded dialog audio file into KeyFrame Data which dynamically controls 16 independent animation Parameters, each associated with a different part of the animated character's mouth, then algorithmically modifying that data such that it conforms to the previously unknown complex, subtle and context-specific relationships between audible phonemes and visible mouth movements.

Abstract: A technology for allowing anyone to easily create interactive media capable of easily recognizing a user interaction by using a stored image is provided. A system according to the present invention includes an image reconstruction server, an image ontology, and an image repository. The image reconstruction server includes an image reconstruction controller, a natural language processing module, and an image search module. The image reconstruction controller of the image reconstruction server receives a scenario based on a natural language from a user and searches for images desired by the user by using the natural language processing module, the image search module, and the image repository. The natural language processing module of the image reconstruction server performs a morphological analysis and a syntax analysis on the scenario input by the user as a preliminary operation for the search of the image ontology.

Abstract: An embodiment combines the concepts of image enhancement and voice-sound command and control to enhance the experience of viewing images by tracking where the viewer is indicating with his/her voice. The result is to make the viewing experience more like viewing the original scene, or to enhance the viewing experience in new ways beyond the original experience, either automatically, or by interacting with a photographer's previously specified intentions for what should happen when the viewer identifies, with his/her voice sounds, including, but not limited to, words, voice tone, voice inflection, voice pitch, or voice loudness, a particular portion of an image or images taken by that photographer.

Abstract: Various methods and systems are provided for puppeteering in augmented reality. Generally, an augmented or virtual reality device for each user generates a virtual 3D environment comprising a virtual representation of a physical room and a 3D asset. An author can record a 3D path for a puppeteering animation of the 3D asset using a 3D interface. At the same time, a coordinated rendering of a corresponding 3D image moving along the 3D path is updated among author devices substantially in real-time. Distinct states of the 3D asset can be assigned to different portions of the 3D path, and authors can set behavior parameters to assign template behaviors such as obstacle avoidance, particle effects, path visualizations and physical effects. The behavior parameters are distributed among presenter and audience devices, and a coordinated rendering of an animation of the 3D image corresponding to the puppeteering animation is triggered.

Abstract: An electronic device with a display is paired with a set of wireless audio output devices, including a first wireless audio output device for outputting audio to a right ear of a user and a second wireless audio output device for outputting audio to a left ear of the user. In response to a request to display status information about the set of wireless audio output devices, the electronic device displays a status user interface, including concurrently displaying a first battery status indicator for the first wireless audio output device with an indication that battery status indicator relates to the device for outputting audio to the right ear of the user and a second battery status indicator for the second wireless audio output device with an indication that battery status indicator relates to the device for outputting audio to the left ear of the user.

Abstract: Collected usage information relating to interaction with content is integrated with operation of a system, such as a content management system. The usage information is collected in response to occurrences of usage events. A user may create, configure and define the usage events according to their needs. The user may also configure/define different values that are associated with the different events. For example, a user may specify: when to count a view (e.g. unique user view or each view); what period of time to collect counts; aggregation of counts (e.g. tenant, site, collection); a weighting for the event; a trim value; when to provide the parameter to a search index of the system such that the value is considered by the search engine of the system; whether or not a parameter is configurable by other users, and the like.

Abstract: A display control system includes a display, a detector, and a controller. The display is configured to display an image. The detector is configured to detect wind. The controller is configured to, in response to the detector detecting wind, control the image based on strength of the detected wind.

Abstract: Adaptive tuning techniques are provided for data communications in an Object Management Group (OMG) Real-Time Publish Subscribe (RTPS) Protocol operable over a communication network to provide good throughput/latency tradeoff as well as efficient bandwidth utilization. With this invention, latency under high throughput conditions can be reduced several times compared with the latency obtained with traditional non-adaptive approaches.

Abstract: A computer-implemented method and system for creating and displaying branching-plot video content. The method comprises obtaining, from a database, a set of nodes and each node comprises an audio element, video element, and a set of node branches, wherein at least on node is a parent and another a child; obtaining a relational table; designating a current node, creating a playlist of audio segments and video segments for display; and traversing the set of nodes by: integrating the audio and video elements, receiving a selection from the user, and designating the child node as the current node. The system comprises a computer store containing data; a set of nodes and each node has a video and audio element and relationships exist between the nodes; and a computer server that obtains a set of nodes, generates a playlist, displays an audio and video sequence, and traverses the set of nodes.

Abstract: Techniques are provided for hand drawing an animation motion path for an object to follow on a graphical user interface (GUI). The motion path may be drawn with a user's finger or drawing device, such as an Apple Pencil®, by selecting a drawing tool (e.g., a freehand tool and/or straight line tool). A new motion path may be added to an existing motion path, such that the new motion path is an extension of the existing motion path. The new motion path may also be added to an end point of an existing motion path, such that the new motion path is a different segment of a motion path and is associated with a new key frame. A motion path segment may be split into additional segments with new key frames, reshaped using editing points, redrawn, and/or deleted from the overall motion path. In some embodiments, the actions applied to the object (e.g., motion path) may be indicated by an associated tray that provides editable context-specific properties related to the action.

Abstract: A method for generating a messaging stream where one or more messages are exchanged between a first user and a second user comprises generating a messaging stream where one or more messages are exchanged between a first user and a second user. The method further includes receiving a selection of an animated object from the first user for the messaging stream. The method further includes providing the animated object in the messaging stream. The method further includes receiving a first action from the first user related to the animated object. The method further includes modifying a display of the animated object based on the first action. The method further includes receiving a second action from the second user related to the animated object. The method further includes modifying the display of the animated object based on the second action.

Abstract: Embodiments of the present disclosure provide a method and apparatus for generating an animation. A method may include: extracting an audio feature from target speech segment by segment, to aggregate the audio feature into an audio feature sequence composed of an audio feature of each speech segment; inputting the audio feature sequence into a pre-trained mouth-shape information prediction model, to obtain a mouth-shape information sequence corresponding to the audio feature sequence; generating, for mouth-shape information in the mouth-shape information sequence, a face image including a mouth-shape object indicated by the mouth-shape information; and using the generated face image as a key frame of a facial animation, to generate the facial animation.

Abstract: Techniques are described for automating animation of fonts. In certain embodiments, segments of a glyph that symbolizes a font character are accessed. Sub-segments are then generated for the glyph by applying an automated segmenting function to the segments. Glyph points are then determined for the glyph based on the generated sub-segments of the glyph. For a glyph point in the glyph points, positions for the glyph point are computed at time points by, for each time point of the time points, applying an effect function to the glyph point. Keyframes are generated corresponding to the time points, wherein each keyframe in the keyframes corresponds to a respective time point in the time points and includes an animation effect generated for the glyph based on respective positions computed for the glyph points at the time point. A font animation is provided based on the keyframes.

Abstract: Embodiments of the present invention provide a displaying method. The method includes steps of: displaying an element at a first position on touchscreen, obtaining touch information, determining an arrangement instruction which is obtained for the greatest number of times within predetermined time according to the touch information, and displaying the element at a second position on the touchscreen according to the arrangement instruction.

Abstract: An avatar motion generating method and a head mounted display system are provided. In the method, an input event is received, and the input event is related to sensing result of a user. First avatar motion is generated based on one of predefined motion data, motion sensing data and a combination thereof at the first period of time. Second avatar motion is generated based on another of the predefined motion data, the motion sensing data and the combination thereof at the second period of time. Accordingly, the motion of the avatar could be smooth and natural.

Abstract: One or more embodiments described herein include methods and systems of providing message status notifications. The status notifications can comprise one or more of sent, delivered, or accessed/read notifications. In one or more embodiments a status notification is persistently displayed in a thread for each participant in a conversation. Each time the participant accesses a new message, the system can move the status notification adjacent to the new message.

Abstract: A method for identifying a body motion includes receiving a series of images including a visual presentation of a human face from the image capture device. The series of images may form an image sequence. Each of the series of images may have a previous image or a next image in the image sequence. The method also includes, for each of the series of images, determining a plurality of characteristic points on the human face, determining positions of the plurality of characteristic points on the human face, and determining an asymmetry value based on the positions of the plurality of characteristic points. The method further includes identifying a head-shaking movement of the human face based on the asymmetry values of the series of images.

Abstract: An information processing apparatus according to an embodiment of the present technology includes a generation unit and a first transmission unit. The generation unit generates parameter information that shows states of a user. The first transmission unit transmits the generated parameter information through a network to an information processing apparatus of a communication partner capable of generating an image that reflects the state of the user on the basis of the parameter information.

Abstract: Disclosed are methods that create the perception for an audience that an actor is being transported from one location to another during a stage performance. Also disclosed are methods for entrance onto/exit from a stage platform by an actor, or entrance onto/exit from a stage backdrop by a precision image that represents an actor. The disclosed methods involve interaction of an actor with an object/prop or image of an object/prop, and/or involve interaction of an image of an actor with an object/prop or image of an object/prop during a stage performance.

Abstract: Systems and methods relate to encoded video streams including geometric-data streams transmitted to a receiver for rendering of a viewpoint-adaptive 3D persona. A method includes obtaining a three-dimensional (3D) mesh of a subject generated from depth-camera-captured information about the subject, obtaining a facial-mesh model, locating a facial portion of the obtained 3D mesh of the subject, computing a geometric transform based on the facial portion and the facial-mesh model, the geometric transform determined in response to one or more aggregated error differences between a plurality of feature points on the facial-mesh model and a plurality of corresponding feature points on the facial portion of the obtained 3D mesh, generating a transformed facial-mesh model using the geometric transform and generating a hybrid mesh of the subject at least in part by combining the transformed facial-mesh model and at least a portion of the obtained 3D mesh.

Abstract: A non-transitory computer readable storage medium storing computer program code that, when executed by a processing device, cause the processing device to perform operations comprising: determining a first representative point, wherein the first representative point represents a first geometric primitive; determining a second representative point, wherein the second representative point represents a second geometric primitive; determining an initial distance between the first representative point and the second representative point; calculating a first displacement based on a velocity of the first representative point; calculating a second displacement based on a velocity of the second representative point; determining a separating direction between the first representative point and the second representative point; projecting the first displacement along the separating direction; projecting the second displacement along the separating direction; calculating a predicted minimum distance between the first repr

Abstract: The present disclosure relates to an AR animation generation system identifies an animation profile for animating the virtual object displayed in an augmented reality (AR) scene. The AR animation generation system creates a link between the virtual object and the mobile computing system based upon a position of the virtual object within the AR scene and a position of a mobile device in a real-world environment. The link enables determining for each position of the mobile device in the real-world environment, a corresponding position for the virtual object in the AR scene.

Abstract: A rail manipulator indicates the possible range(s) of movement of a part of a computer-generated character in a computer animation system. The rail manipulator obtains a model of the computer-generated character. The model may be a skeleton structure of bones connected at joints. The interconnected bones may constrain the movements of one another. When an artist selects one of the bones for movement, the rail manipulator determines the range of movement of the selected bone. The determination may be based on the position and/or the ranges of moments of other bones in the skeleton structure. The range of movement is displayed on-screen to the artist, together with the computer-generated character. In this way, the rail manipulator directly communicates to the artist the degree to which a portion of the computer-generated character can be moved, in response to the artist's selection of the portion of the computer-generated character.

Abstract: An electronic device is provided. The electronic device includes a camera, a display, and a processor configured to obtain a first image including one or more external objects by using the camera, display to output a three-dimensional (3D) object generated based on attributes related to a face among the one or more external objects using the display, receive a selection of at least one graphic attribute from a plurality of graphic attributes which can be applied to the 3D object, generate a 3D avatar for the face based on the at least one graphic attribute, and generate a second image including at least one object reflecting a predetermined facial expression or motion using the 3D avatar.

Abstract: A communication management apparatus includes a receiver to receive image type information indicating a type of an image from a first communication terminal; circuitry to generate image data identification information for identifying image data to be transmitted from the first communication terminal to a second communication terminal, based on reception of the image type information; and a transmitter to transmit the image data identification information that is generated to the first communication terminal, and transmit the image data identification information that is generated and the image type information that is received to the second communication terminal.

Abstract: Processor displays avatar to move from a starting coordinate to first movement destination coordinates in accordance with each instruction in first instruction set. Processor records coordinates after movement by instructions in the first instruction set, as first group, in accordance with instruction included in the first instruction set. Processor returns avatar to the before starting movement coordinates and displays avatar. Processor displays avatar to move from the before starting movement coordinates to second movement destination coordinates in accordance with each instruction in second instruction set. Processor records coordinates after movement by instructions in the second instruction set.

Abstract: A method causes a display device to simultaneously display at least the following: a video depicting an item in a scene and a tag in a first position on the video. The tag is associated with the item depicted in the video. The tag includes text information associated with the item depicted in the video. The method also causes the tag to undergo motion relative to at least a portion of the video scene from the first position to a second position different from the first position, while causing the display device to display the video and the tag on the video.

Abstract: Techniques are described herein that overcome the limitations of conventional techniques by bridging a gap between user interaction with digital content using a computing device and a user's physical environment through use of augmented reality content. In one example, user interaction with augmented reality digital content as part of a live stream of digital images of a user's environment is used to specify a size of an area that is used to filter search results to find a “best fit”. In another example, a geometric shape is used to represent a size and shape of an object included in a digital image (e.g., a two-dimensional digital image). The geometric shape is displayed as augmented reality digital content as part of a live stream of digital images to “assess fit” of the object in the user's physical environment.

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

Abstract: A single-photo generating device is provided. The single-photo generating device includes an image capturing device and a processing device. The image capturing device generates a first image, wherein the first image includes a plurality of people. The processing device is coupled to the image capturing device and obtains the first image from the image capturing device. The processing device extracts each human image corresponding to the plurality of people from the first image and selects a background image, and the processing device generates a plurality of single photos corresponding to each human image according to the extracted human images and the background image.

Abstract: An embodiment of an image processor for immersive video includes technology to re-order patches from a plurality of views based on one or more of relative position and orientation related information for a desired synthesized view, select a set of views to be used in each view synthesis pass, perform two or more view synthesis passes for the synthesized view to provide two or more intermediate view synthesis results, and mask and merge the two or more intermediate view synthesis results to provide a final view synthesis result. Other embodiments are disclosed and claimed.

Abstract: A user interface for animating digital artwork includes a two-part control to change scale, rotation, and/or shear. A stationary portion is manipulated by the user while a moveable portion moves during manipulation to reflect a deformation position resulting from the control For example, a system may store an artwork having a tessellated mesh bounded by an alpha edge and a bend handle associated with at least a first vertex of the mesh. The system also includes a user interface that implements a control for the bend handle. The control includes a stationary portion enabling the user to select a control value for the bend handle and a moveable portion that moves, during a manipulation event of the stationary portion, to a deformed position determined from the control value and from a position of at least one other handle associated with at least a second vertex of the vertices.

Abstract: There is disclosed an educational system including a science experimental set and a computer system, the science experimental set comprising experimental set items, and the computer system including a processor, a detector and a display, the computer system configured to display educational media content on the display relating to the science experimental set in response to the detector detecting an item in the science experimental set, and the processor identifying the media content to be displayed based on the detection of the item. Related methods, computer program products and kits of parts are disclosed.

Abstract: A co-user list may be configured based on user interaction in a virtual world environment. A first user may be enabled to navigate the virtual world environment using an instant messenger application that includes the co-user list. A second user that is located proximate to the first user in the virtual world environment may be detected. An attribute associated with the second user may be determined. The co-user list may be configured based on the attribute associated with the second user.

Abstract: Systems, methods, and devices are disclosed for tracking physical objects using a passive reflective object. A computer-implemented method includes obtaining a location profile derived from content capturing a passive object having a reflective surface reflecting one or more real-world objects. The passive object is attached to a physical object. The method further includes transmitting the location profile to a simulation device. The method further includes generating a virtual representation of the physical object based on the location profile of the passive object. The method further includes presenting the virtual representation in a simulation experience.