Abstract: A method for providing artificial intelligence (AI) characters with changeable behavior includes providing a plurality of behavioral types associated with an AI character model, where the plurality of behavioral types are associated with probabilities, and where the AI character model is configured to generate an AI character; randomly selecting, during interaction of the AI character, and based on the probabilities, a behavioral type from the plurality of behavioral types; and adjusting, based on the selected behavioral type, parameters associated with the AI character, thereby causing the AI character to follow the selected behavioral type.

Abstract: An electronic device and a controlling method thereof are provided. A controlling method of an electronic device according to the disclosure includes: performing first learning for a neural network model for acquiring a video sequence including a talking head of a random user based on a plurality of learning video sequences including talking heads of a plurality of users, performing second learning for fine-tuning the neural network model based on at least one image including a talking head of a first user different from the plurality of users and first landmark information included in the at least one image, and acquiring a first video sequence including the talking head of the first user based on the at least one image and pre-stored second landmark information using the neural network model for which the first learning and the second learning were performed.

Abstract: A spectator system may provide for spectating in online gaming. The spectator system may receive, at a spectator server, game state data from a game simulation server hosting an online game for one or more players, generate one or more spectator game state data corresponding to one or more spectator devices and output the one or more spectator game state data to the spectator devices. The spectator server may further output the game state data to another spectator server.

Abstract: Systems, methods, and devices are described for on-demand launching of an interface on a compute cluster. The interface enables a user to interact with an application while the application is executing on the compute cluster. A job request associated with the application is received. Responsive to the job request, a determination is made if the interface has already been launched on the compute cluster responsive to an earlier-received job request. If the interface has not already been launched, launch instructions are transmitted to the compute cluster to cause the interface to be launched on the compute cluster. Job instructions are transmitted to the compute cluster to cause the application to be executed on the compute cluster.

Abstract: Systems and methods configured to facilitate animation generation are disclosed. Exemplary implementations may: capture via one or more sensors motion and/or sound made by one or more subjects in physical space and generate output signals conveying information related to the motion and/or the sound made by individual ones of the one or more subjects; store, in electronic storage, final compiled animation scenes, initial compiled animation scenes corresponding to the final compiled animation scenes, preliminary animation information associated with the final compiled animation scenes, and input refinement information; and train, from the final compiled animation scenes, the initial compiled animation scenes corresponding to the final compiled animation scenes, the preliminary animation information, and the input refinement information, an animation prediction model.

Abstract: An integrated photo-video volumetric capture system for 3D/4D scanning acquires 3D scans and 4D scans by acquiring images and videos simultaneously. The volumetric capture system for high-quality 4D scanning and mesh-tracking is used to establish topology correspondences across a 4D scanned mesh sequence for generating corrective shapes which will be used in shape interpolation and skeleton driven deformation. The volumetric capture system aids mesh-tracking for maintaining mesh registration (topology consistency) along with ease of extreme pose modeling. Major upper body and lower body joints are able to be identified that are important for generating deformation and capturing the same using a wide range of motion for all movement types across all joint categories. By using the volumetric capture system and mesh tracking, the topology changes are tracked. Each pose captured will have the same topology which makes blending between multiple poses easier and more accurate.

Abstract: A method and apparatus for simulating clothes receive a user setting for an area in which shirring is to be expressed in a two-dimensional (2D) pattern of clothes modeled with a mesh including a plurality of polygons, obtain a first line and a second line parallel to the first line from the area based on the user setting, generate inner lines that are perpendicular to at least one of the first line and the second line of the area between the first line and the second line and that have regular intervals, align polygons included in the area of the 2D pattern based on the inner lines, and perform a draping simulation of three-dimensional (3D) clothes corresponding to the 2D pattern in which the shirring is expressed by the aligned polygons.

Abstract: A virtual instrument for real-time musical generation includes a musical rule set unit for defining musical rules, a time constrained pitch generator for synchronizing generated music, an audio generator for generating audio signals, wherein the rule definitions describe real-time morphable music parameters, and said morphable music parameters are controllable directly by the real-time control signal. With this virtual instrument, the user can create new musical content in a simple and interactive way regardless of the level of musical training obtained before using the instrument.

Abstract: A method, to navigate a video editing project within a video editing application, includes storing a project timeline comprising a plurality of media content items arranged in a chronological sequence, the project timeline having a start time and an end time; causing presentation of a first tool interface, the first tool interface comprising: a video editing canvas for playback of the project timeline; a plurality of tools to enable respective video editing functions; and a plurality of indicia representing the respective plurality of media content items; detecting activation of a first indicium associated with a first media content item of the plurality of media content items; and advancing the playback of the project timeline to a chronological location corresponding to the location of the first media content item within the project timeline.

Abstract: Systems and methods for Artificial Intelligence (AI) Virtual Reality (VR) emotive conversation training.

Abstract: This application discloses a method and apparatus for displaying a picture of a virtual environment, a device, and a medium, and relates to the field of virtual environments.

Abstract: A system is provided. The system includes a plurality of electronic gaming machines, each including a display and a controller. A first electronic gaming machine and a second electronic gaming machine are positioned adjacent to each other laterally. A first display associated with the first electronic gaming machine and a second display associated with the second electronic gaming machine are designed to line up horizontally. A controller associated with at least one of the first electronic gaming machine and the second electronic gaming machine is programmed to control the first display and the second display. The first display and the second display each display a game display area and a background area. The controller is programmed to: a) cause an image to be displayed on the first display; and b) generate and cause to be displayed an animation of the image moving from the first display to the second display.

Abstract: Techniques are described for determining a duration for a transition and alteration of the appearance of a user interface (UI) from a first UI state to a second UI state over the transition duration according to a timing function that specifies different rates of change in appearance over the course of the transition and is derived by adjusting a master timing function that is used to control a plurality of transitions in the UI to span the transition duration for the transition. A time value of an inflection point within the timing function is determined and the transition duration is divided into a first portion and a second portion so that the first portion extends from the beginning of the transition duration to the time value of the inflection point, and the second portion extends from the time value of the inflection point to the end of the transition duration.

Abstract: Methods and systems are disclosed for performing operations for generating a custom sticker. The operations include receiving, by a messaging application implemented on a first device, an image. The operations include receiving, by the messaging application, input that selects a region of the image. The operations include generating, by the messaging application, a graphical element comprising the region of the image selected by the input. The operations include applying, by the messaging application, one or more visual effects to the graphical element. The operations include causing the graphical element to be animated according to a given animation pattern selected from a plurality of animation patterns to generate an animated custom graphic. The operations include sending the animated custom graphic with the one or more visual effects from the first device to a second device.

Abstract: A method for displaying a virtual character includes: displaying the virtual character, a first character part on the virtual character including a first clothes component and a first body component that are associated with each other; obtaining a second clothes component in response to a clothes component replacement instruction, the first clothes component and the second clothes component being corresponding to a same clothes part; updating display to perform a clothes component replacement, the first character part on the virtual character including the second clothes component and a second body component that are associated with each other. The first clothes component is different from the second clothes component in length, the first body component is different from the second body component in length, and a length of the first character part remains unchanged or changes by a value less than a threshold.

Abstract: Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for generating an avatar. The method includes generating an indication of correlation among image information, audio information, and text information of a video. The method may further include generating, based on the indication of the correlation, a first feature set and a second feature set representing features of a target object in the video, wherein the first feature set represents invariant features of the target object in the video, and the second feature set represents equivariant features of the target object in the video. The method may further include generating the avatar based on the first feature set and the second feature set. With this method, the generated avatar can be made more accurate and vivid with a better effect, while also reducing data annotation cost, improving operation efficiency, and enhancing user experience.

Abstract: One aspect of the invention relates to a video distribution system for live distributing a video containing a virtual space and an animation of a character object generated based on a motion of a distributor user. The video distribution system determines, when receiving from a viewer user watching the video a participation request to request participation in the video, which one of first and second groups the viewer user belongs to. If the viewer user is determined to belong to the first group, the video distribution system arranges a specific avatar of the viewer user in a first region within the virtual space. If the viewer user is determined to belong to the second group, the video distribution system arranges the specific avatar in a second region within the virtual space as long as a condition for participation is satisfied.

Abstract: An audio system in a local area providing an audio signal to a headset of a remote user is presented herein. The audio system identifies sounds from a human sound source in the local area, based in part on sounds detected within the local area. The audio system generates an audio signal for presentation to a remote user within a virtual representation of the local area based in part on a location of the remote user within the virtual representation of the local area relative to a virtual representation of the human sound source within the virtual representation of the local area. The audio system provides the audio signal to a headset of the remote user, wherein the headset presents the audio signal as part of the virtual representation of the local area to the remote user.

Abstract: The present disclosure relates to an image processing method and a system thereof. The method may include: obtaining an image including at least one pixel or voxel; causing, via an interface, at least one interface element corresponding to at least one candidate texture model to be displayed, wherein the at least one candidate texture model is selected from a library including a plurality of candidate texture models that correspond to a plurality of candidate categories; receiving, via the at least one interface element, a selection of a texture model from the at least one candidate texture model; associating the texture model with the image; determining an output parameter of the at least one pixel or voxel based on the texture model; and generating an output image based on the output parameter of the at least one pixel or voxel.

Abstract: A system to provide a curated experience can include an application experience compiler configured to receive data indicating an intent for a user to complete a transaction based on spoken audio and a cross-bar array of a plurality of apps, wherein each app is specified to perform at least a discrete function included as part of the transaction, the cross-bar array of the plurality of apps configured to couple outputs of ones of the plurality of apps to inputs of others of the plurality of apps using respective apis of the plurality of apps.

Abstract: A method for generating a first multimedia element includes reading a first media; acquiring at least one image of at least one face of a user; detecting a plurality of characteristic points of the face of the user; generating at least one physiological parameter from at least one processing of at least one characteristic point detected; generating a first multimedia element superimposed on the first media being played on the display, the first multimedia element being determined according to at least the value of the physiological parameter; emitting simultaneously to the generating a piece of digital data deduced from the value of the physiological parameter, the piece of digital data further including a time marker of the first media.

Abstract: A talking head digital identity immutable dual authentication method for use over a distributed network, comprising: downloading talking head and talking head show files from nodes of a distributed network; downloading hash values of a talking head and talking head show from a blockchain; sending a hash of a publisher's identification from the blockchain to a name lookup service; retrieving and confirming the identity of the publisher from the name look up service; recalculating hash values of the talking head and talking head show; comparing the recalculated hash values of the talking head and talking head show with the hash values of the talking head and talking head show retrieved from the blockchain; starting playback of the talking head show if the hash values received from the blockchain match the recalculated hash values of the talking head and the talking head show retrieved from the nodes of the distributed network.

Abstract: A system for producing conversation-driven character animation includes a computing platform having processing hardware and a system memory storing software code, the software code including multiple trained machine learning (ML) models. The processing hardware executes the software code to obtain a conversation understanding feature set describing a present state of a conversation between a digital character and a system user, and to generate an inference, using at least a first trained ML model of the multiple trained ML models and the conversation understanding feature set, the inference including labels describing a predicted next state of a scene within the conversation. The processing hardware further executes the software code to produce, using at least a second trained ML model of the multiple trained ML models and the labels, an animation stream of the digital character participating in the predicted next state of the scene within the conversation.

Abstract: A computer-implemented method for protecting identity metrics may include (i) receiving, by a computing device and from an originating device, an identity metric encrypted by an identity metric protection module on the originating device, where the identity metric includes biometric data about an operator of the originating device, (ii) requesting, by an identity metric protection module on the computing device, a decryption key from an identity metric protection server, (iii) receiving, by the identity metric protection module, the decryption key from the identity metric protection server, (iv) decrypting, by the identity metric protection module, the identity metric with the decryption key received from the identity metric protection server, and (v) providing the decrypted identity metric to an application on the computing device that uses the identity metric to convey a communication from the operator of the originating device. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A background scenery portion may be identified in each of a plurality of image sets of an object, where each image set includes images captured simultaneously from different cameras. A correspondence between the image sets may determined, where the correspondence tracks control points associated with the object and present in multiple images. A multi-view interactive digital media representation of the object that is navigable in one or more dimensions and that includes the image sets may be generated and stored.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and modifying digital animations based on user interactions with a unique user interface portraying a one-dimensional layer motion element and/or elements for generating and utilizing animation path for digital design objects and animation layers. The disclosed system can provide a dynamic one-dimensional layer motion element that adapts to a selected animation layer and portrays selectable animation frames from the animation layer. The disclosed systems can provide options for generating and modifying various frames of the digital animation based on user interactions with the one-dimensional layer motion element, an animation timeline, and/or a corresponding animation canvas.

Abstract: A system and method for performing facial recognition is described. In some implementations, the system and method identify points of a three-dimensional scan that are associated with occlusions, such as eyeglasses, to a face of a target subject and remove the identified points from the three-dimensional scan.

Abstract: The present disclosure describes techniques for generating content based on rhythm. The techniques comprises acquiring a plurality of images comprising an object with movements in the plurality of images; determining whether at least one portion of the at least one part of the object in a first image aligns with a target image overlaid on the first image and whether the at least one portion aligns with the target image at a time proximate to a first rhythmic point of a playback of a selected piece of music; segmenting the at least one part of the object from the first image in response to determining that the at least one portion aligns with the target image at the time proximate to the first rhythmic point of the playback of the selected piece of music; and generating a first overlay based on the at least one part of the object.

Abstract: Described herein is a graphics processing unit (GPU) configured to receive an instruction having multiple operands, where the instruction is a single instruction multiple data (SIMD) instruction configured to use a bfloat16 (BF16) number format and the BF16 number format is a sixteen-bit floating point format having an eight-bit exponent. The GPU can process the instruction using the multiple operands, where to process the instruction includes to perform a multiply operation, perform an addition to a result of the multiply operation, and apply a rectified linear unit function to a result of the addition.

Abstract: When a multimedia conference between multiple users at multiple locations is established, a first cursor controlled by a first user in a first location is provided. A first event associated with the multimedia conference is detected. In response to detecting the first event associated with the multimedia conference, control of cursors in the multimedia conference can be handled in various ways to enhance the multimedia conference. For example, control of the first cursor can be switched from the first user to a second user at a second location, a second cursor can be provided to the multimedia conference that is controlled by the second user, or control of the first cursor can be merged so that the first cursor can be controlled by both the first user and the second user. This allows for enhanced control of the cursor in the multimedia conference that more closely resembles an in-person conference.

Abstract: A computer graphics production control system is configured to generate scenes (including three-dimensional, deformable characters (“3DD characters”)) that can be manipulated to produce still images and/or animated videos. Such control systems may utilize 3DD characters that are controlled by a series of control points that are positioned and/or moved under the control of the artist. Body characteristics of 3DD characters are modeled as a series of inter-related points (e.g., skin triangles) that can be manipulated under the control of the model and the reference points (e.g., bones) of the body.

Abstract: Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within a virtual environment. Various methods for efficient modeling, rendering, and shading are disclosed herein.

Abstract: Systems and methods can enable the control the motion of an animated character based on imagery (e.g., captured by an image capture device such as a web camera or “webcam”) which shows a person in motion. Specifically, the animated character can be automatically rendered to have the same motion as the entity shown in the imagery (e.g., in real time). According to one aspect of the present disclosure, the animated character can be rendered by iteratively transforming (e.g., including deforming the actual geometry of) a vector-based surface illustration. Specifically, the systems and methods present disclosure can leverage the scalable and transformable nature of a vector-based surface illustration to provide more realistic motion-controlled animation, in which the underlying geometry of the animated character is able to be adjusted to imitate human motion more realistically (e.g., as opposed to basic rotations of fixed character geometry).

Abstract: The present disclosure generally relates to techniques for presenting operations in a presentation. A technique is provided for allowing a user to insert media items on consecutive slides. During a presentation mode, the media items are determined to be two instances of a same media item, and matched such that the media item plays continuously across multiple slides. Another technique is provided to allow a user to utilize a user input to override a linearly-defined set of actions within a presentation. Another technique is utilized to temporarily select a visually obstructed object in a graphic editing interface such that the visually obstructed object may be manipulated during the temporary selection mode.

Abstract: Systems and methods are disclosed herein for generating content based on format-specific screenplay parsing techniques. The techniques generate and present content by generating new dynamic content structures to generate content segments for output on electronic devices. In one disclosed technique, a first instance of a first character name is identified from the screenplay document. A first set of character data following the first instance of the first character name from the screenplay document and preceding an instance of a second character name from the screenplay document is then identified. Upon identification of the first set of character data, a content structure including an object is generated. The object includes attribute table entries based on the first set of character data. A content segment is generated for output based on the content structure (e.g., a 3D animation of the first character interacting within a scene).

Abstract: Methods and systems of simulating a fluid. An outflow of the fluid is determined. An inflow of the fluid is determined. Determining a simulated fluid using the inflow and the outflow.

Abstract: A spectator system may provide for spectating in online gaming. The spectator system may receive, at a spectator server, game state data from a game simulation server hosting an online game for one or more players, generate one or more spectator game state data corresponding to one or more spectator devices and output the one or more spectator game state data to the spectator devices. The spectator server may further output the game state data to another spectator server.

Abstract: A method for human body model reconstruction and a reconstruction system are disclosed. The method includes acquiring a target image, and acquiring a segmented image by segmenting the target image based on an object to be reconstructed in the target image, the target image being one front image of the object; acquiring an initial estimate shape and a part of texture information of the object respectively, according to the segmented image; determining an initial 3D model of the object through the initial estimate shape, the initial 3D model being a 3D model without texture; acquiring complete texture information of the object according to the part of texture information and a texture generation model; and generating a 3D reconstruction model of the object based on the initial 3D model and the complete texture information, the 3D reconstruction model being a 3D model with texture.

Abstract: Embodiments of this disclosure include an information processing method, an information processing apparatus, and non-transitory computer-readable storage medium. A first key frame that includes initial posture data corresponding to an initial posture of a target virtual character is obtained. Target posture data is determined by inputting the initial posture data and a target task to a policy network trained by reinforcement learning. An output of the policy network indicates the target posture data corresponding to a target posture. At least one force to be acted on at least one first joint of the target virtual character is determined according to the initial and the target posture data. A posture of the target virtual character is adjusted from the initial posture to the target posture by applying the at least one force on the at least one first joint to obtain a second key frame.

Abstract: Apparatuses, systems, and techniques to render images. In at least one embodiment, at least one visibility parameter determined for a first image region is reused for a different second image region that neighbors the first image region (e.g., spatially and/or temporally).

Abstract: Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions, and determining second costs associated with the warping mesh that include costs of edge-related transformations for preserving straightness of edges of the image. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.

Abstract: There is provided a data processing device including: a data acquisition unit configured to acquire animation data in which clothing moves according to a motion of a wearer's body wearing the clothing; and a data update unit configured to update the animation data based on three types of elements having ratios in accordance with a specified type of an emotion. There is provided a data processing method that is executed by a computer, the data processing method including: acquiring animation data in which clothing moves according to a motion of a wearer's body wearing the clothing; and updating the animation data based on three types of elements having ratios in accordance with a specified characteristic of a motion.

Abstract: A computer-implemented method is provided. The computer-implemented method includes rendering a dynamic effect to one or more objects in an image. The method includes setting boundary points surrounding a foreground object to define a boundary area in which a dynamic movement is to be realized; setting a movement line to define a dynamic movement direction along which the dynamic movement is to be realized, wherein setting the movement line includes detecting a continuous touch over different positions on the touch control display panel; setting a stationary area to define an area in which the dynamic movement is prohibited, wherein setting the stationary area includes detecting a first touch area corresponding to the stationary area on the touch control display panel; and generating an animation of the foreground object in the boundary area moving along the dynamic movement direction, thereby realizing the dynamic effect in the image.

Abstract: The present teaching relates to a method and system for path planning. Information of a current pose of a robotic arm having a plurality of operable segments is obtained. The information includes a plurality of values, each of which corresponds to an angle formed between consecutive operable segments of the robotic arm. A desired pose where the robotic arm needs to reach is also obtained. An angle step-value is computed for the current pose of the robotic arm based on a function of a distance between the current pose and the desired pose, wherein the angle step value is to be used to determine a plurality of candidate next poses of the plurality of operable segments. One or more of candidate next poses is selected based on at least one criterion, and a trajectory is determined from the current pose to the desired pose based on the selected next poses.

Abstract: A computer is configured to receive an input operation from a distribution user and connect to game circuitry that manages progress of a game, and to video distribution circuitry. The computer sends, to the video distribution circuitry, display control data for displaying, on a viewing user device, a video of the game. The computer receives, from the game circuitry, gift data that is based on a gift output request sent from the viewing user device. The computer displays a gift that is based on the gift data. An image corresponding to consecutive behaviors of the game is displayed on the screen of the game, when a specified command included in game operation data sent from a user device used by any of the users participating in the game and the gift output request sent from the viewing user device cause the consecutive behaviors to be established.

Abstract: In a method for operating a computer having a user interface, e.g., a graphical and/or interactive user interface, a robot, which has members, e.g., arms, rotatable relative to each other and a tool and/or a load, are displayed graphically. One of the members is selectable from an indicated set of members, and a value of an inertial characteristic, e.g., a value of the mass, of this member is able to be inputted. The value of the mass of the member, the position of the center of mass of the member, and both the magnitude and the direction of each of the principal axes of inertia of the selected member are displayed graphically.

Abstract: Systems and methods for image retargeting are provided. Image data may be acquired that includes motion capture data indicative of motion of a plurality of markers disposed on a surface of a first subject. Each of the markers may be associated with a respective location on the first subject. A plurality of blendshapes may be calculated for the motion capture data based on a configuration of the markers. An error function may be identified for the plurality of blendshapes, and it may be determined that the plurality of blendshapes can be used to retarget a second subject based on the error function. The plurality of blendshapes may then be applied to a second subject to generate a new animation.

Abstract: Methods, systems, and apparatus, including medium-encoded computer program products, for providing editable keyframe-based animation data for applying to a character to animate motion of the character in three-dimensional space. Three-dimensional motion data is constructed from two-dimensional videos. The three-dimensional motion data represents movement of people in the two-dimensional videos and includes, for each person, a root of a three-dimensional skeleton of the person. The three-dimensional skeleton comprises multiple three-dimensional poses of the person during at least a portion of frames of a video from the two-dimensional videos. The three-dimensional motion data is converted into editable keyframe-based animation data in three-dimensional space and provided to animate motion.

Abstract: A user interface may present multiple presentation slides for user selection. Each slide may include one or more shapes, and a shape thread may be associated with each shape on the slide. For a selected slide, the user interface may present one or more shape threads associated with the selected slide. Each shape displayed on the selected slide may be associated with a particular shape thread, and a user may independently adjust one or more slide transition attributes of a shape via the associated shape thread.

Abstract: A method for analyzing an object. The method includes capturing, using a camera device, a sequence of images of a scene comprising a light source attached to a first element of a plurality of elements comprised in an object, detecting, by a hardware processor based on a pattern of local light change across the sequence of images, the light source in the scene, determining, by the hardware processor, a location of the light source in at least one image of the sequence of images, generating, by the hardware processor based on the location of the light source and a dynamic model of the object, a region-of-interest for analyzing the object, and generating an analysis result of the object based on the region-of-interest, wherein a pre-determined task is performed based on the analysis result.