Abstract: In one aspect, a computerized method of automatically generating video content using a one click artificial-intelligence assistant for generating an animation video includes the step of providing a do-it-yourself (DIY) computer animation generation system. The DIY computer animation generation system includes an animation generation dashboard. The method includes the step of providing a one click AI assistant for generating an animation video in the DIY computer animation generation system. The method includes the step of providing a one click virtual button that is displayed in the animation generation dashboard. The one click AI assistant automatically suggests a set of animation choices to a user on a single button press of the one click virtual button.

Abstract: Disclosed is a method of providing a sign language video reflecting an appearance of a conversation partner. The method includes recognizing a speech language sentence from speech information, and recognizing an appearance image and a background image from video information. The method further comprises acquiring multiple pieces of word-joint information corresponding to the speech language sentence from joint information database, sequentially inputting the word-joint information to a deep learning neural network to generate sentence-joint information, generating a motion model on the basis of the sentence-joint information, and generating a sign language video in which the background image and the appearance image are synthesized with the motion model. The method provides a natural communication environment between a sign language user and a speech language user.

Abstract: Structural modifications to a person's face in a reference image are captured and automatically applied to the person's face in another image. The reference image is processed to compute landmark information on the person's face and apply a mesh to the reference image. When structural modifications are made to the person's face in the reference image, the mesh is modified, and the modified mesh is stored in association with the landmark information. Another image is analyzed to compute landmark information on the person's face in that image and apply a mesh to the image. A transformation matrix is computed using the landmark information from the reference image and current image, and the modified mesh from the reference image is transformed using the transformation matrix. The mesh in the current image is modified using the transformed mesh, thereby applying the structural modification to the person's face in the current image.

Abstract: In an example implementation according to aspects of the present disclosure, a system comprising a sensor, a multimedia presentation device, and a controller. The controller may be configured to receive telemetry from the multimedia device and receive a multimedia capture from the sensor. The controller compares the multimedia capture to a control element and determines a relationship between the telemetry and the comparison. Based on the determination, the controller adjusts the configuration of the multimedia presentation device.

Abstract: A computer program is executed by a processor to move a position of at least one gift by a transparent object in a virtual space between a subject and a camera that images the subject, and move the position of the gift to increase a display area of the subject imaged by the camera. The processor is programmed to (i) acquire information related to the position of a subject in a virtual space, (ii) acquire information related to the position of a camera that images the subject, and (iii) generate a transparent object in the virtual space between the subject and the camera.

Abstract: Various methods, apparatuses, and media for notifying a user of an operational state of a web application are provided. Three values that relate to data caching, error occurrence, and data retrieval are used to determine the operational state. The methods may use a software module that is compatible with any React JavaScript application.

Abstract: Disclosed is a chat group management method, including: detecting a message receiving mode corresponding to a chat group; obtaining a degree of interest of a user for chat group messages and an activity degree of the user in the chat group in accordance with a determination that the message receiving mode corresponding to the chat group is a mute-notification receiving mode; determining an importance ranking for the chat group according to the degree of interest and the activity degree; and updating the chat group's position among a plurality of chat groups in accordance with the importance ranking.

Abstract: Embodiments described herein include an expressive icon system to present an animated graphical icon, wherein the animated graphical icon is generated by capture facial tracking data at a client device. In some embodiments, the system may track and capture facial tracking data of a user via a camera associated with a client device (e.g., a front facing camera, or a paired camera), and process the facial tracking data to animate a graphical icon.

Abstract: Systems and methods enabling rendering an avatar attuned to a user. The systems and methods include receiving audio-visual data of user communications of a user. Using the audio-visual data, the systems and methods may determine vocal characteristics of the user, facial action units representative of facial features of the user, and speech of the user based on a speech recognition model and/or natural language understanding model. Based on the vocal characteristics, an acoustic emotion metric can be determined. Based on the speech recognition data, a speech emotion metric may be determined. Based on the facial action units, a facial emotion metric may be determined. An emotional complex signature may be determined to represent an emotional state of the user for rendering the avatar attuned to the emotional state based on a combination of the acoustic emotion metric, the speech emotion metric and the facial emotion metric.

Abstract: A terminal device for playing a game includes a display screen for displaying animation of the game, and processing circuitry. The processing circuitry detects a frame rate inadequacy of animation frames that are generated according to animation features respectively associated with animation files. Then, the processing circuitry obtains preconfigured values respectively associated with the animation files. A preconfigured value associated with an animation file is indicative of performance influence for turning off an animation feature associated with the animation file. Further, the processing circuitry turns off one or more animation features according to the preconfigured values associated with the animation files until an adequate frame rate is achieved.

Abstract: A system for monitoring objects at sporting events or other types of events uses a wearable drone that has at least one camera or other sensor for capturing or otherwise sensing data. When the drone is to be used for monitoring, such as monitoring an object at a sporting event, the wearable drone may be detached from its user, and it may hover or otherwise fly within a certain position of an object to be monitored. While flying, the drone's sensor may be used to capture information, such as performance data or images, of the object during the sporting event.

Abstract: A novel electronic system provides real-time movement-mirroring and three-dimensional (3D) holographic avatar superimposition on a human subject or another physical target located in a holographic mixed-reality environment. In the visual perspectives of a holographic mixed-reality environment viewer wearing a mixed-reality headset or another mixed-reality visualization device, the physical target becomes invisible and is replaced by a 3D holographic avatar in the same coordinates of the physical space where the holographic mixed-reality environment is active. Typically, the 3D holographic avatar is chosen by a system user to represent or “body double” a particular physical target prior to activating the holographic mixed-reality environment.

Abstract: An input information acquiring section accepts a user's operation. A texture region acquiring section acquires a region of a display image to be presented by use of a texture. A velocity acquiring section acquires for each pixel a movement velocity vector of the texture on a plane of the display image. A texture referencing section adjusts a reference range in an axial direction of the velocity vector in keeping with a magnitude of the movement velocity, before sampling texel values. A pixel value determining section determines a pixel value on the basis of the texel values. An output section outputs the display image.

Abstract: In a method, one or more processing devices perform operations. Such operations include receiving a signal to display a widget for one or more objects displayed in virtual space. The operations further include computing a bounding box for the one or more objects, the bounding box including a bottom section having a set of corners. The operations further include determining, from among the set of corners, a first corner and a second corner that are, respectively, closest and second closest to a virtual camera position. The operations further include generating the widget based on the bounding box, the first corner, and the second corner. The widget includes a first axis handle connected to a second axis handle at the first corner and further connected to a third axis handle at the second corner. The operations further include causing display of the widget along with the one or more objects.

Abstract: A method for of playing an animation image, the method including: obtaining a plurality of images; displaying a first image of the plurality of images; detecting a first event as a trigger to play the animation image for a first object of the first image; and playing the animation image for the first object using the plurality of images.

Abstract: A system for indexing animated content receives detections extracted from a media file, where each one of the detections includes an image extracted from a corresponding frame of the media file that corresponds to a detected instance of an animated character. The system determines, for each of the received detections, an embedding defining a set of characteristics for the detected instance. The embedding associated with each detection is provided to a grouping engine that is configured to dynamically configure at least one grouping parameter based on a total number of the detections received. The grouping engine is also configured to sort the detections into groups using the grouping parameter and the embedding for each detection. A character ID is assigned to each one of the groups of detections, and the system indexes the groups of detections in a database in association with the character ID assigned to each group.

Abstract: In one embodiment, a method includes identifying a first user in an input image, accessing social data of the first user in the input image, where social data comprises information from a social graph of an online social network, selecting, based on social data of the first user in the input image, a mask from a set of masks, where the mask specifies one or more mask effects, and for each of the input images, applying the mask to the input image. The set of masks may comprise masks previously selected by friends of the first user within the online social network. The selected mask may be selected from a lookup table that maps the social data to the selected mask.

Abstract: A rendering device includes at least one memory and at least one processor. The at least one processor acquires information about projection data in a 2D space from information about a region of a 3D model; stores the information about the projection data in association with the information about the region in the at least one memory; and generates the projection data based on the information about the projection data. The associated information includes information associating an identifier given to a part of regions obtained by dividing the 3D model with information about a position where the part of the regions is projected in the 2D space.

Abstract: In a method modifying a user's virtual environment, a banking module retrieves and analyzes context data associated with the user. The banking module applies user and location parameters to determine whether at least one of an avatar modification and an environment modification is available for rendering. Responsive to determining that the avatar selection is not available for rendering, determining whether the avatar is accessible to the user. Responsive to determining that avatar is not accessible to the user, presenting the avatar selection for redemption.

Abstract: In some implementations, a method includes obtaining a first mesh portion and a second mesh portion associated with a skeleton of an object. The first mesh portion and the second mesh portion meet at a skeletal joint that is located on the skeleton. It is detected that a combination of the first mesh portion and the second mesh portion satisfies a joint telemetry criterion. A deformation joint is associated with at least one of the first mesh portion or the second mesh portion. The deformation joint is positioned at a distance away from the skeleton. The deformation joint has a flexion that is a function of the first mesh portion, the second mesh portion and the joint telemetry criterion. A display of the object is modified after associating the deformation joint with the at least one of the first mesh portion or the second mesh portion.

Abstract: In a computer-implemented method for using an application platform to design an application, an interface for developing an application is displayed at a computer system, the interface including a plurality of components for use in visually designing the application. A selection of a component is received at the interface. A placement of the component in the application is received within the interface. The application is compiled such that the application executes natively on a target processor, and where the application is bound directly to a native graphics library associated with the target processor. A style selection for the component of the application is received, the style selection modifying an appearance of the component. The application including the style selection is executed within the interface during design time such that the component is rendered according to the style selection without re-compiling the application.

Abstract: Embodiments provide systems, methods, and computer storage media for text style suggestions and/or text emphasis suggestions. In an example embodiment, an electronic design application provides a text style suggestion tool that generates text style suggestions to stylize a selected text element based on the context of the design. A text emphasis tool allows a user to select a text element and generate text emphasis suggestions for which words should be emphasized with a different text styling. Various interaction elements allow the user to iterate through the suggestions. For example, a set of style suggestions may be mapped to successive rotational increments around a style wheel, and as the user rotates through the positions on the style wheel, a corresponding text style suggestion is previewed and/or applied.

Abstract: Methods and systems for representing emotions of an audience of spectators viewing online gaming of a video game include capturing interaction data from spectators in an audience engaged in watching gameplay of the video game. The captured interaction data is aggregated by clustering the spectators into different groups in accordance to emotions detected from the spectators in the audience. An avatar is generated to represent emotion of each group and expressions of the avatar are dynamically adjusted to match changes in the expressions of the spectators of the respective group. The avatars representing distinct emotions of different group of spectators is presented alongside content of the video game. A size of the avatar for each distinct emotion is influenced by the confidence score associated with the respective group of spectators.

Abstract: Video server systems and methods for providing video streams to a plurality of remote clients are described. In one implementation, the video streams are based on game states received from a remote game server. The game states are dependent on game commands received by the video server system from the remote clients and forwarded to the remote game server. The video server system is configured to appear, from the point of view of the game server, as more than one client. For example, the video server system may receive game states from the remote game server at more than one different Internet Protocol address and each of these Internet Protocol addresses may be associated with a different game session.

Abstract: The specification describes methods and systems for increasing a dimensional depth of a two-dimensional image of a face to yield a face image that appears three dimensional. The methods and systems identify key points on the 2-D image, obtain a texture map for the 2-D image, determines one or more proportions within the 2-D image, and adjusts the texture map of the 3-D model based on the determined one or more proportions within the 2-D image.

Abstract: Learning to estimate a 3D body pose, and likewise the pose of any type of object, from a single 2D image is of great interest for many practical graphics applications and generally relies on neural networks that have been trained with sample data which annotates (labels) each sample 2D image with a known 3D pose. Requiring this labeled training data however has various drawbacks, including for example that traditionally used training data sets lack diversity and therefore limit the extent to which neural networks are able to estimate 3D pose. Expanding these training data sets is also difficult since it requires manually provided annotations for 2D images, which is time consuming and prone to errors. The present disclosure overcomes these and other limitations of existing techniques by providing a model that is trained from unlabeled multi-view data for use in 3D pose estimation.

Abstract: A computing device that provides access to digital media items receives a command from an entity to share a digital media item that was uploaded by another entity. The computing device invokes an interface for trimming the digital media item in response to receiving the command. The computing device receives input for a trim operation to be performed on the digital media item. The computing device then provides a link or embed code for the digital media item for posting on a web site, wherein accessing the link or embed code causes the output of the trim operation to be presented to a user.

Abstract: A method for replicating a media stream generated by a transmitter device. The method can include communicating world context generated at the transmitter device and processing the received world context. The generated world context is associable with description generated based on an application being run at the transmitter device. The generated world context can be based upon to generate the media stream in a manner such that description of the generated media stream can be associated with the description generated based the application being run. Processing of the received world context can be in a manner so as to replicate the media stream generated at the transmitter device. Description of the replicated media stream can correspond to the description of the media stream at the transmitter device. The received world context can be further processed in a manner so as to change the description associable with the replicated media stream.

Abstract: A method and a device for controlling deformation on an image, and a hardware device are provided. In the method for controlling deformation on an image, a to-be-processed image is acquired; an audio file is acquired; the audio file is played and a first attribute value of the audio file corresponding to a current time point is acquired; an extent of the deformation on the image is determined based on the first attribute value; and deformation processing is performed on the to-be-processed image based on the extent of the deformation on the image. With the method for controlling deformation on an image, the extent of the deformation on the image is controlled based on the attribute value of the audio file, thereby solving the technical problem in the conventional technology that the special effects of deformation cannot be flexibly generated.

Abstract: A system and method for creating an embedded phoneme map from a corpus of speech in accordance with a multiplicity of acoustic features of the speech. The embedded phoneme map is used to determine how to pronounce borrowed words from a lending language in the borrowing language, using the phonemes of the borrowing language that are closest to the phonemes of the lending language. The embedded phoneme map is also used to help linguists visualize the phonemes being pronounced by a speaker in real-time and to help non-native speakers practice pronunciation by displaying the differences between proper pronunciation and actual pronunciation for open-ended speech by the speaker.

Abstract: Disclosed is a method and apparatus for generating a three-dimensional particle effect, an electronic device and a computer readable storage medium. The method comprises: receiving a three-dimensional particle resource package; parsing a configuration file of the three-dimensional particle resource package; displaying parameter configuration items corresponding to the configuration file on the display apparatus, the parameter configuration items at least comprises a three-dimensional particle system parameter configuration item, a three-dimensional particle emitter parameter configuration item, and a three-dimensional particle affector parameter configuration item; receiving a parameter configuration command to perform a parameter configuration for the above parameter configuration items; generating the three-dimensional particle effect according to parameters configured in the parameter configuration items.

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing a database of motions; receiving an input image including a body of a person; receiving a user input including a motion selected from the database of motions; segmenting the input image into a body portion and a background portion; fitting the body portion to a hair model; generating, based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; where generating the video includes detecting positions of key points associated with a head of the person in a frame of the video, generating an image of hair of the person based on the positions of the key points and the hair model, and inserting the image of the hair in the frame; and displaying the generated video.

Abstract: The present invention relates to a system, a method, and a program for preventing unauthorized copies of webcomics and tracking replicated webcomics. A method for preventing unauthorized copies of webcomics according to one embodiment of the present invention comprises: a step (S100) in which a service server separates and stores webcomic images and dialogue text which are included in general webcomic data; a step (S110) of recognizing a user operation for a user client and recognizing a point on a webcomic that has moved from an initial position; and a step (S120) of providing final webcomic data that combines the webcomic images and the dialogue text with respect to an area displayed in real time on a screen of the user client.

Abstract: In one embodiment, a service receives signal characteristic data indicative of characteristics of wireless signals received by one or more antennas located in a particular area. The service identifies an object in the particular area, based on the received signal characteristic data. The service associates the identified object with an object kinematics model. The service updates the object kinematics model over time by applying Bayesian inference to changes in the signal characteristic data.

Abstract: A non-transitory computer-readable medium including a video game processing program for causing a server to perform functions regarding a search of a moving route in a virtual space is provided. The functions includes: a setting function configured to set a navigation mesh corresponding to a movable area of an object in a virtual space; an arranging function configured to arrange a plurality of waypoints on the set navigation mesh in accordance with a predetermined arrangement rule; a generating function configured to generate a plurality of regions by grouping the plurality of waypoints arranged in the virtual space based on a predetermined classification rule; a determining function configured to determine movable regions based on arrangement of the plurality of regions thus generated; and a searching function configured to search a moving route of the object based on the waypoints included in the determined movable regions.

Abstract: Systems and methods for generating a video of a user-defined virtual reality scene are disclosed. Exemplary implementations may: obtain a scene definition; obtain camera information for multiple virtual cameras to be used in generating a two-dimensional presentation of the virtual reality scene; execute a simulation of the virtual reality scene from the scene definition for at least a portion of the scene duration; obtain camera timing instructions specifying which of the virtual cameras should be used to generate the two-dimensional presentation of the virtual reality scene as a function of progress through the scene duration; generate the two-dimensional presentation of the virtual reality scene in accordance with the camera timing instructions and the camera information.

Abstract: An animation system wherein a machine learning model is adopted to generate animated facial actions based on parameters obtained from a live actor. Specifically, the anatomical structure such as a facial muscle topology and a skull surface that are specific to the live actor may be used. A muscle structure of simplified “pseudo” muscles that approximate the actual muscle topology but with reduced degree of freedom is determined to improve computational efficiency.

Abstract: An apparatus providing interactive content includes an input interface configured to sense an input of a user, a display configured to output a video, at least one memory configured to store instructions for performing a certain operation, and at least one processor operably connected to the at least one memory and configured to execute the instructions. The processor provides, when a plurality of animation units including object information for specifying an object to be output in the video and driving information for defining motion of the object are played, interactive content played by the object moving according to the driving information to a user, receives information of the user to be reflected in the interactive content, inserts the information of the user to a part of the object information, and plays at least one of the plurality of animation units to play the interactive content.

Abstract: A computing system and method to implement a three-dimensional virtual reality world with avatar posture animation without user posture tracking devices. A position and orientation of a respective avatar in the virtual reality world is tracked to generate a view of the virtual world for the avatar and to present the avatar to others. In response to input data tracking a position, orientation, and motions of a head of a user of the virtual reality world, the server system uses a posture model to predict, from the input data, a posture of an avatar of the user in the virtual reality world, and computes an animation of the avatar showing the posture of the avatar in the virtual reality world.

Abstract: In an example embodiment, a platform is provided that utilizes information available to a computer system to feed a neural network. The neural network is trained to determine both the probability that a searcher would select a given potential search result if it was presented to him or her and the probability that a subject of the potential search result would respond to a communication from the searcher. These probabilities are combined to produce a single score that can be used to determine whether to present the searcher with the potential search result and, if so, how high to rank the potential search result among other search results. During the training process, a rescaling transformation for each input feature is learned and applied to the values for the input features.

Abstract: A graphical user interface comprising at least two layers is displayed. One layer comprises a still and video image layer. The still and video image layer comprises a plurality of still images and a plurality of video content items. One layer comprises an interactive icon layer. The interactive icon layer comprises a plurality of icons. Upon receiving a first navigation request, one the plurality of still images currently being rendered is replaced with another of the plurality of still images. Upon receiving an activation of one of the interactive icons, text and/or graphics or one of a plurality of electronic forms for capturing data input is displayed. Upon the occurrence of a triggering event, the still image ceases to be displayed and, instead, one of the plurality of video content items is displayed. The displayed video content item is randomly selected from the plurality of video content items.

Abstract: A diagnosis support system having a processor configured to acquire medical images; detect a medicine and/or equipment used when the medical images are captured, from the medical images by image recognition; detect a region of interest from the medical images by image recognition; assign, to the medical image from which the medicine and/or equipment is detected, first detection information indicating the detected medicine and/or equipment; and assign, to the medical image from which the region of interest is detected, second detection information indicating the detected region of interest, display, on a display device, the medical images in a list in a display form according to the first detection information and the second detection information.

Abstract: An animation system wherein scanned facial expressions are processed to form muscle models that can be used to generate expressions based on specification of a strain vector and a control vector of the muscle model.

Abstract: A non-transitory computer-readable medium stores an image generation program to perform a method. The method includes determining, in a scene including a timing of a hit of an attack in a battle between characters in a game space, the timing of the hit, and a predetermined portion of a predetermined character and an opponent portion of an opponent character in the battle where the hit will occur, from the predetermined character, the opponent character, and animation data that causes at least the opponent character to perform an action of the battle; calculating a vector from the predetermined portion to the opponent portion at the hit timing; and generating an image of the scene by moving a position of the opponent portion in each frame included in the scene by using the vector such that the opponent portion hits the predetermined portion at the hit timing.

Abstract: An animation system wherein scanned facial expressions are processed to form muscle models that can be used to generate expressions based on specification of a strain vector and a control vector of the muscle model.

Abstract: A combustion simulation system is provided. The combustion simulation system can be performed using a computing device operated by a computer user or artist. The computer-implemented method of simulating a combustion process includes receiving a set of data representing a fluid flow. The fluid flow can include combustion precursors. The method includes simulating a chemical reaction representing simulated combustion of these precursors generating combustion byproducts. The method can include determining a change in temperature of the combustion byproducts due to the chemical reaction, determining a change in molar mass of the combustion byproducts due to the chemical reaction, determining a divergence of the combustion byproducts based on a combination of the change in the temperature and the change in molar mass, and generating data structures of the simulated combustion based on values of the fluid flow.

Abstract: Aspects of the present disclosure relate to automatic weight calculation and determination of unassigned variables within an entity. More specifically, the present disclosure provides a display of automatically calculated weights for unassigned content mapped to an animation token in an animation set. For example, based on a user input of content without an assigned weight, the animation application may automatically calculate the unassigned weight (and any other unassigned weights for content mapped to an animation token). The automatically calculated unassigned weights may then be displayed without any additional user input along with an indication of automatic calculation.

Abstract: In one implementation, a method includes: identifying a first plot-within a scene associated with a portion of video content; synthesizing a scene description for the scene that corresponds to a trajectory of the first plot-effectuator within a setting associated with the scene and actions performed by the first plot-effectuator; and generating a corresponding synthesized reality (SR) reconstruction of the scene by driving a first digital asset associated with the first plot-effectuator according to the scene description for the scene.

Abstract: To provide a game presenting system having a plurality of game systems for each executing a process of a game in which a plurality of users participate, and a game presenting machine for presenting a situation of the game executed by the game system, wherein the game presenting machine obtains a motion image related to the game executed by each of the plurality of game systems, and produces a game presenting screen image showing, as a list, at least some of the plurality of motion images obtained.

Abstract: The present invention provides a horizontal calibration method and system for a panoramic image or video, and a portable terminal. The method comprises: receiving images or video frames of two circles after being imaged by two cameras having opposite photographing directions; obtaining a horizontal calibration matrix during photographing; and pasting, according to the horizontal calibration matrix, the images or video frames of the two circles to a left hemispherical curved surface and a right hemispherical curved surface of a spherical panoramic mathematical model in a UV mapping manner, respectively so that the panoramic images or video frames pasted in the spherical panoramic mathematical model are horizontal. According to the present invention, when an image or a video frame photographed by a panoramic camera is not horizontal, the panoramic image or the video frame pasted in a spherical panoramic mathematical model is still horizontal.