Animation Patents (Class 345/473)
  • Patent number: 11386653
    Abstract: In one implementation, a method includes: identifying a first plot-within a scene associated with a portion of video content; synthesizing a scene description for the scene that corresponds to a trajectory of the first plot-effectuator within a setting associated with the scene and actions performed by the first plot-effectuator; and generating a corresponding synthesized reality (SR) reconstruction of the scene by driving a first digital asset associated with the first plot-effectuator according to the scene description for the scene.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: July 12, 2022
    Inventors: Ian M. Richter, Daniel Ulbricht, Jean-Daniel E. Nahmias, Omar Elafifi, Peter Meier
  • Patent number: 11383163
    Abstract: To provide a game presenting system having a plurality of game systems for each executing a process of a game in which a plurality of users participate, and a game presenting machine for presenting a situation of the game executed by the game system, wherein the game presenting machine obtains a motion image related to the game executed by each of the plurality of game systems, and produces a game presenting screen image showing, as a list, at least some of the plurality of motion images obtained.
    Type: Grant
    Filed: January 28, 2020
    Date of Patent: July 12, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Yumi Kataoka
  • Patent number: 11388336
    Abstract: The present invention provides a horizontal calibration method and system for a panoramic image or video, and a portable terminal. The method comprises: receiving images or video frames of two circles after being imaged by two cameras having opposite photographing directions; obtaining a horizontal calibration matrix during photographing; and pasting, according to the horizontal calibration matrix, the images or video frames of the two circles to a left hemispherical curved surface and a right hemispherical curved surface of a spherical panoramic mathematical model in a UV mapping manner, respectively so that the panoramic images or video frames pasted in the spherical panoramic mathematical model are horizontal. According to the present invention, when an image or a video frame photographed by a panoramic camera is not horizontal, the panoramic image or the video frame pasted in a spherical panoramic mathematical model is still horizontal.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: July 12, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Yuming Xie, Wenxue Peng
  • Patent number: 11380094
    Abstract: A server may assign human personality traits to inanimate objects. In an example, a server may effectuate operations that include obtaining information about an object over a period; comparing the information to usage factors, interaction factors, or environmental factors that are linked to thresholds for a personality; based on the comparing, assigning the personality to the object; and based on the personality of the object, assigning an avatar to the object.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: July 5, 2022
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Robert Koch, Nikhil Marathe, James Pratt, Ari Craine, Eric Zavesky, Timothy Innes, Nigel Bradley
  • Patent number: 11380366
    Abstract: A system and method for generating enhanced closed captioning commands are described. A video having multiple frames is received in a content building environment. Along with the video, user input defining an appearance and a location of text to be displayed is received. The appearance and the location of text correspond to one or more of the frames of the video. The appearance and the location of text are synchronized with each of the frames of the video. A design packet is generated based on the received user input. A delivery packet is generated that includes the design packet, the video, a video timecode, a text timecode, and enhanced closed captioning commands. The delivery packet is provided to a user device for playback.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: July 5, 2022
    Assignee: Vooks, Inc.
    Inventors: Russell Powell Hirtzel, Marshall Bex, IV
  • Patent number: 11379520
    Abstract: A method and a device for controlling deformation on an image, and a hardware device are provided. In the method for controlling deformation on an image, a to-be-processed image is acquired; an audio file is acquired; the audio file is played and a first attribute value of the audio file corresponding to a current time point is acquired; an extent of the deformation on the image is determined based on the first attribute value; and deformation processing is performed on the to-be-processed image based on the extent of the deformation on the image. With the method for controlling deformation on an image, the extent of the deformation on the image is controlled based on the attribute value of the audio file, thereby solving the technical problem in the conventional technology that the special effects of deformation cannot be flexibly generated.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: July 5, 2022
    Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
    Inventors: Yanhao Shen, Xu Fan, Guangyao Ni, Hui Yang
  • Patent number: 11373384
    Abstract: This application provides a method for configuring parameters of a three-dimensional face model. The method includes: obtaining a reference face image; identifying a key facial point on the reference face image to obtain key point coordinates as reference coordinates; and determining a recommended parameter set in a face parameter value space according to the reference coordinates. The first projected coordinates are projected coordinates of the key facial point obtained by projecting a three-dimensional face model corresponding to the recommended parameter set onto a coordinate system. The proximity of the first projected coordinates to the reference coordinates meets a preset condition.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: June 28, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Mu Hu, Sirui Gao, Yonggen Ling, Yitong Wang, Linchao Bao, Wei Liu
  • Patent number: 11372244
    Abstract: The present disclosure provide a laser beam scanning display device and augmented reality (AR) glasses, comprising a focusing lens, a laser emitter located at a focal point of the focusing lens, a beam combiner, a micro-electromechanical assembly and a projection lens. The laser emitter emits trichromatic laser signals, which are irradiated into the beam combiner via the focusing lens. The beam combiner converges the trichromatic laser signals into a convergent laser signal and emits it to the micro-electromechanical assembly. The micro-electromechanical assembly scans the received convergent laser signal to generate a content to be displayed. In the above laser beam scanning display device, the content to be displayed, which is generated by the micro-electromechanical assembly, is displayed on the screen via the projection lens, which dispenses with any laser signal reflecting or transmitting means, thus reducing the volume of the device.
    Type: Grant
    Filed: December 25, 2017
    Date of Patent: June 28, 2022
    Assignee: GOERTEK TECHNOLOGY CO., LTD.
    Inventors: Jin Wang, Bin Jiang
  • Patent number: 11375209
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for processing a video frame. The method may include: acquiring a sequence of video frames of a video; ascertaining, in the sequence of the video frames, a previous frame, and ascertaining, in the sequence of the video frames, a subsequent frame corresponding to the ascertained previous frame based on acquired number of frames from the previous frame to the subsequent frame. An update step is performed as follows: acquiring object regions detected respectively in the ascertained previous frame and the ascertained subsequent frame, and confidence levels of the object regions; fusing a confidence level of a first object region and a confidence level of a second object region, and updating the confidence level of the second object region based on the fusion result; and updating the ascertained previous frame and the ascertained subsequent frame.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: June 28, 2022
    Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.
    Inventors: Xiaoming Wang, Huaifei Xing, Wenpeng Ding, Huifeng Shen, Feifei Cao
  • Patent number: 11375288
    Abstract: Systems and methods for providing a message to a messaging platform include capturing, by a client device installed as a fixture at a location of a live event, media of a participant of the live event. Input is obtained from the participant by the client device. A message is created based on the input comprising the media and authored by a messaging platform account associated with the live event. The message is provided to a messaging platform for broadcasting to accounts associated with the account associated with the event.
    Type: Grant
    Filed: April 2, 2015
    Date of Patent: June 28, 2022
    Assignee: TWITTER, INC.
    Inventors: James R. Buckhouse, Andrew Jared Adashek, Andrew W. McClain
  • Patent number: 11367233
    Abstract: A system and method of creating customized characters and selectively displaying them in an electronic display, such as an augmented reality or virtual reality display is provided. A digital character may be provided by a character provider for customization by others using the system. Such customizations may be instantiated in user devices that provide electronic displays. Instantiation of the custom digital character may be conditioned on one or more trigger conditions, which may be specified by the character customizer. For example, a digital character customized using the system may be conditioned on triggering events in the real-world or in a virtual world. When a relevant triggering condition is satisfied at a user device, the custom character (i.e., information for instantiating the custom character) may be transmitted to that user device. In this manner, the system may push custom characters to user devices that satisfy the triggering condition.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: June 21, 2022
    Assignee: Pure Imagination Holdings, LLC
    Inventors: Lisa Gai-Tzen Wong, Amit Tishler, Richard Paul Weeks
  • Patent number: 11367241
    Abstract: Raytracing can be used to generate high quality, physics-based water caustics patterns in real time. A caustics map is generate to represent locations and normals of points across a water surface. Rays from a light source that are reflected and refracted from these points, as determined by the locations and normals, and can generate hit points on a surface. Neighboring points can be used to help determine the resulting caustics pattern. In one embodiment, information for neighboring points in the caustics map can be used to generate scale factors for geometric regions to be projected onto the surface for each hit point. In another embodiment, these points serve as vertices of a caustic mesh that can be projected onto the surface, where the brightness at a primitive is determined by the size of the primitive area defined by the vertices of the caustics mesh.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: June 21, 2022
    Assignee: NVIDIA CORPORATION
    Inventors: Xueqing Yang, Nan Lin
  • Patent number: 11361750
    Abstract: Disclosed is an electronic device. Other various embodiments as understood from the specification are also possible.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: June 14, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seong Min Je, Yong Joon Jeon, Kyung Tae Kim, June Sig Sung
  • Patent number: 11361496
    Abstract: Described herein is a graphics processing unit (GPU) comprising a single instruction, multiple thread (SIMT) multiprocessor comprising an instruction cache, a shared memory coupled with the instruction cache, and circuitry coupled with the shared memory and the instruction cache, the circuitry including multiple texture units, a first core including hardware to accelerate matrix operations, and a second core configured to receive an instruction having multiple operands in a bfloat16 (BF16) number format, wherein the multiple operands include a first source operand, a second source operand, and a third source operand, and the BF16 number format is a sixteen-bit floating point format having an eight-bit exponent and process the instruction, wherein to process the instruction includes to multiply the second source operand by the third source operand and add a first source operand to a result of the multiply.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: June 14, 2022
    Assignee: Intel Corporation
    Inventors: Subramaniam Maiyuran, Shubra Marwaha, Ashutosh Garg, Supratim Pal, Jorge Parra, Chandra Gurram, Varghese George, Darin Starkey, Guei-Yuan Lueh
  • Patent number: 11361163
    Abstract: Systems and methods develop a natural language interface. Conversational data including user utterances is received for a plurality of conversations from a natural language interface. Each of the conversations is classified to determine intents for each user utterance, and for each of the conversations, a control flow diagram showing the intents and sequential flow of the conversation is generated. Each of the control flow diagrams is processed to generate a graph embedding representative of the conversation. A previous conversation that is similar to the current conversation is identified from a previous graph embedding that is nearest to a current graph embedding of a most recent utterance in a current conversation. A previous outcome of the previous conversation is used to predict an outcome of the current conversation, which, when not positive, may control response outputs of the natural language interface to steer the current conversation towards a positive result.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: June 14, 2022
    Assignee: MUYVENTIVE, LLC
    Inventor: Zvi Topol
  • Patent number: 11354841
    Abstract: The present disclosure discloses a speech-driven facial animation generation method. The method is mainly divided into six steps: extracting speech features, collecting frequency information, summarizing time information, decoding action features, driving a facial model, and sliding a signal window. The present disclosure can drive, according to an input speech audio signal, any facial model in real time under a particular delay to generate animation. The quality of the animation reaches the currently most advanced speech animation technology level, and has the characteristics of light weight and good robustness. The present disclosure can be used to generate speech animation under different scenes, such as VR virtual social networking, and virtual speech assistants and games.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: June 7, 2022
    Assignees: ZHEJIANG UNIVERSITY, FACEUNITY TECHNOLOGY CO., LTD.
    Inventors: Kun Zhou, Yujin Chai, Yanlin Weng, Lvdi Wang
  • Patent number: 11354508
    Abstract: A method for processing a narrative generated by an artificial Intelligence based natural language generator, to assess relationships between words and phrases in the generated narrative, where necessary, to replace particular words and phrases and more clearly convey a desired intended semantic content of the generated narrative, and/or generate learning data for use by the natural language generator to improve its text generating operation. Based on an input received by the AI based natural language generator, the method generates a narrative, processing the narrative by implementing one or more mechanisms to provide at least one cue in the narrative, in accordance with a plurality of rules to identify semantic content and based on a cue, and the identified semantic content of the narrative, determining how relationships between the words and phrases comprising the narrative could be altered to more clearly convey the semantic content, to realize a directive and communicating the directive.
    Type: Grant
    Filed: May 20, 2019
    Date of Patent: June 7, 2022
    Assignee: Truthful Speakimg, Inc.
    Inventor: Zamir Korn
  • Patent number: 11354878
    Abstract: A simulator computes surfaces corresponding to objects in a simulation by computing covariance matrices for particles that use a square root of a diagonal matrix. The simulator might operate by receiving positions and sizes for each particle of a plurality of particles comprising a first object, identifying a subset of the plurality of particles whose positions are proximate to a first surface of the first object, deforming particles of the subset of the plurality of particles by generating a covariance matrix for each particle of the plurality of particles, using a square root of a diagonal matrix, wherein the diagonal matrix is a diagonal matrix of neighboring particles for each particle of the plurality of particles, and computing the first surface of the first object based on the deformed particles.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: June 7, 2022
    Assignee: Unity Technologies SF
    Inventors: Alexey Stomakhin, Daniel Martin Elliott Jones
  • Patent number: 11344193
    Abstract: A method for performing an assessment of vision is provided, and comprises: determining a current difficulty level for the assessment; displaying a question of the assessment, the question including a visual element that has a movable pattern, the movable pattern having at least one variable attribute that is related to the current difficulty level; in response to receipt of an inputted answer, determining whether the inputted answer is correct; and determining whether the assessment is to be concluded, and in the affirmative, generating a result of the assessment based on the current difficulty level.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: May 31, 2022
    Assignee: CHANG GUNG UNIVERSITY
    Inventors: Jyh-Da Wei, Jerry Chien-Chieh Huang, Shin-Yi Chen
  • Patent number: 11348297
    Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: May 31, 2022
    Assignee: Snap Inc.
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11348286
    Abstract: A realistic feather generation may be represented via a user interface in a modeling system. To perform the feather generation, a curve defining a spine of a feather is received from input to the user interface of the modeling system. The feather is created in the user interface based at least on the curve, where the feather includes barbs extended away from the spine of the feather in one or more directions. The feather is deformed based on one or more deformation parameters. A feather contour of the barbs along at least one of the one or more directions is generated based on a contour parameter defining the feather contour. A barb density for a number of the barbs along the spine of the feather is established based on a barb density parameter. Thereafter, a data structure representing the feather is generated.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: May 31, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Christoph Sprenger, Matthias Baas
  • Patent number: 11341182
    Abstract: The invention relates to a field of data processing, and more specifically to electronic devices for selecting articles, that includes a server adapted for connection, by means of a unified network, with user client devices, said server comprising interconnected elements including a module for the input of a plurality of images of articles; connected thereto a module for producing a three-dimensional model of articles; a module for the input of a plurality of images of a bulk body, with which the articles to be selected are compared; connected thereto a module for producing a three-dimensional model of the bulk body; a database of articles with three-dimensional models of the articles in question; a database of bulk bodies with three-dimensional models of the bulk bodies in question; connected to the databases a module for comparing, on the same scale, the three-dimensional model of the bulk body and the three-dimensional model of articles; and, connected thereto, a module for sending the results of the compa
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: May 24, 2022
    Inventor: Artashes Valeryevich Ikonomov
  • Patent number: 11341925
    Abstract: A portable information handling system presents visual images at first and second displays integrated in first and second rotationally-coupled housing portions. When the housing portions rotate to a clamshell configuration, a keyboard disposed on one of the displays accepts keyed inputs and, to save power, backlight segments below the keyboard are powered down. The display can present information as visual images proximate the keyboard with illumination provided by other backlight segments or by a secondary light source that is presented in coordination with liquid crystal panel pixels transitioning to transparent and opaque states.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: May 24, 2022
    Assignee: Dell Products L.P.
    Inventors: Jace W. Files, John T. Morrison, Gerald R. Pelissier, Preeth K. Srinivasan
  • Patent number: 11340751
    Abstract: Methods and devices for providing a virtual keyboard in connection with a multiple screen device are provided. More particularly, information displayed on the screen of a multiple screen device having a current focus of the user is identified, and is presented by a top screen. The virtual keyboard is presented by the bottom screen. The virtual keyboard can be dismissed in response to detecting a change in the focus of the user.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: May 24, 2022
    Assignee: Z124
    Inventors: Sanjiv Sirpal, Martin Gimpl
  • Patent number: 11334990
    Abstract: Provided are an information processing apparatus, an information processing method, and a program capable of accurately extracting a target region from a medical image. An information processing apparatus includes an extraction unit that extracts information indicating a physique of a subject from an image acquired by imaging the subject, a specification unit that specifies a group into which the subject is classified by using the information indicating the physique of the subject extracted by the extraction unit, and a generation unit that generates a learned model for each group through machine learning using, as learning data, image data indicating a medical image acquired by imaging the subject for each group and information indicating a region extracted from the medical image.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: May 17, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Kenta Yamada
  • Patent number: 11335027
    Abstract: In one example in accordance with the present disclosure, a system is described. The system includes a pose estimator to identify a plurality of anatomical points on a person depicted in an image. A frame former of the system generates a frame for the person by connecting a first set of the plurality of anatomical points to form a skeleton and forming at least a head region and a torso region of the person based on a second set of the plurality of anatomical points. A map generator of the system generates a spatial gradient map projecting outwards from the frame. In the system, the spatial gradient map is based on pixel distance from the frame and an intensity along the gradient map indicates a pixels likelihood of form a part of the person.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: May 17, 2022
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Weijuan Xi, Qian Lin, Jan Phillip Allebach
  • Patent number: 11328103
    Abstract: A computer-implemented method for inverse simulation of a plurality of fibers. The method comprises: providing a computational model for describing mechanical behavior of fibers; obtaining target geometry information describing a target configuration or dynamical behavior of the plurality of fibers; and inverse simulating the behavior of the plurality of fibers, using the computational model and the target geometry information, to calculate a target set of fiber mechanical parameters for the plurality of fibers. Fibers with the calculated target set of fiber mechanical parameters exhibit the target configuration or dynamical behavior. In some embodiments, the inverse simulation comprises using analysis-by-synthesis to help derive the target set of fiber mechanical parameters. In some embodiments, the inverse simulation uses a neural network to infer information about fiber mechanical parameters from the target geometry information. The invention also provides a method of training the neural network.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: May 10, 2022
    Assignee: The Procter and Gamble Company
    Inventors: Knut Meinert, Dominik L Michels
  • Patent number: 11330022
    Abstract: Providing a user experience on a multimodal communications terminal configured to communicate according to a plurality of communication includes: executing a single application that provides a user experience (UX) for controlling user selection of preferences of the plurality of communication methods when originating or receiving communication sessions; and providing, via the single application, a selectable control that is persistent such that the selectable control is displayed in any screen of the single application, wherein the control allows selection of one of the plurality of communication methods to use for a particular communication session.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: May 10, 2022
    Assignee: Avaya Inc.
    Inventors: Jason G. Tanabe, Kyle Klassen, Geoffrey L. Baskwill, Jason Milley
  • Patent number: 11323754
    Abstract: Aspects of the subject disclosure may include, for example, embodiments comprising obtaining a plurality of original frames for video content, receiving a first viewpoint from a mobile device, and processing the plurality of original frames according to the first viewpoint generating a plurality of first viewpoint frames. Further embodiments include providing the plurality of first viewpoint frames to the mobile device, generating a group of delta frames in response to receiving a change in viewpoint from the mobile device, and providing the group of delta frames to the mobile device. The mobile device processes a portion of the plurality of first viewpoint frames according to the group of delta frames to generate a group of second viewpoint frames and the mobile device presents the group of second viewpoint frames. Other embodiments are disclosed.
    Type: Grant
    Filed: November 20, 2018
    Date of Patent: May 3, 2022
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Shu Shi, Varun Gupta, Rittwik Jana, John F. Murray, Michael Hwang
  • Patent number: 11321895
    Abstract: Digital character animation automated generation techniques are described that are implemented by an animation generation system via a computing device. These techniques enable the animation generation system to generate an animation of a digital character automatically and without user intervention responsive to a user input of a target action such that the digital character is capable of performing a complex set of actions in a precise and realistic manner within an environment contained within digital content, e.g., an animation as part of a digital video.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: May 3, 2022
    Assignee: Adobe Inc.
    Inventors: Wolfram Sebastian Starke, Jun Saito
  • Patent number: 11321891
    Abstract: The disclosure provides a method for generating action according to an audio signal and an electronic device. The method includes: receiving an audio signal and extracting a high-level audio feature therefrom; extracting a latent audio feature from the high-level audio feature; in response to determining that the audio signal corresponds to a beat, obtaining a joint angle distribution matrix based on the latent audio feature; in response to determining that the audio signal corresponds to a music, obtaining a plurality of designated joint angles corresponding to a plurality of joint points based on the joint angle distribution matrix; and adjusting a joint angle of each of the joint points on the avatar according to the designated joint angles.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: May 3, 2022
    Assignee: HTC Corporation
    Inventors: Tung-Ting Yang, Chun-Li Wang, Yao-Chen Kuo, Hung-Yi Yang
  • Patent number: 11295526
    Abstract: The invention is a method and system for creating an interactive virtual tour. The invention performs consecutive shooting sessions for capturing angularly spaced images of a place or property using a mobile terminal. Each session is performed by rotation of the terminal at a different location of the property, the terminal collects its orientation when capturing the first image of each session and generates for each session a panorama projection (P1-Pn) by automatically assembling captured images. After the first session each further session is performed by directing the terminal so that the first image of the session is substantially centered on a previous location. The collected orientation at the direction is used to create a linking vector between the first images of the further and previous sessions. The vectors are used to create interactive browsing capability upon assembly of the projections within an interactive virtual tour.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: April 5, 2022
    Assignee: NODALVIEW
    Inventor: Pierre De Preter
  • Patent number: 11295502
    Abstract: Examples of systems and methods for augmented facial animation are generally described herein. A method for mapping facial expressions to an alternative avatar expression may include capturing a series of images of a face, and detecting a sequence of facial expressions of the face from the series of images. The method may include determining an alternative avatar expression mapped to the sequence of facial expressions, and animating an avatar using the alternative avatar expression.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: April 5, 2022
    Assignee: Intel Corporation
    Inventors: Yikai Fang, Yangzhou Du, Qiang Eric Li, Xiaofeng Tong, Wenlong Li, Minje Park, Myung-Ho Ju, Jihyeon Kate Yi, Tae-Hoon Pete Kim
  • Patent number: 11295479
    Abstract: The systems and methods described herein can pre-process a blendshape matrix via a global clusterization process and a local clusterization process. The pre-processing can cause the blendshape matrix to be divided into multiple blocks. The techniques can further apply a matrix compression technique to each block of the blendshape matrix to generate a compression result. The matrix compression technique can comprise a matrix approximation step, an accuracy verification step, and a recursive compression step. The compression result for each block may be combined to generate a compressed blendshape matrix for rendering a virtual entity.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: April 5, 2022
    Assignee: ELECTRONIC ARTS INC.
    Inventor: Dmitry Andreevich Andreev
  • Patent number: 11295501
    Abstract: Most of the prior art references that generate animations fail to determine and consider head movement data. The prior art references which consider the head movement data for generating the animations rely on a sample video to generate/determine the head movements data, which, as a result, fail to capture changing head motions throughout course of a speech given by a subject in an actual whole length video. The disclosure herein generally relates to generating facial animations, and, more particularly, to a method and system for generating the facial animations from speech signal of a subject. The system determines the head movement, lip movements, and eyeball movements, of the subject, by processing a speech signal collected as input, and uses the head movement, lip movements, and eyeball movements, to generate an animation.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: April 5, 2022
    Assignee: Tata Consultancy Services Limited
    Inventors: Sandika Biswas, Dipanjan Das, Sanjana Sinha, Brojeshwar Bhowmick
  • Patent number: 11295113
    Abstract: A system includes an identification system and an information database for linking an unidentified animal (UA) to a registered animal. A requester sends the media corresponding to the UA to the identification system. The UA images are used for determining an orientation and position of the UA. A selected 3DSM of the registered animal may be reconfigured using a 3DSM generator by moving the movable joints of the 3DSM to have the same orientation and position as the UA images. A 2DSM generator is used to generate 2D synthetic images (2DSIs) of the selected 3DSM. The images of the unidentified animal are compared to the 2DSIs of the selected 3DSM. When a match probability exceeds a threshold probability, a match is reported to a requester. The requester can obtain permission from an owner to get access to the information pertaining to the UA.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: April 5, 2022
    Assignee: ID Lynx Ltd.
    Inventors: Christopher John Raczkowski, Liwen Zhang
  • Patent number: 11295504
    Abstract: Systems, methods, and non-transitory computer-readable media can receive render instructions for rendering an animation. The animation comprises a plurality of layers, each layer comprising one or more layer properties, and a first dynamic property to be defined at runtime prior to rendering the animation. The first dynamic property is mapped to a first set of layer properties of the one or more layer properties. A first dynamic property value is received for the first dynamic property. The first set of layer properties are defined based on the first dynamic property value. The animation is rendered on a computing device based on the render instructions and the first dynamic property value.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: April 5, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Robert Alexander Allen, Jr., Michael O'Brien, Nicholas J. Kwiatek, Alexander Zats, Jerod Wanner, Emily Dubinsky Gasca, Eduardo de Mello Maia, Christopher Slowik, Renyu Liu, Rajesh Janakiraman, David Graham McDermott
  • Patent number: 11295503
    Abstract: Aspects of the present disclosure are directed to creating interactive avatars that can be pinned as world-locked artificial reality content. Once pinned, an avatar can interact with the environment according to contextual queues and rules, without active control by the avatar owner. An interactive avatar system can configure the avatar with action rules, visual elements, and settings based on user selections. Once an avatar is configured and pinned to a location by an avatar owner, when other XR devices are at that location, a central system can provide the avatar (with its configurations) to the other XR device. This allows a user of that other XR device to discover and interact with the avatar according to the configurations established by the avatar owner.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: April 5, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Campbell Orme, Matthew Adam Hanson, Daphne Liang, Matthew Roberts, Fangwei Lee, Bryant Jun-Yao Tang
  • Patent number: 11295493
    Abstract: The present subject matter discloses system and method for generating a scalar vector graphics (SVG) image in an imaginary console. The system receives one or more image parameters, corresponding to the image, from the user. Further, the imaginary console emulates a browser environment by using a JavaScript Engine and a browser emulator. The SVG executer processes the one or more image parameters corresponding to the image to render the image on the imaginary console, and produces the image having SVG format. Further, the document generator module may convert the image having the SVG format into the raster image based on report format specified by the user. Further, the document generator module embeds the image into the offline readable format to be used by the user.
    Type: Grant
    Filed: October 14, 2016
    Date of Patent: April 5, 2022
    Inventors: Anurag Sanghai, Hemendra Vyas, Pratik Jain
  • Patent number: 11289125
    Abstract: According to one implementation, a media content conformation system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive an editing file including edits to media content, the edits being based on a compressed representation of the media content and having a first data format. The software code also obtains cross-referencing data that maps a timecode data of the compressed representation of the media content to segments of an uncompressed representation of the media content, and transforms the editing file to a conformation file including the edits in a second data format based on the cross-referencing data. The conformation file enables rendering of an edited version of the media content including the edits.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: March 29, 2022
    Assignee: Disney Enterprises, Inc.
    Inventors: David M. Adler, Giovanni Colombo, Jonathan Hartzberg, Colin Smith
  • Patent number: 11288511
    Abstract: Methods and systems are provided for displaying pertinent data, using augmented reality, to supplement information in images provided from a mobile communication device. The images can be analyzed to find one or more matched objects, and it can be determined whether recognized target components from the matched objects match one or more known patterns. Pertinent data pertaining to the known patterns can be sent to the mobile communication device so that it can be displayed using augmented reality to supplement information in the images.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: March 29, 2022
    Assignee: salesforce.com, inc.
    Inventors: Sachin Desai, Eugene Oksman
  • Patent number: 11282182
    Abstract: Embodiments of this disclosure provide an image processing method and apparatus, a computer-readable medium, and an electronic device. The image processing method includes: obtaining a to-be-processed image; determining a to-be-processed object in the to-be-processed image, the to-be-processed object comprising at least one of a human face, an animal face, or a cartoon character face; selecting a reference animated image to be applied to the to-be-processed image; processing the to-be-processed image according to the reference animated image, to generate a plurality of frames of images, each frame of the plurality of frames of images comprising the to-be-processed object; and composing the plurality of frames of images into a target animated image.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: March 22, 2022
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Le Yu, Neng Liu, Huiying Zhu, Youwei Hua
  • Patent number: 11284057
    Abstract: The image processing apparatus that generates a virtual viewpoint image includes a generation unit. The generation unit generates a virtual viewpoint image in which in accordance with a virtual viewpoint specified by the virtual viewpoint information. The degree of transparency of a specific object at a position a specific distance apart from a position of a first virtual viewpoint in a virtual viewpoint image in accordance with the first virtual viewpoint corresponding to a first angle of view, which is generated by the generation unit, is higher than a degree of transparency of an object at a position the specific distance apart from a position of a second virtual viewpoint in a virtual viewpoint image in accordance with the second virtual viewpoint corresponding to a second angle of view larger than the first angle of view.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: March 22, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Yuji Kato
  • Patent number: 11278807
    Abstract: A method for gaming, including establishing a first communication channel with a first computing device associated with a first user configured for implementing a first instance of a gaming application in association with a first game play of the first user. The method further including establishing a second channel with a second computing device associated with the first user. The method further including generating an interface including information related to the first game play of the first user and second game play of a second user playing the gaming application. The method further including delivering the interface and the information over the second channel to the second computing device for display concurrent with the first game play of the first user.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: March 22, 2022
    Assignee: Sony Interactive Entertainment LLC
    Inventors: Warren Benedetto, Landon Noss, Adil Sherwani, Akihiko Kusumoto, Nicole Hayashida
  • Patent number: 11282257
    Abstract: This disclosure generally relates to character animation. More specifically, but not by way of limitation, this disclosure relates to pose selection using data analytics techniques applied to training data, and generating 2D animations of illustrated characters using performance data and the selected poses. An example process or system includes obtaining a selection of training poses of the subject and a set of character poses, obtaining a performance video of the subject, wherein the performance video includes a plurality of performance frames that include poses performed by the subject, grouping the plurality of performance frames into groups of performance frames, assigning a selected training pose from the selection of training poses to each group of performance frames using the clusters of training frames, generating a sequence of character poses based on the groups of performance frames and their assigned training poses, outputting the sequence of character poses.
    Type: Grant
    Filed: November 22, 2019
    Date of Patent: March 22, 2022
    Assignees: Adobe Inc., Princeton University
    Inventors: Wilmot Li, Hijung Shin, Adam Finkelstein, Nora Willett
  • Patent number: 11278809
    Abstract: A non-transitory computer-readable medium stores an image generation program to perform a method which includes, in a scene including a hit timing of an attack in a battle between characters in a game space, determining the hit timing, and a standard portion of a standard character and an opponent portion of an opponent character in the battle which are supposed to hit each other, from the standard character, the opponent character, and animation data; and generating an image of a scene by applying the amination data to at least one of the opponent character and an actual character while moving the position of the actual or opponent character to generate the scene where a portion of the actual character corresponding to the standard portion hits the opponent portion at the hit timing. The actual character has a skeleton model corresponding to that of the standard character.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: March 22, 2022
    Assignee: KOEI TECMO GAMES CO., LTD.
    Inventor: Yuishin Takafuji
  • Patent number: 11276218
    Abstract: Embodiments of the present disclosure provide a method for skinning a character model, a device for skinning a character model, a computer readable medium, and an electronic device, and relate to the field of computer technology. The method comprises: obtaining a first character model and a corresponding skeleton structure; determining a vertex attribute of the first character model and a connecting relationship between the vertices; performing a nonlinear transformation process on the vertex attribute to obtain the first feature, and performing a graph convolution process on the connecting relationship and the first feature to obtain a second feature; determining a global feature and a local feature of the character model according to the second feature; and determining a target feature representing a binding relationship between the first character model and the skeleton hierarchy according to the global feature and the local feature.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: March 15, 2022
    Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.
    Inventors: Lijuan Liu, Di Tang, Yi Yuan, Changjie Fan
  • Patent number: 11277585
    Abstract: Provided is a content distribution server that is configured to improve the convenience of virtual space sharing formats. The content distribution server comprises: a participation accepting unit that accepts a participation request from another individual to participate in a virtual space used for distribution by a distributor; an information acquiring unit that acquires motion information indicating movement by the distributor and a participant participating on the basis of a participation request, as well as information on the virtual characters of the distributor and the participant; and a distribution unit that distributes live content based on video in virtual space obtained by synthesizing motion information acquired by the information acquiring unit with movement by the virtual characters.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: March 15, 2022
    Inventors: Nobuo Kawakami, Kentarou Matsui, Shinnosuke Iwaki, Takashi Kojima, Naoki Yamaguchi
  • Patent number: 11276216
    Abstract: Systems and methods for generating a customized virtual animal character are disclosed. A system may obtain video data or other media depicting a real animal, and then may provide the obtained media to one or more machine learning models configured to learn visual appearance and behavior information regarding the particular animal depicted in the video or other media. The system may then generate a custom visual appearance model and a custom behavior model corresponding to the real animal, which may subsequently be used to render, within a virtual environment of a video game, a virtual animal character that resembles the real animal in appearance and in-game behavior.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: March 15, 2022
    Assignee: Electronic Arts Inc.
    Inventors: Igor Borovikov, Mohsen Sardari, Harold Henry Chaput, Navid Aghdaie, Kazi Atif-Uz Zaman, Kenneth Alan Moss
  • Patent number: 11272045
    Abstract: An electronic display system comprises first and second display surfaces and a computer. Each of the first and second display surfaces is configured to receive and transmit display light from an emissive element. Each of the first and second display surfaces includes both a flat portion and an edge portion non-coplanar to the flat portion. The computer is configured to control the emissive elements of the first and second display surfaces so as to present a first section of a display image on the first display surface and a second section of the display image on the second display surface. In this example, one or more rows of the display image rendered on the flat portion of a display surface are rendered duplicatively on an edge portion.
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: March 8, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ziyad Ibrahim, Glenn Frederick Evans, Nicholas Fredrick Ray