Motion Planning Or Control Patents (Class 345/474)
  • Patent number: 11967178
    Abstract: A face-processing system is described for producing a target image based on a source image and driving information. The source image includes data depicting at least a face of a source subject having a source identity, a source pose, and a source expression. The driving information specifies one or more driving characteristics. The target image combines characteristics of the source image and the driving information. According to illustrative implementations, the face-processing system produces the target image by using plural warping subcomponents that operate at plural respective levels of a neural network and at increasing respective resolutions. Each warping subcomponent operates, in part, based on geometric displacement field (GDF) information that describes differences between a source mesh derived from the source image and a driving mesh derived from the driving information.
    Type: Grant
    Filed: April 26, 2022
    Date of Patent: April 23, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yatao Zhong, Faezeh Amjadi, Ilya Dmitriyevich Zharkov
  • Patent number: 11962547
    Abstract: Systems and methods are provided for performing operations including: retrieving a plurality of content items; determining a first category of a first content item in the plurality of content items; selecting a first presentation arrangement from a plurality of presentation arrangements based on the first category determined for the first content item; and presenting the first content item to a user according to the selected first presentation arrangement.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: April 16, 2024
    Assignee: SNAP INC.
    Inventors: Newar Husam Al Majid, Nathan Kenneth Boyd, Laurent Desserrey, Matthew Thompson, Jeremy Voss
  • Patent number: 11941393
    Abstract: A system method of managing a software repository. The method including receiving a dataset comprising a set of computer instructions, retrieving feature-related data from the dataset, determining, by a machine learning model executing on the computing device, a function of the computer instructions based on the feature-related data, and generating a synopsis of the function of the computer instructions. The method can include transmitting the synopsis to a user interface and receiving feedback from a user indicative of whether the synopsis accurately describes the function of the computer instructions. If the feedback indicates that the synopsis accurately describes the function of the computer instructions, the method can include storing the synopsis in a memory of the computing device. If the feedback indicates that the synopsis inaccurately describes the function of the computer instructions, the method can include generating a revised synopsis of the function of the computer instructions.
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: March 26, 2024
    Assignee: CAPITAL ONE SERVICES, LLC
    Inventors: Brian Burgess, Benjamin Cabell Glancy, Narender Pashikant, Guganathan Sellamuthu
  • Patent number: 11922574
    Abstract: A method for determining a plurality of layers of bounding boxes of an object includes determining a polyhedron capable of accommodating the object therein as a first-layer bounding box. The method also includes selecting one vertex from a plurality of vertices of the first-layer bounding box as a target vertex, and determining, by processing circuitry of a computing device, a support plane of the object. The support plane has a normal vector that has a specific direction corresponding to the target vertex and that is closest to the target vertex, the support plane being a plane passing through a point on a surface of the object such that the object is completely located on one side of the support plane. The method further includes cutting the first-layer bounding box based on at least the support plane to form a smaller bounding box, as a second-layer bounding box.
    Type: Grant
    Filed: July 29, 2021
    Date of Patent: March 5, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Yu Zheng, Zhengyou Zhang
  • Patent number: 11921959
    Abstract: A computing device having a touch-sensitive surface and a display, detects a stylus input on the touch-sensitive surface while displaying a user interface. A first operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface while the stylus is detected on the touch-sensitive surface. A second operation different from the first operation is performed in the user interface in accordance with a determination that the stylus input includes rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface. A third operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface and rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface.
    Type: Grant
    Filed: October 24, 2022
    Date of Patent: March 5, 2024
    Assignee: APPLE INC.
    Inventors: Julian Missig, May-Li Khoe, Bianca Cheng Costanzo, Jeffrey Traer Bernstein
  • Patent number: 11908210
    Abstract: A method and apparatus for detecting an object in a three-dimensional (3D) point cloud are disclosed. The apparatus includes a three-dimensional (3D) model reconstruction unit configured to reconstruct a three-dimensional (3D) model using three-dimensional (3D) point cloud data, a two-dimensional (2D) object detection unit configured to detect an object in at least one two-dimensional (2D) image captured to generate the three-dimensional (3D) point cloud data, a three-dimensional (3D) position estimation unit configured to form a cylinder surrounding the object in the three-dimensional (3D) model based on a two-dimensional (2D) position of the detected object so as to estimate a three-dimensional (3D) position of the detected object using the cylinder, and an object region extraction unit configured to acquire three-dimensional (3D) point cloud data contained in the cylinder so as to extract an object region from the acquired three-dimensional (3D) point cloud data.
    Type: Grant
    Filed: March 5, 2021
    Date of Patent: February 20, 2024
    Assignee: Meissa Inc.
    Inventor: Suk Won Choi
  • Patent number: 11908059
    Abstract: A server device is configured to provide a combined environment and includes processor circuitry configured to determine first parameters indicative of a first location, generate first environment data indicative of the first location, determine second parameters indicative of a second location, and associate the second parameters with the first environment data for providing combined environment data, and output the combined environment data.
    Type: Grant
    Filed: March 15, 2022
    Date of Patent: February 20, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Hannes Bergkvist, Peter Exner, Peter Blomqvist, Anders Isberg
  • Patent number: 11900519
    Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure encode features of a source image to obtain a source appearance encoding that represents inherent attributes of a face in the source image; encode features of a target image to obtain a target non-appearance encoding that represents contextual attributes of the target image; combine the source appearance encoding and the target non-appearance encoding to obtain combined image features; and generate a modified target image based on the combined image features, wherein the modified target image includes the inherent attributes of the face in the source image together with the contextual attributes of the target image.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: February 13, 2024
    Assignee: ADOBE INC.
    Inventors: Kevin Duarte, Wei-An Lin, Ratheesh Kalarot, Shabnam Ghadar, Jingwan Lu, Elya Shechtman, John Thomas Nack
  • Patent number: 11889102
    Abstract: The present invention relates to the field of video image processing, and provides a filtering method and an apparatus, to resolve a problem that subjective quality and objective quality of an image deteriorate because filtering processing cannot be performed on internal blocks of a non-translational motion prediction unit.
    Type: Grant
    Filed: February 1, 2022
    Date of Patent: January 30, 2024
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Huanbang Chen, Sixin Lin, Haitao Yang, Shan Gao
  • Patent number: 11875601
    Abstract: A meme generation method, an electronic device, and a storage medium are provided. The method includes: determining a plurality of second expression images corresponding to a target face image based on a plurality of first expression images contained in a first meme; generating a second meme corresponding to the target face image based on the plurality of second expression images corresponding to the target face image; wherein, determining an affine transformation parameter between the target face image and an i-th first expression image in the plurality of first expression images according to a corresponding relation between a face key point in the target face image and a face key point in the i-th first expression image; and transforming the target face image based on the affine transformation parameter to obtain an i-th second expression image corresponding to the target face image.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: January 16, 2024
    Assignee: Beijing Baidu Netcom Science and Technology Co., LTD
    Inventors: Xin Li, Fu Li, Tianwei Lin, Henan Zhang
  • Patent number: 11869197
    Abstract: An information processing apparatus includes a specification unit, a determination unit, and a generation unit. The specification unit specifies a relationship between a plurality of objects detected in a video. The determination unit determines arrangement of motion trajectories of the plurality of objects, the relationship between which has been specified by the specification unit, while maintaining a relative appearance order in the video and avoiding an overlap of the motion trajectories in a temporal direction. The generation unit generates a summary video of the video based on the arrangement determined by the determination unit.
    Type: Grant
    Filed: December 16, 2020
    Date of Patent: January 9, 2024
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hiroki Urashima
  • Patent number: 11836839
    Abstract: The present disclosure provides a method for generating an animation figure, a device and a storage medium. The method includes: acquiring an image including at least one target object; acquiring position information about key points of the target object in the image; determining target angle information about lines connecting the key points in accordance with the position information about the key points; and adjusting a predetermined animation figure in accordance with the target angle information. A pose of a target animation figure acquired through adjustment is identical to a pose of the target object in the image, and the target animation figure corresponds to the target object.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: December 5, 2023
    Assignee: BOE Technology Group Co., Ltd.
    Inventors: Rui Zheng, Fengshuo Hu
  • Patent number: 11829333
    Abstract: The disclosed embodiments relate to a mechanism for allowing concurrent access, e.g. write operations, to a data structure, e.g. a file, which may have limited capacity, by multiple processes or threads and, in particular, for allowing concurrent, or otherwise substantially simultaneously, appending of data to the file thereby. Each process/thread requests the amount of space it needs to append its data. Upon request, the disclosed mechanism allocates and reserves the requested amount of space and allows the requesting process/thread to commence its append operation. Subsequent to the commencement of the append operation, another thread is then free to request space for its needs and commence its append operation concurrently, or otherwise substantially simultaneously, with the previous append operation, i.e. before the prior append operation is completed.
    Type: Grant
    Filed: May 8, 2015
    Date of Patent: November 28, 2023
    Assignee: Chicago Mercantile Exchange Inc.
    Inventors: Kyle D. Kavanagh, Andrew Pikler
  • Patent number: 11790589
    Abstract: A user may create an avatar and/or animated sequence illustrating a particular object or living being performing a certain activity, using images of portions of the object or living being extracted from a still image or set of still images of the object or living being.
    Type: Grant
    Filed: June 14, 2023
    Date of Patent: October 17, 2023
    Assignee: IMPLEMENTATION APPS LLC
    Inventors: Ayla Mandel, David Mandel, Stephen D. Williams
  • Patent number: 11771505
    Abstract: Apparatus and methods are provided for mapping and displaying three dimensional surgical pathways within imaging of cranial structures derived from voxels of a cranial scan. Entry voxel and target voxel are selected as pathway endpoints. A series of respective neighbor voxels are mapped between the entry voxel and the target voxel to define a pathway. For each voxel Vxi,yi,zi in the series, an immediately succeeding voxel of voxel Vxi,yi,zi is selected from among the group of neighbor voxel of voxel Vxi,yi,zi which excludes neighbor voxels of the immediately preceding voxel of voxel Vxi,yi,zi. The selection is made by comparing selection weights determined based on relative distances with respect to the endpoint voxels and relative distance from voxels within a predetermined distance that represent at least a threshold density. The voxels of the pathway are then selectively highlighted in a displayed view to provide a visualization of the 3D surgical pathway.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: October 3, 2023
    Assignee: Biosense Webster (Israel) Ltd.
    Inventors: Yair Palti, Remi Bettan, Vadim Gliner, Uri Avni
  • Patent number: 11763511
    Abstract: The present disclosure provides a method and apparatus of displaying an image, an electronic device and a storage medium. The method includes: obtaining a preset number of candidate sub-images by segmenting a to-be-displayed first candidate image; assigning each of the candidate sub-images to a corresponding first image sub-template in a preset first image template sequentially, where a number of the first image sub-templates is equal to a number of the candidate sub-images; adjusting each of the first image sub-templates in the first image template such that the first candidate image displays a preset animation effect, where the preset animation effect is obtained from configuration information of an electronic device.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: September 19, 2023
    Assignee: BOE Technology Group Co., Ltd.
    Inventor: Haijun Fan
  • Patent number: 11748961
    Abstract: A client device can display various augmented reality and virtual reality images to a user. For example, the client device captures images of an external environment and identifies objects in the environment. If an object satisfies a virtual environment criterion, the client device displays a window to a virtual environment at the location of the object in the environment. In another example, the client device includes a light assembly that can generate light. If the user turns the light assembly on, virtual objects displayed in the environment will gather to a region highlighted by the light from the light assembly. In another example, the client device estimates depth information of an object in the environment. The client device then displays a virtual object in the environment based on the depth information and may also display the virtual object interacting with an object in the external environment.
    Type: Grant
    Filed: May 18, 2022
    Date of Patent: September 5, 2023
    Assignee: Niantic, Inc.
    Inventors: Chihiro Kanno, Shigeru Miyamoto
  • Patent number: 11741629
    Abstract: Embodiments of the present disclosure disclose image processing methods and apparatuses, image devices, and storage media. The image processing method includes: obtaining an image; obtaining the feature of the limb of the body based on the image, where the limb includes the upper limb and/or the lower limb; determining first-type movement information of the limb based on the feature; and controlling the movement of the limb of a controlled model according to the first-type movement information.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: August 29, 2023
    Assignee: Beijing Sensetime Technology Development Co., Ltd.
    Inventors: Fubao Xie, Wentao Liu, Chen Qian
  • Patent number: 11734868
    Abstract: Provided is a system that receives a three-dimensional (3D) skinned model of a first object and a set of images of a second object. The second object is same as or structurally similar to the first object in appearance. The system executes a differentiable rendering operation to generate a first image which includes a contour of the 3D skinned model. The system further generates a reference image which includes a contour of the second object, based on the received set of images. The system updates first values of bone parameters associated with the 3D skinned model based on a difference between the generated first image and the generated reference image. The system updates the 3D skinned model based on the updated first values of the bone parameters.
    Type: Grant
    Filed: July 19, 2021
    Date of Patent: August 22, 2023
    Assignee: SONY GROUP CORPORATION
    Inventor: Tamaki Kojima
  • Patent number: 11721056
    Abstract: In some embodiments, a model training system obtains a set of animation models. For each of the animation models, the model training system renders the animation model to generate a sequence of video frames containing a character using a set of rendering parameters and extracts joint points of the character from each frame of the sequence of video frames. The model training system further determines, for each frame of the sequence of video frames, whether a subset of the joint points are in contact with a ground plane in a three-dimensional space and generates contact labels for the subset of the joint points. The model training system trains a contact estimation model using training data containing the joint points extracted from the sequences of video frames and the generated contact labels. The contact estimation model can be used to refine a motion model for a character.
    Type: Grant
    Filed: January 12, 2022
    Date of Patent: August 8, 2023
    Assignee: Adobe Inc.
    Inventors: Jimei Yang, Davis Rempe, Bryan Russell, Aaron Hertzmann
  • Patent number: 11698688
    Abstract: A pointing device includes an acceleration sensor, a motion sensor and a processor. The processor includes a first attitude angle calculator, a second attitude angle calculator and an attitude angle selector. When a predetermined condition is satisfied, the processor control the acceleration sensor to generate acceleration data, the first attitude angle calculator calculates a first attitude angle output according to the acceleration data, and the attitude angle selector receives the first attitude angle output as the reference data. When the predetermined condition is not satisfied, the second attitude angle calculator calculates a second attitude angle output according to angular velocity data generated by the motion sensor and the reference data, and the attitude angle selector receives the second attitude angle output as the reference data. The present disclosure also provides a control method of the pointing device.
    Type: Grant
    Filed: September 1, 2021
    Date of Patent: July 11, 2023
    Assignee: Chicony Electronics Co., Ltd.
    Inventor: Chien-Tsung Chen
  • Patent number: 11699266
    Abstract: A method, apparatus and system for facilitating navigation toward a region of interest in an extended scene of video content include determining a timeline including information regarding at least one region of interest in the video content and displaying, in a portion of the video content currently being displayed, a visual indicator indicating a direction in which to move in the video content to cause the display of the at least one region of interest. In one embodiment of the present principles a timeline is attached to the content and carries information evolving over time about the region(s) of interest. A renderer processes the timeline and provides navigation information to a user using available means such as a graphical representation or haptic information, or a combination of several means.
    Type: Grant
    Filed: August 26, 2016
    Date of Patent: July 11, 2023
    Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
    Inventors: Anthony Laurent, Vincent Alleaume, Maximilien Bellot
  • Patent number: 11687154
    Abstract: A method for generating a limitless path in a virtual reality environment (VR) for a continuous locomotion within a real physical space using Head-Mounted-Display (HMD) device associated with a user is provided. The method includes determining a line segment between two points that corresponds to an initial path travelled by the user. The method includes detecting a boundary of the VR environment to generate a next line segment. The method includes generating and adding a new line segment to end of the initial path. The method includes generating and adding the new line segment to the end of the next line segment. The method includes generating an updated path by adding the new line segment in a direction at the angle of shift angle to the direction of the next line segment. The method includes, configuring to output updated path as two-dimensional points to render updated path into VR environment.
    Type: Grant
    Filed: May 28, 2022
    Date of Patent: June 27, 2023
    Assignee: INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY, HYDERABAD
    Inventors: Y Raghu Reddy, Raghav Mittal, Sai Anirudh Karre
  • Patent number: 11675988
    Abstract: An apparatus detects a plurality of areas from an overall image, determines on each of the plurality of areas whether the area is a candidate for an area including an object as a processing target based on a determination reference value (first determination processing), acquires a zoom-in image of the area determined to be the candidate for the area including the object in the first determination processing, and determines whether the acquired zoom-in image is an image of the object (second determination processing). The apparatus identifies an area, in the overall image, corresponding to the zoom-in image determined not to be the image of the object in the second determination processing, and performs control to update the determination reference value used in the first determination processing based on image information of the identified area in the overall image.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: June 13, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomoya Asanuma, Shinya Omori
  • Patent number: 11663791
    Abstract: An example method includes identifying a need and an emotional state of a user who is participating in an interaction with a support application, retrieving a set of preferences for the user, selecting a set of features for an avatar to be presented to the user, wherein the set of features is selected based at least on the emotional state of the user and the set of preferences, selecting a stored workflow based on the need of the user, and rendering the avatar to exhibit the set of features and to present the stored workflow as part of the interaction.
    Type: Grant
    Filed: November 16, 2021
    Date of Patent: May 30, 2023
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: James Pratt, Yupeng Jia, Eric Zavesky
  • Patent number: 11657557
    Abstract: Generating data to provide an animated visual representation is disclosed. A method comprises receiving input data obtained by a first sensor system measuring information about at least one target person. One data unit is selected from a database comprising a plurality of the data units. Each data unit comprises information about a reference person in a reference state measured at a previous time by the first sensor system or by a second sensor system. The information in each data unit allows generation of an animated visual representation of the reference person in the reference state. The reference state is different for each of the data units. The selected data unit and the input data are used to generate output data usable to provide an animated visual representation corresponding to the target person and synchronized with activity of the target person measured by the first sensor system.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: May 23, 2023
    Assignee: RealD Spark, LLC
    Inventors: Eric Sommerlade, Alexandros Neophytou
  • Patent number: 11651074
    Abstract: Methods, apparatus, systems and articles of manufacture are disclosed herein to accelerate security threat investigation. An example apparatus includes a model trainer to train a security investigation model, a game engine to determine a source security software product and a destination security software product of a security threat object, an actions database to store at least one of the previous security response action, the source security software product, the destination security software product, and the security threat object, an action generator to generate at least one suggested security response action in response to a user security investigation action, wherein the suggested security response action is based on an execution of the security investigation model, and a software product controller to adjust a display of the destination security software product of the security threat object in response to the security response action.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: May 16, 2023
    Assignee: MUSARUBRA US LLC
    Inventor: Wayne Anderson
  • Patent number: 11645797
    Abstract: Various implementations disclosed herein include devices, systems, and methods for controlling motion of CGR objects. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes determining, by a first animation controller, values for a first set of animation parameters associated with a first animation for a computer-generated reality (CGR) object. In some implementations, the CGR object is associated with a plurality of joints. In some implementations, the method includes generating, by a motion controller, respective joint movements for the plurality of joints based on the values for the first set of animation parameters. In some implementations, the method includes manipulating the CGR object in accordance with the respective joint movements for the plurality of joints in order to provide an appearance that CGR object is moving within a degree of similarity to the first animation.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: May 9, 2023
    Assignee: APPLE INC.
    Inventor: Daniel Laszlo Kovacs
  • Patent number: 11618170
    Abstract: A method and apparatus for controlling a social robot includes providing a set of quantitative personality trait values, also called a “personality profile” to a decision engine of the social robot. The personality profile is derived from a character portrayal in a fictional work, dramatic performance, or by a real-life person (any one of these sometime referred to herein as a “source character”). The decision engine controls social responses of the social robot to environmental stimuli, based in part on the set of personality trait values. The social robot thereby behaves in a manner consistent with the personality profile for the profiled source character.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: April 4, 2023
    Assignee: WARNER BROS. ENTERTAINMENT INC.
    Inventors: Thomas Gewecke, Victoria L. Colf, Gregory I. Gewickey, Lewis S. Ostrover
  • Patent number: 11604991
    Abstract: Techniques for adaptive thresholding are provided. A first data point in a data stream is received, and a first plurality of data points from the data stream is identified, where the first plurality of data points corresponds to a timestamp associated with the first data point. At least a first cluster is generated for the first plurality of data points, and a predicted value for the first data point is generated based at least in part on data points in the first cluster. A deviation is computed between the predicted value for the first data point and an actual value for the first data point. Upon determining that the deviation exceeds a first predefined threshold, the first data point is labeled as anomalous, and reallocation of computing resources is facilitated based on labeling the first data point as anomalous.
    Type: Grant
    Filed: July 1, 2022
    Date of Patent: March 14, 2023
    Assignee: Cisco Technology, Inc.
    Inventors: Om Prakash Suthar, Anwin P. Kallumpurath, Rajiv Asati
  • Patent number: 11557075
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
    Type: Grant
    Filed: March 25, 2021
    Date of Patent: January 17, 2023
    Assignee: Snap Inc.
    Inventors: Avihay Assouline, Itamar Berger, Yuncheng Li
  • Patent number: 11557103
    Abstract: A virtual reference plane and a virtual camera are updated based on detection of a characteristic portion in a captured image. A virtual object and the virtual camera are updated based on a shooting state. An overlay image in which an image of the virtual object is overlaid on the captured image is generated. The virtual camera and the virtual object are controlled such that the virtual object is in a field-of-view range, before the detection of the characteristic portion. The virtual object, the virtual reference plane, and the virtual camera are updated such that the virtual object is along the virtual reference plane, based on the shooting state, after the detection of the characteristic portion, and such that an appearance of the virtual object is in association with the shooting state, no matter whether or not the characteristic portion has been detected, when a position fixation condition is satisfied.
    Type: Grant
    Filed: November 16, 2021
    Date of Patent: January 17, 2023
    Assignee: NINTENDO CO., LTD.
    Inventors: Junpei Horita, Masahiro Nitta, Kazuyoshi Sensui, Yasuharu Ohta, Junki Uosawa
  • Patent number: 11546504
    Abstract: A method for utilizing human recognition and a method utilizing the same are provided. The method for utilizing human recognition includes updating a moving image database to include information about a moving image in which a cluster subject appears, the information being extracted based on clustering using a face feature; receiving a search condition; and detecting moving image information using the database. According to the present disclosure, a skeleton can be analyzed and a face can be recognized using an artificial intelligence (AI) model performing deep learning through a fifth generation (5G) network, and using the analysis result, a photographing composition can be determined, and moving image information can be constructed at an edge.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: January 3, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Young Han Kim, Sang Hyun Lee, Sang Hyun Jung
  • Patent number: 11527052
    Abstract: A method for controlling placement of a virtual character includes: displaying a virtual character at a first position in a virtual reality (VR) scene; receiving a first instruction in the VR scene, the first instruction indicating moving the virtual character from the first position by a designated movement; displaying, in response to receiving the first instruction, third indication information as a preview of the designated movement in the VR scene; determining, according to the first instruction, a second position by the designated movement from the first position in response to the first instruction; removing the virtual character from the first position; and placing the virtual character at the second position, the virtual character not appearing between the first position and the second position after being removed from the first position.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: December 13, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Chao Shen, Xueqiang Wang
  • Patent number: 11528535
    Abstract: This application discloses a video file playing method and apparatus, and a storage medium. The video file playing method includes playing an animation file frame by frame according to a playback time of a video file, the video file comprising at least one displayed object, and the animation file comprising an animation element generated according to the displayed object; determining click/tap position information of a screen clicking/tapping event in response to the screen clicking/tapping event being detected; determining an animation element display area corresponding to the click/tap position information of the screen clicking/tapping event in the animation file according to the click/tap position information; determining, according to the corresponding animation element display area, an animation element triggered by the screen clicking/tapping event; and determining an interactive operation corresponding to the triggered animation element and performing the interactive operation.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: December 13, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Jiaping Yuan
  • Patent number: 11514673
    Abstract: An augmented reality viewer includes components, assemblies, and executable logic to provide a user with the perception of rich augmented reality experiences, including aspects of the aquatic world.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: November 29, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Daniel Lewinn Lehrich, David C. Lundmark
  • Patent number: 11514947
    Abstract: A method for real-time video processing for changing features of an object in a video, the method comprises: providing an object in the video, the object being at least partially and at least occasionally presented in frames of the video; detecting the object in the video; generating a list of at least one element of the object, the list being based on the object's features to be changed according to a request for modification; detecting the at least one element of the object in the video; tracking the at least one element of the object in the video; and transforming the frames of the video such that the at least one element of the object is modified according to the request for modification.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: November 29, 2022
    Assignee: Snap Inc.
    Inventor: Elena Shaburova
  • Patent number: 11501577
    Abstract: An information processing apparatus includes: a first obtaining unit configured to obtain a first three-dimensional model expressing a position and a shape of a first object in a three-dimensional space based on images of the first object captured by a plurality of image-capturing devices at different locations; a second obtaining unit configured to obtain a second three-dimensional model expressing a position and a shape of a second object in the three-dimensional space; an identifying unit configured to identify a plurality of parts of the first object; a determining unit configured to determine a contact between a certain part of the first object and the second object based on the obtained first three-dimensional model and second three-dimensional model and an identification result of the plurality of parts; and an output unit configured to output information according to a determination result of the contact.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: November 15, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Daichi Adachi
  • Patent number: 11487494
    Abstract: A system (1) for displaying an optical image (2) by means of unmanned autonomous vehicles. Each vehicle has a display for displaying at least a part of the image (2) by way of stored or transmitted image information as well as a control unit (9). The control unit (9) is configured to control the image information and to move the vehicle using a drive unit (11) by means of stored or transmitted positon information. At least two vehicles are configured as land crafts (5), wherein the displays (3) of the land crafts (5) are oriented in parallel to a substantially horizontal image plane (6) and configured as displays (3) accessible by a human person.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: November 1, 2022
    Assignee: ARS ELECTRONICA LINZ GMBH & CO KG
    Inventors: Horst Hörtner, Hideaki Ogawa, Peter Holzkorn
  • Patent number: 11481946
    Abstract: There is provided information processing apparatuses, information processing methods, programs, and information processing systems capable of reinforcing the reinforcement target behavior without causing the user's consciousness. A quest is presented for urging a user to execute a reinforcement target behavior, and when the user executes the reinforcement target behavior upon the request, an electroencephalogram is measured, emotion is estimated on the basis of the electroencephalogram, and when the number of times that dominant emotion having the highest emotion score among emotion of the emotion estimation results is detected exceeds a predetermined number of times, an avatar is changed corresponding to the emotion that is detected as the dominant emotion. The present disclosure can be applied to long-term feedback technology.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Itaru Shimizu, Kazuhito Iwasa, Takanori Morii
  • Patent number: 11475619
    Abstract: To allow free animation production in virtual space, an animation production method executing: a step of placing a virtual camera for shooting a character in a virtual space; a step of placing a first plate object with a first image attached as a texture under the foot of the character in response to an instruction from a user; a step of placing a second plate object with a second image attached as a texture in response to an instruction from the user; a step of correcting the posture of the second plate object such that the second plate object is perpendicular to the first plate object; and a step of generating an image captured by the camera.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: October 18, 2022
    Assignee: ANICAST RM INC.
    Inventors: Yoshihito Kondoh, Masato Murohashi
  • Patent number: 11461965
    Abstract: A representation of a surface in a three-dimensional space is obtained. A first input representing a starting point and a second input representing a next point are obtained. A representation of a surface-aware spline comprising vertices is generated, with the representation of the surface-aware spline including a starting vertex corresponding to the starting point and a next vertex corresponding to the next point. First and second projection points corresponding to projections of a first vertex and a second vertex onto the surface are determined. New points corresponding to equal distance points for the first and second vertices aligned with the first and second projection points are determined, and a rigid transformation is determined from the new points. The representation of the surface-aware spline is adjusted based on a transformation of the new points using the rigid transformation.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: October 4, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11450057
    Abstract: Enhanced techniques applicable to a ray tracing hardware accelerator for traversing a hierarchical acceleration structure and its underlying primitives are disclosed. For example, traversal speed is improved by grouping processing of primitives sharing at least one feature (e.g., a vertex or an edge) during ray-primitive intersection testing. Grouping the primitives for ray intersection testing can reduce processing (e.g., projections and transformations of primitive vertices and/or determining edge function values) because at least a portion of the processing results related to the shared feature in one primitive can be used in determine whether the ray intersects another primitive(s). Processing triangles sharing an edge can double the culling rate of the triangles in the ray/triangle intersection test without replicating the hardware.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: September 20, 2022
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess, Ian Chi Yan Kwong
  • Patent number: 11449748
    Abstract: Techniques for adaptive thresholding are provided. First and second data points are received. A plurality of data points are identified, where the plurality of data points corresponds to timestamps associated with the first and second data points. At least one cluster is generated for the plurality of data points based on a predefined cluster radius. Upon determining that the first data point is outside of the cluster, the first data point is labeled as anomalous. A predicted value is generated for the second data point, based on processing data points in the cluster using a machine learning model, and a deviation between the predicted value and an actual value for the second data point is computed. Upon determining that the deviation exceeds a threshold, the second data point is labeled as anomalous. Finally, computing resources are reallocated, based on at least one of the anomalous data points.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: September 20, 2022
    Assignee: Cisco Technology, Inc.
    Inventors: Om Prakash Suthar, Anwin P. Kallumpurath, Rajiv Asati
  • Patent number: 11450051
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: September 20, 2022
    Assignee: Snap Inc.
    Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
  • Patent number: 11439904
    Abstract: Systems and methods are described for imparting dynamic, non-linear and realistic movement and look and feel to a player's/virtual character's first-person limbs and hand-held object model, and procedurally animating a first-person virtual camera such that it simulates the movement of a camera handheld by the player/virtual character. To impart chaotic or random motion to the first-person limbs and hand-held object model a first module defines and implements first and second two dimensional mass-spring-damper systems, each of which is linked to the player's/virtual vector's view vector. Procedural animation or rotational shake is implemented by a second module by applying a coherent noise function to each of the six axes of the first-person virtual camera.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: September 13, 2022
    Assignee: Activision Publishing, Inc.
    Inventors: Matthew John Stine, Cody Palmatier Pierson
  • Patent number: 11410704
    Abstract: A digital content package includes first content comprising a video feature such as a motion picture or the like, and a user-selectable application configured to operate as follows. When activated using an icon off of a menu screen, the application records an identifier for scenes (discrete portions) of the first content that are selected by a user to generate a playlist. The user may select the scenes by indicating a start and end of each scene. The application saves the playlist locally, then uploads to a server. Via a user account at the server, a user may publish the playlist to a user-created distribution list, webpage, or other electronic publication, and modify the playlist by deleting or reordering scenes.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: August 9, 2022
    Assignee: WARNER BROS. ENTERTAINMENT INC.
    Inventors: Kim Lau, Jacob Frautschi, Massimiliano Gasparri, Randy Lee, Patrick Harman
  • Patent number: 11400363
    Abstract: An information processing apparatus connected to a controller device equipped with proximity sensors that are provided for at least respective fingers of a user, estimating amounts of bending of the fingers of the user using a first method on the basis of detection results from the proximity sensors, estimating a posture and a shape of a hand of the user using a second method different from the first estimation method, and correcting by using information estimated by the first method, information regarding an amount of movement of each finger in a bending direction in information regarding the posture and the shape of the hand of the user estimated by the second method to generate information relating to the posture and the shape of the hand of the user.
    Type: Grant
    Filed: February 16, 2018
    Date of Patent: August 2, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Yoshinori Ohashi, Kazuyuki Arimatsu
  • Patent number: 11380038
    Abstract: To enable you to take animations in a virtual space, an animation production method comprising: placing a first and second objects and a virtual camera in a virtual space; controlling an action of the first object in response to an operation from the first user; controlling an action of the second object in response to an operation from the second user; and controlling the camera in response to an operation from the first or second user or the second user to shoot the first and second objects.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: July 5, 2022
    Assignee: AniCast RM Inc.
    Inventors: Yoshihito Kondoh, Masato Murohashi
  • Patent number: 11373358
    Abstract: Ray tracing hardware accelerators supporting motion blur and moving/deforming geometry are disclosed. For example, dynamic objects in an acceleration data structure are encoded with temporal and spatial information. The hardware includes circuitry that test ray intersections against moving/deforming geometry by applying such temporal and spatial information. Such circuitry accelerates the visibility sampling of moving geometry, including rigid body motion and object deformation, and its associated moving bounding volumes to a performance similar to that of the visibility sampling of static geometry.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: June 28, 2022
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess