Motion Planning Or Control Patents (Class 345/474)
  • Patent number: 11145102
    Abstract: A method of and system for recreating a real world pose or aligning a real world object in a virtual space, the method including: prompting a user to successively place a device at a plurality of positions/alignments associated with a plurality of physical points associated with a body of the user, a body of another, or an object; capturing the plurality of positions/alignments with respect to a real world frame of reference; translating the plurality of positions/alignments with respect to the real world frame of reference to a frame of reference in virtual space; and recreating a pose of the body of the user, a pose of the body of the other, or an alignment of the object in the virtual space using the translated plurality of positions/alignments.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: October 12, 2021
    Assignee: Volvo Car Corporation
    Inventors: Qinzi Tan, Lukasz Pasek
  • Patent number: 11133990
    Abstract: A system and method for providing a dynamic comparative network health analysis of a network environment, the method comprising: obtaining dynamic and static network environment parameters of a plurality of network environments; creating network environment profiles of each network environment of the plurality of network environments based on the dynamic and static network environment parameters; performing comparative analysis of network environment profiles of a first network environment of the plurality of network environments with network environment profiles of a second network environment of the plurality of network environments to generate a comparative analysis; based on the comparative analysis, determining whether to reconfigure the first network environment or create a new network environment; if it is determined to reconfigure the first network environment, generating a remedial plan for the first network environment; if it is determined to create a new network environment, generating a new plan f
    Type: Grant
    Filed: May 1, 2019
    Date of Patent: September 28, 2021
    Assignee: Extreme Networks, Inc.
    Inventors: Norival Figueira, Shyamsundar Pullela, Alan Amrod
  • Patent number: 11126412
    Abstract: Computer-implemented design tool functions are described herein for automatically performing edits across different portions of one or more design layouts. According to an example, a method includes causing a display device to display a design interface used to edit a design layout, which includes at least a first frame and a second frame. The method includes receiving first input to initiate a multi-edit mode in the design interface and receiving second input to perform a first operation to edit a first node in the first frame. The method further includes identifying, based at least in part on the second input, a second node in the second frame and corresponding to the first node in the first frame. In this example, the method includes performing, based at least in part on the second input, the first operation to edit the first node in the first frame and a second operation to edit the second node in the second frame.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: September 21, 2021
    Assignee: Figma, Inc.
    Inventors: Sho Kuwamoto, Nikolas Klein, Rasmus Mathias Andersson, Bradee Evans
  • Patent number: 11128909
    Abstract: Provided is a device including: a controller configured to obtain illumination information about illumination around the device, determine, based on the illumination information, a thickness of an outline of an object included in content reproduced by the device, and perform image processing on the content such that the outline of the object is represented as having the determined thickness; and a display displaying the content on which the image processing is performed.
    Type: Grant
    Filed: March 19, 2018
    Date of Patent: September 21, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jung-hoon Cho, Seung-chan Kim, Yong-nam Kim
  • Patent number: 11119735
    Abstract: A method and system for providing a hybrid block and text-based programming environment. The hybrid block and text-based programming environment provides a software development tool suitable for users of different programming skill levels to write and understand code. The hybrid programming environment enables a user to view and edit source code through multiple graphical representative displays of the source code in a manner not previously achievable. Each of the graphical representative displays is linked to a particular programming view that has a unique set of rules related to the functionality of the displayed graphical elements to enable the more comprehensive functionality. The graphical representative displays provide a tool to educate novice programmers as they become more proficient and assist in the transition between block-based and textual representations.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: September 14, 2021
    Assignee: MODKIT INC.
    Inventors: Edward K. Baafi, Collin C. Reisdorf
  • Patent number: 11112856
    Abstract: In an embodiment there is provided a user interface device for interfacing a user with a computer, the computer comprising at least one processor to generate instructions for display of a graphical environment of a virtual reality simulation. The user interface device includes a sensor for detecting activation and/or a sensor for detecting proximity of a body part of the user (e.g., hand). At least partially based on detection by one of these sensors, a transition between virtual reality states is triggered.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: September 7, 2021
    Assignee: Logitech Europe S.A.
    Inventors: Thomas Rouvinez, Aidan Kehoe, Mario Gutierrez, Vincent Jalil, Damien O'Sullivan, Mathieu Meisser, Nicolas Ramond, Regis Croisonnier
  • Patent number: 11069109
    Abstract: Processes for reviewing and editing a computer-generated animation are provided. In one example process, multiple images representing segments of a computer-generated animation may be displayed. In response to a selection of one or more of the images, geometry data associated with the corresponding segment(s) of computer-generated animation may be accessed. An editable geometric representation of the selected segment(s) of computer-generated animation may be displayed based on the accessed geometry data. In some examples, previously rendered representations and/or geometric representations of the same or other segments of the computer-generated animation may be concurrently displayed adjacent to, overlaid with, or in any other desired manner with the displayed geometric representation of the selected segment(s) of computer-generated animation.
    Type: Grant
    Filed: June 11, 2015
    Date of Patent: July 20, 2021
    Assignee: DreamWorks Animation L.L.C.
    Inventors: Fredrik Nilsson, Luke Halliwell, Josiah Larson, Matthew Christopher Gong
  • Patent number: 11062496
    Abstract: Disclosed herein is a motion modeling method and device using a virtual joint sphere. The motion modeling method using the virtual joint sphere includes (a) modeling a 3D virtual character, wherein the 3D virtual character sets a virtual joint sphere for each body part; and (b) forming a trajectory for a motion of a target body part of the 3D virtual character as a specific motion is performed on a surface of the virtual joint sphere assigned to the target body part, when reconstructing the motion of the 3D virtual character according to the specific motion.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: July 13, 2021
    Assignee: CHUNG ANG UNIVERSITY INDUSTRY ACADEMIC COOPERATION FOUNDATION
    Inventors: Young Ho Chai, Seong Hun Kim
  • Patent number: 11055810
    Abstract: A technique is described for clustering graphics objects in a graphic artwork based on affine variance. Geometry data associated with an input set of graphics objects can be processed to identify pairs of graphics objects that are affine variants of each other. The identified affine variants can then be clustered into one or more affine groups. Similar graphics objects in a given affine group can then be represented using a base geometry and a corresponding transformation matrix. Accordingly, the overall geometric complexity of the graphic artwork can be simplified thereby providing various benefits such as reducing file size and improving rendering performance.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: July 6, 2021
    Assignee: ADOBE INC.
    Inventors: Sumit Dhingra, Vineet Batra, Praveen Kumar Dhanuka, Ankit Phogat
  • Patent number: 11055069
    Abstract: To reduce a burden on a user in editing tree structure data with a text editor. When a selection range is designated on an edit screen, a node selection unit of a tree structure data editing device selects one or more node IDs in the tree structure data, based on the position of the selection range. When a paste target for the selection range is designated on the edit screen, a connection target determination unit determines a connection target node ID in the tree structure data, based on the position of the paste target. A tree structure data editing unit edits the tree structure data such that the node or nodes identified by the one or more node IDs is/are connected to the node identified by the connection target node ID. A conversion unit convers the tree structure data edited by the tree structure data editing unit into text data. A display control unit updates the edit screen displayed, based on the text data converted by the conversion unit.
    Type: Grant
    Filed: July 31, 2015
    Date of Patent: July 6, 2021
    Assignee: RAKUTEN, INC.
    Inventors: Ryosuke Aoki, Asami Ando, Hidetomo Suzuki
  • Patent number: 11049329
    Abstract: Embodiments of the present application disclose a method and an apparatus for controlling placement of a virtual character and a storage medium. The method includes: receiving a first instruction in a virtual reality (VR) scene, the first instruction indicating moving a virtual character from a first position by a designated movement; determining a second position by the designated movement from the first position in response to the first instruction; removing the virtual character from the first position; and placing the virtual character at the second position, the virtual character not appearing between the first position and the second position after being removed from the first position.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: June 29, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Chao Shen, Xueqiang Wang
  • Patent number: 11036989
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: June 15, 2021
    Assignee: Snap Inc.
    Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
  • Patent number: 11033223
    Abstract: Examples of systems, devices, and methods as described in this disclosure include a shoulder motion measurement system comprising a mounting device comprising a receptacle configured to hold an electronic device at a fixed orientation relative to a scapula of a patient, wherein the mounting device comprises one or more structures configured for handling by a user when aligning the shoulder motion measurement system against the patient.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: June 15, 2021
    Assignee: Regents of the University of Minnesota
    Inventors: Paula Ludewig, Justin Staker
  • Patent number: 11016116
    Abstract: A system including: a plurality of sensor modules having inertial measurement units and attached to different parts of a user (e.g., head, hands, arms) to measure their orientations; a plurality of optical marks attached to the user; a camera attached to the user; and a computing device configured to correct an accumulated error by detecting the optical marks in an image generated by the camera and identifying mismatches in directions of the optical marks (or the sensors, or parts of the users) as measured and/or calculated based on the image and the corresponding directions of the optical marks (or the sensors, or parts of the users) as measured and/or calculated from the orientation measurements generated by the sensor modules.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: May 25, 2021
    Assignee: Finch Technologies Ltd.
    Inventors: Viktor Vladimirovich Erivantcev, Alexander Sergeevich Lobanov, Alexey Ivanovich Kartashov, Daniil Olegovich Goncharov
  • Patent number: 10997699
    Abstract: The present invention allows to estimate a continuous surface that defines a boundary surface of an object using image data, even if the image data was acquired by an imaging method in which image information on the boundary surface of the object is limited. An image processing apparatus according to the present invention includes a calculating unit that calculates a brightness gradient of a voxel group constituting volume data which represents a reconstructed image, and an estimating unit that estimates by using the brightness gradient a continuous surface which defines a boundary surface of an object corresponding to the volume data.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: May 4, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Hiroyuki Sekiguchi, Kohtaro Umezawa
  • Patent number: 10996847
    Abstract: Method for providing content search interface in electronic device including executing content on screen; displaying first graphic user interface (GUI) including a first object indicating starting point of content, second object indicating ending point of content, and third object indicating point of playback of content, wherein first object and second object are near each other and third object is displayed on curved path connecting first object and second object; in response to receiving first user input on first GUI, moving third object on curved path; in response to receiving second user input, displaying second GUI forming angle within selected range on curved path, wherein second GUI comprises plurality of discrete labels representing different speeds or rates at which third object moves on curved path; and in response to receiving third gesture input on second GUI while content is executed, changing speed at which third object moves on curved path.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: May 4, 2021
    Inventors: Gi Yong Lee, Min Kyu Park, Ji Won Jeon
  • Patent number: 10984575
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
    Type: Grant
    Filed: February 6, 2019
    Date of Patent: April 20, 2021
    Assignee: Snap Inc.
    Inventors: Avihay Assouline, Itamar Berger, Yuncheng Li
  • Patent number: 10977851
    Abstract: A computer system is used to host a virtual reality universe process in which multiple avatars are independently controlled in response to client input. The host provides coordinated motion information for defining coordinated movement between designated portions of multiple avatars, and an application responsive to detect conditions triggering a coordinated movement sequence between two or more avatars. During coordinated movement, user commands for controlling avatar movement may be in part used normally and in part ignored or otherwise processed to cause the involved avatars to respond in part to respective client input and in part to predefined coordinated movement information. Thus, users may be assisted with executing coordinated movement between multiple avatars.
    Type: Grant
    Filed: February 27, 2019
    Date of Patent: April 13, 2021
    Assignee: PFAQUTRUMA RESEARCH LLC
    Inventor: Brian Mark Shuster
  • Patent number: 10970557
    Abstract: A posture determination method applicable to an electronic system including an image capturing device is provided. The image capturing device is set up corresponding to a target. The posture determination method includes: acquiring a plurality of consecutive images captured by the image capturing device; performing a motion detection on the consecutive images; determining whether an image content of the consecutive images is static after a movement according to a detection result of the motion detection; and determining a posture of the target when the image content is static after the movement. In addition, the electronic system and a non-transitory computer-readable recording medium using the method are also provided.
    Type: Grant
    Filed: July 23, 2018
    Date of Patent: April 6, 2021
    Assignee: Wistron Corporation
    Inventor: Shih-Hao Kuo
  • Patent number: 10957091
    Abstract: An embodiment provides a mobile application that animates change information in a way that specifically indicates a change in workflow information for various users. This animation of change information permits users, which are often busy healthcare professionals, to be quickly apprised of relevant changes to workflow status. The mobile application also allows users to communicate change information, e.g., for updating the status of a workflow item, which may then be propagated throughout a network, including mobile devices.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: March 23, 2021
    Assignee: TeleTracking Technologies, Inc.
    Inventors: Steven Edward Spear, Michael James Weber
  • Patent number: 10958950
    Abstract: The present disclosure relates to methods, apparatus or systems for formatting of backward compatible immersive video streams. At least one legacy rectangular video is captured from an immersive video obtained from a source (82). A set of camera control data are used to determine which parts of the immersive video will constitute legacy videos (84). These part are removed from the immersive video (83) and every prepared videos are packaged in a stream (85). The structure from the stream is a container. Information data about the location and size of removed parts may be added in the stream.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: March 23, 2021
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Renaud Dore, Julien Fleureau, Thierry Tapie
  • Patent number: 10950027
    Abstract: An embodiment provides a mobile application that animates change information in a way that specifically indicates a change in workflow information for various users. This animation of change information permits users, which are often busy healthcare professionals, to be quickly apprised of relevant changes to workflow status. The mobile application also allows users to communicate change information, e.g., for updating the status of a workflow item, which may then be propagated throughout a network, including mobile devices.
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: March 16, 2021
    Assignee: TeleTracking Technologies, Inc.
    Inventors: Steven Edward Spear, Michael James Weber
  • Patent number: 10948995
    Abstract: According to one aspect of the invention, there is provided a method for assisting object control, comprising the steps of: specifying, in a real-world coordinate system, a control vector corresponding to a gesture or manipulation performed by a user; determining an object indicated by the control vector as a target object to be controlled by the gesture or manipulation performed by the user; performing mapping for specifying a control coordinate point corresponding to a magnitude or direction of the control vector in a target object reference coordinate system defined on the basis of a characteristic of the target object; and determining a control command to be applied to the target object, with reference to the control coordinate point specified by the mapping.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: March 16, 2021
    Assignee: VTOUCH CO., LTD.
    Inventor: Seok Joong Kim
  • Patent number: 10939031
    Abstract: A method, a device, and a non-transitory storage medium are described in which a machine learning-based device placement and configuration service is provided. The machine learning-based device placement and configuration system uses regression models calculated from installation and performance data. The regression model includes data associated with sites at which video cameras were previously installed and tested for detection accuracy levels possibly associated with a service area. With these generated models, information about the physical space, and desired performance criteria, designers optimize camera number, camera placement, and geo-location camera parameters. The device placement and configuration service may find an optimal camera placement and geo-location camera parameter set which satisfy certain criteria. The geo-location parameters include position, height, heading, pitch, and roll.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: March 2, 2021
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Andrew W. Herson, Domonkos Huszar, Istvan S. Horvath, Christopher Kennedy, Csaba Rekeczky
  • Patent number: 10921885
    Abstract: Apparatus and method for using light fields for virtual visualization and virtual navigation.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: February 16, 2021
    Inventor: Arjuna Indraeswaran Rajasingham
  • Patent number: 10921946
    Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: February 16, 2021
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald
  • Patent number: 10915606
    Abstract: An audiovisual media composition system is provided for creating photographs, videos, and live streams of one or more assets sourced from different geographic locations. The audiovisual media composition system may include an media parsing component, transposition component, communication component, interface aspects, and/or additional components and features. A method for creating photographs, videos, and live streams of one or more assets sourced from different geographic locations using the audiovisual media composition system is also provided.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: February 9, 2021
    Assignee: Grupiks LLC
    Inventor: Sam Juma
  • Patent number: 10909744
    Abstract: Disclosed herein includes a system, a method, and a non-transitory computer readable medium for generating and rendering computer generated images of simulated garments with wrinkles based on a physics based cloth simulator and a machine learning model. In one aspect, by a physics based cloth simulator executing on one or more processors, a first normal map of a simulated garment having a first level of detail of wrinkles and a second normal map of the simulated garment having a second level of detail of wrinkles higher than the first level of detail of wrinkles are generated. In one aspect, by the one or more processors, the first normal map and the second normal map are provided as inputs to train a machine learning model. In one aspect, by the one or more processors via training, the machine learning model is configured to generate an output normal map with a level of detail of wrinkles higher than that of an input normal map.
    Type: Grant
    Filed: May 10, 2019
    Date of Patent: February 2, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Tuur Jan M Stuyck, Tony Tung
  • Patent number: 10899017
    Abstract: Described is a system for co-adaptation of robot control to human biomechanics. During operation, the system receives joint angle and joint velocity of a human and co-robot and generates estimated internal states of the human. A task space motion plan is then generated for the co-robot based on a specified cooperative task and estimated internal states and joint angle and joint velocity of the human. Joint torque commands are then generated based on the task space motion plan and joint angle and joint velocity of the human and co-robot. Motion of the co-robot is then controlled, such as causing the co-robot to actuate one or more actuators to move based on the joint torque commands.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: January 26, 2021
    Assignee: HRL Laboratories, LLC
    Inventors: Vincent De Sapio, Heiko Hoffmann
  • Patent number: 10860900
    Abstract: Systems, computer-implemented methods, and computer program products for transforming a source distribution to a target distribution. A system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a sampling component that receives a source distribution having a source sample and a target distribution having a target sample. The computer executable components can further comprise an optimizer component that employs a neural network to find a critic that dynamically discriminates between the source sample and the target sample, while constraining a gradient of the neural network. The computer executable components can further comprise a morphing component that generates a first product distribution by morphing the source distribution along the gradient of the neural network to the target distribution.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: December 8, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Youssef Mroueh, Tom Sercu
  • Patent number: 10846942
    Abstract: Free space machine interface and control can be facilitated by predictive entities useful in interpreting a control object's position and/or motion (including objects having one or more articulating members, i.e., humans and/or animals and/or machines). Predictive entities can be driven using motion information captured using image information or the equivalents. Predictive information can be improved applying techniques for correlating with information from observations.
    Type: Grant
    Filed: August 29, 2014
    Date of Patent: November 24, 2020
    Assignee: Ultrahaptics IP Two Limited
    Inventors: Kevin A Horowitz, David S Holz
  • Patent number: 10846902
    Abstract: A method and apparatus are disclosed for generating an avatar in an augmented reality environment on a computing device, associating that avatar with a particular physical location, configuring the avatar to perform certain actions, configuring access rights for the avatar, and then storing the state of the avatar. At a later time, the user of another computing device visits the same physical location, views the physical location through the computing device, and the avatar is inserted into the image on the display of computing device and then performs the actions previously specified.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: November 24, 2020
    Assignee: IMVU, INC.
    Inventors: Peter Kevin Reeves, Robert Rui Otani
  • Patent number: 10843078
    Abstract: Mental state data is collected as a person interacts with a game played on a machine. The mental state data includes facial data, where the facial data includes facial regions or facial landmarks. The mental state data can include physiological data and actigraphy data. The mental state data is analyzed to produce mental state information. Mental state data and/or mental state information can be shared across a social network or a gaming community. The affect of the person interacting with the game can be represented to the social network or gaming community in the form of an avatar. Recommendations based on the affect resulting from the analysis can be made to the person interacting with the game. Mental states are analyzed locally or via a web services. Based on the results of the analysis, the game with which the person is interacting is modified.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: November 24, 2020
    Assignee: Affectiva, Inc.
    Inventors: Rana el Kaliouby, Panu James Turcot, Forest Jay Handford, Daniel Bender, Rosalind Wright Picard, Richard Scott Sadowsky, Oliver Orion Wilder-Smith
  • Patent number: 10839526
    Abstract: An information processing device includes: a memory; and a processor coupled to the memory and configured to: estimate a first position of a first joint in a two-dimensional plane based on a color image, and estimate a first positional relationship between the first joint and a second joint coupled to the first joint via a portion in the two-dimensional plane; estimate a second position of the first joint in the two-dimensional plane based on a depth image indicating respective depths of the first joint and the second joint, and estimate a second positional relationship between the first joint and the second joint in a three-dimensional space; and estimate a third position of the first joint in the two-dimensional plane and posture of the portion in the three-dimensional space based on the first position, the first positional relationship the second position, and the second positional relationship.
    Type: Grant
    Filed: May 10, 2019
    Date of Patent: November 17, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Ryosuke Yamanaka, Mitsuru Tomono, Satoshi Tanabe
  • Patent number: 10838495
    Abstract: A data input device having inertial sensor units, one or more touch input devices, a microcontroller configured to collect sensor data from the inertial sensors and the one or more touch input devices and process the sensor data to generate processed sensor data, and a wireless transceiver configured to transmit the processed sensor data to a host computer. A method can include: receiving sensor data from a handheld device; calculating hand movement characteristics in three dimensional space based on the sensor data; calculating the position and orientation of the components of the handheld device; identifying positions and movements of one or more fingers of a user manipulating the handheld device; identifying a gesture from the positions and movements of one or more fingers of a user manipulating the handheld device; identifying a recognized gesture corresponding to the identified gesture; and dispatching an event notifying the gesture to an application.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: November 17, 2020
    Assignee: Finch Technologies Ltd.
    Inventors: Viktor Vladimirovich Erivantcev, Rustam Rafikovich Kulchurin, Alexander Sergeevich Lobanov, Iakov Evgenevich Sergeev, Yana Olegovna Gabdullina, Alexey Ivanovich Kartashov
  • Patent number: 10825220
    Abstract: Techniques are disclosed that allow animators to easily share and reuse character poses such as gestures, expressions, and mouth shapes. When starting on a new shot, an animator often wants a character to have the same pose exactly as the end of the previous shot. According to various embodiments, an animator can easily set up these hookup poses by animator copying a pose directly from a clip of prerecorded media. In one aspect, a pose at the current playhead of the playback tool is copied into a software buffer of an animation tool and then pasted into a character. Thus, the animator may copy a pose exactly as he/she is seeing visually. In various aspects, animators can choose a pose from an entire inventory of available animated videos. This provides a more efficient method for selecting a pose since the user can easily choose and pick a pose from a large inventory of animated videos and bring in a desired pose in a matter of a few mouse clicks.
    Type: Grant
    Filed: October 3, 2013
    Date of Patent: November 3, 2020
    Assignee: Pixar
    Inventors: Juei Chang, Tom Hahn
  • Patent number: 10810409
    Abstract: A face is detected and identified within an acquired digital image. One or more features of the face is/are extracted from the digital image, including two independent eyes or subsets of features of each of the two eyes, or lips or partial lips or one or more other mouth features and one or both eyes, or both. A model including multiple shape parameters is applied to the two independent eyes or subsets of features of each of the two eyes, and/or to the lips or partial lips or one or more other mouth features and one or both eyes. One or more similarities between the one or more features of the face and a library of reference feature sets is/are determined. A probable facial expression is identified based on the determining of the one or more similarities.
    Type: Grant
    Filed: November 13, 2017
    Date of Patent: October 20, 2020
    Assignee: FotoNation Limited
    Inventors: Ioana Bacivarov, Peter Corcoran
  • Patent number: 10803630
    Abstract: An image processing system includes first circuitry that controls display of an image of a space including one or more materials on a first display, and second circuitry which controls display of an image of each of the materials on a second display, controls specifying of each of the materials in the space, and controls specifying of illumination information and material information associated with a specified material. The second circuitry controls display of the image of the materials based on a specified illumination information, material information, and a relative positional relationship of a light fixture, a display surface of the second display, and a viewer.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: October 13, 2020
    Assignee: TOPPAN PRINTING CO., LTD.
    Inventor: Takayuki Hasegawa
  • Patent number: 10789924
    Abstract: Systems and methods are provided for assembling and displaying a visual ensemble of musical performances that were created and uploaded from one or more locations that are remote from a host of the network, a director or other administrator reviewing submissions for selection and assembly, or perhaps merely remote from one or more other submissions received over a computer network. The assembled performances include a plurality of submissions, the submissions including performances created and uploaded at one or more locations remote from the location of the director for the assembly and display over the computer network. Systems and methods are also included for mapping one performance against another performance qualitatively, quantitatively, in real-time, or some combination thereof, enabling a musician, or a reviewer of performances, in the assessment of one performance relative to another performance.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: September 29, 2020
    Assignee: JAMMIT, INC.
    Inventors: Scott Humphrey, Frank Gryner
  • Patent number: 10786315
    Abstract: A system to control the interaction between a user-interface of a teleoperated surgical system and an input device of the teleoperated surgical system, the system comprising a first master controller communicatively coupled to the teleoperated surgical system, a feedback control communicatively coupled to the first master controller, and a display device communicatively coupled to the teleoperated surgical system and configured to display the user interface. The feedback control is configured to restrict the movement of the first master controller based on a state of the user interface changing from a previous state.
    Type: Grant
    Filed: November 12, 2015
    Date of Patent: September 29, 2020
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Ashwinram Suresh, Joey Chau
  • Patent number: 10777006
    Abstract: Plural individual sensor assemblies are engaged with respective parts of a person's body. Each assembly may include accelerometers, magnetometers, and gyroscopes. Sensor data is fused together to get the orientation at each body location. To simplify, the body is assumed to consist of rigid bars of known length connected with ball joints so that once the relative orientations of all bars are given by the respective assemblies, body pose can be computed. Then the body pose is translated as a virtual body into a virtual world either by a ray cast method that anchors a foot of the virtual body to the ground assuming infinite gravity and infinite friction and then translating the other body parts to make the ground contact point fixed, or by implementing an approximate dynamics physics engine on the virtual body. The technique may be used in VR location-based entertainment and for motion capture.
    Type: Grant
    Filed: October 23, 2017
    Date of Patent: September 15, 2020
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Sergey Bashkirov, Takeo Matsukawa
  • Patent number: 10765944
    Abstract: An animation system and method generates predictive models that are deployed in animations, such as an animation associated with a video game, to predict outcomes resulting from events occurring in the animation, such as interactions between two or more objects in the animation. These predictive models may be generated based at least in part on training data that is generated by running the animation, such as playing a video game, generating parameter values associated with events in the animation, and determining an outcome of the events. The training data may be used to generate predictive models, such as by using machine learning algorithms. The predictive models may then be deployed in the animation, such as in a video game, to make real time or near real-time predictions of outcomes based at least in part on events in the animation.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: September 8, 2020
    Assignee: Electronic Arts Inc.
    Inventor: Cesar Dantas de Castro
  • Patent number: 10769422
    Abstract: A computer-implemented method and system for neural network-based recognition of trade workers present on industrial sites is presented.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: September 8, 2020
    Assignee: indus.ai Inc
    Inventors: Lai Him Matthew Man, Mohammad Soltani, Ahmed Aly, Walid Aly
  • Patent number: 10762721
    Abstract: Embodiments of the present disclosure disclose an image compositing method and apparatus, used for harmoniously obtaining and displaying a simulation object composited with an accessory, so that a user has desirable experience and visual enjoyment. The apparatus obtains first data of a skeletal model of a simulation object and skeleton data of an accessory to be composited to the simulation object and determines, based on the first data and the skeleton data of the accessory, a target skeleton that is on the skeletal model and that corresponds to the accessory. The apparatus copies first target data of the target skeleton from the first data and adjusts the first target data of the target skeleton based on preconfigured offset data of the target skeleton to obtain first adjusted data. Finally the apparatus performs shading based on the first adjusted data and the first data to obtain the simulation object composited with the accessory.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: September 1, 2020
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Bing Li, Jiang Pan, Yang Lan
  • Patent number: 10754543
    Abstract: Operating a touch-screen device includes displaying at least a portion of a keyboard on a touch-screen, detecting a touch on the touch-screen, and detecting movement of the touch on the touch-screen. Operating the touch-screen device also includes moving the displayed keyboard in response to the detected movement of the touch on the touch-screen, detecting a release of the touch from the touch-screen, and assigning a character according to a final location of the touch relative to a location of the displayed keyboard.
    Type: Grant
    Filed: February 12, 2018
    Date of Patent: August 25, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Olivier Artigue, Jean-Michel Douliez, Francois Trible
  • Patent number: 10748235
    Abstract: Techniques are provided for optimizing display processing of layers below a dim layer by a display system. Because the dim layer may partially obstruct, conceal, or otherwise impact a user view of layers below the dim layer, resource-saving techniques may be used in the processing the layers below the dim layer. While these techniques may impact visual quality, a user is unlikely to notice visual artifacts or other reductions in quality in the modified layers below the dim layer. For example, when a dim layer is to be displayed, a GPU can render layers below the dim layer at a lower resolution. Furthermore, the GPU can increase a compression ratio for layers below the dim layer. The low-resolution layers can be scaled-up to an original resolution and the compressed layers can be uncompressed in the display pipeline for display underneath the dim layer.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: August 18, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Raviteja Tamatam, Jayant Shekhar, Kalyan Thota, Venkata Nagarjuna Sravan Kumar Deepala
  • Patent number: 10740636
    Abstract: A method, a system and a terminal for identity authentication, and a computer readable storage medium are provided. The method for identity authentication includes: acquiring a facial image of a person to be authenticated, and determining from the facial image facial feature information of the person to be authenticated; determining a suspected object using a face authentication platform according to the facial feature information of the person to be authenticated; acquiring a human body image of the person to be authenticated, and determining from the human body image a plurality of skeleton key points of the person to be authenticated; converting the skeleton key points into feature data; and recognizing an identity of the person to be authenticated according to the feature data of the person to be authenticated and information of the suspected object.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: August 11, 2020
    Assignee: Baidu Online Nework Technology (Beijing) Co., Ltd.
    Inventors: Wenbin Xie, Weiqing He, Fanping Liu, Xiangli Chen
  • Patent number: 10713835
    Abstract: A method for of playing an animation image, the method including: obtaining a plurality of images; displaying a first image of the plurality of images; detecting a first event as a trigger to play the animation image for a first object of the first image; and playing the animation image for the first object using the plurality of images.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: July 14, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Pavan Sudheendra, Sarvesh, Yogesh Manav, Adappa M Gourannavar, Rahul Varna, Sumanta Baruah
  • Patent number: 10702778
    Abstract: Objects in a virtual space may be non-traversable such that traversal by characters of the virtual space through such objects is not permitted by the physics of the virtual space. Objects may be relocated during interactive gameplay. A navigation map of the virtual space is updated interactively, e.g. after an object has been relocated, by determining which regions are traversable or non-traversable, the boundaries of these regions, and which boundaries separate adjacent traversable regions. The updated navigation map may be queried on behalf of a non-player character in the virtual space, e.g. to determine where to go and/or how to get there.
    Type: Grant
    Filed: March 21, 2013
    Date of Patent: July 7, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: James Rowe, Travis Nixon
  • Patent number: 10695676
    Abstract: An example of an information processing device generates a game field for each of a plurality of game stages. The information processing device executes a game process of controlling a player object in response to an operation by a user in a game stage for which the game field has been generated. The information processing device determines whether the user has cleared or failed to clear the game stage. In response to a determination that the user has cleared the game stage, the information processing device starts the game process for a next game stage while maintaining a state of the player object at the time of clearing. On the other hand, in response to a determination that the user has failed to clear the game stage, the information processing device starts the game process for a next game stage.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: June 30, 2020
    Assignee: Nintendo Co., Ltd.
    Inventors: Shigeru Miyamoto, Takashi Tezuka, Norihito Ito, Yugo Hayashi