Motion Planning Or Control Patents (Class 345/474)
  • Patent number: 11557075
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
    Type: Grant
    Filed: March 25, 2021
    Date of Patent: January 17, 2023
    Assignee: Snap Inc.
    Inventors: Avihay Assouline, Itamar Berger, Yuncheng Li
  • Patent number: 11557103
    Abstract: A virtual reference plane and a virtual camera are updated based on detection of a characteristic portion in a captured image. A virtual object and the virtual camera are updated based on a shooting state. An overlay image in which an image of the virtual object is overlaid on the captured image is generated. The virtual camera and the virtual object are controlled such that the virtual object is in a field-of-view range, before the detection of the characteristic portion. The virtual object, the virtual reference plane, and the virtual camera are updated such that the virtual object is along the virtual reference plane, based on the shooting state, after the detection of the characteristic portion, and such that an appearance of the virtual object is in association with the shooting state, no matter whether or not the characteristic portion has been detected, when a position fixation condition is satisfied.
    Type: Grant
    Filed: November 16, 2021
    Date of Patent: January 17, 2023
    Assignee: NINTENDO CO., LTD.
    Inventors: Junpei Horita, Masahiro Nitta, Kazuyoshi Sensui, Yasuharu Ohta, Junki Uosawa
  • Patent number: 11546504
    Abstract: A method for utilizing human recognition and a method utilizing the same are provided. The method for utilizing human recognition includes updating a moving image database to include information about a moving image in which a cluster subject appears, the information being extracted based on clustering using a face feature; receiving a search condition; and detecting moving image information using the database. According to the present disclosure, a skeleton can be analyzed and a face can be recognized using an artificial intelligence (AI) model performing deep learning through a fifth generation (5G) network, and using the analysis result, a photographing composition can be determined, and moving image information can be constructed at an edge.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: January 3, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Young Han Kim, Sang Hyun Lee, Sang Hyun Jung
  • Patent number: 11527052
    Abstract: A method for controlling placement of a virtual character includes: displaying a virtual character at a first position in a virtual reality (VR) scene; receiving a first instruction in the VR scene, the first instruction indicating moving the virtual character from the first position by a designated movement; displaying, in response to receiving the first instruction, third indication information as a preview of the designated movement in the VR scene; determining, according to the first instruction, a second position by the designated movement from the first position in response to the first instruction; removing the virtual character from the first position; and placing the virtual character at the second position, the virtual character not appearing between the first position and the second position after being removed from the first position.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: December 13, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Chao Shen, Xueqiang Wang
  • Patent number: 11528535
    Abstract: This application discloses a video file playing method and apparatus, and a storage medium. The video file playing method includes playing an animation file frame by frame according to a playback time of a video file, the video file comprising at least one displayed object, and the animation file comprising an animation element generated according to the displayed object; determining click/tap position information of a screen clicking/tapping event in response to the screen clicking/tapping event being detected; determining an animation element display area corresponding to the click/tap position information of the screen clicking/tapping event in the animation file according to the click/tap position information; determining, according to the corresponding animation element display area, an animation element triggered by the screen clicking/tapping event; and determining an interactive operation corresponding to the triggered animation element and performing the interactive operation.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: December 13, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Jiaping Yuan
  • Patent number: 11514947
    Abstract: A method for real-time video processing for changing features of an object in a video, the method comprises: providing an object in the video, the object being at least partially and at least occasionally presented in frames of the video; detecting the object in the video; generating a list of at least one element of the object, the list being based on the object's features to be changed according to a request for modification; detecting the at least one element of the object in the video; tracking the at least one element of the object in the video; and transforming the frames of the video such that the at least one element of the object is modified according to the request for modification.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: November 29, 2022
    Assignee: Snap Inc.
    Inventor: Elena Shaburova
  • Patent number: 11514673
    Abstract: An augmented reality viewer includes components, assemblies, and executable logic to provide a user with the perception of rich augmented reality experiences, including aspects of the aquatic world.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: November 29, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Daniel Lewinn Lehrich, David C. Lundmark
  • Patent number: 11501577
    Abstract: An information processing apparatus includes: a first obtaining unit configured to obtain a first three-dimensional model expressing a position and a shape of a first object in a three-dimensional space based on images of the first object captured by a plurality of image-capturing devices at different locations; a second obtaining unit configured to obtain a second three-dimensional model expressing a position and a shape of a second object in the three-dimensional space; an identifying unit configured to identify a plurality of parts of the first object; a determining unit configured to determine a contact between a certain part of the first object and the second object based on the obtained first three-dimensional model and second three-dimensional model and an identification result of the plurality of parts; and an output unit configured to output information according to a determination result of the contact.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: November 15, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Daichi Adachi
  • Patent number: 11487494
    Abstract: A system (1) for displaying an optical image (2) by means of unmanned autonomous vehicles. Each vehicle has a display for displaying at least a part of the image (2) by way of stored or transmitted image information as well as a control unit (9). The control unit (9) is configured to control the image information and to move the vehicle using a drive unit (11) by means of stored or transmitted positon information. At least two vehicles are configured as land crafts (5), wherein the displays (3) of the land crafts (5) are oriented in parallel to a substantially horizontal image plane (6) and configured as displays (3) accessible by a human person.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: November 1, 2022
    Assignee: ARS ELECTRONICA LINZ GMBH & CO KG
    Inventors: Horst Hörtner, Hideaki Ogawa, Peter Holzkorn
  • Patent number: 11481946
    Abstract: There is provided information processing apparatuses, information processing methods, programs, and information processing systems capable of reinforcing the reinforcement target behavior without causing the user's consciousness. A quest is presented for urging a user to execute a reinforcement target behavior, and when the user executes the reinforcement target behavior upon the request, an electroencephalogram is measured, emotion is estimated on the basis of the electroencephalogram, and when the number of times that dominant emotion having the highest emotion score among emotion of the emotion estimation results is detected exceeds a predetermined number of times, an avatar is changed corresponding to the emotion that is detected as the dominant emotion. The present disclosure can be applied to long-term feedback technology.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Itaru Shimizu, Kazuhito Iwasa, Takanori Morii
  • Patent number: 11475619
    Abstract: To allow free animation production in virtual space, an animation production method executing: a step of placing a virtual camera for shooting a character in a virtual space; a step of placing a first plate object with a first image attached as a texture under the foot of the character in response to an instruction from a user; a step of placing a second plate object with a second image attached as a texture in response to an instruction from the user; a step of correcting the posture of the second plate object such that the second plate object is perpendicular to the first plate object; and a step of generating an image captured by the camera.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: October 18, 2022
    Assignee: ANICAST RM INC.
    Inventors: Yoshihito Kondoh, Masato Murohashi
  • Patent number: 11461965
    Abstract: A representation of a surface in a three-dimensional space is obtained. A first input representing a starting point and a second input representing a next point are obtained. A representation of a surface-aware spline comprising vertices is generated, with the representation of the surface-aware spline including a starting vertex corresponding to the starting point and a next vertex corresponding to the next point. First and second projection points corresponding to projections of a first vertex and a second vertex onto the surface are determined. New points corresponding to equal distance points for the first and second vertices aligned with the first and second projection points are determined, and a rigid transformation is determined from the new points. The representation of the surface-aware spline is adjusted based on a transformation of the new points using the rigid transformation.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: October 4, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11450057
    Abstract: Enhanced techniques applicable to a ray tracing hardware accelerator for traversing a hierarchical acceleration structure and its underlying primitives are disclosed. For example, traversal speed is improved by grouping processing of primitives sharing at least one feature (e.g., a vertex or an edge) during ray-primitive intersection testing. Grouping the primitives for ray intersection testing can reduce processing (e.g., projections and transformations of primitive vertices and/or determining edge function values) because at least a portion of the processing results related to the shared feature in one primitive can be used in determine whether the ray intersects another primitive(s). Processing triangles sharing an edge can double the culling rate of the triangles in the ray/triangle intersection test without replicating the hardware.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: September 20, 2022
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess, Ian Chi Yan Kwong
  • Patent number: 11449748
    Abstract: Techniques for adaptive thresholding are provided. First and second data points are received. A plurality of data points are identified, where the plurality of data points corresponds to timestamps associated with the first and second data points. At least one cluster is generated for the plurality of data points based on a predefined cluster radius. Upon determining that the first data point is outside of the cluster, the first data point is labeled as anomalous. A predicted value is generated for the second data point, based on processing data points in the cluster using a machine learning model, and a deviation between the predicted value and an actual value for the second data point is computed. Upon determining that the deviation exceeds a threshold, the second data point is labeled as anomalous. Finally, computing resources are reallocated, based on at least one of the anomalous data points.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: September 20, 2022
    Assignee: Cisco Technology, Inc.
    Inventors: Om Prakash Suthar, Anwin P. Kallumpurath, Rajiv Asati
  • Patent number: 11450051
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: September 20, 2022
    Assignee: Snap Inc.
    Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
  • Patent number: 11439904
    Abstract: Systems and methods are described for imparting dynamic, non-linear and realistic movement and look and feel to a player's/virtual character's first-person limbs and hand-held object model, and procedurally animating a first-person virtual camera such that it simulates the movement of a camera handheld by the player/virtual character. To impart chaotic or random motion to the first-person limbs and hand-held object model a first module defines and implements first and second two dimensional mass-spring-damper systems, each of which is linked to the player's/virtual vector's view vector. Procedural animation or rotational shake is implemented by a second module by applying a coherent noise function to each of the six axes of the first-person virtual camera.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: September 13, 2022
    Assignee: Activision Publishing, Inc.
    Inventors: Matthew John Stine, Cody Palmatier Pierson
  • Patent number: 11410704
    Abstract: A digital content package includes first content comprising a video feature such as a motion picture or the like, and a user-selectable application configured to operate as follows. When activated using an icon off of a menu screen, the application records an identifier for scenes (discrete portions) of the first content that are selected by a user to generate a playlist. The user may select the scenes by indicating a start and end of each scene. The application saves the playlist locally, then uploads to a server. Via a user account at the server, a user may publish the playlist to a user-created distribution list, webpage, or other electronic publication, and modify the playlist by deleting or reordering scenes.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: August 9, 2022
    Assignee: WARNER BROS. ENTERTAINMENT INC.
    Inventors: Kim Lau, Jacob Frautschi, Massimiliano Gasparri, Randy Lee, Patrick Harman
  • Patent number: 11400363
    Abstract: An information processing apparatus connected to a controller device equipped with proximity sensors that are provided for at least respective fingers of a user, estimating amounts of bending of the fingers of the user using a first method on the basis of detection results from the proximity sensors, estimating a posture and a shape of a hand of the user using a second method different from the first estimation method, and correcting by using information estimated by the first method, information regarding an amount of movement of each finger in a bending direction in information regarding the posture and the shape of the hand of the user estimated by the second method to generate information relating to the posture and the shape of the hand of the user.
    Type: Grant
    Filed: February 16, 2018
    Date of Patent: August 2, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Yoshinori Ohashi, Kazuyuki Arimatsu
  • Patent number: 11380038
    Abstract: To enable you to take animations in a virtual space, an animation production method comprising: placing a first and second objects and a virtual camera in a virtual space; controlling an action of the first object in response to an operation from the first user; controlling an action of the second object in response to an operation from the second user; and controlling the camera in response to an operation from the first or second user or the second user to shoot the first and second objects.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: July 5, 2022
    Assignee: AniCast RM Inc.
    Inventors: Yoshihito Kondoh, Masato Murohashi
  • Patent number: 11373330
    Abstract: Systems and methods for image-based guidance for facilitating navigation of tubular networks. A region of interest in three-dimensional image data may first be segmented. An endoscopic instrument may be detected in two-dimensional intraoperative image data of the region of interest. A centerline of the detected endoscopic instrument may then be determined. The endoscopic instrument and the centerline may be backprojected to generate a three-dimensional backprojected volume. A device path of the endoscopic instrument may be generated based at least in part on the three-dimensional backprojected volume and the three-dimensional image data.
    Type: Grant
    Filed: March 27, 2018
    Date of Patent: June 28, 2022
    Assignee: Siemens Healthcare GmbH
    Inventors: Sebastian Schafer, Randolph M. Setser, Maddalena Strumia
  • Patent number: 11373358
    Abstract: Ray tracing hardware accelerators supporting motion blur and moving/deforming geometry are disclosed. For example, dynamic objects in an acceleration data structure are encoded with temporal and spatial information. The hardware includes circuitry that test ray intersections against moving/deforming geometry by applying such temporal and spatial information. Such circuitry accelerates the visibility sampling of moving geometry, including rigid body motion and object deformation, and its associated moving bounding volumes to a performance similar to that of the visibility sampling of static geometry.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: June 28, 2022
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess
  • Patent number: 11368743
    Abstract: Systems, devices and processes and described herein to improve the generation of video content in video production systems. In general, the systems, devices and processes facilitate the incorporation of remotely generated user telestration inputs into output video streams generated by the video production systems. In one embodiment user telestration inputs are received at a control device. Minimum capture shapes corresponding to the user telestration inputs are then determined and images corresponding to the minimum capture shape are captured. The captured images are then transmitted from the control device to the video access point device. At the video access point device the captured images can then be combined with previously captured and transmitted images and overlaid with a selected input video stream. The video input stream with the overlaid image can then be transmitted as an output video stream.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: June 21, 2022
    Assignee: SLING MEDIA PVT LTD
    Inventors: Rahul Lokesh, Adithya Narayana, Abhiroop Boggavarapu, Laxminarayana Dalimba
  • Patent number: 11363329
    Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to discover, select, explore, and manipulate objects within the modeled worlds used to generate video content. The RVE system may implement methods that allow users to view and explore in more detail the features, components, and/or accessories of selected objects that are being manipulated and explored. The RVE system may also implement methods that allow users to interact with interfaces of selected objects or interfaces of components of selected objects.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: June 14, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Gerard Joseph Heinz, II, Michael Schleif Pesce, Collin Charles Davis, Michael Anthony Frazzini, Ashraf Alkarmi, Michael Martin George, David A. Limp, William Dugald Carr, Jr.
  • Patent number: 11354871
    Abstract: An apparatus for configuring an avatar responsive to a content having at least one of a video and an audio signal includes an authoring unit configured to detect one or more events in a content comprising at least one of a video and an audio signal, categorise one or more of the detected events, and generate an event track for the content, the event track comprising one or more of the categorised events associated with a respective time; a selecting unit configured to select a configuration of an avatar to correspond to a respective categorised event of the event track; and an output generator configured to generate control data to configure an avatar in response to a selected configuration.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: June 7, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Michael Adam Kavallierou
  • Patent number: 11349720
    Abstract: A method, system, and computer program product to manage a network comprising a plurality of interconnected components are described. The method includes obtaining a set of all the components that are part of the network over time, and identifying one or more repeating patterns of components among the set of all the components as corresponding lower-level definitions to generate a hierarchical set of all the components. The method also includes obtaining time-varying information regarding topology and operational values within the network, and creating a representation of the network at a set of times based on the hierarchical set of all the components and the time-varying information.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: May 31, 2022
    Assignee: Utopus Insights, Inc.
    Inventors: Ulrich A. Finkler, Fook-Luen Heng, Steven N. Hirsch, Mark A. Lavin, Jun Mei Qu, Amith Singhee, Wei Wu
  • Patent number: 11349839
    Abstract: The present disclosure is directed to systems and methods for providing improved tools (e.g., user interfaces) that can be used for managing access permissions to cloud or other network resources. In general, the systems and methods include providing a user interface that can function in at least two modes which together can provide an improved user experience for intuitively and effectively developing code. As an example, the two interface modes can include a builder mode in which the user interface includes one or more interactive elements that enable a user to modularly build a set of computer-readable code that controls access permissions to one or more computing resources and an editor mode in which the user interface allows the user to directly edit the set of computer-readable code.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: May 31, 2022
    Assignee: GOOGLE LLC
    Inventors: Yuanzhen Wang, Matthew Terich, Tristan Andrew Swadell, Elaine Lu, Laura Rebeca Pina, John Josef Kloninger, Himanshu Agrawal, Blake Michael Tyra
  • Patent number: 11341704
    Abstract: Various implementations disclosed herein include devices, systems, and methods for selectively applying a tool and/or a rig to a skeleton of an object based on an upcoming motion. In some implementations, a method includes obtaining, from a memory location, a response characteristic to be exhibited by an object while displaying the object in a computer graphics environment. A tool is selected that allows the object to be manipulated to exhibit the response characteristic in the computer graphics environment. The tool is associated with a skeleton of the object. A manipulation of the object is displayed within the computer graphics environment in accordance with the response characteristic after associating the tool with the skeleton of the object.
    Type: Grant
    Filed: January 14, 2021
    Date of Patent: May 24, 2022
    Assignee: APPLE INC.
    Inventors: Richard Ignatius Punsal Lozada, James Graham McCarter
  • Patent number: 11335060
    Abstract: A location-based augmented-reality system to generate and cause display of augmented-reality content that includes three-dimensional typography, based on a perspective, and location of a client device.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: May 17, 2022
    Assignee: Snap Inc.
    Inventors: Piers George Cowburn, David Li, Isac Andreas Müller Sandvik, Qi Pan
  • Patent number: 11314924
    Abstract: Techniques described herein take character glyphs as input and generate a text-on-a-path text object that includes the character glyphs arranged in a determined order along a path. For instance, a method described herein includes accessing character glyphs in input data. The method further includes determining an order for the character glyphs based on relative positions and orientations of the character glyphs in the input data. The method further includes generating a path for the character glyphs, based on the order, and associating the path with the character glyphs. Further, the method includes generating a text object that includes the set of character glyphs arranged in the order along the path.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: April 26, 2022
    Assignee: ADOBE INC.
    Inventors: Arushi Jain, Vijit Saxena, Praveen Kumar Dhanuka, Matthew Fisher
  • Patent number: 11301951
    Abstract: An electronic chip, a chip assembly, a computing device, and a method are described. The electronic chip comprises a plurality of processing cores and at least one hardware interface coupled to at least one of the one or more processing cores. At least one processing core implements a game engine and/or a simulation engine and one or more processing cores implements an artificial intelligence engine, whereby implementations are on-chip implementations in hardware by dedicated electronic circuitry. The one or more game and/or simulation engines perform tasks on sensory data, generating data sets that are processed through machine learning algorithms by the hardwired artificial intelligence engine. The data sets processed by the hardwired artificial intelligence engine include at least contextual data and target data, wherein combining both data and processing by dedicated hardware results in enhanced machine learning processing.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: April 12, 2022
    Assignee: THE CALANY Holding S. À R.L.
    Inventor: Cevat Yerli
  • Patent number: 11297122
    Abstract: A method of network-based media processing (NBMP) can include receiving a function description of a media processing function from a function repository at a workflow manager in an NBMP system. The function description can include a configuration descriptor providing configuration information of parameters for the media processing function. The parameters can have logical relationships represented by a parameter representation graph constructed according to a set of rules. The media processing function can be instantiated as a media processing task that is part of a workflow. The media processing task can be configured based on the configuration information of the parameters in the configuration descriptor.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: April 5, 2022
    Assignee: Tencent America LLC
    Inventor: Iraj Sodagar
  • Patent number: 11270041
    Abstract: Embodiments of the present invention provide a position-based dynamics approach for simulating objects using a set of points and constraints, applied as equations that restrict the relative motion of bodies. Forces are applied to the points to move them, and the constraints ensure that the points will not move in a way that is inconsistent with rules of the simulation. The present invention improves upon existing PBD approaches by using regularized constraints that directly correspond to well-defined energy potentials, and which can advantageously be solved independent of time step and iteration count.
    Type: Grant
    Filed: September 24, 2018
    Date of Patent: March 8, 2022
    Assignee: NVIDIA Corporation
    Inventors: Miles Macklin, Matthias Müller, Nuttapong Chentanez
  • Patent number: 11263723
    Abstract: The present disclosure provides an image warping method and an image warping device, including: obtaining an image or a video; identifying at least one target portion of a to-be-warped portrait in the image or the video; and performing a warping process on the target portion using a preset warping algorithm, where the warping process includes one or more of the following processes: enlarging, narrowing down, or shifting. In this way, a portrait in the image or the video can be beautified automatically, without a manual beautification of the image from a user, making the beautification more intelligent and simpler, thereby improving the user experience. Moreover, according to the method of the present disclosure, a warping process can be performed on an image or a video online in real time, or performed on a stored image or a stored video offline, allowing the image warping method to be more widely used.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: March 1, 2022
    Inventor: Yuanzhang Chang
  • Patent number: 11237690
    Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
    Type: Grant
    Filed: January 19, 2021
    Date of Patent: February 1, 2022
    Assignee: GoPro, Inc.
    Inventors: Daryl Stimm, William Edward MacDonald
  • Patent number: 11204409
    Abstract: Systems and methods for reconstructing a motion-compensated magnetic resonance image are presented. In certain implementations, a computer-implemented method is provided. The method may include a plurality of operations, including receiving a set of k-space data from a magnetic resonance imaging device, dividing the set of k-space data into a plurality of groups, performing a plurality of initialization operations, performing a first iterative process until a first criteria for the first iterative process is achieved for a current scale of motion estimation, performing a second iterative process until a second criteria for the second iterative process is achieved, and outputting a motion-compensated magnetic resonance image reconstructed in accordance with a predetermined scale of motion estimation.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: December 21, 2021
    Assignee: University of Virginia Patent Foundation
    Inventors: Luonan Wang, Daniel Stuart Weller, John P. Mugler, III, Craig H. Meyer
  • Patent number: 11189035
    Abstract: A retrieval device includes one or more processors. The processors acquire trajectory information indicating a movement trajectory of a target in time-series images. The processors acquire situation information indicating a peripheral situation of the target in the time-series images. The processors acquire a retrieval query containing a movement trajectory and a peripheral situation. The processors retrieve an image matching with the retrieval query among images contained in the time-series images based on the trajectory information and the situation information.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: November 30, 2021
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Toshiaki Nakasu, Daisuke Kobayashi, Kazushige Ouchi
  • Patent number: 11184558
    Abstract: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: November 23, 2021
    Assignee: Adobe Inc.
    Inventors: Lu Zhang, Jianming Zhang, Zhe Lin, Radomir Mech
  • Patent number: 11184216
    Abstract: A state control method includes detecting an operation execution event used for requesting to operate on a first object in a first application. The method also includes determining whether a next node of a current node of the first object in a hybrid state machine is a first state node or a first behavior-tree node. Nodes in the hybrid state machine includes at least a state node and a behavior-tree node, and a state change relationship exists among the nodes in the hybrid state machine. The method further includes, when it is determined that the next node is the first state node, performing on the first object an operation in a first state corresponding to the first state node; and, when it is determined that the next node is the first behavior-tree node, performing on the first object an operation in a first behavior-tree corresponding to the first behavior-tree node.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: November 23, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Lei Jiang, Haobo Shan, Jinyuan Zhou
  • Patent number: 11175729
    Abstract: A system to track orientations of parts of a user based on both images and inertial measurement units (IMUs). For example, the system receives images showing a portion of the user wearing sensor modules. The system receives a first set of orientation measurements generated by the sensor modules attached to some parts of the user. The system determines the second set of orientation measurements of one or more features of the portion of the user from the images. The system provides the first set of orientation measurements and the second set of orientation measurements as input to an artificial neural network that is configured to predict orientation measurements of the one or more other parts of the user that would be measured by additional sensor modules if the additional sensor modules were to be attached to the other parts of the user.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: November 16, 2021
    Assignee: Finch Technologies Ltd.
    Inventors: Viktor Vladimirovich Erivantcev, Alexey Ivanovich Kartashov, Alexander Sergeevich Lobanov, Daniil Olegovich Goncharov, Ratmir Rasilevich Gubaidullin, Ravil Rustemovich Kurbanaev, Alexey Andreevich Gusev
  • Patent number: 11172854
    Abstract: An analysis system analyzes a state of a person and includes a terminal configured to be worn on the person's body. The terminal includes an acceleration sensor, a storage unit, and a processing unit. The processing unit determines whether each value contained in the time series data is in a first state in which the value is equal to or greater than the threshold or in a second state in which the value is less than the threshold. The processing unit also determines a duration which is a period of time during which the first state continues. The processing unit quantifies a brain state of the person on the basis of the duration.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: November 16, 2021
    Assignee: Happiness Planet, Ltd.
    Inventors: Satomi Tsuji, Kazuo Yano, Nobuo Sato, Miki Hayakawa, Koji Ara, Tomoaki Akitomi
  • Patent number: 11170551
    Abstract: Motion retargeting with kinematic constraints is implemented in a digital medium environment. Generally, the described techniques provide for retargeting motion data from a source motion sequence to a target visual object. Accordingly, the described techniques position a target visual object in a defined visual environment to identify kinematic constraints of the target object relative to the visual environment. Further, the described techniques utilize an iterative optimization process that fine tunes the conformance of retargeted motion of a target object to the identified kinematic constraints.
    Type: Grant
    Filed: May 1, 2020
    Date of Patent: November 9, 2021
    Assignee: Adobe Inc.
    Inventors: Ruben Eduardo Villegas, Jun Saito, Jimei Yang, Duygu Ceylan Aksit
  • Patent number: 11145102
    Abstract: A method of and system for recreating a real world pose or aligning a real world object in a virtual space, the method including: prompting a user to successively place a device at a plurality of positions/alignments associated with a plurality of physical points associated with a body of the user, a body of another, or an object; capturing the plurality of positions/alignments with respect to a real world frame of reference; translating the plurality of positions/alignments with respect to the real world frame of reference to a frame of reference in virtual space; and recreating a pose of the body of the user, a pose of the body of the other, or an alignment of the object in the virtual space using the translated plurality of positions/alignments.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: October 12, 2021
    Assignee: Volvo Car Corporation
    Inventors: Qinzi Tan, Lukasz Pasek
  • Patent number: 11133990
    Abstract: A system and method for providing a dynamic comparative network health analysis of a network environment, the method comprising: obtaining dynamic and static network environment parameters of a plurality of network environments; creating network environment profiles of each network environment of the plurality of network environments based on the dynamic and static network environment parameters; performing comparative analysis of network environment profiles of a first network environment of the plurality of network environments with network environment profiles of a second network environment of the plurality of network environments to generate a comparative analysis; based on the comparative analysis, determining whether to reconfigure the first network environment or create a new network environment; if it is determined to reconfigure the first network environment, generating a remedial plan for the first network environment; if it is determined to create a new network environment, generating a new plan f
    Type: Grant
    Filed: May 1, 2019
    Date of Patent: September 28, 2021
    Assignee: Extreme Networks, Inc.
    Inventors: Norival Figueira, Shyamsundar Pullela, Alan Amrod
  • Patent number: 11128909
    Abstract: Provided is a device including: a controller configured to obtain illumination information about illumination around the device, determine, based on the illumination information, a thickness of an outline of an object included in content reproduced by the device, and perform image processing on the content such that the outline of the object is represented as having the determined thickness; and a display displaying the content on which the image processing is performed.
    Type: Grant
    Filed: March 19, 2018
    Date of Patent: September 21, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jung-hoon Cho, Seung-chan Kim, Yong-nam Kim
  • Patent number: 11126412
    Abstract: Computer-implemented design tool functions are described herein for automatically performing edits across different portions of one or more design layouts. According to an example, a method includes causing a display device to display a design interface used to edit a design layout, which includes at least a first frame and a second frame. The method includes receiving first input to initiate a multi-edit mode in the design interface and receiving second input to perform a first operation to edit a first node in the first frame. The method further includes identifying, based at least in part on the second input, a second node in the second frame and corresponding to the first node in the first frame. In this example, the method includes performing, based at least in part on the second input, the first operation to edit the first node in the first frame and a second operation to edit the second node in the second frame.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: September 21, 2021
    Assignee: Figma, Inc.
    Inventors: Sho Kuwamoto, Nikolas Klein, Rasmus Mathias Andersson, Bradee Evans
  • Patent number: 11119735
    Abstract: A method and system for providing a hybrid block and text-based programming environment. The hybrid block and text-based programming environment provides a software development tool suitable for users of different programming skill levels to write and understand code. The hybrid programming environment enables a user to view and edit source code through multiple graphical representative displays of the source code in a manner not previously achievable. Each of the graphical representative displays is linked to a particular programming view that has a unique set of rules related to the functionality of the displayed graphical elements to enable the more comprehensive functionality. The graphical representative displays provide a tool to educate novice programmers as they become more proficient and assist in the transition between block-based and textual representations.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: September 14, 2021
    Assignee: MODKIT INC.
    Inventors: Edward K. Baafi, Collin C. Reisdorf
  • Patent number: 11112856
    Abstract: In an embodiment there is provided a user interface device for interfacing a user with a computer, the computer comprising at least one processor to generate instructions for display of a graphical environment of a virtual reality simulation. The user interface device includes a sensor for detecting activation and/or a sensor for detecting proximity of a body part of the user (e.g., hand). At least partially based on detection by one of these sensors, a transition between virtual reality states is triggered.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: September 7, 2021
    Assignee: Logitech Europe S.A.
    Inventors: Thomas Rouvinez, Aidan Kehoe, Mario Gutierrez, Vincent Jalil, Damien O'Sullivan, Mathieu Meisser, Nicolas Ramond, Regis Croisonnier
  • Patent number: 11069109
    Abstract: Processes for reviewing and editing a computer-generated animation are provided. In one example process, multiple images representing segments of a computer-generated animation may be displayed. In response to a selection of one or more of the images, geometry data associated with the corresponding segment(s) of computer-generated animation may be accessed. An editable geometric representation of the selected segment(s) of computer-generated animation may be displayed based on the accessed geometry data. In some examples, previously rendered representations and/or geometric representations of the same or other segments of the computer-generated animation may be concurrently displayed adjacent to, overlaid with, or in any other desired manner with the displayed geometric representation of the selected segment(s) of computer-generated animation.
    Type: Grant
    Filed: June 11, 2015
    Date of Patent: July 20, 2021
    Assignee: DreamWorks Animation L.L.C.
    Inventors: Fredrik Nilsson, Luke Halliwell, Josiah Larson, Matthew Christopher Gong
  • Patent number: 11062496
    Abstract: Disclosed herein is a motion modeling method and device using a virtual joint sphere. The motion modeling method using the virtual joint sphere includes (a) modeling a 3D virtual character, wherein the 3D virtual character sets a virtual joint sphere for each body part; and (b) forming a trajectory for a motion of a target body part of the 3D virtual character as a specific motion is performed on a surface of the virtual joint sphere assigned to the target body part, when reconstructing the motion of the 3D virtual character according to the specific motion.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: July 13, 2021
    Assignee: CHUNG ANG UNIVERSITY INDUSTRY ACADEMIC COOPERATION FOUNDATION
    Inventors: Young Ho Chai, Seong Hun Kim
  • Patent number: 11055069
    Abstract: To reduce a burden on a user in editing tree structure data with a text editor. When a selection range is designated on an edit screen, a node selection unit of a tree structure data editing device selects one or more node IDs in the tree structure data, based on the position of the selection range. When a paste target for the selection range is designated on the edit screen, a connection target determination unit determines a connection target node ID in the tree structure data, based on the position of the paste target. A tree structure data editing unit edits the tree structure data such that the node or nodes identified by the one or more node IDs is/are connected to the node identified by the connection target node ID. A conversion unit convers the tree structure data edited by the tree structure data editing unit into text data. A display control unit updates the edit screen displayed, based on the text data converted by the conversion unit.
    Type: Grant
    Filed: July 31, 2015
    Date of Patent: July 6, 2021
    Assignee: RAKUTEN, INC.
    Inventors: Ryosuke Aoki, Asami Ando, Hidetomo Suzuki