Three-dimension Patents (Class 345/419)
  • Patent number: 10923004
    Abstract: An information processing apparatus configured to paste a full-spherical panoramic image along an inner wall of a virtual three-dimensional sphere; calculate an arrangement position for arranging a planar image closer to a center point of the virtual three-dimensional sphere than the inner wall, in such an orientation that a line-of-sight direction from the center point to the inner wall and a perpendicular line of the planar image are parallel to each other, the planar image being obtained by pasting an embedding image to be embedded in the full-spherical panoramic image, on a two-dimensional plane; and display a display image on a display unit. The display image is a two-dimensional image viewed from the center point in the line-of-sight direction in a state in which the full-spherical panoramic image is pasted along the inner wall of the virtual three-dimensional sphere and the planar image is arranged at an arrangement position.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: February 16, 2021
    Assignee: RICOH COMPANY, LTD.
    Inventor: Taketo Chiba
  • Patent number: 10922859
    Abstract: Vector art object deformation techniques applied to digital images by vector art rendering system of a computing device are described. The vector art rendering system is configured to deform vector art objects associated with anchor points within a digital image based solely on the movement of the anchor points. Moreover, the vector art rendering system is also configured to adjust anchor points associated with vector art objects within a digital image based solely on the movement of the vector art objects. Techniques are also described that facilitate the automatic association of path segment and vector art objects to anchor points that possess multiple preexisting vector art object associations.
    Type: Grant
    Filed: October 15, 2018
    Date of Patent: February 16, 2021
    Assignee: Adobe Inc.
    Inventors: Sanjeev Kumar Biswas, Ankit Aggarwal, Rajeev Kumar, Sunny Ladkani
  • Patent number: 10922879
    Abstract: A method of generating an image includes receiving a video stream, the video stream having a two-dimensional video of a three-dimensional scene captured by a video camera; determining a mapping between locations in the two-dimensional video of the scene and locations in a three-dimensional representation of the scene, the mapping being determined based on a known parameter of the video camera and a known size of a feature in the three-dimensional scene; generating a three-dimensional graphical representation of the scene based on the determined mapping; determining a virtual camera angle from which the three-dimensional graphical representation of the scene is to be viewed; rendering an image corresponding to the graphical representation of the scene viewed from the determined virtual camera angle, and outputting the rendered image for display.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: February 16, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Fabio Cappello, Matthew William Sanders, David Erwan Damien Uberti, Andrew William Walker
  • Patent number: 10922891
    Abstract: The disclosure relates to a method for generating an augmented representation of a real environment, called an augmented reality representation. Such a method includes obtaining, as a function of said real environment, a virtual boundary dividing the real environment into two spaces, respectively called an activity space and a mixed space. The augmented reality representation is generated by obtaining a first part of the augmented reality representation, called an activity part, corresponding to a representation of at least one part of the activity space. Thereafter, obtaining a second part of the augmented reality representation, called a mixed part, corresponding to an augmented representation of at least one part of the mixed space, in which at least one virtual content is combined with the representation of at least one part of the mixed space.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: February 16, 2021
    Assignee: INTERDIGITAL CE PATENT HOLDINGS
    Inventors: Tao Luo, Philippe Robert, Anthony Laurent
  • Patent number: 10922892
    Abstract: A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, techniques are performed for manipulating virtual objects in an XR environment. In one technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location, within a plane parallel to a touchscreen of a mobile device, responsive to a displacement determined based on user input detected via the touchscreen.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: February 16, 2021
    Assignee: SPLUNK INC.
    Inventors: Devin Bhushan, Jesse Chor, Glen Wong, Jim Jiaming Zhu
  • Patent number: 10924662
    Abstract: A system for generation of a virtual template of at least one part of the body of a user includes an acquisition unit, which has a structure defining an acquisition chamber and includes a plurality of image capture devices such as cameras or the like. Such structure has a frame that supports a plurality of panels, each panel having a corresponding image capture device arranged thereon facing the acquisition chamber, the panels being arranged to shape the acquisition chamber like an egg.
    Type: Grant
    Filed: May 31, 2018
    Date of Patent: February 16, 2021
    Inventors: Davide Luigi Berlusconi, Nicoló Spallarossa, Luca Dallepiane
  • Patent number: 10921409
    Abstract: A magnetic resonance imaging apparatus according to an embodiment includes a display, an input interface, and processing circuitry. The display displays at least a locator image and a reference image. The input interface sets a region of interest on the locator image displayed on the display. The processing circuitry scans a subject to obtain three dimensional data, generates a locator image from the three dimensional data and displaying the locator image on the display, generates a reference image corresponding to the location of the region of interest from the three dimensional data and displaying the reference image on the display, and makes, when a size or position of the region of interest on one of the locator image and the reference image is changed by the input interface, adjustments to correspondingly change the display magnification or position of the other one of the locator image and the reference image.
    Type: Grant
    Filed: November 28, 2017
    Date of Patent: February 16, 2021
    Assignee: CANON MEDICAL SYSTEMS CORPORATION
    Inventors: Ye Liu, Bin Fu, Bing Li, Jinbiao Zhang, Xiaofei Sun
  • Patent number: 10922870
    Abstract: A method of digital continuous and simultaneous three-dimensional painting, drawing and three-dimensional object navigating with steps of providing a digital electronic display capable of presenting two pictures for a right eye and a left eye; providing means for creating a continuous 3D virtual canvas by digitally changing a value and sign of horizontal disparity between two images for the right eye and the left eye and their scaling on the digital electronic display corresponding to instant virtual distance between the user and an instant image within the virtual 3D canvas; providing at least one multi-axis input control device allowing digital painting or object navigating within virtual 3D canvas by providing simultaneous appearance of a similar objects on the images for the right eye and the left eye on the digital electronic display.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: February 16, 2021
    Inventor: Vladimir Vaganov
  • Patent number: 10921969
    Abstract: A user interface for rotating imagery among a plurality of canonical views of a geographic area of interest is disclosed. The interface includes at least one rotation control icon for rotating the imagery among a plurality of canonical views of the geographic area, and a direction indicating portion that indicates a compass direction associated with the canonical view presented on the display device. In particular implementations, the interface can be configured to come into view over the imagery whenever a user navigates to a particular view of the imagery where a plurality of canonical views is available. The motion of the navigation control interface appearing into the imagery is intended to draw attention to the control interface to inform the user that additional canonical views are available.
    Type: Grant
    Filed: June 16, 2020
    Date of Patent: February 16, 2021
    Assignee: Google LLC
    Inventors: Willem Van Lancker, Christopher R. Harrelson, Matthew Robert Simpson, Amanda Marie Leicht Moore
  • Patent number: 10918943
    Abstract: Embodiments relate to hexagonal fragmentation of terrain. Terrain data including locations on a terrain and corresponding hex identifiers of hexagonal terrain tiles of a three-dimensional topology to be placed at the locations are received at a computing device. Hex definition data corresponding to a hexagonal terrain tile includes a constraint condition imposed on an adjacent hexagonal terrain tile so that it can be placed adjacent to the hexagonal terrain tiles. A representation of the terrain is generated by instantiating the hexagonal terrain tiles at the locations indicated in the terrain data with faces of one or more of the hexagonal terrain adjoined to each other in compliance with the constraint condition.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: February 16, 2021
    Assignee: Square Enix Ltd.
    Inventor: Marco Till Brenner
  • Patent number: 10918945
    Abstract: Methods and systems for spectating a live video game are presented. In one embodiment, a method for performing an automated catch-up to a player is provided. The method includes providing an interface for presenting a first view of a video game on a client device where the first view has a first vantage point and includes a target player. The method includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point. The method further includes an operation for moving the second vantage point toward the target object within the portal. Additionally, the method provides an operation for wiping away the portal.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: February 16, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mahdi Azmandian, Steven Osman
  • Patent number: 10916064
    Abstract: Embodiments resolve hemisphere ambiguity at a system comprising sensors. A hand-held controller of the system emits magnetic fields. Sensors positioned within a headset of the system detect the magnetic fields. A first position and orientation of the hand-held controller is determined within a first hemisphere with respect to the headset based on the magnetic fields. A second position and orientation of the hand-held controller is determined within a second hemisphere, diametrically opposite the first hemisphere, with respect to the headset based on the magnetic fields. A normal vector is determined with respect to the headset, and a position vector identifying a position of the hand-held controller with respect to the headset in the first hemisphere. A dot-product of the normal vector and the position vector is calculated, and the first position and orientation of the hand-held controller is determined to be accurate when a result of the dot-product is positive.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: February 9, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Sheng Wan
  • Patent number: 10915984
    Abstract: The present invention relates to a method of streaming interactive computer graphics from a server to a client device. The method includes the steps of: intercepting graphics instructions transmitted from an application destined for a graphical processing unit (GPU) at the server; processing the graphics instructions to generate graphics data at the server; generating index information for, at least, some of the graphics data at the server; transmitting the index information in place of the graphics data to a client device; extracting corresponding graphics data stored at the client device utilizing the index information; and rendering computer graphics at a graphical processing unit (GPU) at the client device using the corresponding graphics data. A system for streaming interactive computer graphics is also disclosed.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: February 9, 2021
    Assignee: ELEKTRAGLIDE LTD
    Inventor: Adam Billyard
  • Patent number: 10915981
    Abstract: Graphics processing renders a scene with a plurality of different rendering parameters for different locations on a screen area. Graphics depicting one or more objects mapped to a screen area are processed. The screen area includes a plurality of zones, each having a different set of rendering parameters. Primitives belonging to one of the objects that covers at least two of the zones are received. Each primitive is assembled to screen space by iterating each primitive over each zone it covers using the rendering parameters of the respective zone with each iteration.
    Type: Grant
    Filed: October 5, 2017
    Date of Patent: February 9, 2021
    Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
    Inventors: Mark Evan Cerny, Jason Scanlin
  • Patent number: 10916059
    Abstract: An interactive video game system includes at least one sensor and at least one display device disposed near a play area. The system also includes a controller communicatively coupled to the at least one sensor and the at least one display device, wherein the controller is configured to: receive, from the at least one sensor, the scanning data of the player in the play area; generate at least one model from the scanning data of the player; identify an action of the player in the play area based on the at least one model; generate the virtual representation for the player based on the at least one model and the action of the player; and present, on the display device, the virtual representation of the player in a virtual environment, wherein an action of the virtual representation is augmented relative to the action of the player.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: February 9, 2021
    Assignee: Universal City Studios LLC
    Inventors: Travis Jon Cossairt, Wei Cheng Yeh, Neil Andrew Leiba, Erica Lynn McCay
  • Patent number: 10917581
    Abstract: There is provided an optical distance measurement system including an image sensor and a processing unit. The processing unit is configured to generate an image to be calculated according to at least one image captured by the image sensor, wherein different image regions of the image to be calculated correspond to different exposure times thereby improving the accuracy of the distance calculation.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: February 9, 2021
    Assignee: PIXART IMAGING INC.
    Inventors: Guo-Zhen Wang, Shiaw-Yu Jou
  • Patent number: 10915185
    Abstract: A method of generating a three-dimensional (3D) image includes displaying a two-dimensional (2D) image of at least a portion of a (3D) object on a display surface. The method includes detecting a tilt angle of a digital pen while the digital pen is used to contact at least one location on a first surface of the (2D) image on the display surface, wherein the detected tilt angle represents a surface property of the first surface at the at least one location. The method includes generating a (3D) image of the object based on the detected tilt angle.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: February 9, 2021
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventor: Ian N. Robinson
  • Patent number: 10915779
    Abstract: A method for extracting uniform features of at least one object, from a point cloud of an environment, includes acquiring the point cloud associated with the environment having the at least one object, wherein the point cloud is associated with a volume comprising a plurality of points; segmenting the point cloud into at least one sub-volume corresponding to each of the at least one object; applying a non-uniform transform on each of the plurality of points corresponding to each of the at least one sub-volume, to obtain a transform coefficient for each of the plurality of points; and selecting a subset of the plurality of transform coefficients as the extracted uniform features of the at least one object within the environment.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: February 9, 2021
    Assignee: Unikie Oy
    Inventor: Sergey Smirnov
  • Patent number: 10915673
    Abstract: An Unmanned Aerial Vehicle (UAV), method, apparatus, and computer-readable medium for solar site assessment includes generating a three-dimensional model of a solar site based at least in part on data captured by an Unmanned Aerial Vehicle (UAV), importing one or more solar paths into the three-dimensional model based at least in part on a geo-location of the solar site, and determining, one or more solar collection estimates corresponding to one or more locations in the solar site based at least in part on the three-dimensional model and the one or more solar paths.
    Type: Grant
    Filed: May 26, 2015
    Date of Patent: February 9, 2021
    Assignee: SCANIFLY, LLC
    Inventor: John Novak
  • Patent number: 10916025
    Abstract: A 3D imaging system is proposed in which an object is successively illuminated in at least three directions and at least three images of the object are captured by one or more energy sensors. A set of images is produced computationally showing the object from multiple viewpoints, and illuminated in the at least three directions simultaneously. This set of images is used stereoscopically to form an initial 3D model of the object. Variations in the brightness of the object provides features useful in the stereoscopy. The initial model is refined using photometric data obtained from images in which the object is illuminated in the at least three directions successively.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: February 9, 2021
    Assignee: FUEL 3D TECHNOLOGIES LIMITED
    Inventors: Marian Elizabeth Harrington, Leonardo Rubio Navarro
  • Patent number: 10915781
    Abstract: A scene reconstructing system, scene reconstructing method and non-transitory computer-readable medium are provided in this disclosure. The scene reconstructing system includes a first electronic device and a second electronic device. A first electronic device includes a first camera unit, a first processor, and a first communication unit. The first processor is configured for recognizing at least a first object from a first image to construct a first map. The second electronic device includes a second camera unit, a second processor, and a second communication unit. The second processor is configured for recognizing at least a second object from a second image to construct a second map; calculating a plurality of confidence values corresponding to the second map. The second communication unit is configured for transmitting a location information to the first communication unit according to the plurality of confidence values.
    Type: Grant
    Filed: February 27, 2019
    Date of Patent: February 9, 2021
    Assignee: HTC Corporation
    Inventors: Cheng-Hsien Lin, Po-Chuan Cho, Yen-Jung Lee, Hung-Yi Yang
  • Patent number: 10915996
    Abstract: Techniques are provided for enhancement of edges in image frames using depth information. A methodology implementing the techniques according to an embodiment includes receiving a color image frame and a depth map frame. The method also includes generating a sharpness mask to control the application of image sharpening to the color pixels. The sharpness mask is based on the value of depth pixels corresponding to the color pixels; and on properties of the depth camera that generated the color image frame, including depth of field, focal distance, and hyperfocal distance. The method further includes calculating sharpness strength for the color pixels. The sharpness strength is proportional to the value of the depth pixel corresponding to the color pixel. The method further includes applying a sharpening filter to the color image frame to enhance edge image features. The sharpening filter is based on the sharpness mask and the sharpness strength.
    Type: Grant
    Filed: July 1, 2016
    Date of Patent: February 9, 2021
    Assignee: Intel Corporation
    Inventors: Yunbiao Lin, Yadong Li, Changliang Wang, Gang Hu
  • Patent number: 10916046
    Abstract: Techniques are disclosed for estimating poses from images. In one embodiment, a machine learning model, referred to herein as the “detector,” is trained to estimate animal poses from images in a bottom-up fashion. In particular, the detector may be trained using rendered images depicting animal body parts scattered over realistic backgrounds, as opposed to renderings of full animal bodies. In order to make appearances of the rendered body parts more realistic so that the detector can be trained to estimate poses from images of real animals, the body parts may be rendered using textures that are determined from a translation of rendered images of the animal into corresponding images with more realistic textures via adversarial learning. Three-dimensional poses may also be inferred from estimated joint locations using, e.g., inverse kinematics.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: February 9, 2021
    Assignees: Disney Enterprises, Inc., ETH Zurich (Eidgenoessische Technische Hochschule Zurich)
    Inventors: Martin Guay, Dominik Tobias Borer, Ahmet Cengiz Öztireli, Robert W. Sumner, Jakob Joachim Buhmann
  • Patent number: 10909749
    Abstract: Techniques for generating an arbitrary perspective of a composite object are disclosed. In some embodiments, a specification of an orthographic view of a composite object comprises combined orthographic views of a plurality of objects, and an arbitrary perspective of the composite object is at least in part generated by populating the arbitrary perspective of the composite object with pixels harvested from existing images of the plurality of objects.
    Type: Grant
    Filed: October 25, 2018
    Date of Patent: February 2, 2021
    Assignee: Outward, Inc.
    Inventors: Clarence Chui, Manu Parmar, Brook Seaton
  • Patent number: 10907955
    Abstract: A three-dimensional (3D) measuring system and a method of determining a distance is provided. A three-dimensional (3D) measuring system includes a master part having a first base part and a first part-under-test including a second base. A photogrammetry camera images the master part to generate two-dimensional (2D) images. A first 3D imager determines 3D coordinates in a first imager frame of reference. A second 3D imager determines 3D coordinates in a second imager frame of reference. The system determines in a system frame of reference a first pose of the first imager and a second pose of the second imager. The system is further configured to determine 3D coordinates of the first part-under-test in the system frame of reference.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: February 2, 2021
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Matthew Armstrong, Christopher S. Garcia, Theodore J. Hordeski, Jr., Michael Veksland, Yevgeniy Vinshtok
  • Patent number: 10909699
    Abstract: The present invention provides a method and a device for image processing, which are applied to the field of image processing. The method includes: receiving a first image, wherein the first image includes a face; detecting the face and a background region in the first image, establishing a three-dimensional model of the face according to the first image; rotating the three-dimensional model of the face by a first angle; projecting the three-dimensional model of the face rotated by the first angle to an image coordinate system of the first image, and fusing a face region with a processed background region to obtain a second image. The prevent invention provides a method and device for image processing, which can adjust the angle of a face in a captured image to achieve the effect of face enhancement.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: February 2, 2021
    Assignee: ARCSOFT CORPORATION LIMITED
    Inventors: Wenxing Xi, Hui Deng, Hongzhuang Yang, Naiyang Lin, Long Zhang
  • Patent number: 10911882
    Abstract: A spatialized audio presentation system selects, based on an orientation of an avatar with respect to a virtual sound source, a head-related impulse response from a library of head-related impulse responses corresponding to different potential orientations of the avatar with respect to the virtual sound source. The spatialized audio presentation system applies the selected head-related impulse response to a sound that is generated by the virtual sound source and is to be presented to a user associated with the avatar. Additionally, the spatialized audio presentation system applies an additional effect to the sound that is to be presented to the user. Corresponding methods and systems are also disclosed.
    Type: Grant
    Filed: January 4, 2019
    Date of Patent: February 2, 2021
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Samuel C. Mindlin, Kunal Jathal, Shan Anis
  • Patent number: 10908587
    Abstract: A factory server receives part requests from customer devices and controls one or more manufacturing tools, such as 3D printers, to fabricate the requested parts. The factory server implements several features to streamline the process of fabricating parts using the manufacturing tools. For instance, the factory server can facilitate the design of a part by extracting features from the part request and identifying model files having those features. The factory server can also select an orientation in which to fabricate the part and determine print settings to use when fabricating the part. In addition, the factory server can implement a process to fabricate a three-dimensional part with a two-dimensional image applied to one or more of its external surfaces. Furthermore, the factory server can also generate a layout of multiple part instances on a build plate of a 3D printer so that multiple part instances can be fabricated at once.
    Type: Grant
    Filed: October 27, 2017
    Date of Patent: February 2, 2021
    Assignee: DESPREZ LLC
    Inventors: Jonathan Schwartz, Max Friefeld, Oliver Ortlieb
  • Patent number: 10911106
    Abstract: A radio network sub-tiles reference signals (RSs) within a set of resource elements (REs) such that each sub-tiled RS occupies less than a time and/or frequency and/or power extent of its respective RE. The set of REs are dispersed across both frequency bins and time slots according to a pre-defined grid; and transmitted. The user equipment (UE) uses that pre-defined grid to locate within that transmission the set of dispersed REs. The UE accumulates and combines at least one subset of the sub-tiled RSs and estimates therefrom a quality; then reports uplink an indication of that estimated quality. Examples of the RSs include channel state information RSs, beam RSs and beam refinement RSs. Advantages are particularly relevant for 5G new radio systems.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: February 2, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Wolfgang Zirwas, Rakash Sivasivaganesan, Berthold Panzner
  • Patent number: 10910100
    Abstract: A method and system for determining a treatment order for a plurality of patient imaging records. The method includes extracting, by a trained neural network, image features from each of the plurality of imaging records, generating, by the trained neural network, a written report associated with each of the plurality of imaging records based on the extracted image features, wherein the trained neural network generates the written report based on a sentence annotation model that provides abnormality annotations on an individual sentence basis, determining, by the trained neural network, an abnormality score associated with each written report, and providing the written reports to a treating physician in a sorted order based on the abnormality score associated with each written report.
    Type: Grant
    Filed: March 14, 2019
    Date of Patent: February 2, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Philipp Daniel Harzig, Yin-Ying Chen, Francine Chen
  • Patent number: 10911799
    Abstract: An apparatus to facilitate processing video bit stream data is disclosed. The apparatus includes one or more processors to decode point cloud data, reconstruct the decoded point cloud data and fill one or more holes in reconstructed point cloud frame data using patch metadata included in the decoded point cloud data and a memory communicatively coupled to the one or more processors.
    Type: Grant
    Filed: July 31, 2018
    Date of Patent: February 2, 2021
    Assignee: Intel Corporation
    Inventors: Jill Boyce, Scott Janus, Prasoonkumar Surti, Stanley Baran, Michael Apodaca, Srikanth Potluri, Hugues Labbe, Jong Dae Oh, Gokcen Cilingir, Archie Sharma, Jeffrey Tripp, Jason Ross, Barnan Das
  • Patent number: 10904507
    Abstract: A method and apparatus for providing multi-view composed frames uses a single display pipe mechanism. The single display pipe includes, in one example, a memory requestor that fetches multi-view data from a frame buffer using a plurality of viewports. The single display pipe may also include a multi-view packer. Each viewport of the single display pipe has access to a frame buffer holding multi-view frame data, and may be configured to have access to different areas of the frame buffer. In this fashion the single display pipe may fetch data representing more than one view of a multi-view frame. Additionally, the multi-view packer combines the data fetched from one or more of the viewports to form a multi-view frame to be supplied for display.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: January 26, 2021
    Assignee: ATI Technologies ULC
    Inventor: Dennis Au
  • Patent number: 10902676
    Abstract: A system and method of controlling a virtual camera. The method comprises receiving a camera path of the virtual camera, the camera path defining movement of the virtual camera over a period of time to capture video data of a scene; and determining a plurality of control points on the camera path using a plurality of time markers within the period of time, each of the time markers corresponding to at least one event of a predetermined type being identified in the scene, wherein the control points at least partially define the camera path. The method further comprises controlling the virtual camera using the camera path modified based on the plurality of control points in response to a user input in relation to at least one of the control points.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: January 26, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Berty Jacques Alain Bhuruth
  • Patent number: 10901499
    Abstract: A method is performed at a computing system for rendering a content preview in a virtual space based on user locations. The computing system is communicatively connected to a head-mounted display wore by a user. The method includes: rendering a user interface panel in the virtual space, wherein the user interface panel includes multiple content posters, each having a unique location in the virtual space; measuring the head-mounted display's location in a physical space using a position tracking system adjacent the user; determining the user's location in the virtual space according to the head-mounted display's location in the physical space; and in accordance with a determination that the user's location and at least one of the multiple content posters' location in the virtual space satisfy a predefined condition, replacing the user interface panel with a content preview associated with the corresponding content poster in the virtual space.
    Type: Grant
    Filed: October 1, 2019
    Date of Patent: January 26, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Dhaval Jitendra Joshi, Jingzhou Chen, Xiaomei Chen, Wenjie Wu
  • Patent number: 10901214
    Abstract: The disclosure discloses a method and device for controlling display of an image and a Head-Mounted Display (HMD). The method includes: three-dimensional reconstruction is performed on an initial image to obtain a three-dimensional reconstructed light field by adopting a preset light field display manner; the three-dimensional reconstructed light field is segmented, according to wavefront map information, into a plurality of focal planes, wherein the wavefront map information is obtained by scanning each eye of a user watching the initial image through a wavefront aberrometer, and the plurality of focal planes respectively correspond to diopters of different parts of each eye, and are focused on a retina of each eye; and the plurality of focal planes are controlled to be focused on the retina of each eye of the user to display the initial image as an image to be displayed.
    Type: Grant
    Filed: April 12, 2017
    Date of Patent: January 26, 2021
    Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.
    Inventor: Dongsheng Yuan
  • Patent number: 10902675
    Abstract: A method for smoothing a graphic model includes forming a loop from a plurality of parametrically defined curves and creating a ribbon along each parametrically defined base curve between preceding and subsequent parametrically defined curves of the loop. The ribbons are blended to form a multi-sided surface patch between the parametrically defined curves. A system for smoothing a graphic model includes a curve network module, a lofting module and a blending module. The curve network module, the lofting module and the blending module, are configured to cause a processor to form a loop from a plurality of parametrically defined curves, create a ribbon along each parametrically defined curve between a preceding parametrically defined curve of the loop and a subsequent parametrically defined curve of the loop and blend the ribbons to form a multi-sided surface patch between the parametrically defined curves.
    Type: Grant
    Filed: December 17, 2019
    Date of Patent: January 26, 2021
    Inventor: Alyn Rockwood
  • Patent number: 10901420
    Abstract: Unmanned aerial vehicle-based systems and methods for agricultural landscape modeling are disclosed herein. An example unmanned aerial vehicle includes a communicator to receive an instruction to request the unmanned aerial vehicle to fly over an area of interest. The instruction is from a vehicle in the area of interest. The unmanned aerial vehicle is to fly over the area of interest. The example unmanned aerial vehicle includes a camera to generate image data for the area of interest. The example unmanned aerial vehicle includes a data generator to generate a vegetation landscape model of the area of interest based on the image data. The communicator is to communicate the vegetation landscape model to the vehicle.
    Type: Grant
    Filed: November 3, 2017
    Date of Patent: January 26, 2021
    Assignee: Intel Corporation
    Inventors: Markus Achtelik, Jan Stumpf, Daniel Gurdan, Bastian Jaeger
  • Patent number: 10902681
    Abstract: A system for displaying a virtual object includes a display device for displaying an environment; a video camera, where the video camera is operable to capture a video image of an area of a user's environment, the size of the area in the video image being larger than the size of the area of the environment viewable at the display device; a motion predictor operable to predict a motion of the camera; a scene processor operable to identify and process a portion of the captured video image that corresponds to an area of the environment that is expected to be made viewable at the display device, as a result of the predicted motion; an image generator configured to receive an input from the scene processor, and in response thereto, generate a virtual object for display at the display device; and where the image generator is configured to output the virtual object for display in response to a detection of the predicted motion.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: January 26, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: David Erwan Damien Uberti
  • Patent number: 10904517
    Abstract: A display panel including: a display unit configured to provide a first image to one of a left eyeball and a right eyeball of a user and to provide a second image having the same tone as a tone of the first image to the other one of the left eyeball and the right eyeball of the user; a brightness correcting unit configured to generate second image data corresponding to the second image by using first image data corresponding to the first image; and a data driver configured to generate a first data signal based on the first image data, to generate a second data signal based on the second image data, and to provide the first and second data signals to the display unit, and the first image and the second image are displayed with different brightnesses during at least a part of an image display period.
    Type: Grant
    Filed: October 16, 2017
    Date of Patent: January 26, 2021
    Assignee: Samsung Display Co., Ltd.
    Inventors: Hyun Koo Lee, Soo Young Kim, Min Tak Lee, Kyu Seok Kim, Young Nam Yun, Si Beak Pyo
  • Patent number: 10898298
    Abstract: Methods and systems for determining an orthodontic treatment for a patient are provided. The method comprises: receiving image data associated with a patient's skull; identifying, based on the image data, a first pair of reference pints; identifying, based on the image data, a second pair of reference points; generating based on the first and second pairs of reference points a first reference line and the second reference line, respectively; determining, based on an intersection of the first reference line and the second reference line, a rotation center of a patient's mandible; and based on the rotations center, determining the orthodontic treatment for the patient.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: January 26, 2021
    Assignee: Oxilio Ltd
    Inventor: Islam Khasanovich Raslambekov
  • Patent number: 10902312
    Abstract: A method of mapping a first operation of a source framework to a second operation of a target framework for an artificial neural network includes determining an alignment between a current source axis order and a current target axis order. The method also includes setting the current target axis order based on the alignment, and an expected source axis order of the first operation and/or an expected target axis order of the second operation.
    Type: Grant
    Filed: September 12, 2017
    Date of Patent: January 26, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Tejash Shah, Durk Van Veen
  • Patent number: 10902638
    Abstract: Disclosed herein is method and system for detecting pose of a subject in real-time. In an embodiment, nodal points corresponding to the subject may be identified and used for identifying skeleton pose of the subject. Thereafter, a feature descriptor for the skeleton pose may be computed based on the nodal points. Further, the feature descriptor of the skeleton pose may be compared with predetermined feature descriptors for detecting the pose of the subject as predefined pose corresponding to one of the predetermined feature descriptors used for the comparison. The method of present disclosure makes accurate pose detection from a two-dimensional image of the subject, using a pose detection model, which is pre-trained with predetermined feature descriptors and deep learning techniques.
    Type: Grant
    Filed: November 20, 2018
    Date of Patent: January 26, 2021
    Assignee: Wipro Limited
    Inventors: Gopichand Agnihotram, Prashanth Kumar Ponnarassery, Pandurang Naik
  • Patent number: 10902685
    Abstract: Frontend and backend systems and processes. Technical foundations on which an Augmented Reality (AR) platform, such as an AR Social Media Platform. Systems and methods are used to construct and manage an AR Cloud backend and frontend environment facilitation: persistent 3-Dimensional and 2-Dimensional geo-located content that can be created, viewed, changed, and interacted with by users in the same or different sessions; ephemeral content; local creation and posting of content; remote creation and posting of content; remote visualization, altering, and placing content on a 3D map; filtering and management of content in the camera view based on a visibility layer/similar theme and content priority based on preferences, categorization, and ownership; automated creation and posting; lighting of content and digital environments; linking of point clouds with real-world geo-coordinates for accurate map construction; and the security of property and content rights and ownership via smart contracts on a blockchain.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: January 26, 2021
    Inventor: John T. Daly
  • Patent number: 10896535
    Abstract: A system and method for generating real-time facial animation is disclosed. The system relies upon pre-generating a series of key expression images from a single neutral image using a pre-trained generative adversarial neural network. The key expression images are used to generate a set of FACS expressions and associated textures which may be applied to a three-dimensional model to generate facial animation. The FACS expressions and textures may be provided to a mobile device to enable that mobile device to generate convincing three-dimensional avatars in real-time with convincing animation in a processor non-intensive way through a blending process using the pre-determined FACS expressions and textures.
    Type: Grant
    Filed: June 3, 2019
    Date of Patent: January 19, 2021
    Assignee: Pinscreen, Inc.
    Inventors: Hao Li, Koki Nagano, Jaewoo Seo, Lingyu Wei, Jens Fursund
  • Patent number: 10896316
    Abstract: Techniques and technologies for automated microscopy scanning systems are disclosed wherein a microscopy system performs “hunt mode” operations at coarsely-spaced locations throughout a scanning window until an acceptable quality scan result is achieved. The system then performs detailed scans at all fields of view within a grid cell that includes the location having the acceptable scan result. The system performs another evaluation of the scan results for the entire grid cell, and if the scan results for the grid cell are collectively acceptable, then the system proceeds to perform “scan mode” operations. The scan mode operations include scanning and evaluating all of the fields of view within one or more grid cells adjacent to the acceptable grid cell from the hunt mode operations. The system may successively perform hunt mode operations and scan mode operations, compiling information regarding one or more aspects of the scanning process, until one or more termination criteria are satisfied.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: January 19, 2021
    Assignee: Tokitae, LLC
    Inventors: Matthew Horning, Liming Hu, Shawn McGuire, Courosh Mehanian
  • Patent number: 10891798
    Abstract: A system for displaying an asset of an interactive electronic technical publication synchronously in a plurality of extended reality display devices. The system comprises a computer having a display displaying the interactive electronic technical publication with a reference to the asset; a multi-channel messaging subsystem; an extended reality application and the plurality of extended reality display devices. The multi-channel messaging subsystem comprises a key-value server and a subscription manager together defining a message broker and using a reactive protocol component allowing clients to subscribe to a channel associated to a conversation. The reactive protocol component used by the message broker allows sending and receiving messages containing at least one of commands, events and property value changes relative to the asset referenced in the interactive electronic technical publication.
    Type: Grant
    Filed: June 5, 2018
    Date of Patent: January 12, 2021
    Assignee: 2689090 Canada Inc.
    Inventor: Charles L. Guerin
  • Patent number: 10890967
    Abstract: A method for improving user interaction with a virtual environment includes presenting the virtual environment to a user on a display, measuring a gaze location of a user's gaze relative to the virtual environment, casting an input ray from an input device, measuring an input ray location at a distal point of the input ray, and snapping a presented ray location to the gaze location when the input ray location is within a snap threshold distance of the input ray location.
    Type: Grant
    Filed: July 9, 2018
    Date of Patent: January 12, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sophie Stellmach, Sheng Kai Tang, Casey Leon Meekhof, Julia Schwarz, Nahil Tawfik Sharkasi, Thomas Matthew Gable
  • Patent number: 10891330
    Abstract: Provided are a computer program product, system, and method for processing images from a gaze tracking device to provide location information for tracked entities. A gazed image is received from a gaze tracking device at which the user is gazing while operating the gaze tracking device. User speech is received from a microphone. The user speech is as having memorization intent. A description of a tracked entity that is an object of the memorization intent is extracted from the user speech. A tracking object in a tracking object database is created including the gazed image and the extracted description of the tracked entity for which the user has memorization intent. A determination is made of a location of the tracked entity and the determined location of the tracked entity is associated with the created tracking object in the tracking object database.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: January 12, 2021
    Assignee: International Business Machines Corporation
    Inventors: Nadiya Kochura, Fang Lu
  • Patent number: 10891742
    Abstract: An apparatus to facilitate motion tracking is disclosed. The apparatus includes one or more processors to receive video data including a plurality of point clouds in a time series, convert each of the plurality of point clouds into a deformable model representation and generate an inter-frame mapping between the deformable model representations to track motion between the plurality of point clouds.
    Type: Grant
    Filed: January 23, 2019
    Date of Patent: January 12, 2021
    Assignee: Intel Corporation
    Inventor: Blake C. Lucas
  • Patent number: 10891795
    Abstract: A localization method and apparatus are provided. The method comprises generating a synthetic image corresponding to a current time period based on a three-dimensional (3D) color map corresponding to an image captured at a time period prior to the current time period, and position information at the current time period time, and determining final position information at the current time period based on the synthetic image corresponding to the current time period and an image captured at the current time period.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: January 12, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Inwoo Ha, Nahyup Kang