Space Transformation Patents (Class 345/427)
  • Patent number: 10733766
    Abstract: Methods and apparatus to encode and/or decode normals of geometric representations of surfaces are disclosed herein. An example method includes receiving a plurality of points, each point representing a normal to the surface and being arranged within a tile; generating a plurality of regions within the tile, each region including points of the plurality of points; retrieving a first and second point, the first point representing a first normal and the second point representing a second normal, the first point being outside of a specified baseline region; performing a point transformation operation on the first point to produce a transformed first point of the baseline region and performing the point transformation on the second point to produce a transformed second point; generating a difference between the transformed first point and the transformed second point to produce a difference value; and encoding the difference value.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: August 4, 2020
    Assignee: GOOGLE, LLC
    Inventors: Michael Hemmer, Lauren DeNaut
  • Patent number: 10728520
    Abstract: An exemplary depth data generation system accesses first and second depth maps of a real-world scene, the depth maps independently captured using first and second depth map capture techniques, respectively. The first and second depth maps include, respectively, first and second depth data points both representative of a same physical point on a surface of an object in the real-world scene. Based on the first and second depth map capture techniques and based on an attribute of the surface of the object, the system assigns a first confidence value to the first depth data point and a second confidence value to the second depth data point. Based on the first and second confidence values, the system converges the first and second depth maps to form a converged depth map of the real-world scene that includes a third depth data point representing the physical point on the surface of the object.
    Type: Grant
    Filed: February 18, 2019
    Date of Patent: July 28, 2020
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Syed Meeran Kamal, Steven L. Smith, Yongsheng Pan, Sergey Virodov, Jonathan A. Globerson, Lama Hewage Ravi Prathapa Chandrasiri, Mohammad Raheel Khalid
  • Patent number: 10728513
    Abstract: An image processing apparatus includes: an image obtaining unit configured to obtain images of an image capturing target area from a plurality of directions; an information obtaining unit configured to obtain viewpoint information; a determination unit configured to determine a pixel value of a particular area in a virtual viewpoint image according to a virtual viewpoint at a first time indicated by the viewpoint information, based on a pixel value of an obtained image based on image capturing by a first image capturing apparatus at a second time, and a pixel value of an obtained image based on image capturing by a second image capturing apparatus at the first time, wherein the particular area is not captured by the first image capturing apparatus at the first time; and a generation unit configured to generate a virtual viewpoint image in accordance with the determination of the pixel value.
    Type: Grant
    Filed: September 17, 2018
    Date of Patent: July 28, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Tatsuro Koizumi
  • Patent number: 10726067
    Abstract: A method and an apparatus for data retrieval in a lightfield database are described. An acquiring unit of the apparatus acquires a sample data. An operation unit determines a plurality of two-dimensional (2D) images from each 4D lightfield data of the lightfield database, and match the sample data with the determined 2D images according to geometrical parameters of the sample data and geometrical parameters of the 2D images. One of the 2D images is selected as a target image based on the matching result, and the 4D lightfield from which the target image is determined is retrieved.
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: July 28, 2020
    Assignee: INTERDIGITAL CE PATENT HOLDINGS
    Inventors: Jurgen Stauder, Neus Sabater, Cedric Thebault
  • Patent number: 10725153
    Abstract: Data is received characterizing a plurality of measurements for a scene received by a plurality of sensor elements forming a sensor array. A plurality of scene sub-domains is mapped to the plurality of sensor elements. A plurality of voxels associated with one of the plurality of scene sub-domains is mapped to a plurality of measurement sub-domains. One or more scattering coefficients of the scene is determined by applying the mapping to the received data. Related apparatus, systems, techniques, and articles are also described.
    Type: Grant
    Filed: September 7, 2017
    Date of Patent: July 28, 2020
    Inventor: Alec Rose
  • Patent number: 10713513
    Abstract: The present invention is to reduce the time required to detect an object after completion of the rotation of a head or a body of a robot. A robot 100 includes a camera 111, and a control unit 127 which determines an overlapping area between a first image captured with the camera 111 at first timing and a second image captured with the camera 111 at second timing later than the first timing to detect an object included in an area of the second image other than the determined overlapping area.
    Type: Grant
    Filed: February 24, 2018
    Date of Patent: July 14, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Takashi Yamaya, Kouichi Nakagome, Keisuke Shimada
  • Patent number: 10705786
    Abstract: A collaboration system including a spatial event map that can be published as an electronic document by a collaboration server and consumed by a consuming workstation. The electronic document is self-contained, and includes a viewer that has a module for rendering each of the graphical target types in the workspace onto a screen space. The system includes a server-side data processor that maintains the spatial event map which locates events in a workspace. The spatial event map includes a log of events, entries in the log having a location of a graphical target of the event in the workspace and a time.
    Type: Grant
    Filed: April 4, 2019
    Date of Patent: July 7, 2020
    Assignee: Haworth, Inc.
    Inventors: Diyu Liu, Keefe Roedersheimer, Satish Santhakumar, Demian Entrekin
  • Patent number: 10706020
    Abstract: A computer-implemented method for sharing CAx data includes receiving CAx data in a first CAx format from a first client, storing the CAx data in a plurality of alternate formats, receiving a request for the CAx data from a second client, providing the CAx data to the second client using at least one alternate format of the plurality of alternate formats responsive to receiving the request for the CAx data from the second client. An apparatus and system corresponding to the above method is also disclosed herein.
    Type: Grant
    Filed: April 14, 2017
    Date of Patent: July 7, 2020
    Assignee: BRIGHAM YOUNG UNIVERSITY
    Inventors: Kelly Eric Bowman, Charles Greg Jensen, Joshua Coburn, Dan Staves, M. Scott Christensen, Bryce DeFigueiredo, Robert Freeman
  • Patent number: 10699676
    Abstract: A display apparatus, a method of controlling the same, and a computer program product thereof are provided. The display apparatus includes a display configured to display an image; and a processor configured to determine output coordinates of a frame involved in a section, according to a plurality of sections of content including a plurality of frames reproducible for a predetermined period of time, and control the display to display a region of a frame corresponding to a viewpoint while moving the viewpoint along determined output coordinates, when determination of the output coordinates of at least one section among the plurality of sections is completed.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: June 30, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jong-in Lee, Sung-hyun Kim
  • Patent number: 10692235
    Abstract: The disclosure relates to an image processing apparatus for determining a depth of a pixel of a reference image of a plurality of images representing a visual scene relative to a plurality of locations, wherein the plurality of locations define a two-dimensional grid with rows and columns and wherein the location of the reference image is associated with a reference row and a reference column of the grid. The image processing apparatus comprises a depth determiner configured to determine a first depth estimate on the basis of the reference image and a first subset of the plurality of images for determining the depth of the pixel of the reference image, wherein the images of the first subset are associated with locations being associated with a row of the grid different than the reference row and with a column of the grid different than the reference column.
    Type: Grant
    Filed: July 20, 2017
    Date of Patent: June 23, 2020
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Thoma Papadhimitri, Onay Urfalioglu, Hector Navarro Fructuoso, Jacek Konieczny
  • Patent number: 10688392
    Abstract: A reusable video game camera rig framework is described herein. The framework may include instruction sets for controlling a virtual camera rig, which is used to set a position and orientation of a virtual camera within a virtual area of a video game. The instruction sets may be reusable in a variety of different camera contexts, such as a first person camera, a third person camera, a top-down camera, and many others. The instruction sets may also be reusable in a variety of different video game contexts, such as combat games, sports games, fantasy games, racing games, and many others. The instruction sets may be both modifiable and extendible to different camera and game contexts, for example allowing developers to easily generate new camera behaviors for their games and also to modify existing available camera behaviors to better match their particular camera and game contexts.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: June 23, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Jeremy Hardiman, Christopher Roby
  • Patent number: 10679426
    Abstract: The embodiment of the present invention discloses a method and an apparatus for processing display data. The method includes: obtaining user data of a user render request according to the received user render request, wherein the user data include: a scene picture and an augmented reality picture; setting layer information of a virtual camera that performs image render on the scene picture and the augmented reality picture in a render process, and layer information of the scene picture and the augmented reality picture in the render process, wherein the virtual camera and the scene picture and the augmented reality picture rendered by the virtual camera correspond to the same layer information in the render process; and rendering the scene picture and the augmented reality picture by the virtual camera corresponding to layer information in the render process according to different layer information.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: June 9, 2020
    Assignee: CLOUDMINDS (SHENZHEN) ROBOTICS SYSTEMS CO., LTD.
    Inventors: Kai Wang, Shiguo Lian
  • Patent number: 10681269
    Abstract: A non-transitory computer-readable recording medium stores therein an information processing program that causes a computer to execute a process including: acquiring images photographed with a first angle of view and a second angle of view wider than the first angle of view; specifying a position and an attitude of a camera that photographed the image photographed with the first angle of view based on the image photographed with the second angle of view; stitching a plurality of images photographed with the first angle of view to generate a panoramic image; correcting the position on the generated panoramic image, of the image photographed with the first angle of view based on the specified position and attitude of the camera; and mapping the panoramic image to a three-dimensional model by texture mapping based on the corrected position.
    Type: Grant
    Filed: February 6, 2017
    Date of Patent: June 9, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Manabu Nakao, Moyuru Yamada, Yoshiro Hada
  • Patent number: 10659766
    Abstract: Provided is a confidence generation apparatus including: an acquisition unit configured to acquire a depth image signal which includes depth information representing a depth to an object in each of a plurality of pixels; and a generation unit configured to generate global confidence which represents confidence in a global region of the depth image signal. The generation unit includes: a first generation processing unit configured to generate local confidence which represents the confidence in the depth information in each of the plurality of pixels; a region division processing unit configured to divide the depth image signal into a plurality of regions based on the depth information; and a second generation processing unit configured to generate the global confidence in each of the plurality of regions based on the local confidence.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: May 19, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Kazuya Nobayashi, Takashi Sasaki
  • Patent number: 10659750
    Abstract: The disclosure relates to a method and system for presenting at least part of an image of a real object in a view of a real environment, comprising providing a first image of at least part of a real object captured by a first camera, determining at least part of the real object in the first image as an object image area, determining a first 3D plane relative to the first camera, the first camera being at a position where the first image is captured, providing at least one image feature related to the real object in the first image, providing at least one first ray passing an optical center of the first camera being at a position where the first image is captured and the at least one image feature, determining, according to a first plane normal direction of the first 3D plane, at least one first angle between the first 3D plane and the at least one first ray, providing a second image of a real environment captured by a second camera, determining a second 3D plane relative to the second camera, the second camer
    Type: Grant
    Filed: July 23, 2014
    Date of Patent: May 19, 2020
    Assignee: Apple Inc.
    Inventors: Peter Meier, Lejing Wang, Stefan Misslinger
  • Patent number: 10659767
    Abstract: A camera and a method for extracting depth information by the camera having a first lens and a second lens are provided. The method includes photographing, by the first lens, a first image; photographing, by the second lens, a second image of a same scene; down-sampling the first image to a resolution of the second image if the first image is an image having a higher resolution than a resolution of the second image; correcting the down-sampled first image to match the down-sampled first image to the second image; and extracting the depth information from the corrected down-sampled first image and the second image.
    Type: Grant
    Filed: October 17, 2017
    Date of Patent: May 19, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jin-Kyung Lee, Tae-Kyung Kim, Taek-Seong Jeong
  • Patent number: 10650594
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: May 12, 2020
    Assignee: Globus Medical Inc.
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Patent number: 10650579
    Abstract: An electronic system for displaying visual information to a user includes a head-mounted display (HMD) including a near-eye display (NED), a microprocessor in data communication with the NED, and a storage device in data communication with the microprocessor. The storage device has instructions stored thereon that, when executed by the microprocessor, cause the microprocessor to perform a method. The method includes identifying an origin point and target point and calculating an object distance between the origin point and the target point in three-dimensional space. The target point is part of a virtual object that is procedurally generated. The object distance is used to adjust a threshold value of a distance test. The method further includes determining a shader value for the target point and applying a shader to the target point to create a shaded virtual object. The shaded virtual object is then displayed to the user with the NED.
    Type: Grant
    Filed: November 30, 2017
    Date of Patent: May 12, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Tong Chen, Morien Thomas
  • Patent number: 10649616
    Abstract: Systems and methods for a volumetric multi-selection interface for selecting multiple entities in three-dimensional (3D) space are provided. An example method includes generating a selection region within a three-dimensional space and receiving a selection path user input to define a selection path. The method also includes defining a selection volume based on the selection region and the selection path and selecting entities within the 3D space based on the selection volume. In some implementations, an alter selection region user input is received while the selection path is being defined. The size or shape of the selection region may be altered in response thereto.
    Type: Grant
    Filed: July 5, 2018
    Date of Patent: May 12, 2020
    Assignee: GOOGLE LLC
    Inventors: Evan Moore, Christopher Ross, Ian MacGillivray
  • Patent number: 10652522
    Abstract: A method for creating multiple viewpoint images for an image frame. The method includes receiving by a processing element a left eye image and a right eye image, wherein the left eye image and right eye image comprise a stereoscopic image pair. Once the images are received, the method includes determining by the processing element a first viewing location corresponding to the left eye image and a second viewing location corresponding to the right eye image and determining by the processing element a plurality of new viewpoint locations using the first viewing location and the second viewpoint location.
    Type: Grant
    Filed: October 8, 2018
    Date of Patent: May 12, 2020
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Lewis Nathaniel Siegel, Brandon Bloch, Robert M. Neuman, Brian Whited, David Anthony Bossert
  • Patent number: 10645278
    Abstract: An imaging control apparatus includes: a control unit configured to receive a first user operation and configured to: when the first user operation is not received, execute control to output an image signal which is to be displayed on a display unit, the image signal being one of: a first image corresponding to a first range of a live VR image; and a second image corresponding to a second range of the live VR image, and when the first user operation is received: execute control to output an image signal which is to change the image displayed on the display unit from one of the first image and the second image to the other of the first image and the second image, or to both the first image and the second image; and issue a preparation instruction to execute imaging preparation processing.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: May 5, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Shingo Isobe
  • Patent number: 10628019
    Abstract: An electronic device and a controlling method of an electronic device are provided. The electronic device includes a display and a processor configured to control the display to display multimedia content with a 360-degree angle of view at a first viewing angle, control the display to display, on the multimedia content, a first user interface (UI) element to change the first viewing angle to a predetermined viewing angle and display the multimedia content at the predetermined viewing angle. Further, in response to the first UI element being selected, the processor is further configured to control the display to display a viewing angle option list to select one of a plurality predefined viewing angles.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: April 21, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Monil Parmar, Manish Chhabra
  • Patent number: 10620137
    Abstract: A contact lens inspection system, in particular for soft contact lenses, comprises a light source (40) for illuminating a contact lens to be inspected; a plenoptic camera (1) for producing an electronic plenoptic image; a processing unit (103) adapted for electronically processing the electronic plenoptic image of the contact lens and configured for refocusing the image.
    Type: Grant
    Filed: September 6, 2018
    Date of Patent: April 14, 2020
    Assignee: Alcon Inc.
    Inventors: Sarah Unterkofler, Matthias Schwab
  • Patent number: 10621751
    Abstract: A head-mounted display device includes a camera, an inertial sensor in a first spatial relationship with the camera, and a processor that: acquires an image data sequence from the camera; and acquires a sensor data sequence from the inertial sensor; derives a first pose of an object based at least on one of image frames in the image data sequence and template data created based on a 3D model corresponding to the object; derives a second spatial relationship between an object coordinate system defined on the object or the 3D model and a global coordinate system based at least on the first pose or a pose tracked from the first pose, the sensor data sequence and the first spatial relationship; and derives a second pose of the object based at least on the image data sequence, the sensor data sequence and the second spatial relationship using a non-linear estimation algorithm.
    Type: Grant
    Filed: June 16, 2017
    Date of Patent: April 14, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Yang Yang, Jie Wang, Guoyi Fu
  • Patent number: 10621463
    Abstract: A method for creating image products includes the following steps. Image data and positional data corresponding to the image data are captured and processed to create geo-referenced images. Edge detection procedures are performed on the geo-referenced images to identify edges and produce geo-referenced, edge-detected images. The geo-referenced, edge-detected images are saved in a database. A user interface to view and interact with the geo-referenced image is also provided such that the user can consistently select the same Points of Interest between multiple interactions and multiple users.
    Type: Grant
    Filed: July 25, 2014
    Date of Patent: April 14, 2020
    Assignee: Pictometry International Corp.
    Inventors: Steven Douglas Adams, Yandong Wang, Frank D. Giuffrida
  • Patent number: 10607409
    Abstract: Systems and methods for constructing and saving files containing computer-generated image data with associated virtual camera location data during 3-D visualization of an object (e.g., an aircraft). The process tags computer-generated images with virtual camera location and settings information selected by the user while navigating a 3-D visualization of an object. The virtual camera location data in the saved image file can be used later as a way to return the viewpoint to the virtual camera location in the 3-D environment from where the image was taken. For example, these tagged images can later be drag-and-dropped onto the display screen while the 3-D visualization application is running to activate the process of retrieving and displaying a previously selected image. Multiple images can be loaded and then used to determine the relative viewpoint offset between images.
    Type: Grant
    Filed: July 19, 2016
    Date of Patent: March 31, 2020
    Assignee: The Boeing Company
    Inventors: James J. Troy, Christopher D. Esposito, Vladimir Karakusevic
  • Patent number: 10600253
    Abstract: An information processing apparatus including: a display control unit configured to cause a first video to be displayed in a display area that a user visually recognizes, the first video being captured by a first imaging unit mounted on a first moving body that moves in a first space. The display control unit generates a first transition video corresponding to a viewpoint position that is moved continuously between a first viewpoint which is a viewpoint of the first imaging unit and a second viewpoint for imaging the first space.
    Type: Grant
    Filed: July 12, 2016
    Date of Patent: March 24, 2020
    Assignee: SONY CORPORATION
    Inventor: Junichi Rekimoto
  • Patent number: 10588573
    Abstract: A datum warning method and a datum rebuilding method are applied to a bio-sensor module equipped in a wearable electronic device. The wearable electronic device includes a warning interface and a bio-sensor module coupled with the warning interface. The bio-sensor module includes a sensor and a processor electrically connected with the sensor. The sensor is adapted to continuously receive a plurality of physical signal. The processor is adapted to identify if one specific physical signal meets a predefined condition, and output a warning signal to show a reminder via the warning interface when the specific physical signal is identified. Further, the processor is adapted to display each of the physical signals via the warning interface, and replace at least one of the physical signals and then store the replaced physical signal with non-replaced physical signals for rebuilding a statistic curve.
    Type: Grant
    Filed: May 31, 2018
    Date of Patent: March 17, 2020
    Assignee: PixArt Imaging Inc.
    Inventors: Chen-Han Tsai, Hsiu-Ling Yeh, Yung-Chang Lin
  • Patent number: 10593718
    Abstract: A surface profiling system is provided including an imaging detector array and an optical imaging array comprising at least one set of optical channels. Each optical channel includes a lens arrangement (e.g., including a GRIN lens) configured to provide an erect image at a detector. The optical channels have overlapping fields of view (FOV) and overlapping imaged fields of view (IFOV). A workpiece surface point may be simultaneously imaged in at least two overlapping IFOVs of two optical channels. A surface point that is not at an object reference distance (e.g., a front focal length) may be imaged at different respective positions along the imaging detector array, and the difference between the respective positions may define a respective image offset for that surface point. A surface height measurement coordinate for the surface point may be determined based on the corresponding image offset.
    Type: Grant
    Filed: March 28, 2017
    Date of Patent: March 17, 2020
    Assignee: Mitutoyo Corporation
    Inventor: Joseph Daniel Tobiason
  • Patent number: 10587865
    Abstract: An apparatus and method capable of simultaneously acquiring 3D geometry and appearance modeling data. The 3D reconstruction apparatus including material appearance modeling includes a light source arc including light sources configured to irradiate an object located at a photographing stage, a camera arc including cameras configured to photograph the object at the photographing stage, a driving operation unit configured to rotate the light source arc and camera arc, and a control unit configured to control the light source arc, camera arc, and driving operation unit. The control unit rotates the light source arc and camera arc at a constant interval based on an operation axis through the driving operation unit, and multiple image samples are acquired by operating the light source and camera at a predefined location in a hemi-sphere direction with respect to the object, whereby 3D modeling information including information about geometry and texture can be provided.
    Type: Grant
    Filed: March 6, 2018
    Date of Patent: March 10, 2020
    Assignee: GWANGJU INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventors: Jun Ho Choi, Kwan Heng Lee, Yong Hwi Kim, Ahmed Bilal
  • Patent number: 10582188
    Abstract: An apparatus for performing simultaneous localization and mapping (SLAM) with an imaging device having at least two lenses includes an Inertial Measurement Unit (IMU) configured to measure rotations of a second stereoscopic frame acquired at a second time point in related to a first stereoscopic frame at a first time point, and a controller configured to acquire the first stereoscopic frame and the second stereoscopic frame, acquire rotation data of the second stereoscopic frame from said IMU, and match said first and second stereoscopic frames by combining the rotation data with the first and second stereoscopic frames. Said first stereoscopic frame overlaps with said second stereoscopic frame by a predetermined percentage.
    Type: Grant
    Filed: August 4, 2017
    Date of Patent: March 3, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Honghui Zhang, Cong Zhao
  • Patent number: 10580218
    Abstract: In one embodiment, a computing system accesses a first tracking record of a first user during a first movement session. The first tracking record comprises a plurality of locations of the first user and associated time measurements. During a second movement session, the system determines a current location of a second user and an associated current time measurement. From the plurality of locations in the first tracking record, a first location of the first user in the first movement session is determined based on (1) the associated time measurement relative to a start time of the first movement session and (2) the current time measurement relative to a start time of the second movement session. The system determines a display position of a virtual object on a display screen of the second user based on the first location relative to the current location of the second user.
    Type: Grant
    Filed: July 12, 2018
    Date of Patent: March 3, 2020
    Assignee: Facebook, Inc.
    Inventor: David Michael Viner
  • Patent number: 10572548
    Abstract: Aspects of the disclosure provide a system and method for prerendering of search result pages. A search engine may process search queries received from a client. The search engine may determine one or more search results in response to the search query. One or more of the search results may be associated with prerender instructions, such that when the search results are received by the client, the client prerenders the search results associated with the prerender instructions. Prerender instructions may be associated with the search results in various manners, including ranking the search results based on relevance, or ranking the search results based on the likelihood of selection. Metrics and analytical data may be collected from the client to improve the search result prerendering process.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: February 25, 2020
    Assignee: Google LLC
    Inventors: Timo Burkard, Ziga Mahkovec, Christopher Bentzel
  • Patent number: 10571671
    Abstract: A surgical control device that includes circuitry that changes an imaging viewpoint of a surgical imaging device in order to maintain a substantially constant distance between a focal point of an object and the surgical imaging device that images the object, based on a first instruction of a user and position information acquired by an acquisition unit implemented by circuitry configured to acquire position information indicating a position of the focal point of the object.
    Type: Grant
    Filed: March 20, 2015
    Date of Patent: February 25, 2020
    Assignee: SONY CORPORATION
    Inventor: Tomoyuki Hirayama
  • Patent number: 10565717
    Abstract: A depth sensing system includes a sensor having first and second sensor pixels to receive light from a surface. The system also includes a filter to allow transmission of full spectrum light to the first sensor pixel and visible light to the second sensor pixel while preventing transmission of infrared light to the second sensor pixel. The system further includes a processor to analyze the full spectrum light and the visible light to determine a depth of the surface. The filter is disposed between the sensor and the surface.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: February 18, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Gregory Michael Link
  • Patent number: 10567739
    Abstract: Techniques are provided for synthesis of transformed image views, based on a reference image, using depth information. The transformed image views may simulate a change in position or focal length of a camera that produced the reference image. An example system includes an image transformation circuit configured to transform the reference image corresponding to a first viewpoint, to a transformed image corresponding to a second viewpoint. The system also includes an inverse warping circuit configured to calculate a mapping from the pixels of the transformed image to corresponding pixels of the reference image. The system further includes a hole detection circuit configured to detect holes in the transformed image based on depth discontinuities between the reference and transformed images; and a hole filling circuit configured to in-fill the detected holes using a sampling of selected neighboring pixels from the reference image, to synthesize a view based on the transformed image.
    Type: Grant
    Filed: April 22, 2016
    Date of Patent: February 18, 2020
    Assignee: Intel Corporation
    Inventors: Daniel C. Middleton, Jianbo Shi
  • Patent number: 10559119
    Abstract: An apparatus and method for natural hand processing for virtual reality. For example, one embodiment of an apparatus comprises: graphics processing circuitry to render left and right scenes responsive to a virtual reality application, the left and right scenes to be displayed on left and right displays, respectively, of a virtual reality device; and a natural hand processing pipeline to project a representation of a user's hands into the left and right scenes to allow the user to interact with one or more objects in the scenes, the natural hand processing pipeline comprising: a depth/mask data smoothing and reconstruction module to receive noisy depth and mask data associated with images of the user's hands and to enhance the noisy depth data and mask data to generate enhanced depth and mask data; a hand mesh generator to generate a hand mesh using the enhanced depth and mask data; and a mesh data projector to project the hand mesh into the left and right scenes.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: February 11, 2020
    Assignee: INTEL CORPORATION
    Inventors: Alexandra Manevitch, Itamar Gilad, Kfir Viente, Tal Tamir, Konstantin Lazarev
  • Patent number: 10554882
    Abstract: The present application discloses a panoramic camera and a shooting method thereof, the panoramic camera includes: N sub-cameras, a synchronization control module, a stitching and correcting module, configured for caching successive m rows of pixel values in the shot image in a sliding window manner, and correcting the pixel values according to a preset correction table and the cached m-row pixel values, and sequentially outputting the corrected pixel values of each row, wherein m is greater than the sum of a preset maximum number of distortion rows and 2, and m is smaller than the total number of rows of the shot image; a stitching fusion module, configured for stitching the corrected images into a stitched image according to the overlapping portions of the images shot by the sub-cameras, wherein the images are shot synchronously by the sub-cameras under the control of the synchronization control module; and a transmission module.
    Type: Grant
    Filed: April 11, 2017
    Date of Patent: February 4, 2020
    Assignee: HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO., LTD.
    Inventors: Huahua Zhang, Xiaojiang Wang, Changzhi Ke
  • Patent number: 10551845
    Abstract: A method for generating at least one image data set for training to be used for a CNN capable of detecting objects in an input image is provided for improving hazard detection while driving. The method includes steps of: a computing device (a) acquiring a first label image in which edge parts are set on boundaries between the objects and a background and different label values are assigned corresponding to the objects and the background; (b) generating an edge image by extracting edge parts from the first label image; (c) generating a second label image by merging the first label image with a reinforced edge image, generated by assigning weights to the extracted edge parts; and (d) storing the input image and the second label image as the image data set. Further, the method allows a degree of detecting traffic sign, landmark, road marker and the like to be increased.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: February 4, 2020
    Assignee: Stradvision, Inc.
    Inventors: Kye-Hyeon Kim, Yongjoong Kim, Insu Kim, Hak-Kyoung Kim, Woonhyun Nam, SukHoon Boo, Myungchul Sung, Donghun Yeo, Wooju Ryu, Taewoong Jang, Kyungjoong Jeong, Hongmo Je, Hojin Cho
  • Patent number: 10553024
    Abstract: A tile-based rendering method includes receiving a drawcall, determining a location of primitives in a frame based on the drawcall, dividing the frame into a plurality of tiles, and rendering the tiles, wherein the rendering includes determining a rendering order of the tiles based on primitives included in the tiles, and rendering the tiles according to the rendering order. A graphics processing unit (GPU) is configured to perform the tile-based rendering method, and may include a memory, a processor including at least one core and at least one cache. The GPU may execute a tile-based graphics pipeline for tile-based rendering of images, and allocate tiles including identical primitives to a core.
    Type: Grant
    Filed: May 25, 2017
    Date of Patent: February 4, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Min-Kyu Jeong, Jae-Don Lee, Sang-Won Ha, Min-Young Son
  • Patent number: 10551826
    Abstract: A method and system to increase operator awareness for process control application providing operators team real time information on controlled process and equipment immersing them into augmented and virtual reality, provided by a computing system which collects and integrates data from process and equipment, leaving equipment, controls, and procedure unmodified.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: February 4, 2020
    Inventors: Andrei Popa-Simil, Victor Popa-Simil
  • Patent number: 10552973
    Abstract: Exemplary embodiments provide an image vision processing method, device and equipment and relate to: determining parallax and depth information of event pixel points in a dual-camera frame image acquired by Dynamic Vision Sensors; determining multiple neighboring event pixel points of each non-event pixel point in the dual-camera frame image; determining, according to location information of each neighboring event pixel point of each non-event pixel point, depth information of the non-event pixel point; and performing processing according to the depth information of each pixel point in the dual-camera frame image. Since non-event pixel points are not required to participate in the matching of pixel points, even if it is difficult to distinguish between the non-event pixel points or the non-event pixel points are occluded, depth information of the non-event pixel points can be accurately determined according to the location information of neighboring event pixel points.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: February 4, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Dongqing Zou, Feng Shi, Weiheng Liu, Deheng Qian, Hyunsurk Eric Ryu, Jia Li, Jingtao Xu, Keun Joo Park, Qiang Wang, Changwoo Shin
  • Patent number: 10552979
    Abstract: A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs includes instructions, which when executed by a computing device, causes the computing device to perform the following steps comprising: performing data alignment among sensors including a LiDAR, cameras and an IMU-GPS module; collecting image data and generating point clouds; processing, in the IMU-GPS module, a pair of consecutive images in the image data to recognize pixels corresponding to a same point in the point clouds; and establishing an optical flow for visual odometry.
    Type: Grant
    Filed: September 13, 2017
    Date of Patent: February 4, 2020
    Assignee: TUSIMPLE
    Inventors: Wentao Zhu, Yi Wang, Yi Luo
  • Patent number: 10547772
    Abstract: Systems and methods for reducing motion blur in images or video in ultra low light with array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method for synthesizing an image from multiple images captured using an array camera includes capturing image data using active cameras within an array camera, where the active cameras are configured to capture image data and the image data includes pixel brightness values that form alternate view images captured from different viewpoints, determining sets of corresponding pixels in the alternate view images where each pixel in a set of corresponding pixels is chosen from a different alternate view image, summing the pixel brightness values for corresponding pixels to create pixel brightness sums for pixel locations in an output image, and synthesizing an output image from the viewpoint of the output image using the pixel brightness sums.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: January 28, 2020
    Assignee: FotoNation Limited
    Inventor: Gabriel Molina
  • Patent number: 10546423
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: January 28, 2020
    Assignee: Globus Medical, Inc.
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Patent number: 10542186
    Abstract: A memory footprint of look up tables for color transforms can be reduced by separating the look up tables into factors, applying frequency domain transforms, dividing the look up tables into zones, or establishing hierarchical levels with increasing resolution. The methods can be applied to still image or video cameras with limited computation resources that can benefit from reduced memory footprints.
    Type: Grant
    Filed: September 29, 2016
    Date of Patent: January 21, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Joonsoo Kim, Jon S. McElvain
  • Patent number: 10540796
    Abstract: In some implementations, a system may include a camera, a display, one or more memories, and one or more processors communicatively coupled to the one or more memories. The system may identify a horizontal plane in an image being captured by the camera and presented on the display, may determine a size of the horizontal plane, and may determine that the size of the horizontal plane satisfies a threshold. The system may designate the horizontal plane as a ground plane based on determining that the size of the horizontal plane satisfies the threshold. The system may output an indication that the horizontal plane has been designated as the ground plane.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: January 21, 2020
    Assignee: Capital One Services, LLC
    Inventors: Geoffrey Dagley, Jason Hoover, Qiaochu Tang, Stephen Wylie, Sunil Vasisht, Micah Price
  • Patent number: 10532561
    Abstract: A method of collecting a metrology data set of a contoured surface with a metrology system and executing an automatic control plan for printing on a contoured surface is disclosed. The method includes attaching a work piece to a work piece frame and scanning a contoured surface of the work piece to obtain a metrology data set, a three-dimensional point cloud model is generated based on the metrology data set. Additionally, the method includes defining a spatial reference model of the work piece frame, and defining a print path for a print head assembly of a surface treatment assembly. Furthermore, the method includes discretizing the contoured surface into a plurality of regions and the print path is further defined into at least one independent regional print path for each region of the plurality of regions. Moreover, a computer software simulation verifies a control plan for printing on the contoured surface.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: January 14, 2020
    Assignee: The Boeing Company
    Inventors: Luke C. Ingram, Anthony W. Baker, Zachary R. Smith
  • Patent number: 10536691
    Abstract: In one embodiment, a method includes sending information configured to render a virtual space on a display device; receiving a first input from a first controller device, wherein the first controller device is associated with a first location on a body of a user; sending information configured to render a user interface comprising a menu of items, the menu of items comprising one or more interactive elements; receiving a second input from a second controller device, wherein the second controller device is associated with a second location on the body of the user, and wherein the second input indicates a selection of a particular interactive element; and sending information configured to render a response to the selection of the particular interactive element on a display device associated with the user.
    Type: Grant
    Filed: October 2, 2017
    Date of Patent: January 14, 2020
    Assignee: Facebook, Inc.
    Inventors: Gabriel Valdivia, Cliff Warren, Maheen Sohail, Christophe Marcel Rene Tauziet, Alexandros Alexander, Michael Stephen Booth, Charles Matthew Sutton
  • Patent number: 10529062
    Abstract: An image processing device includes a parameter processing circuit and an image correction circuit. The image processing device rearrange a plurality of parameters in order of a plurality of reference image data items written to an image memory. The image correction circuit includes a parameter memory, a pixel calculation circuit, an acquisition circuit, a comparison circuit, and a logic circuit. The image correction circuit reads one of one of the plurality of reference image data items from the image memory storing input image data and perform image correction on the one of the plurality of reference image data items to generate an output image corresponding to one of a plurality of output image areas.
    Type: Grant
    Filed: June 15, 2017
    Date of Patent: January 7, 2020
    Assignee: Ricoh Company, Ltd.
    Inventor: Yasuhiro Okada