Single Camera From Multiple Positions Patents (Class 348/50)
  • Patent number: 12033316
    Abstract: The present disclosure is generally related to systems and methods that can be implemented in a mobile application to allow users, such as parents and care providers, to measure and monitor, for example, a patient's body including an infant's head shape, at the point of care. The point of care can be, for instance, the home environment, a doctor's office, or a hospital setting. After acquiring 2D and/or 3D images of the body part, parameters reflecting potential deformity can be calculated. If abnormal measurements are determined, the user can be guided through therapeutic options to improve the condition. Based on the severity of the condition, different recommendations can be provided. Moreover, longitudinal monitoring and evaluation of the parameters can be performed. Monitoring of the normal child development can also be performed through longitudinal determination of parameters and comparison to normative values. Data can be shared with clinician's office.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: July 9, 2024
    Assignee: PediaMetrix Inc.
    Inventor: Fereshteh Aalamifar
  • Patent number: 12002220
    Abstract: An image acquisition method and apparatus are provided. By controlling a motion device, at least one of an image acquisition device or a photographed target object moves under the driving of the motion device, so that a sample image including the target object can be acquired in a preset designated acquisition pose after movement, thereby improving the accuracy of a relative pose between the image acquisition device and the target object during acquisition, reducing human intervention during acquisition, improving the automation degree, and providing the possibility for subsequent services that need to be performed according to sample images captured with relatively high shooting pose accuracy.
    Type: Grant
    Filed: February 15, 2022
    Date of Patent: June 4, 2024
    Assignee: BEIJING SANKUAI ONLINE TECHNOLOGY CO., LTD.
    Inventors: Chunle Gao, Huaxia Xia, Hao Shen, Qiong Nie, Tiansi Han, Yiming Li, Jizhou Ma, Feipeng Tian, Binyang Hu, Mi Tian
  • Patent number: 11880178
    Abstract: A surface data acquisition, storage, and assessment system for detecting and quantifying similarities or differences between scanned surface data before and after the surface has been acted upon by a surface altering element.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: January 23, 2024
    Inventors: Paul E. Thomson, Adam R. Gerlach
  • Patent number: 11854231
    Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: December 26, 2023
    Assignee: Snap Inc.
    Inventors: Maria Jose Garcia Sopo, Qi Pan, Edward James Rosten
  • Patent number: 11692814
    Abstract: A hand-held device for obtaining a three-dimensional topological surface profile of a tire, the device comprising: a base comprising an aperture; a light source arranged in use to generate an elongate pattern of light, and to project said pattern through the aperture onto a rolling surface of the tire; a detector arranged to image a region of the rolling surface of the tire; a plurality of pairs of guide wheels mounted on respective axles mounted on the base, wherein the guide wheels on adjacent axles are linked by gears; and a rotary encoder arranged to generate a signal corresponding to rotation of an axle.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: July 4, 2023
    Assignee: SNAP-ON EQUIPMENT S.R.L. A UNICO SOCIO
    Inventors: Andrew Pryce, Björn Gustafsson, Kshitij Sisodia, Allen Pearson
  • Patent number: 11551428
    Abstract: Methods and apparatus to generate photo-realistic three-dimensional models of a photographed environment are disclosed. An apparatus includes an object position calculator to determine a three-dimensional (3D) position of an object detected within a first image of an environment and within a second image of the environment. The apparatus further includes a 3D model generator to generate a 3D model of the environment based on the first image and the second image. The apparatus also includes a model integrity analyzer to detect a difference between the 3D position of the object and the 3D model. The 3D model generator automatically modifies the 3D model based on the difference in response to the difference satisfying a confidence threshold.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: January 10, 2023
    Assignee: INTEL CORPORATION
    Inventors: Wenlong Li, Yuri Shpalensky, Alex Gendelman, Maria Bortman, Asaf Shiloni
  • Patent number: 11538220
    Abstract: A tangible object virtualization station including a base capable of stably resting on a surface and a head component unit connected to the base. The head component unit extends upwardly from the base. At an end of the head component opposite the base, the head component comprises a camera situated to capture a downward view of the surface proximate the base, a lighting array that directs light downward toward the surface proximate the base. The tangible object virtualization station further comprises a display interface included in the base. The display interface is configured to hold a display device in an upright position and connect the display device to the camera and the lighting array.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: December 27, 2022
    Assignee: Tangible Play, Inc.
    Inventors: Mark Solomon, Ariel Zekelman, Jon Dukerschein, Jerome Scholler, Vivek Vidyasagaran
  • Patent number: 11496676
    Abstract: In one embodiment of the present disclosure, an example system may receive a plurality of frames from at least one image sensor associated with a mobile device, at least one of the plurality of frames containing an image of a wound; display a real time video including at least a portion of the plurality of frames and a visual overlay indicating a desired position of the wound; detect, based on at least part of the plurality of frames, that the wound is in the desired position; display an indication to move the mobile device in a desired direction; receive motion data from at least one motion sensor associated with the mobile device; detect that the mobile device has moved in the desired direction; and display an additional indication on the mobile device.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: November 8, 2022
    Assignee: HEALTHY.IO LTD
    Inventors: Yonatan Adiri, Ron Zohar, Ido Omer, Nathaniel Bubis
  • Patent number: 11488415
    Abstract: A three-dimensional facial shape estimating device (300) includes a face image acquiring unit (301) configured to acquire a plurality of image frames that capture a subject's face; a face information acquiring unit (302) having, preset therein, a predetermined number of facial feature points, the face information acquiring unit (302) being configured to acquire, for each of the plurality of image frames, face information that indicates a position of each of the predetermined number of facial feature points of the subject's face within the image frame; and a three-dimensional shape estimating unit (303) configured to perform mapping of each of the predetermined number of facial feature points of the subject's face between the plurality of image frames based on the face information of each of the plurality of image frames and to estimate the three-dimensional shape of the subject's face based on a result from the mapping.
    Type: Grant
    Filed: October 18, 2018
    Date of Patent: November 1, 2022
    Assignee: NEC CORPORATION
    Inventor: Akinori Ebihara
  • Patent number: 11445165
    Abstract: A method, system and computer readable storage media for visualizing to a patient a magnified dental treatment site. By obtaining raw data from a stereo camera recording a dental treatment site, an enlarged, well-lit and spatially displayed view of the dental treatment site may be visualized in real time in augmented reality and virtual reality systems for diagnoses and treatment planning.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: September 13, 2022
    Assignee: DENTSPLY SIRONA INC.
    Inventor: Bjoern Voss
  • Patent number: 11431900
    Abstract: Disclosed is an electronic device including an image obtaining device configured to obtain at least one pieces of image data, at least one sensor to sense movement of a user, a display, at least one processor electrically connected to the image obtaining device, the at least one sensor, and the display, and a memory electrically connected to the at least one processor to store instructions that when executed, cause the processor to obtain multiple pieces of first image data through the image obtaining device while obtaining data associated with a first movement of the user through the at least one sensor, obtain multiple pieces of second image data through the image obtaining device while obtaining data associated with a second movement of the user through the at least one sensor, process the multiple pieces of first image data through a first image processing scheme corresponding to the first movement and output a processing result through the display, and process the multiple pieces of second image data thr
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: August 30, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Wonseok Kang, Wonbae Lim, Sangwoo Park, Eunkyu Lee, Soohwan Chae, Meeryung Choi, Eujin Ha
  • Patent number: 11416941
    Abstract: A computer device and method for managing multiple electronic sensors is provided where a server receives building condition data from a motion sensor, analyzes the received data, and activates (or reconfigures) a camera sensor to capture an image of the inhabitants present within the building; the server then identifies the inhabitant of the building and retrieves profile data associated with the identified inhabitant; the server then, based on the profile data, generates an instruction to modify one or more conditions within the building (e.g., the environmental conditions of the building) and transmits the instruction to one or more devices (e.g., an environmental device) within the building.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: August 16, 2022
    Assignee: United Services Automobile Association (USAA)
    Inventors: Michael J. Allen, Ramsey Devereaux, Spencer Read, David S. Franck, William Chandler, Justin D. Haslam
  • Patent number: 11393256
    Abstract: The embodiments disclose a method and device for liveness detection and a computer-readable storage medium. The method includes that: a first image collected by a first image sensor of a binocular camera is acquired, and a second image collected by a second image sensor of the binocular camera is acquired: binocular matching processing is performed on the first image and the second image to obtain parallax information of the first image and the second image; and a Iiveness detection result is obtained according to the parallax information. By adopting the embodiments of the present disclosure, the accuracy of liveness detection can be improved.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: July 19, 2022
    Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Rui Zhang, Wukui Yang, Kai Yang, Mingyang Liang, Xiaoyang Guo, Liwei Wu
  • Patent number: 11369467
    Abstract: Systems, methods, and devices useful in medical procedures, such as, e.g., aesthetic and/or reconstructive surgeries, are described. The system may be an imaging system that includes a database and a computer system configured to create, modify, and/or display three-dimensional images created from digital image data of an anatomical region of a subject. The digital image data may be obtained with an imaging device such as a scanner.
    Type: Grant
    Filed: April 4, 2017
    Date of Patent: June 28, 2022
    Assignee: Establishment Labs S.A.
    Inventors: Juan José Chacón Quirós, Rafael G. Corrales, Gerardo Mora, Ana Y. Quiros, Celso P. Garcia, Jorge Mayorga, Mario Ramirez, Federico Carbo
  • Patent number: 11354854
    Abstract: Disclosed herein a method of removing a point cloud outlier and an apparatus implementing the method. The method includes: arranging a point cloud obtained from a laser scanner along at least a first direction; selecting, neighboring first-axis points, between which a separation degree satisfies an inspection start threshold condition, as a first leading-side representative point and a first trailing-side representative point; selecting a first leading-side outlier candidate and a first trailing-side outlier candidate based on a first leading-side separation degree and a first trailing-side separation degree; and determining the first leading-side outlier candidate and the first trailing-side outlier candidate as a first outlier point, when the number of the outlier candidates satisfies an allowable threshold condition.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: June 7, 2022
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Hyun Cheol Kim, Hyuk Min Kwon, Jeong Il Seo, Sang Woo Ahn, Seung Jun Yang
  • Patent number: 11321859
    Abstract: A method for scene reconstruction includes generating a depth estimate and a first pose estimate from a current image. The method also includes generating a second pose estimate based on the current image and one or more previous images in a sequence of images. The method further includes generating a warped image by warping each pixel in the current image based on the depth estimate, the first pose estimate, and the second pose estimate. The method still further includes controlling an action of an agent based on the second warped image.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: May 3, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Vitor Guizilini, Adrien David Gaidon
  • Patent number: 11237451
    Abstract: An optical device includes a first electrode layer, a first alignment layer, a liquid crystal layer, a second alignment layer, and a second electrode layer being arranged in turn along a light transmission direction; wherein the first electrode layer comprises a first electrode, a second electrode, and a first impedance membrane arranged between the first electrode and the second electrode, and the first electrode and the second electrode are respectively arranged on opposite ends of the first impedance membrane; the second electrode layer has a structure similar to that of the first electrode layer. The four electrodes form a light transmission hole being shaped as a parallelogram. The present invention solves the problem that the focal length of the liquid crystal lens cannot be accurately adjusted due to the instability of the impedance of the impedance membrane of the present liquid crystal lens.
    Type: Grant
    Filed: August 8, 2020
    Date of Patent: February 1, 2022
    Assignee: University of Electronic Science and Technology of China
    Inventors: Mao Ye, Xiaoxi Chen, Guangyong Li, Yalei Zhang
  • Patent number: 11238273
    Abstract: Provided are a data processing method and apparatus, an electronic device and a storage medium. The data processing method comprises: according to a reference depth value and an actual depth value of a key point of a target in an image, converting first 2D coordinates of the key point into second 2D coordinates, wherein the second 2D coordinates and the reference depth value constitute a first 3D feature of the key point; and based on the first 3D feature, obtaining a 3D posture of the target.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: February 1, 2022
    Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Min Wang, Zhuang Zou, Wentao Liu, Chen Qian, Lizhuang Ma
  • Patent number: 11227428
    Abstract: A main video sequence of a live action scene is captured along with ancillary device data to provide corresponding volumetric information about the scene. The volumetric data can then be used to visually remove or replace objects in the main video sequence. A removed object is replaced by the view that would have been captured by the main video sequence had the removed object not been present in the live action scene at the time of capturing.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: January 18, 2022
    Assignee: WETA DIGITAL LIMITED
    Inventors: Kimball D. Thurston, III, Peter M. Hillman
  • Patent number: 11228704
    Abstract: An image capturing apparatus comprises a capture unit (101) for capturing images of a scene. A tracker (103) dynamically determines poses of the capture unit and a pose processor (105) determines a current pose of the capture unit (101) relative to a set of desired capture poses. The pose may include a position and orientation of the capture unit (101). A display controller (107) is coupled to the pose processor (105) and is arranged to control a display to present a current capture pose indication, the current capture pose indication comprising an indication of a position of the current pose of the capture unit (101) relative to the set of desired capture poses in a direction outside an image plane of capture unit (101). In some embodiments, the set of desired capture poses may be adaptively updated in response to data captured for the scene.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: January 18, 2022
    Assignee: Koninklijke Philips N.V.
    Inventors: Christiaan Varekamp, Bartholomeus Wilhelmus Sonneveldt
  • Patent number: 11215465
    Abstract: Some embodiments of location estimation methods may (1) facilitate the task of efficiently finding the location of a mobile platform in scenarios in which the uncertainties associated with the coordinates of the map features are anisotropic and/or non-proportional, and/or (2) facilitate decoupling of location estimation from feature estimation. Some embodiments of feature estimation methods may (1) facilitate the combining of environmental descriptions provided by two or more mobile platforms, and/or (2) facilitate decoupling of a data aggregation from feature re-estimation.
    Type: Grant
    Filed: October 15, 2019
    Date of Patent: January 4, 2022
    Assignee: Reification Inc.
    Inventor: Gabriel Archacki Hare
  • Patent number: 11164327
    Abstract: Techniques are provided for estimation of human orientation and facial pose, in images that include depth information. A methodology embodying the techniques includes detecting a human in an image generated by a depth camera and estimating an orientation category associated with the detected human. The estimation is based on application of a random forest classifier, with leaf node template matching, to the image. The orientation category defines a range of angular offsets relative to an angle corresponding to the human facing the depth camera. The method also includes performing a three dimensional (3D) facial pose estimation of the detected human, based on detected facial landmarks, in response to a determination that the estimated orientation category includes the angle corresponding to the human facing the depth camera.
    Type: Grant
    Filed: June 2, 2016
    Date of Patent: November 2, 2021
    Assignee: Intel Corporation
    Inventors: Haibing Ren, Yimin Zhang, Xiaobo Hu, Fei Duan
  • Patent number: 11151729
    Abstract: Improvement in the accuracy of estimating the position of a mobile entity even while traveling or if there is an error in the calibration performed utilizing: a mobile entity; an imaging device provided in the mobile entity; and an information processing device for determining a first movement amount by which a detection point that is the same object has moved on the basis of a first image and a second image acquired by the imaging device and a second movement amount by which the mobile entity has moved while the first image and the second image were acquired, determining the accuracy of recognizing the detection point acquired by the imaging device on the basis of the first movement amount and the second movement amount, and estimating the position of the mobile entity on the basis of the accuracy of recognition and position information that pertains to the detection point.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: October 19, 2021
    Assignee: HITACHI AUTOMOTIVE SYSTEMS, LTD.
    Inventors: Alex Masuo Kaneko, Kenjiro Yamamoto, Shinya Ootsuji, Shigenori Hayase
  • Patent number: 11132813
    Abstract: A distance to an object is estimated with a monocular camera that estimates a distance from a moving object to feature points on an image from an imaging device mounted on the moving object. The distance estimator sets one or more feature points on the image acquired from the imaging device at a first timing and detects the feature point on the image acquired from the imaging device at a second timing. The distance estimator also determines the movement amount of the feature point on the image between the first timing and the second timing and determines the movement amount of the moving object between the first and second timings. The distance estimator then estimates the distance from the moving object to the feature point based on the movement amount on the image and the movement amount of the moving object between the first and second timings.
    Type: Grant
    Filed: February 22, 2018
    Date of Patent: September 28, 2021
    Assignee: HITACHI, LTD.
    Inventors: Alex Masuo Kaneko, Kenjiro Yamamoto
  • Patent number: 11122993
    Abstract: A portable photogrammetry studio for topographical digitisation of stationary surfaces, such as human body surfaces, including at least one high-resolution digital camera to photograph said surface; one or more light sources capable of illumination of said surface; and a mechanised viewing system that is capable of providing different views of said surface to said camera; such that multiple pictures may be taken of said surface from multiple different positions by each said camera. The human body surface is prepared, preferably by coating with a texturiser.
    Type: Grant
    Filed: May 25, 2016
    Date of Patent: September 21, 2021
    Assignee: BESPOKE MEDICAL INNOVATIONS PTY LTD
    Inventor: John Hilton
  • Patent number: 11108964
    Abstract: An information processing apparatus presenting information to an operator operating an image pickup device includes an image-pickup range setting portion setting an image pickup range over which an image can be taken by the image pickup device, a position and orientation calculation portion calculating a position and orientation of the image pickup device by using the image taken by the image pickup device, an evaluation portion evaluating an image pickup situation in the image pickup range, set by the image-pickup range setting portion, on the basis of the position and orientation calculated by the position and orientation calculation portion, and a guide information presentation portion presenting, in accordance with evaluation by the evaluation portion, guide information for guiding an operation of the image pickup device on a display device.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: August 31, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Nozomu Kasuya, Makoto Tomioka, Daisuke Kotake, Masahiro Suzuki, Takayuki Yamada, Masakazu Fujiki, Akihiro Katayama
  • Patent number: 10943411
    Abstract: A system configured to provide a three-dimensional representation of a physical environment. The three-dimensional representation including annotation data associated with particular objects and/or viewpoints of the three-dimensional representation. In some cases, the viewpoints may be rendered using image data associated with a photograph captured from a corresponding viewpoint within the physical environment.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: March 9, 2021
    Assignee: Occipital, Inc.
    Inventors: Jeffrey Roger Powers, Vikas M. Reddy, Alex Schiff
  • Patent number: 10921820
    Abstract: Disclosed herein are a movable object and a movable object control method. The movable object control method may include acquiring an image of a movable object's surroundings, acquiring a signal having strength changing depending on a location of the movable object, generating a map on the basis of the signal and the image of the surroundings of the movable object, and applying the map to an algorithm to acquire a learned algorithm.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: February 16, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Suk June Yoon, No San Kwak, Kyung Shik Roh, Soon Yong Park, Sung Hwan Ahn
  • Patent number: 10885657
    Abstract: A process determines a position of an image capture device with respect to a physical object. The position corresponds to a vantage point for an initial image capture of the physical object performed by the image capture device at a first time. Further, the process generates an image corresponding to the position. In addition, the process displays the image on the image capture device. Finally, the process outputs one or more feedback indicia that direct a user to orient the image capture device to the image for a subsequent image capture at a second time within a predetermined tolerance threshold of the vantage point.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: January 5, 2021
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Steven Chapman, Mehul Patel, Joseph Popp, Alice Taylor
  • Patent number: 10887566
    Abstract: An image display system is provided and includes: at least one first projection unit, configured to project rays of N images on a first plane, so that the rays of the N images are projected on N first regions of the first plane, where the N images are images of a target object photographed based on N angles, and N?2; and at least one first refraction unit, configured on the first plane, and configured to perform refraction processing on the rays of the images projected on the first regions, so that the rays of the N images are collected on a common display region. In this way, presentation of a three-dimensional image can adapt to a human eye viewing habit.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: January 5, 2021
    Assignees: Huawei Technologies Co., Ltd., Cambridge Enterprise Limited
    Inventors: Jia Jia, Jhensi Chen, Daping Chu, Jun Yao
  • Patent number: 10834372
    Abstract: A method and system of converting stereo video content to multi-view video content combines an Eulerian approach with a Lagrangian approach. The method comprises generating a disparity map for each of the left and right views of a received stereoscopic frame. For each corresponding pair of left and right scanlines of the received stereoscopic frame, the method further comprises decomposing the left and right scanlines into a left sum of wavelets or other basis functions, and a right sum wavelets or other basis functions. The method further comprises establishing an initial disparity correspondence between left wavelets and right wavelets based on the generated disparity maps, and refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets. The method further comprises reconstructing at least one novel view based on the left and right wavelets.
    Type: Grant
    Filed: June 5, 2018
    Date of Patent: November 10, 2020
    Assignee: Massachusetts Institute of Technology
    Inventors: Wojciech Matusik, Piotr K. Didyk, William T. Freeman, Petr Kellnhofer, Pitchaya Sitthi-Amorn, Frederic Durand, Szu-Po Wang
  • Patent number: 10809053
    Abstract: A movement assisting device includes an imaging unit to take first and second images of an imaging unit from first and second viewpoints; a first calculator to calculate, using the first and second images, first position and orientation of the imaging unit at the first viewpoint and calculate second position and orientation of the imaging unit at the second viewpoint; a second calculator to calculate, using the first and second positions and the first and second orientations, and calculate a first angle between a first axis based on a first optical axis of the imaging unit at the first viewpoint, and a second axis based on a second optical axis at the second viewpoint; a third calculator to calculate the next viewpoint positioned in direction of increase of the first angle; and an output unit to output information prompting movement of the imaging unit in direction of the next viewpoint.
    Type: Grant
    Filed: September 9, 2015
    Date of Patent: October 20, 2020
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Hideaki Uchiyama, Akihito Seki
  • Patent number: 10726616
    Abstract: An image processing system configured to process perceived images of an environment includes a central processing unit (CPU) including a memory storage device having stored thereon a computer model of the environment, at least one sensor configured and disposed to capture a perceived environment including at least one of visual images of the environment and range data to objects in the environment, and a rendering unit (RU) configured and disposed to render the computer model of the environment forming a rendered model of the environment. The image processing system compares the rendered model of the environment to the perceived environment to update the computer model of the environment.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: July 28, 2020
    Assignee: ROSEMOUNT AEROSPACE INC.
    Inventors: Julian C. Ryde, Xuchu Ding
  • Patent number: 10719953
    Abstract: A system tracks poses of a passive object using fiducial markers on fiducial surfaces of a polygonal structure of the object using image data captured by a camera. The system includes an object tracking controller that generates an estimated pose for a frame of the image data using an approximate pose estimation (APE), and then updates the estimated pose using a dense pose refinement (DPR) of pixels. The APE may include minimizing reprojection error between projected image points of the fiducial markers and observed image points of the fiducial markers in the frame. The DPR may include minimizing appearance error between image pixels of the fiducial markers in the frame and projected model pixels of the fiducial markers determined from the estimated pose and the object model. In some embodiments, an inter-frame corner tracking (ICT) of the fiducial markers may be used to facilitate the APE.
    Type: Grant
    Filed: March 27, 2018
    Date of Patent: July 21, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Yuting Ye, Robert Y. Wang, Christopher David Twigg, Shangchen Han, Po-Chen Wu
  • Patent number: 10686973
    Abstract: An image pickup apparatus, includes a first optical system and a second optical system which generate two optical images having mutual parallax; and one image sensor which captures the two optical images, wherein each of the first optical system and the second optical system has a different focusing unit, further includes a first frame which holds some of lenses in the first optical system, a second frame which holds the image sensor; and a third frame which holds lenses in the first optical system other than the lenses held by the first frame, and lenses in the second optical system, wherein the first frame is movable in a direction of optical axes with respect to the third frame, and the second frame is movable in a direction of optical axes with respect to the third frame.
    Type: Grant
    Filed: June 8, 2018
    Date of Patent: June 16, 2020
    Assignee: OLYMPUS CORPORATION
    Inventor: Takeshi Suga
  • Patent number: 10643389
    Abstract: A system for allowing a virtual object to interact with other virtual objects across different spaces within an augmented reality (AR) environment and to transition between the different spaces is described. An AR environment may include a plurality of spaces, each comprising a bounded area or volume within the AR environment. In one example, an AR environment may be associated with a three-dimensional world space and a two-dimensional object space corresponding with a page of a book within the AR environment. A virtual object within the AR environment may be assigned to the object space and transition from the two-dimensional object space to the three-dimensional world space upon the detection of a space transition event. In some cases, a dual representation of the virtual object may be used to detect interactions between the virtual object and other virtual objects in both the world space and the object space.
    Type: Grant
    Filed: March 28, 2016
    Date of Patent: May 5, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mathew J. Lamb, Ben J. Sugden, Robert L. Crocco, Jr., Brian E. Keane, Christopher E. Miles, Kathryn Stone Perez, Laura K. Massey, Alex Aben-Athar Kipman
  • Patent number: 10643360
    Abstract: Some systems include a memory, and a processor coupled to the memory, wherein the processor is configured to: identify one or more spatial markers in a medical data-based image of a patient, identify one or more spatial markers in a real-time perceived image of the patient, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient, superimpose the medical data-based image of the patient with the real-time perceived image of the patient, and align the one or more spatial markers in the medical data-based image with the respective one or more spatial markers in the real-time perceived image.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: May 5, 2020
    Assignee: ARIZONA BOARD OF REGENTS ON BEHALF OF ARIZONA STATE UNIVERSITY
    Inventors: David Frakes, Ross Maciejewski, Mark Spano, Dustin Plaas, Alison Van Putten, Joseph Sansone, Matthew Mortensen, Nathaniel Kirkpatrick, Jonah Thomas
  • Patent number: 10600240
    Abstract: A system for acquiring a 3D digital representation of a physical object, the system comprising: A scanning station comprising an object support for receiving a physical object; an image capturing device operable to capture two or more images of a physical object when the physical object is placed on the object support, wherein the two or more images are taken from different view points relative to the physical object; and a processor configured to process the captured two or more images and to create a 3D digital model of the physical object.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: March 24, 2020
    Assignee: LEGO A/S
    Inventors: Morgan James Walker, Jonathan B. Bennink, Luka Kapeter, Henrik Munk Storm
  • Patent number: 10587796
    Abstract: Systems and methods for analyzing image data to automatically ensure image capture consistency are described. According to certain aspects, a server may access aerial and other image data and identify a set of parameters associated with the capture of the image data. The server may access a corresponding set of acceptable image capture parameters, and may compare the set of parameters to the set of acceptable parameters to determine whether image data is consistent with the set of acceptable parameters. In some embodiments, if the image data is not consistent, the server may generate a notification or instruction to cause an image capture component to recapture additional image data.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: March 10, 2020
    Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
    Inventors: Bradley A. Sliz, Lucas Allen, Jeremy T. Cunningham
  • Patent number: 10552666
    Abstract: A candidate human head is found in depth video using a head detector. A head region of light intensity video is spatially resolved with a three-dimensional location of the candidate human head in the depth video. Facial recognition is performed on the head region of the light intensity video using a face recognizer.
    Type: Grant
    Filed: August 1, 2017
    Date of Patent: February 4, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Robert M. Craig, Vladimir Tankovich, Craig Peeper, Ketan Dalal, Bhaven Dedhia, Casey Meekhof
  • Patent number: 10529128
    Abstract: A sensor apparatus may include an array of protruding members that each extend outward in a different radial direction from a central axis, each protruding member including a projector that projects structured light into a local environment, one or more cameras that capture reflections of the structured light from the local environment, and another camera that captures visible-spectrum light from the local environment. The sensor apparatus may also include one or more localization devices for determining a location of the sensor apparatus. Various other apparatuses, systems, and methods are also disclosed.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: January 7, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Yuheng Ren, Julian Straub, Shobhit Verma, Richard Andrew Newcombe, Renzo De Nardi
  • Patent number: 10499046
    Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used to generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.
    Type: Grant
    Filed: April 18, 2017
    Date of Patent: December 3, 2019
    Assignee: Facebook, Inc.
    Inventors: Michael John Toksvig, Forrest Samuel Briggs, Brian Keith Cabral
  • Patent number: 10484561
    Abstract: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display.
    Type: Grant
    Filed: May 11, 2015
    Date of Patent: November 19, 2019
    Assignee: ML Netherlands C.V.
    Inventors: Alexander Ilic, Benedikt Koeppel
  • Patent number: 10477195
    Abstract: Different full screen content is displayed on the same television at the same time from the perspective of the viewer by displaying as the content as two full screen sequential frames. The different full screen content may be provided as a single combined frame signal such as a side-by-side, top-bottom, or checkerboard signal which is then displayed as two sequential full screen frames. Configured glasses such as polarized or shutter are used to view the different content as full screen content where one pair of configured glasses views an initial one of the sequential frames but blocks the subsequent one and another pair of configured glasses blocks the initial one of the sequential frames and views the subsequent one. Shutter glasses have both lenses open during the initial frame and both closed during the subsequent one. For polarized glasses, the initial frame has a polarization matching both lenses of one pair of glasses while the subsequent frame has a polarization that differs from both lenses.
    Type: Grant
    Filed: July 13, 2017
    Date of Patent: November 12, 2019
    Inventor: Jeramie J. Keys
  • Patent number: 10444021
    Abstract: Some embodiments of location estimation methods may (1) facilitate the task of efficiently finding the location of a mobile platform in scenarios in which the uncertainties associated with the coordinates of the map features are anisotropic and/or non-proportional, and/or (2) facilitate decoupling of location estimation from feature estimation. Some embodiments of feature estimation methods may (1) facilitate the combining of environmental descriptions provided by two or more mobile platforms, and/or (2) facilitate decoupling of a data aggregation from feature re-estimation.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: October 15, 2019
    Assignee: Reification Inc.
    Inventor: Gabriel Archacki Hare
  • Patent number: 10432842
    Abstract: A movement recognition system includes an inertial sensor, a depth sensor, and a processor. The inertial sensor is coupled to an object and configured to measure a first unit of inertia of the object. The depth sensor is configured to measure a three dimensional shape of the object using projected light patterns and a camera. The processor is configured to receive a signal representative of the measured first unit of inertia from the inertial sensor and a signal representative of the measured shape from the depth sensor and to determine a type of movement of the object based on the measured first unit of inertia and the measured shape utilizing a classification model.
    Type: Grant
    Filed: April 6, 2016
    Date of Patent: October 1, 2019
    Assignee: THE TEXAS A&M UNIVERSITY SYSTEM
    Inventors: Nasser Kehtarnavaz, Roozbeh Jafari, Kui Liu, Chen Chen, Jian Wu
  • Patent number: 10373337
    Abstract: A method is provided for calibrating a stereo imaging system by using at least one camera and a planar mirror. The method involves obtaining at least two images with the camera, each of the images being captured from a different camera position and containing the mirror view of the camera and a mirror view of an object, thereby obtaining multiple views of the object. The method further involves finding the center of the picture of the camera in each of the images, obtaining a relative focal length of the camera, determining an aspect ratio in each of the images, determining the mirror plane equation in the coordinate system of the camera, defining an up-vector in the mirror's plane, selecting a reference point in the mirror's plane, determining the coordinate transformation from the coordinate system of the image capturing camera into the mirror coordinate system, and determining a coordinate transformation.
    Type: Grant
    Filed: March 18, 2016
    Date of Patent: August 6, 2019
    Assignee: Lateral Reality KFT.
    Inventor: Péter Torma
  • Patent number: 10353191
    Abstract: Described embodiments provide a method of generating an image of a region of interest of a target object. A plurality of concentric circular scan trajectories are determined to sample the region of interest. Each of the concentric circular scan trajectories have a radius incremented from an innermost concentric circular scan trajectory having a minimum radius to an outermost concentric circular scan trajectory having a maximum radius. A number of samples are determined for each of the concentric circular scan trajectories. A location of each sample is determined for each of the concentric circular scan trajectories. The locations of each sample are substantially uniformly distributed in a Cartesian coordinate system of the target object. The target object is iteratively rotated along each of the concentric circular scan trajectories and images are captured at the determined sample locations to generate a reconstructed image from the captured images.
    Type: Grant
    Filed: January 13, 2016
    Date of Patent: July 16, 2019
    Assignee: Massachusetts Institute of Technology
    Inventors: Brian W. Anthony, Xian Du
  • Patent number: 10356394
    Abstract: An apparatus and method for measuring the position of a stereo camera. The apparatus for measuring a position of the camera according to an embodiment includes a feature point extraction unit for extracting feature points from images captured by a first camera and a second camera and generating a first feature point list based on the feature points, a feature point recognition unit for extracting feature points from images captured by the cameras after the cameras have moved, generating a second feature point list based on the feature points, and recognizing actual feature points based on the first feature point list and the second feature point list, and a position variation measurement unit for measuring variation in positions of the cameras based on variation in relative positions of the actual feature points.
    Type: Grant
    Filed: February 18, 2016
    Date of Patent: July 16, 2019
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Jae-Hean Kim, Hyun Kang, Soon-Chul Jung, Young-Mi Cha, Jin-Sung Choi
  • Patent number: 10347029
    Abstract: A three-dimensional shape measurement apparatus includes an imaging unit that successively outputs two-dimensional images captured, a memory unit that stores the two-dimensional images outputted by the imaging unit, a three-dimensional shape model generation unit which generates a three-dimensional shape model, based on the two-dimensional images and stores the three-dimensional shape model in the memory unit, a region calculation unit that calculates, based on the two-dimensional images and the three-dimensional shape model stored in the memory unit, a measurement-completed region in the two-dimensional images, and a display image generation unit that generates, based on the measurement-completed region, a display image from the two-dimensional images.
    Type: Grant
    Filed: May 6, 2016
    Date of Patent: July 9, 2019
    Assignee: TOPPAN PRINTING CO., LTD.
    Inventors: Hiroki Unten, Tatsuya Ishii