Multiple Cameras Patents (Class 348/47)
  • Patent number: 10704896
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: July 7, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Yibing Michelle Wang
  • Patent number: 10701342
    Abstract: An imaging system for producing images to be displayed to user via a head-mounted display apparatus that includes means for detecting gaze direction of user. The imaging system includes a first outer camera and a second outer camera, at least one inner camera, and processor coupled to aforesaid cameras and means for detecting gaze direction. The processor is configured to (i) obtain inter-pupillary distance of user with respect to user's gaze at infinity; (ii) receive detected gaze direction; (iii) control first outer camera, second outer camera and at least one inner camera to capture first outer image, second outer image and at least one inner image of a scene; and (iv) process first outer image and inner image to generate first view of the scene, and process second outer image and inner image to generate second view of the scene, based upon inter-pupillary distance and detected gaze direction.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: June 30, 2020
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 10701283
    Abstract: The electronic apparatus includes: a plurality of image sensors including a first image sensor and a second image sensor; and a processor electrically connected to the plurality of image sensors and configured to output a read control signal and a synchronization signal to the plurality of image sensors, wherein the processor is further configured to: output a first read control signal to the first image sensor and receive first data read from the first image sensor; output a second read control signal to the second image sensor and store second data read from the second image sensor in a temporary memory; and output the second data stored in the temporary memory based on an output control signal generated between the first read control signal and a next first read control signal and generate merged data in which the first data and the second data are merged.
    Type: Grant
    Filed: November 29, 2016
    Date of Patent: June 30, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Il-Kwon Park, Hyeong-chan Seo, Sung-ki Jin
  • Patent number: 10695912
    Abstract: According to an embodiment, an actuation system includes a movable member, an actuator, at least one image taking unit, a coordinate conversion unit and a first actuation control unit. The actuator moves the movable member. The coordinate conversion unit performs coordinate conversion from an image-taking coordinate system of a taken image taken by the image taking unit to an arithmetic coordinate system for performing comparison. The first actuation control unit controls the actuator to reduce a deviation according to visual servo in the arithmetic coordinate system.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: June 30, 2020
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Yoshiyuki Ishihara, Nobukatsu Sugiyama, Junji Oaki, Akihito Ogawa
  • Patent number: 10691967
    Abstract: A method and apparatus for measuring a distance to an object, be a device (100) having at least two cameras (104, 106), is described. One or more first images including the object are acquired by a first camera of the device and one or more first reference images are acquired by a second camera of the device, while the device is in a first position. One or more second images including the object and one or more second reference images are acquired by cameras of the device, while the device is in a second position, different from the first position. Based on the first and second reference images, information on the displacement of at least one camera of the device between the first and second position are determined. The distance from the device to the object is calculated based on the first and second images including the object and the determined information on the displacement of the at least one camera.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: June 23, 2020
    Assignee: Snap Inc.
    Inventors: Eyal Zak, Ozi Egri
  • Patent number: 10687000
    Abstract: An infrared sensor including a plurality of infrared cameras is described. Each infrared camera includes an infrared detector and imaging optics. The imaging optics are arranged to image infrared light onto the infrared detector, the imaging optics having a field of view with a center optical axis, and field of view boundary lines bounding the field of view on sides of the field of view. The infrared cameras are arranged such that the center optical axes of the field of views intersect each other, and the fields of view overlap each other.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: June 16, 2020
    Assignee: Rockwell Collins, Inc.
    Inventor: Daniel Henry
  • Patent number: 10679396
    Abstract: A system or method for training may display a student avatar and an expert avatar. A method may include capturing movement of a user attempting a technique, and generating a student avatar animation from the captured movement. The method may include retrieving a 3D expert avatar animation corresponding to the technique. The method may include displaying the 3D student avatar animation and the 3D expert avatar animation. For example, the animations may be displayed concurrently.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: June 9, 2020
    Assignee: Visyn Inc.
    Inventors: Jeffrey Thielen, Andrew John Blaylock
  • Patent number: 10681250
    Abstract: An in-vehicle camera apparatus is provided for use in a vehicle. The in-vehicle camera apparatus includes at least one image capturing unit configured to capture an image of an external environment of the vehicle, at least one housing configured to have the at least one image capturing unit mounted thereto, and a mounting part via which the at least one housing is to be mounted to the vehicle. The mounting part is made of a material having a lower coefficient of linear expansion than the at least one housing. The mounting part has at least one first portion configured to be fixed to the vehicle and a plurality of second portions configured to be fixed to the at least one housing.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: June 9, 2020
    Assignee: DENSO CORPORATION
    Inventors: Shunya Kobayashi, Koji Wato
  • Patent number: 10670725
    Abstract: The present disclosure relates to methods and systems that facilitate determination of a pose of a vehicle based on various combinations of map data and sensor data received from light detection and ranging (LIDAR) devices and/or camera devices. An example method includes receiving point cloud data from a (LIDAR) device and transforming the point cloud data to provide a top-down image. The method also includes comparing the top-down image to a reference image and determining, based on the comparison, a yaw error. An alternative method includes receiving camera image data from a camera and transforming the camera image data to provide a top-down image. The method also includes comparing the top-down image to a reference image and determining, based on the comparison, a yaw error.
    Type: Grant
    Filed: July 25, 2017
    Date of Patent: June 2, 2020
    Assignee: Waymo LLC
    Inventors: John Tisdale, Michael Montemerlo, Andrew Chatham
  • Patent number: 10654422
    Abstract: A view friendly monitor system provides a monitor and a sequence of views that are regions of interest. The monitor can display a region of the camera view; the system is configured such that the displayed region of the camera view is a region of interest to the user. The displayed portion of the camera view changes to match the changing interests of the user. For example, a user that is interested to see a view in a direction beyond a certain edge of the monitor would move her head generally in an opposite direction. To see farther outside the edge, she needs to move her head farther in the opposite direction. In response to her head movement, the view friendly monitor system would change the region of interest based on the direction and the length of her head movement and display the new region of interest on the monitor.
    Type: Grant
    Filed: December 26, 2017
    Date of Patent: May 19, 2020
    Inventor: Razmik Karabed
  • Patent number: 10659762
    Abstract: The present invention provides a stereo camera in which it is possible to improve the precision of correcting vertical offset between a first image captured by a first image-capture unit and a second image captured by a second image-capture unit. In the present invention, an image-capture system unit 100a captures a benchmark image. An image-capture system unit 100b captures a reference image. A geometry correction unit 125 generates a plurality of geometry-corrected reference images having differing amounts of vertical-direction movement from the reference image. A parallax calculation unit 126 generates a plurality of parallax images from the combination of the benchmark image and each of the reference images. A parallax image evaluation unit 131 calculates evaluation values pertaining to the reliability of each of the parallax images.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: May 19, 2020
    Assignee: HITACHI AUTOMOTIVE SYSTEMS, LTD.
    Inventors: Toshiyuki Aoki, Takuma Osato, Takeshi Nagasaki, Naoya Tada
  • Patent number: 10649088
    Abstract: In one general aspect, a non-transitory computer-readable storage medium can be configured to store instructions that when executed cause a processor to perform a process. The process can include transmitting a plurality of laser beams at a feature on an object, and calculating a candidate shape parameter representing the feature based on a plurality of laser beams reflected from the feature. The process can include determining that the candidate shape parameter matches a measured shape parameter stored in a shape parameter database and representing a measured feature of the object, and identifying an absolute location corresponding with the measured feature of the object.
    Type: Grant
    Filed: January 13, 2016
    Date of Patent: May 12, 2020
    Assignee: DSCG Solutions, Inc.
    Inventor: Richard Sebastian
  • Patent number: 10650546
    Abstract: A method of providing a descriptor for at least one feature of an image comprises the steps of providing an image captured by a capturing device and extracting at least one feature from the image, and assigning a descriptor to the at least one feature, the descriptor depending on at least one parameter which is indicative of an orientation, wherein the at least one parameter is determined from the orientation of the capturing device measured by a tracking system. The invention also relates to a method of matching features of two or more images.
    Type: Grant
    Filed: July 26, 2018
    Date of Patent: May 12, 2020
    Assignee: Apple Inc.
    Inventors: Daniel Kurz, Selim Benhimane
  • Patent number: 10652521
    Abstract: Provided is an imaging system such as a stereo camera which includes a mechanism capable of controlling a camera setting such as zooming or panning/tilting, wherein the stereo camera and the imaging system maintains measurement accuracy of the imaging system even when the camera setting is changed. The stereo camera including at least two cameras estimates camera parameters of the camera when a lens position of the camera is changed by an operation instruction of the camera. In addition, the imaging system includes at least two cameras, a camera control unit which controls at least a lens position of the camera, a calibration unit which estimates camera parameters of the camera when at least the lens position of the camera is moved by the camera control unit, and an image recognition unit which performs three-dimensional restoration of captured images of the cameras based on the camera parameters.
    Type: Grant
    Filed: January 5, 2017
    Date of Patent: May 12, 2020
    Assignee: Hitachi, Ltd.
    Inventors: Masaya Itoh, Yuan Li
  • Patent number: 10645364
    Abstract: System, apparatus, method, and computer readable media for on-the-fly dynamic calibration of multi-camera platforms using images of multiple different scenes. Image frame sets previously captured by the platform are scored as potential candidates from which new calibration parameters may be computed. The candidate frames are ranked according to their score and iteratively added to the calibration frame set according to an objective function. The selected frame set may be selected from the candidates based on a reference frame, which may be a most recently captured frame, for example. A device platform including a CM and comporting with the exemplary architecture may enhance multi-camera functionality in the field by keeping calibration parameters current. Various computer vision algorithms may then rely upon these parameters, for example.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: May 5, 2020
    Assignee: Intel Corporation
    Inventors: Avinash Kumar, Ramkumar Narayanswamy, Manjula Gururaj
  • Patent number: 10645374
    Abstract: First and second display devices have first and second common display areas in which image display with common content to left and right eyes is performed. At least one of the first and second display devices has an extended display area. A display control unit generates a signal including common image information for the first and second common display areas and extension image information for the extended display area.
    Type: Grant
    Filed: February 15, 2017
    Date of Patent: May 5, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Takashi Takeda, Masayuki Takagi, Toshiaki Miyao, Akira Komatsu, Takahiro Totani
  • Patent number: 10645309
    Abstract: In accordance with disclosed embodiments, there are provided systems, methods, and apparatuses for implementing maximum likelihood image binarization in a coded light range camera.
    Type: Grant
    Filed: November 6, 2015
    Date of Patent: May 5, 2020
    Assignee: Intel Corporation
    Inventors: Alexander Bronstein, Aviad Zabatani, Ron Kimmel, Michael Bronstein, Erez Sperling, Vitaly Surazhsky
  • Patent number: 10638117
    Abstract: An information handling system includes a RGB digital camera and a secondary digital camera that can be any type of two-dimensional or three-dimensional digital camera known in the art and a processor. The processor executes code instructions of a gross-level input detection system to detect objects in images taken contemporaneously by the RGB digital camera and the secondary digital camera using object detection techniques, and to calculate the positions of regions of interest within those objects. Further, the processor executes code instructions to detect the orientation of regions of interest within identified objects, and to associate those orientations, changes in orientations, or movement of regions of interest with user commands.
    Type: Grant
    Filed: June 14, 2018
    Date of Patent: April 28, 2020
    Assignee: Dell Products, LP
    Inventors: Roman Joel Pacheco, Thomas Lanzoni, Deeder M. Aurongzeb
  • Patent number: 10634770
    Abstract: Optical systems that may, for example, be used in remote sensing systems, for example in systems that implement combining laser pulse transmission in LiDAR and that include dual transmit and receive systems. A dual receiver system may include a receiver including an optical system with a relatively small aperture and wide field of view for capturing reflected light from short-range (e.g., <20 meters) objects, and a receiver that includes an optical system with a relatively large aperture and small field of view for capturing reflected light from long-range (e.g., >20 meters) objects. The optical systems may refract the reflected light to photodetectors (e.g., single photo-avalanche detectors (SPADs)) that capture the light. Light captured at the photodetectors may, for example, be used to determine range information for objects or surfaces in the environment.
    Type: Grant
    Filed: June 28, 2017
    Date of Patent: April 28, 2020
    Assignee: Apple Inc.
    Inventors: Chandra S. Kakani, Alexander Shpunt, Mina A. Rezk, Robert S. Upton, Yuval Gerson
  • Patent number: 10636118
    Abstract: Methods and devices for scaling virtual movement may include receiving from a positional tracking system attached to the computer device, a current physical location of a body part of a user being tracked for providing an input to a virtual reality simulation. The methods and devices may include determining a start position based at least upon the current physical location of the user for scaling virtual movements in the virtual reality simulation corresponding to received physical movements of the user. The methods and devices may include determining a scale factor to apply to the physical movements from the start position to generate scaled virtual movements of the physical movements. The methods and devices may include transmitting the scaled virtual movement for presentation on a display.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: April 28, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventor: Dan Ronny Andersson
  • Patent number: 10623624
    Abstract: An electronic apparatus that achieves a function of a compound eye camera using a plurality of photographing modules and that improves AF accuracy even if environmental conditions vary or even if a state is changed by impact from outside. The electronic apparatus includes two photographing modules. A first obtaining unit performs contrast AF by one of the two photographing modules to obtain a first focus detection result. A second obtaining unit calculates an object distance from parallax information between the two photographing modules to obtain a second focus detection result. A correction unit corrects a calculation result of the object distance obtained by the second obtaining unit in a case where a state of at least one of the two photographing modules and a body of the electronic apparatus varies and where a difference between the first and second focus detection results is more than a threshold.
    Type: Grant
    Filed: March 14, 2018
    Date of Patent: April 14, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yosuke Fukai, Kiyoshi Nitto, Toshihiro Ogawa, Junichiro Iwamatsu
  • Patent number: 10621787
    Abstract: A method of overlaying a picture of a real scene with a virtual image comprises a step of reading image data, wherein the image data represent a picture of the real scene captured by an environment sensor of a mobile device, a step of determining marker data from the image data, wherein the marker data represent a picture and a positioning of a marker arranged in the real scene, a step of reading virtual image data, wherein the virtual image data represent image data selected from a plurality of virtual image data using the marker data, wherein the virtual image data comprise a representation instruction for representing the virtual image and a positioning instruction for positioning the virtual image, a step of determining object data from the image data, wherein the object data represent a picture and a positioning of object portion of an object arranged in the environment of the marker in the real scene and a step of ascertaining a positioning rule for representing the virtual image with reference to the p
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: April 14, 2020
    Assignee: 3DQR GMBH
    Inventor: Daniel Anderson
  • Patent number: 10616561
    Abstract: A method and apparatus are provided for generating a three dimensional image, wherein the method includes: illuminating a target; capturing an image that comprises an object present at the illuminated target; converting the captured image into data and processing it to determine depth of the object; and generating a three dimensional image of the object whose depth has been determined. Preferably, the illumination intensity applied while illuminating the target, is determined based on the current intensity of ambient light at the target.
    Type: Grant
    Filed: September 6, 2016
    Date of Patent: April 7, 2020
    Assignee: INUITIVE LTD.
    Inventors: Lev Goldentouch, Chagai Ensenberg
  • Patent number: 10613412
    Abstract: A conventional optical switching engine has difficulty in producing a universal multiport switching engine being capable of (i) programmatically changing regions to be switched, (ii) generating no wavelength dependent loss, (iii) having a small Walk-off, and (iv) being usable for small to large light beams. Produced is a light beam deflecting element in which a polarization grating is fitted in parallel on an N×M transmissive birefringence modulator formed such that a transmissive variable half-wavelength liquid crystal plate is divided into rectangular extreme small pixels, and many N and M pixels thus obtained are respectively arranged in X and Y axes directions in a matrix form, the polarization grating being a grating in which a period ? changes in an X? axis direction (direction to which a birefringence axis rotates) in accordance with a wavelength width of light.
    Type: Grant
    Filed: April 18, 2016
    Date of Patent: April 7, 2020
    Assignee: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE
    Inventors: Hisato Uetsuka, Shu Namiki, Hitoshi Kawashima, Kazuhiro Ikeda
  • Patent number: 10616550
    Abstract: Multiple cameras with different orientations capture images of an object positioned at a target position relative to the cameras. Images from each camera are processed in parallel to determine depth information from correspondences between different regions within an image captured by each image capture device in parallel. Depth information for images from each camera is modified in parallel based on shading information for the images and stereoscopic information from the images. In various embodiments, the depth information is refined by minimizing a total energy from intensities of portions of the images having a common depth and intensities of portions of the image from shading information from images captured by multiple cameras. The modified depth information from multiple images is combined to generate a reconstruction of the object positioned at the target position.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: April 7, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Chenglei Wu, Shoou-I Yu
  • Patent number: 10607351
    Abstract: An apparatus for determining a depth map for an image of a scene comprises an active depth sensor (103) and a passive depth sensor (105) for determining a depth map for the image. The apparatus further comprises a light determiner (109) which determines a light indication indicative of a light characteristic for the scene. The light indication may specifically reflect a level of visible and/or infrared light for the scene. A depth map processor (107) determines an output depth map for the image by combining the first depth map and the second depth map. Specifically, a depth value for the output depth map is determined as a combination of depth values of the first and the second depth map where the combining is dependent on the light indication. The light determiner (109) estimates the first infrared light indication from a visible light indication indicative of a light level in a frequency band of the visible light spectrum.
    Type: Grant
    Filed: July 12, 2016
    Date of Patent: March 31, 2020
    Assignee: Koninklijke Philips N.V.
    Inventors: Christiaan Varekamp, Patrick Luc Els Vandewalle
  • Patent number: 10607371
    Abstract: A camera calibration method which calculates camera parameters of at least three cameras (a1) acquires three-dimensional coordinate set of a calibration point and image coordinate pair of the calibration point in each camera image, (a2) acquires camera parameters of each camera, (a3) calculates a view angle-corresponding length corresponding to a view angle of each pair of cameras viewing the calibration point, (a4) calculates a three-dimensional position of a measurement point corresponding to a three-dimensional position of the calibration point for each camera pair using parallax of the calibration point between the cameras in the camera pair, (a5) weights the three-dimensional position of each measurement point using the view angle-corresponding length corresponding to the measurement point, (a6) calculates a three-dimensional position of a unified point of the weighted measurement points, and (a7) updates the camera parameters based on the three-dimensional coordinate set of the calibration point and the
    Type: Grant
    Filed: April 11, 2018
    Date of Patent: March 31, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Nobuhiko Wakai, Takeo Azuma, Kunio Nobori, Satoshi Sato
  • Patent number: 10609359
    Abstract: Apparatuses, methods and storage media for providing a depth image of an object are described. In some embodiments, the apparatus may include a projector to perform a controlled motion, to project a light pattern on different portions of the scene at different time instances, and an imaging device coupled with the projector, to generate pairs of images (a first image of a pair from a first perspective, and a second image of the pair from a second perspective), of different portions of the scene in response to the projection of the light pattern on respective portions. The apparatus may include a processor coupled with the projector and the imaging device, to control the motion of the projector, and generate the depth image of the object in the scene, based on processing of the generated pairs of images of the portions of the scene. Other embodiments may be described and claimed.
    Type: Grant
    Filed: June 22, 2016
    Date of Patent: March 31, 2020
    Assignee: Intel Corporation
    Inventor: Nizan Horesh
  • Patent number: 10605592
    Abstract: The disclosure relates to an arrangement and a method for capturing coordinates of an object surface by triangulation. At least two partial light patterns are generated representing a decomposition of a corresponding basic light pattern. The partial light patterns are separately projected onto the object surface, an image of the object surface is captured during the projection of one of the partial light patterns, and components of the total intensity of the captured images are ascertained. A balance of direct and indirect intensity components is established per image and for each pixel under the assumption that the indirect intensity components in all images are equal. A reflection image is established based on the direct and/or indirect intensity components which approximates the image that would be capturable during a projection of the basic light pattern without indirect intensity components. Based on the reflection image, coordinates of the object surface are ascertained.
    Type: Grant
    Filed: April 6, 2019
    Date of Patent: March 31, 2020
    Assignee: Carl Zeiss Industrielle Messtechnik GmbH
    Inventors: Wolfgang Hoegele, Sebastian Oberndorfner
  • Patent number: 10600154
    Abstract: A system and method for generating high-resolution stereo images and depth map in multi-camera systems having multiple cameras with different resolutions and view angles. One method is to improve the lower resolution image and combining it with the higher resolution image, then the resulting image is processed by extensive algorithms to ensure utmost high quality. The system can also handle non-planar image contents. The process is to generate a crude depth map first and then divide the map into multiple layers. Each layer will be separately registered. The results from the registered layers will be merged to improve the depth map generation. The improved depth map could be repeatedly fed back to the beginning of the process to further improve the registration performance. The system and method can generate stereo images using uncalibrated cameras with different views and resolutions.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: March 24, 2020
    Assignee: Applied Research, LLC
    Inventor: Chiman Kwan
  • Patent number: 10600230
    Abstract: A mesh rendering system, a mesh rendering method and a non-transitory computer readable medium are provided. The mesh rendering system includes a database, a user device and a server. The server obtains preprocessing data of a cloth and a rigidbody according to initial mesh state of the cloth, initial mesh state of the rigidbody and motion of the rigidbody, wherein the cloth and the rigidbody are deformable and motion of the cloth corresponding to the motion of the rigidbody is a small deformation. The server stores the preprocessing data in the database. A finite state machine of the server receives a real-time input data from the user device through a web service and the preprocessing data, and the finite state machine outputs a deformation result of the cloth and the rigidbody to the user device through a handshake mechanism.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: March 24, 2020
    Inventors: Sheng-Yen Lin, Sheng-Wei Lin, Ching-Tung Lin, Jui-Fen Ho
  • Patent number: 10585283
    Abstract: The present specification relates to a head mounted display and a control method therefor, the subject matter thereof relates to: receiving a rendered frame from a computing device on the basis of first sensing information; time-warping the received frame on the basis of second sensing information; processing the frame time-warped on the basis of the second sensing information; and displaying the processed frame on a screen.
    Type: Grant
    Filed: August 24, 2015
    Date of Patent: March 10, 2020
    Assignee: LG ELECTRONICS INC.
    Inventor: Yonghahk Park
  • Patent number: 10579871
    Abstract: An object of the present invention is to provide a biological feature composite imaging technology that multiplexing of the imaging functions and a mobile terminal comprising said composite imaging system. The composite imaging system comprises: a lens assembly (130); an optical filter assembly (120) including at least a visible light bandpass region and an infrared light bandpass region; an image sensor (110) that includes a visible light imaging region, an infrared light imaging region, and a transition region between said two regions, said image sensor (110) operating under one of the visible light imaging mode and the infrared light imaging mode. Under the infrared light imaging mode, specific physical properties of the biological features are used as the image quality information to realize auto-focus of the biological features in the region of interest.
    Type: Grant
    Filed: February 3, 2016
    Date of Patent: March 3, 2020
    Inventor: Hefei Xu
  • Patent number: 10573091
    Abstract: A system for generating virtual objects, including personalized avatars. The system comprises modules for acquiring a plurality of series of bi-dimensional images, deriving point clouds and point cloud three-dimensional models therefrom and generating a global point cloud three-dimensional model by computing a weighted average.
    Type: Grant
    Filed: February 22, 2018
    Date of Patent: February 25, 2020
    Inventor: Andre R. Vincelette
  • Patent number: 10567738
    Abstract: An activity recording system is provided. The activity recording system includes a three-dimensional camera, a sensor arrangement that is fitted to a subject being recorded, and an activity recording device. The activity recording device receives image information from the three-dimensional camera and sensor arrangement information from the sensor arrangement. Both the image information and the sensor arrangement information include location measurements. The sensor arrangement information is generated by location sensors that are positioned at target features of the subject to be tracked. The sensor arrangement information is a key to the image information that specifies where, in any given image, the target features of the subject lie. Activity data having these characteristics may be applied to solve a variety of system development problems. Such activity data can be used to training machine learning components or test computer vision components for a fraction of the cost of using conventional techniques.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: February 18, 2020
    Assignee: Intel Corporation
    Inventor: Amit Bleiweiss
  • Patent number: 10559063
    Abstract: Disclosed are an apparatus and a method for generating an image for generation of a 3D panorama image. A method for generating a 3D panorama image in an image generating apparatus comprises the steps of: receiving an input of a plurality of 2D images and a plurality of depth maps corresponding to the plurality of 2D images; setting a left-eye image area and a right-eye image area for each of the plurality of 2D images on the basis of the plurality of depth maps; and synthesizing images of each of the left-eye image areas that are set in the plurality of 2D images to thereby generate a left-eye panorama image and synthesizing images of each of the right-eye image areas that are set in the plurality of 2D images to thereby generate a right-eye panorama image. Accordingly, the image generating apparatus can generate a 3D panorama image without distortion on the basis of a plurality of 2D images.
    Type: Grant
    Filed: September 23, 2015
    Date of Patent: February 11, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Do-wan Kim, Geng-yu Ma, Sung-jin Kim, Jae-yun Jeong
  • Patent number: 10560617
    Abstract: A device includes a housing having a first transparent area and a second transparent area and a multi-aperture imaging device arranged inside the housing and including a beam deflector. The device includes a first diaphragm and a second diaphragm, the portable device having a first operating state and a second operating state. In the first operating state, the beam deflector deflects an optical path of the imaging device such that it passes through the first transparent area and that the second diaphragm at least partly optically closes the second transparent area. In the second operating state, the beam deflector deflects the optical path of the imaging device such that it passes through the second transparent area. In the second operating state, the first diaphragm at least partly optically closes the first transparent area.
    Type: Grant
    Filed: February 16, 2018
    Date of Patent: February 11, 2020
    Inventors: Frank Wippermann, Andreas Brückner, Andreas Bräuer, Alexander Oberdörster
  • Patent number: 10560676
    Abstract: Color calibration of color image rendering devices, such as large color displays, which operate by either projection or emission of images, utilize internal color measurement instrument or external color measurement modules locatable on a wall or speaker. A dual use camera is provided for a portable or laptop computer, or a cellular phone, handset, personal digital assistant or other handheld device with a digital camera, in which one of the camera or a display is movable with respect to the other to enable the camera in a first mode to capture images of the display for enabling calibration of the display, and in a second mode for capturing image other than of the display. The displays may represent rendering devices for enabling virtual proofing in a network, or may be part of stand-alone systems and apparatuses for color calibration.
    Type: Grant
    Filed: July 29, 2018
    Date of Patent: February 11, 2020
    Assignee: RAH COLOR TECHNOLOGIES LLC
    Inventor: Richard A. Holub
  • Patent number: 10554895
    Abstract: An information processing apparatus includes: a visual field determination section 122 that determines, for a predetermined subject distance and on the basis of two images with different parallaxes that have been captured by a plurality of imaging units that perform three-dimensional image shooting, a common visual field range of the two images with different parallaxes; and a display controller 138 that displays, on a display, information on the determined common visual field range.
    Type: Grant
    Filed: April 5, 2018
    Date of Patent: February 4, 2020
    Assignee: Olympus Corporation
    Inventors: Hideaki Yoshida, Hisayuki Harada, Toshikazu Hayashi, Keiji Okada, Osamu Nonaka, Yuichi Tsuchimochi
  • Patent number: 10549638
    Abstract: An information display apparatus emits an image forming light beam to a transmissive reflection member and makes a virtual image visible through the reflection member. The information display apparatus is configured to display the virtual image so that a difference between a convergence angle when viewing the virtual image through the reflection member and a convergence angle when viewing a real object through the reflection member is less than or equal to 1 degree.
    Type: Grant
    Filed: September 13, 2016
    Date of Patent: February 4, 2020
    Assignee: Ricoh Company, Ltd.
    Inventors: Yuuki Suzuki, Kenichiroh Saisho, Masato Kusanagi, Takuro Yasuda, Kazuhiro Fujita
  • Patent number: 10554956
    Abstract: A depth-based computational photography method includes recording a first image using a stereoscopic camera system, establishing a disparity map, via a processor, of the first image including a determination of pixel distance between features in the first image and the features in a second image, determining a histogram of pixel disparity values from the disparity map, and removing statistical outlier pixel disparity values. The method further includes identifying holes in disparity map of the first image and computationally shrinking holes in the disparity map via averaging disparity map values based on radially sampled areas proximate to the hole and sharpening histogram pixel disparity value peaks by shifting pixel disparity values in a close neighborhood range of a histogram pixel disparity value peak maximum closer to a pixel disparity value at the histogram pixel disparity value peak maximum.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: February 4, 2020
    Assignee: Dell Products, LP
    Inventor: Sujata Das
  • Patent number: 10551911
    Abstract: A device (DA) analyses an immersive virtual reality system (SI) comprising a target (CD) that is securely fastened to an object (OM), detecting means (MD) that deliver a first signal representative of the current position of the target (CD), processing means (MT) that define images depending on the detected current position, and at least one image-displaying means (EA, PI). This device (DA) comprises a first sensor (C1) that generates a second signal when the object (OM) reaches a known position, a second sensor (C2) that generates a third signal when it detects a change in displayed image consecutive to the detection of the object (OM) in this known position by the detecting means (MD), and analysing means (MA) that determine first and second times of reception of the second and third signals then a first time difference between these first and second times of reception.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: February 4, 2020
    Assignee: PSA Automobiles SA
    Inventors: Matthieu Mika, Christophe Mion
  • Patent number: 10545457
    Abstract: In an embodiment, an off-axis hologram is provided. The off-axis hologram creates two, conjugate images which are on either side (off-axis) of the 0-order beam. A Multiple Beam Grating (MBG) is used to both duplicate the conjugate images and to redirect the images along the axis. The 0-order beam is blocked before or at the MBG. The MBG projects the images onto a 3D surface, such as a person's face.
    Type: Grant
    Filed: March 8, 2019
    Date of Patent: January 28, 2020
    Assignee: K Laser Technology, Inc.
    Inventor: Wai-Hon Lee
  • Patent number: 10536687
    Abstract: A stereoscopic video imaging display. A virtual field-of-view frame or reference window is set in a field of view of a stereo camera. Standard stereoscopic video data is sent. On a display side, stereoscopic videos are alternately displayed in a time-division manner with a width in a left view angle determined by lines connecting both ends of a reference dimension display screen and a left eye of an observer and in a right view angle determined by lines connecting both the ends of the reference dimension display screen and a right eye of the observer. Thus, the left and right videos are displayed at a position where they partially overlap each other, thereby allowing the stereoscopic video equivalent to the reference dimension display screen to be viewed.
    Type: Grant
    Filed: April 6, 2017
    Date of Patent: January 14, 2020
    Inventor: Minoru Inaba
  • Patent number: 10529060
    Abstract: A time of flight (ToF) measuring apparatus and an image processing method for reducing blur of a depth image in the ToF measuring apparatus are provided. The apparatus senses infrared (IR) light reflected by a subject and incident via an optical shutter, models a spread characteristic of the IR light based on an intensity distribution of the sensed IR light, and acquires a sharpening filter by using the modeled spread characteristic.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: January 7, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Namseop Kwon, Byunghoon Na, Yonghwa Park, Jangwoo You, Heesun Yoon
  • Patent number: 10517471
    Abstract: Embodiments of a hybrid imaging sensor that optimizes a pixel array area on a substrate using a stacking scheme for placement of related circuitry with minimal vertical interconnects between stacked substrates and associated features are disclosed. Embodiments of maximized pixel array size/die size (area optimization) are disclosed, and an optimized imaging sensor providing improved image quality, improved functionality, and improved form factors for specific applications common to the industry of digital imaging are also disclosed.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: December 31, 2019
    Assignee: DePuy Synthes Products, Inc.
    Inventor: Laurent Blanquart
  • Patent number: 10523852
    Abstract: One aspect of this disclosure involves a wearable device that includes a frame that is worn on a user's head, and an inward-facing camera (camera) physically coupled to the frame. The optical axis of the camera is either above the Frankfort horizontal plane and pointed upward to capture an image of a region of interest (ROI) above the user's eyes, or the optical axis is below the Frankfort horizontal plane and pointed downward to capture an image of an ROI below the user's eyes. The camera includes a sensor and a lens. The sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image. The Scheimpflug principle is a geometric rule that describes the orientation of the plane of focus of a camera when the lens plane is tilted relative to the sensor plane.
    Type: Grant
    Filed: October 2, 2017
    Date of Patent: December 31, 2019
    Assignee: Facense Ltd.
    Inventors: Arie Tzvieli, Gil Thieberger, Ari M Frank
  • Patent number: 10523919
    Abstract: The present invention provides a method and apparatus for adjusting stereoscopic image parallax and a stereo camera. The parallax adjusting method includes obtaining a depth range of a current scene. A preset parallax range may also be obtained according to a current viewing condition. Expected camera parameters of the current scene are calculated according to the depth range of the current scene and the preset parallax range. The stereo camera is adjusted according to the expected camera parameters and used to capture preprocessed stereoscopic images. Further, the captured preprocessed stereoscopic images are processed according to the expected camera parameters to make the preprocessed stereoscopic images suitable for being viewed under the current viewing condition. The disclosed method and apparatus can jointly adjust parameters of the stereo camera and captured stereo images to obtain images or videos with a maximum parallax as well as desired display effect under a specified condition.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: December 31, 2019
    Assignee: SUPERD TECHNOLOGY CO., LTD.
    Inventors: Chunhui Cui, Lei Song, Ning Liu
  • Patent number: 10524331
    Abstract: According to at least one embodiment, a computer-implemented method to illuminate a room is described. At least one person entering the room may be identified. The room may be illuminated based at least in part on the identifying. An occupancy count for the room may be maintained based at least in part on the illuminating, wherein the occupancy count comprises a number of one or more people present in the room. The room may be darkened based at least in part on the occupancy count for the room reaching a pre-determined count.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: December 31, 2019
    Assignee: Vivint, Inc.
    Inventor: Harry Rein
  • Patent number: 10516873
    Abstract: A depth imaging device is provided. A first camera and a second camera form a first depth imaging system. A projection element and a second camera form a second depth imaging system. The control unit is configured to instruct one of the first and second depth imaging systems to acquire a depth map and a confidence map, and determine whether each of confidence values in the confidence map is less than a confidence threshold value. If each of the confidence values is less than the confidence threshold value, then the control unit turns on the other of the first and second depth imaging systems. If at least one of the confidence values is not less the confidence threshold value, then the control unit determines whether a closest distance in the depth map falls within a predetermined range or not. A driving method of a depth imaging device is also provided.
    Type: Grant
    Filed: January 9, 2018
    Date of Patent: December 24, 2019
    Assignees: LITE-ON ELECTRONICS (GUANGZHOU) LIMITED, Lite-On Technology Corporation
    Inventors: Shou-Te Wei, Hsing-Hung Chen