Single Camera With Optical Path Division Patents (Class 348/49)
  • Patent number: 11968351
    Abstract: In a 3D imaging method using scanning-type coherent diffraction, a 2D photodetector detects diffraction of a coherent beam emitted from a light source that moves in a scanning manner toward a sample object to obtain multiple 2D diffraction data distributions; and a processor converts the 2D diffraction data distributions into multiple 3D intensity distributions in a reciprocal space, performs one or more iterations based on a sample function, a light source function and the 3D intensity distributions to obtain a phase-retrieval sample function, and generates a 3D reconstruction image of the sample object based on the phase-retrieval sample function.
    Type: Grant
    Filed: June 21, 2022
    Date of Patent: April 23, 2024
    Assignee: National Tsing Hua University
    Inventor: Chien-Chun Chen
  • Patent number: 11942499
    Abstract: An image sensor includes a pixel array and a logic circuit. The pixel array includes a pixel isolation layer between a plurality of pixels. Each of the plurality of pixels include a pixel circuit below at least one photodiode. The logic circuit acquires a pixel signal from the plurality of pixels. The pixel array includes at least one autofocusing pixel, which includes a first photodiode, a second photodiode, a pixel internal isolation layer between the first and second photodiodes, and a microlens on the first and second photodiodes. The pixel internal isolation layer includes a first pixel internal isolation layer and a second pixel internal isolation layer, separated from each other in a first direction, perpendicular to the upper surface of the substrate, and the first pixel internal isolation layer and the second pixel internal isolation layer include different materials.
    Type: Grant
    Filed: April 16, 2021
    Date of Patent: March 26, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Masato Fujita, Doosik Seol, Kyungduck Lee, Kyungho Lee, Taesub Jung
  • Patent number: 11908293
    Abstract: An information processing system is provided. The information processing system comprises at least one processor configured to receive inputs of videos captured by a plurality of imaging apparatuses, detect a first person image appearing in a first video captured by a first imaging apparatus and a second person image appearing in a second video captured by a second imaging apparatus, associate a first person with a second person based on a first feature value of the first person and a second feature value of the second person, and provide an elapsed time from a first time point when the first person disappears from the first video to a second time point when the second person appears in the second video. The first feature value and the second feature value may include information based on histogram.
    Type: Grant
    Filed: May 31, 2022
    Date of Patent: February 20, 2024
    Assignee: NEC CORPORATION
    Inventor: Hiroyoshi Miyano
  • Patent number: 11887330
    Abstract: A method of assisting object registration in a smart home system including a plurality of objects is disclosed. The disclosed method may include allowing a user to select an object from among a plurality of objects, capturing a plurality of pointing gestures by allowing the user to perform the plurality of pointing gestures at the selected object, configuring a pointing ray using each of the plurality of captured pointing gestures, estimating a position of a nearest point extending from the plurality of pointing rays, and registering the estimated position of the nearest point as a position of the selected object.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: January 30, 2024
    Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventors: Junyong Noh, Hyunggoog Seo, Jaedong Kim, Kwanggyoon Seo, Bumki Kim
  • Patent number: 11846873
    Abstract: Various embodiments include an aperture stop for a camera with folded optics. In some examples, a folded optics arrangement of the camera may include one or more lens elements and one or more light path folding elements (e.g., a prism or a mirror). The aperture stop may be an elongated aperture stop. According to various examples, one or more prisms of the folded optics arrangement may have an elongated dimension in the same direction as an elongated dimension of the elongated aperture stop. In some embodiments, the aperture stop may be located between a prism and a lens group of the folded optics arrangement. In some embodiments, the aperture stop may be located proximate an optical element that optically powers a prism of the folded optics arrangement.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: December 19, 2023
    Assignee: Apple Inc.
    Inventors: Norimichi Shigemitsu, Hideki Tanaka
  • Patent number: 11831859
    Abstract: Techniques are described for passive three-dimensional image sensing based on referential image blurring. For example, a filter mask is integrated with a lens assembly to provide one or more normal imaging bandpass (NIB) regions and one or more reference imaging bandpass (RIB) regions, the regions being optically distinguishable and corresponding to different focal lengths and/or different focal paths. As light rays from a scene object pass through the different regions of the filter mask, a sensor can detect first and second images responsive to those light rays focused through the NIB region and the RIB region, respectively (according to their respective focal lengths and/or respective focal paths). An amount of blurring between the images can be measured and correlated to an object distance for the scene object. Some embodiments project additional reference illumination to enhance blurring detection in the form of reference illumination flooding and/or spotted illumination.
    Type: Grant
    Filed: May 8, 2021
    Date of Patent: November 28, 2023
    Assignee: SHENZHEN GOODIX TECHNOLOGY CO., LTD.
    Inventors: Yi He, Bo Pi
  • Patent number: 11831858
    Abstract: Techniques are described for passive three-dimensional image sensing based on referential image blurring. For example, a filter mask is integrated with a lens assembly to provide one or more normal imaging bandpass (NIB) regions and one or more reference imaging bandpass (RIB) regions, the regions being optically distinguishable and corresponding to different focal lengths and/or different focal paths. As light rays from a scene object pass through the different regions of the filter mask, a sensor can detect first and second images responsive to those light rays focused through the NIB region and the RIB region, respectively (according to their respective focal lengths and/or respective focal paths). An amount of blurring between the images can be measured and correlated to an object distance for the scene object. Some embodiments project additional reference illumination to enhance blurring detection in the form of reference illumination flooding and/or spotted illumination.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: November 28, 2023
    Assignee: SHENZHEN GOODIX TECHNOLOGY CO., LTD.
    Inventors: Yi He, Bo Pi
  • Patent number: 11828954
    Abstract: A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns, and the image patterns are rotated by an angle such that edges of the image patterns are not in parallel with a baseline between the structured light projection module and a capture module.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: November 28, 2023
    Assignee: Orbbec Inc.
    Inventors: Yuanhao Huang, Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
  • Patent number: 11716521
    Abstract: Obtaining depth information using an IR sensor with a beam splitter including illuminating a subject with IR light using an IR light source; receiving reflected light including visible light and the IR light at a beam splitter; splitting the reflected light into two identical beams, a first beam and a second beam, using the beam splitter; receiving and processing the first beam at an IR sensor to pass the IR light and to block the visible light, to generate an IR image; receiving and processing the second beam at a visible light sensor to pass the visible light and to block the IR light, to generate a visible light image; and using a time of flight of the IR light transmitted by the IR light source and received by the IR sensor to calculate a distance of the subject from the beam splitter.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: August 1, 2023
    Assignees: Sony Group Corporation, Sony Pictures Entertain Inc.
    Inventor: Joseph Wise
  • Patent number: 11675549
    Abstract: A print control apparatus is configured to transfer transparent protective ink onto an image printed on a substrate. The print control apparatus includes an extraction unit configured to extract a contour of a subject in the image, and a control unit configured to generate print data for transferring the protective ink using a printing apparatus, based on the extracted contour of the subject. The control unit generates the print data by assigning a high gradation value to a contour line corresponding to the extracted contour of the subject, assigning a low gradation value to a region corresponding to the subject, and assigning a mixture of the high gradation value and the low gradation value to an outer peripheral region of the subject.
    Type: Grant
    Filed: March 22, 2022
    Date of Patent: June 13, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yukiteru Yano
  • Patent number: 11637978
    Abstract: A depth camera assembly (DCA) includes a direct time of flight system for determining depth information for a local area. The DCA includes an illumination source, a camera, and a controller. In some embodiments, the controller uses previous image frames to determine confidence measurements, and selectively adjusts a number of pulses from the illuminator in a subsequent frame based on the determined confidence values. In some embodiments, the sensor uses autonomous gating, and the depth system includes a depth recovery pipeline which provide depth map estimates from the autonomous gated measurements.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: April 25, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Charles Patrick Saunders, Michael Hall, Augusto Ronchini Ximenes
  • Patent number: 11637948
    Abstract: An image capturing apparatus including a lens and a processing unit, wherein the lens includes a first region through which a first light ray passes and a second region through which a second light ray passes, wherein the first region and the second region are arranged in a predetermined direction, and wherein the processing unit sets a component of the predetermined direction as a degree of freedom in a first relative positional relationship between a predetermined position in the first region and a predetermined position in the second region is employed.
    Type: Grant
    Filed: May 11, 2020
    Date of Patent: April 25, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keita Dan
  • Patent number: 11625140
    Abstract: A configuration system uses multiple depth cameras to create a volumetric capture space around an electronically controllable industrial machine or system, referred to as a target system. The output of the cameras is processed to create a live 3D model of everything within the space. A remote operator can then navigate within this 3D model, for example from a desktop application, in order to view the target system from various perspectives in a live 3D telepresence. In addition to the live 3D model, a configuration system generates a 3D user interface for programming and configuring machines or target systems within the space in a spatially coherent way. Local operators can interact with the target system using mobile phones which track the target system in augmented reality. Any number of local operators can interact with a remote operator to simultaneously program and configure the target system.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: April 11, 2023
    Inventors: Benjamin Reynolds, Valentin Heun, James Keat Hobin, Hisham Bedri
  • Patent number: 11589002
    Abstract: A webcam apparatus, having a display surface characterized by a display area, includes an image capture device characterized by an optical axis and a first footprint in a plane perpendicular to the optical axis; and an energy transfer device with a first portion coupled to the image capture device; and a second portion allowing attachment to an edge of a display screen. When attached, the image capture device and the first portion lie against and in contact with the display surface, or in a proximate and parallel plane. An optical axis characterizing the image capture device is aligned with a gaze direction of a user addressing a viewer via the captured images. The first portion of the energy transfer device is transparent at optical wavelengths, and has a second footprint in the plane perpendicular to the optical axis. The first and second footprints are small relative to the display area.
    Type: Grant
    Filed: November 8, 2021
    Date of Patent: February 21, 2023
    Inventors: Barbara Baney, Douglas M Baney
  • Patent number: 11531151
    Abstract: A polarization filter effect is prevented from being changed due to a change in orientation of an imaging apparatus. An imaging apparatus according to the present technique includes an imaging section including a first pixel capable of receiving light in a first polarization direction and a second pixel capable of receiving light in a second polarization direction different from the first polarization direction, a detection section detecting an orientation of the imaging section, and an image generating section generating, on the basis of signals for the first and second pixels, an image corresponding to a polarization direction corresponding to a detection result from the detection section. Thus, as an image corresponding to a particular polarization direction, that is, an image corresponding to application of a polarization filter effect, an image can be generated that corresponds to a polarization direction corresponding to a change in the orientation of the imaging section.
    Type: Grant
    Filed: June 4, 2018
    Date of Patent: December 20, 2022
    Assignee: Sony Group Corporation
    Inventors: Hitoshi Mitani, Masafumi Wakazono
  • Patent number: 11514556
    Abstract: An apparatus which is capable of displaying an image for a user to easily recognize the brightness and colors of an area of interest in the image and easily determine whether a subject is in focus. The amount of image shift between parallax image signals is calculated. The amount of blur in an area where an image shift occurs in the parallax image signals is determined based on the amount of image shift. A blurring process is performed on at least one of the parallax image signals based on the amount of blur. An image based on the display image signal generated based on the resulting parallax image signal is displayed on a display. The determined amount of blur is greater than the amount of blur shown by a subject image defocused by the amount of defocus converted from the amount of image shift.
    Type: Grant
    Filed: May 11, 2021
    Date of Patent: November 29, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hiroshi Nakaoka
  • Patent number: 11503225
    Abstract: Embodiments of the present disclosure include apparatuses and methods for stacked polarizer hyperspectral imaging. In a number of embodiments, a method can include passing a light source input through a lens and a hyperspectral sensor, activating a first polarization layer of a plurality of polarization layers, detecting a first hyperspectral image with an array of pixels from the light source input that is polarized when passed through the first polarization layer, and determining, via a controller coupled to the array of pixels, whether a quality of the first hyperspectral image that was polarized by the first polarization layer meets a threshold. A stacked polarizer can include a plurality of polarizers that are stacked upon each other such that a hyperspectral light source input can be pass through the stack of polarizers and be detected by a pixel of an image sensor cell. Each of the polarizers in the stack of polarizers can be individually activated and deactivated.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: November 15, 2022
    Assignee: Micron Technology, Inc.
    Inventor: Zahra Hosseinimakarem
  • Patent number: 11490067
    Abstract: Embodiments of systems and methods for multi-aperture ranging are disclosed. An embodiment of a device includes a main lens, configured to receive an image from the field of view of the main lens, a multi-aperture optical component having optical elements optically coupled to the main lens and configured to create a multi-aperture image set that includes a plurality of subaperture images, wherein at least one point in the field of view is captured by at least two of the subaperture images, an array of sensing elements, a ROIC configured to receive the signals, to convert the signals to digital data, and to output the digital data, and an image processing system, responsive to the digital data that is output from the ROIC, which is configured to generate disparity values that correspond to at least one point in common between the at least two subaperture images.
    Type: Grant
    Filed: August 9, 2021
    Date of Patent: November 1, 2022
    Assignee: OWL AUTONOMOUS IMAGING, INC.
    Inventors: Srinath Obla, Eugene M. Petilli, Akash Chintha, Charles F. Gershman, Francis J. Cusack, Jr.
  • Patent number: 11461973
    Abstract: Embodiments described herein disclose methods and systems directed to locomotion in virtual reality (VR) based on hand gestures of a user. In some implementations, the user can navigate between locations using hand gestures that trigger teleportation. In other implementations, the user can separately control forward/backward movement and the direction orientation the user is facing. The separate control can either be with one hand when making different gestures or by using different hands to control movement and orientation. In some implementations, a dragging gesture by the user is interpreted by the VR system to trigger movement. In this way, the user can turn in place without moving forward, move forward without turning, or can move forward and turn, while controlling speed, all with a single gesture.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: October 4, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventor: Etienne Pinchon
  • Patent number: 11460807
    Abstract: A gating and a 3D holographic display device are provided. The grating includes grating electrodes and spacing pillars disposed between a first substrate and a second substrate opposite to the first substrate. The grating electrodes extend along a first direction and are arranged along a second direction. Along a plane parallel to the first substrate, positions of spacing pillars are referred to as matrix points. The spacing pillars correspond to the matrix points; the matrix points include multiple first matrix point units arranged as an array. A minimum repeating unit of the matrix points includes four first matrix point units located at four vertices of a first quadrilateral. Two adjacent sides of the first quadrilateral are defined as a first unit vector and a second unit vector, respectively; and an angle between the first unit vector and the second unit vector is ?1, and 0°??1?90°.
    Type: Grant
    Filed: April 29, 2021
    Date of Patent: October 4, 2022
    Assignee: Xiamen Tianma Micro-Electronics Co., Ltd.
    Inventor: Yang Zeng
  • Patent number: 11394866
    Abstract: Provided is a signal processing device including a control unit that acquires distance measurement information on the basis of an addition value obtained by adding together outputs of a plurality of phase difference detection pixels supplied from an imaging element in which the plurality of phase difference detection pixels different in phase difference characteristic is arranged.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: July 19, 2022
    Assignee: Sony Group Corporation
    Inventor: Shinichi Fujii
  • Patent number: 11367330
    Abstract: An information processing system is provided. The information processing system comprises at least one processor configured to receive inputs of videos captured by a plurality of imaging apparatuses, detect a first person image appearing in a first video captured by a first imaging apparatus and a second person image appearing in a second video captured by a second imaging apparatus, associate a first person with a second person based on a first feature value of the first person and a second feature value of the second person, and provide an elapsed time from a first time point when the first person disappears from the first video to a second time point when the second person appears in the second video. The first feature value and the second feature value may include information based on histogram.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: June 21, 2022
    Assignee: NEC CORPORATION
    Inventor: Hiroyoshi Miyano
  • Patent number: 11317016
    Abstract: An imaging device acquires a plurality of viewpoint image signals having different viewpoints from an imaging element. The imaging device selects a subject region within a captured image, and divides the subject region into a plurality of regions. The imaging device performs a correlation operation for each divided region, and calculates an amount of parallax on the basis of one or more extreme positions. In addition, the imaging device calculates distance information of a subject on the basis of the amount of parallax, and calculates a reliability for the distance information. If there are two or more pieces of distance information which are output in the divided region, the imaging device generates a distance histogram using the two or more pieces of distance information based on the reliability.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: April 26, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Kazuma Sakato, Yohei Horikawa
  • Patent number: 11315236
    Abstract: The present disclosure relates to a method and an apparatus for assuring quality of a component, and more particularly, to a method and an apparatus for quality assurance of an automobile component using a marker, that can remove human error and apply a user-oriented display method, by utilizing image analysis techniques, such as a compensation technique according to shooting distance of a high-resolution camera of a terminal having a shooting function, a reference measurement technique where a marker itself includes information such as spatial information and measurement specifications and the like, and distortion correction of a taken image.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: April 26, 2022
    Assignee: KOREA UNIVERSITY OF TECHNOLOGY AND EDUCATION INDUSTRY-UNIVERSITY COOPERATION FOUNDATION
    Inventor: Han-Kyung Yun
  • Patent number: 11301990
    Abstract: A method for borescope inspection of a component uses a stereo borescope for recording the component. The method includes: generating two stereoscopic partial images by means of the stereo borescope; calculating 3D triangulation data from the two stereoscopic partial images; registering the 3D triangulation data to a 3D CAD reference model of the component captured by the stereo borescope, while determining a projection point; projecting 2D image data determined from the two stereoscopic partial images onto the 3D CAD reference model from the determined projection point; and determining damage by image analysis of the projected 2D image data and by ascertaining deviations of the registered 3D triangulation data vis-à-vis the 3D CAD reference model.
    Type: Grant
    Filed: January 14, 2020
    Date of Patent: April 12, 2022
    Assignee: LUFTHANSA TECHNIK AG
    Inventors: Jan Oke Peters, Michael Thies, Sven Rasche, Tomas Domaschke, Thorsten Schueppstuhl, Werner Neddermeyer, Soenke Bahr
  • Patent number: 11294475
    Abstract: Embodiments described herein disclose methods and systems directed to input mode selection in artificial reality. In some implementations, various input modes enable a user to perform precise interactions with a target object without occluding the target object. Some input modes can include rays that extend along a line that intersects an origin point, a control point, and an interaction point. An interaction model can specify when the system switches between input modes, such as modes based solely on gaze, using long or short ray input, or with direct interaction between the user's hand(s) and objects. These transitions can be performed by evaluating rules that take context factors such as whether a user's hands are in view of the user, what posture the hands are in, whether a target object is selected, and whether a target object is within a threshold distance from the user.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: April 5, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Etienne Pinchon, Jennifer Lynn Spurlock, Nathan Aschenbach, Gerrit Hendrik Hofmeester, Roger Ibars Martinez, Christopher Alan Baker, Chris Rojas
  • Patent number: 11257235
    Abstract: A system for sub-pixel disparity estimation is described herein. The system includes memory circuitry to store image data and at least one processor to execute instructions to calculate a first disparity for a set of reference views. The reference views correspond to a first subset of views among a plurality of sub-aperture views represented in the image data. The at least one processor is to refine the first disparity to a second disparity for the reference views. The second disparity has higher precision than the first disparity. The at least one processor is to map the second disparity from the reference views to a second subset of views among the plurality of sub-aperture views different than the first subset of views.
    Type: Grant
    Filed: October 16, 2020
    Date of Patent: February 22, 2022
    Assignee: Intel Corporation
    Inventors: Yi Wu, Shaojun Yao, Yong Jiang
  • Patent number: 11252394
    Abstract: A lens apparatus includes two different optical systems. Each of the two optical systems includes a front lens unit having negative refractive power, an intermediate lens unit, and a rear lens unit disposed in this order from an object side to an image plane side. Each of the intermediate lens units in the two optical systems includes a first reflecting member for bending an optical path at a position adjacent to the front lens unit, and a second reflecting member for bending the optical path at a position adjacent to the rear lens unit. The following conditional expression is satisfied: 0.05<Dout/Din<0.50, where Din is a distance between surface vertexes of lenses closest to an object in the two optical systems, and Dout is a distance between surface vertexes of lenses closest to an image plane in the two optical systems.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: February 15, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hiroki Ebe
  • Patent number: 11252361
    Abstract: An imaging element, an imaging device, and an information processing method are disclosed. In one example, an imaging element includes pixel output units configured for independently setting incident angle directivity for incident light incident through both of an imaging lens and a pinhole. The pixel output units include image restoration pixel output units arranged in a matrix, at least some of the pixel output units having the incident angle directivity both in a row direction and in a column direction of the matrix, and a unidirectional pixel output unit having the incident angle directivity only in the row direction of the matrix or only in the column direction of the matrix.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: February 15, 2022
    Assignee: Sony Group Corporation
    Inventor: Yoshitaka Miyatani
  • Patent number: 11242972
    Abstract: A reflector unit may behave as a retroreflector to reflect light of a selected color. The reflector unit may comprise a first reflector having a first color, a second reflector having a second color, and a mask that either allows incoming light to reach the first reflector and not the second reflector or allows incoming light to reach the second reflector and not the first reflector. An active light unit may emit light of a particular color in response to receiving light. In this fashion, the active light unit may simulate the operation of a reflector. The reflector unit and the active light unit may operate on a bi-directional vehicle.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: February 8, 2022
    Assignee: Zoox, Inc.
    Inventors: Chang Gi Samuel Hong, Andrew Mark Stieber, George William Sabet Fahmy, Evan David Cook
  • Patent number: 11238298
    Abstract: Systems, devices, and methods for monitoring items in a defined physical area can include a primary camera configured to detect a region of interest within a defined physical area and the coordinates of the region of interest in the defined physical area. A plurality of secondary cameras can positioned throughout a defined physical area. One of the secondary cameras can be selected to capture an image of a region of interest based on the coordinates of the region of interest.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: February 1, 2022
    Assignee: United States Postal Service
    Inventor: Todd M. Schimmel
  • Patent number: 11233961
    Abstract: An image processing system includes a movable lens that transfers an external light, an image sensor that includes a pixel array that generates an image signal based on the light and generates image data based on the image signal, and a processor that generates focus information for controlling a position of the movable lens and that generates a depth map based on calibration data and the image data. The calibration data include a value that depends on a position of the objective lens and a position of a pixel included in the pixel array.
    Type: Grant
    Filed: October 8, 2019
    Date of Patent: January 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Hee Kang, Youngjun Song, Seokjae Kang, Taeksun Kim, Dongki Min, Jongmin You, Jeehong Lee, Joonhyuk Im
  • Patent number: 11209268
    Abstract: A depth measuring method and system applicable to a first binocular camera having a zoom lens is provided.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: December 28, 2021
    Assignee: HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO., LTD.
    Inventors: Jingxiong Wang, Hui Mao, Shiliang Pu
  • Patent number: 11178382
    Abstract: Disclosed herein are systems and methods for calibrating a stereoscopic imaging device. An example implementation includes receiving, at a processor, a plurality of image pairs from the stereoscopic imaging device and calculating, for each image pair in the plurality of image pairs, a respective row delta value indicative of a deviation along a horizontal axis between the first image captured by the first sensor and the second image captured by the second sensor. The implementation further includes determining a median row delta value based on each respective row delta value and subsequently a set of respective disparities in one or more features in the first image and the second image based on the median row delta value. The method further includes calculating a column delta value and calibrating the stereoscopic imaging device using the median row delta value and the column delta value.
    Type: Grant
    Filed: October 27, 2020
    Date of Patent: November 16, 2021
    Assignee: ShopperTrak RCT Corporation
    Inventor: Zhiqian Wang
  • Patent number: 11172174
    Abstract: In an imaging apparatus, two pupils of a pupil division optical system transmits light of a first wavelength band and light of a second wavelength band. An amount of components of the first wavelength band in first transmittance characteristics and second transmittance characteristics is more than an amount of components of the second wavelength band in the first transmittance characteristics and the second transmittance characteristics. An amount of components of the second wavelength band in third transmittance characteristics is more than an amount of components of the first wavelength band in the third transmittance characteristics. A processor is configured to generate a color image including a first signal that is based on the first transmittance characteristics as a first channel and a second signal that is based on the second transmittance characteristics as a second channel and a third channel.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: November 9, 2021
    Assignee: OLYMPUS CORPORATION
    Inventors: Toshiaki Mikami, Kiyotomi Ogawa, Hideaki Takahashi, Munenori Fukunishi
  • Patent number: 11156899
    Abstract: A light flux adjustment module is provided for adjusting light flux of light having an optical axis, including a fixed portion, a connecting element, a first blade, and a drive assembly. The fixed portion includes a window, and the light passes through the window. The connecting element is movably connected to the fixed portion. The first blade is movably connected to the connecting element and the fixed portion, and the first blade is adjacent to the window. The drive assembly is used for driving the connecting element to move relative to the fixed portion in a first moving dimension. When the connecting element is moved relative to the fixed portion in the first direction, the first blade is driven by the connecting element to move relative to the fixed portion in a second moving dimension, and the first moving dimension and the second moving dimension are different.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: October 26, 2021
    Assignee: TDK TAIWAN CORP.
    Inventors: Chao-Hsi Wang, Chao-Chang Hu, Chih-Wei Weng, Sin-Jhong Song
  • Patent number: 11122186
    Abstract: An image pickup device includes a first camera, a second camera, a first image signal processor (ISP) and a second ISP. The first camera obtains a first image of an object. The second camera obtains a second image of the object. The first ISP performs a first auto focusing (AF), a first auto white balancing (AWB) and a first auto exposing (AE) for the first camera based on a first region-of-interest (ROI) in the first image, and obtains a first distance between the object and the first camera based on a result of the first AF. The second ISP calculates first disparity information associated with the first and second images based on the first distance, moves a second ROI in the second image based on the first disparity information, and performs a second AF, a second AWB and a second AE for the second camera based on the moved second ROI.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: September 14, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Duck-Soo Kim
  • Patent number: 11076144
    Abstract: The object of the present disclosure is to provide a method and apparatus for obtaining an image, a storage medium and an electronic device, in order to solve the problem that the shooting operation of 3D images in related art is not flexible enough. The method includes: obtaining interpupillary distance information of a target user in response to an operation of shooting a 3D image; adjusting a double-shooting spacing of a binocular camera of an electronic device according to the interpupillary distance information of the target user and a preset corresponding relationship between the interpupillary distance and the double-shooting spacing; and shooting a 3D image through the adjusted binocular camera.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: July 27, 2021
    Inventor: Lei Luo
  • Patent number: 11074431
    Abstract: A facial recognition device includes a determination section for determining presence of an accessory worn on a face from a captured image capturing a human face, an acquisition section for acquiring height information indicative of a height of the accessory from the surface of the face in case the determination section determines presence of the accessory on the face, a production section for producing a three-dimensional face model based on the height information and a fitting section for fitting the face included in the captured image, with using the three-dimensional face model.
    Type: Grant
    Filed: August 29, 2017
    Date of Patent: July 27, 2021
    Assignee: AISIN SEIKI KABUSHIKI KAISHA
    Inventor: Yuya Yamada
  • Patent number: 11076145
    Abstract: The invention describes a depth map generator comprising an array comprising a plurality of individually addressable array elements, wherein an array element comprises a semiconductor emitter or a reflector arranged to reflect light emitted by a semiconductor emitter; a driver realised to switch an array element according to a predefined illumination pattern; a number of image sensors, wherein an image sensor is arranged to detect light reflected from a scene irradiated by the irradiation pattern; and a processing unit realised to compute a depth map of the scene on the basis of a light pattern detected by an image sensor. The invention further describes an irradiation arrangement for use in such a depth map generator; a method of generating a depth map of a scene; and a device comprising such a depth map generator.
    Type: Grant
    Filed: July 30, 2019
    Date of Patent: July 27, 2021
    Assignee: Lumileds LLC
    Inventors: Arjen Van Der Sijde, Nicola Pfeffer
  • Patent number: 11055929
    Abstract: A display provides display light to an eyebox area. A reflective layer receives the display light from the display and redirects the display light to the eyebox area. The reflective layer receives scene light from an external environment of the device and redirects the scene light to a camera for capturing scene images. The camera is positioned a first distance from the reflective layer that is approximately the same as a second distance between the reflective layer and the eyebox area.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: July 6, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Brian Wheelwright, Jacques Gollier, Yusufu Njoni Bamaxam Sulai, Fenglin Peng, Babak Amirsolaimani
  • Patent number: 10979686
    Abstract: A liquid crystal display device which is an image display device for displaying a stereoscopic image includes two correction tables (a nighttime correction table and a daytime correction table) storing correction values corresponding to combinations of a gradation value of a processing target pixel and a gradation value of an adjacent pixel, a correction table selection unit configured to select one of the two correction tables depending on conditions, and gradation value correction units (a right-image gradation value correction unit and a left-image gradation value correction unit) configured to correct the gradation value of the processing target pixel based on the correction table selected by the correction table selection unit.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: April 13, 2021
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Hiroshi Hasegawa
  • Patent number: 10977818
    Abstract: A method for deriving an image sensor's 3D pose estimate from a 2D scene image input includes at least one Machine Learning algorithm trained a priori to generate a 3D depth map estimate from the 2D image input, which is used in conjunction with physical attributes of the source imaging device to make an accurate estimate of the imaging device 3D location and orientation relative to the 3D content of the imaged scene. The system may optionally employ additional Machine Learning algorithms to recognize objects within the scene to further infer contextual information about the scene, such as the image sensor pose estimate relative to the floor plane or the gravity vector. The resultant refined imaging device localization data can be applied to static (picture) or dynamic (video), 2D or 3D images, and is useful in many applications, most specifically for the purposes of improving the realism and accuracy of primarily static, but also dynamic Augmented Reality (AR) applications.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: April 13, 2021
    Assignee: Manor Financial, Inc.
    Inventors: Taylor Clark, Andrew Kemendo, Mark Shanks
  • Patent number: 10970870
    Abstract: An object detection apparatus includes: a camera; a map database; a radar sensor; and an electronic control unit configured to detect a first object in a camera image, detect a first relative position of the first object relative to the road structure in the camera image, detect a second object based on a result received by the radar sensor, detect a second relative angle and a relative distance between the host vehicle and the second object, estimate a second relative position of the second object relative to the road structure, determine, based on the first relative angle, the first relative position, the second relative angle, and the second relative position, whether the first and second objects belong to the same object, and recognize the first and second of as the same object, when it is determined that the first and second objects belong to the same object.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: April 6, 2021
    Assignee: Toyota Jidosha Kabushiki Kaisha
    Inventors: Jun Ozawa, Teppei Ohta, Yoshitaka Oikawa
  • Patent number: 10939088
    Abstract: Dense field imagers are disclosed which are configured to provide combined, aggregated, fused, and/or stitched light field data for a scene. A dense field imager can include a plurality of imaging elements configured to be joined into image blocks or facets that each provides light field data about a scene. The dense field imager can include a plurality of facets in a fixed or modular fashion such that the dense field imager is configured to combine, aggregate, fuse and/or stitch light field data from the plurality of facets. The facets can be mounted such that one or more facets are non-coplanar with other facets. The facets can be configured to provide a representation of the light field with overlapping fields of view. Accordingly, the dense field imager can provide dense field data over a field of view covered by the plurality of facets.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: March 2, 2021
    Assignee: RED.COM, LLC
    Inventors: James H. Jannard, Bimal Mathur, Howard John Postley
  • Patent number: 10911676
    Abstract: The memory card includes: a gyro sensor that detects each of angular velocities in respective directions of axial rotation about three orthogonal axes; a first recording unit that records the moving image captured by the electronic device; a second recording unit that records each of first, second, and third sensor outputs indicating the angular velocities in the directions of axial rotation about the three orthogonal axes, which are detected by the gyro sensor, in association with the moving image to be recorded in the first recording unit; a determination unit that determines a direction of insertion of the memory card, which is mounted on the electronic device, into the electronic device; and a third recording unit that records information indicating the direction of insertion determined by the determination unit.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: February 2, 2021
    Assignee: FUJIFILM Corporation
    Inventors: Junya Kitagawa, Tomonori Masuda
  • Patent number: 10878050
    Abstract: A mobile device application is provided with a dynamic interface for capturing vehicle data. Using a captured VIN number, decoded particulars of the vehicle can be retrieved, together with other particulars from third party databases. Fields of a data capture form are pre-populated with this retrieved data as well as user input in text and multimedia formats. The unfilled fields are presented to the user through an interface in a staged format, showing only relevant unfilled fields. This is reconfigured dynamically (to show more or less fields) as the data is entered/retrieved. The application may use distinct text entry and multimedia entry modes, which may be guided (e.g. with visual cues for photo/video capture). A related method is also provided.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: December 29, 2020
    Assignee: NTHGEN SOFTWARE INC.
    Inventors: Mark Endras, Hon-Wai Chia
  • Patent number: 10863165
    Abstract: The present disclosure relates to information processing apparatus and method configured so that more information can be obtained without the need for a frame memory. Scan of a point light source or a line light source configured to project a pattern image on an object is performed, and exposure and reading by line scan for capturing an image of the object is performed multiple times during a single cycle of the scan as projection of the pattern image. The present disclosure is, for example, applicable to an information processing apparatus, an image processing apparatus, an image projection apparatus, a control apparatus, a projection image capturing system, an information processing method, a program, or the like.
    Type: Grant
    Filed: May 24, 2018
    Date of Patent: December 8, 2020
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventors: Hiroaki Takahashi, Norimitsu Okiyama, Hiroyuki Kasahara
  • Patent number: 10861240
    Abstract: A head mounted display (HMD) includes a display, at least one reflective layer, and a camera. The camera captures scene images from reflections of scene light off the at least one reflective layer. The camera is positioned in a virtual pupil position of the eyebox area with respect to the incoming scene light.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: December 8, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Brian Wheelwright, Jacques Gollier, Yusufu Njoni Bamaxam Sulai, Fenglin Peng, Babak Amirsolaimani
  • Patent number: 10852520
    Abstract: In a first invention, a SCAPE system routes light from a tilted intermediate image plane (170) to an infinity space disposed behind a third objective (180). A first dichroic beam splitter (52) positioned in the infinity space routes light from the intermediate image plane with different wavelengths in different directions. First and second light detector arrays (90) capture first and second wavelength images, respectively, and optical components (54,56,58,82) route light having the first and second wavelengths towards the first and second light detectors, respectively. In a second invention, a SCAPE system is used to capture a plurality of images while a sample is perturbed (e.g., vibrated, deformed, pushed, pulled, stretched, or squeezed) in order to visualize the impact of the perturbation on the sample.
    Type: Grant
    Filed: September 12, 2017
    Date of Patent: December 1, 2020
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Elizabeth M. C. Hillman, Kripa B. Patel