Single Camera With Optical Path Division Patents (Class 348/49)
  • Patent number: 10838687
    Abstract: An audio processor for processing an audio signal includes: an audio signal modifier for modifying the audio signal in response to a user input; a loudness controller for determining a loudness compensation gain based on a reference loudness or a reference gain and a modified loudness or a modified gain, where the modified loudness or the modified gain depends on the user input; and a loudness manipulator for manipulating a loudness of a signal using the loudness compensation gain.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: November 17, 2020
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Fabian Küch, Christian Uhle, Michael Kratschmer, Bernhard Neugebauer, Michael Meier
  • Patent number: 10832430
    Abstract: A system for sub-pixel disparity estimation is described herein. The system includes a plenoptic camera, a memory, and a processor. The memory is configured to store imaging data. The processor is \coupled to the memory and the plenoptic camera. The processor is to obtain a plurality of sub-aperture views, select a subset of sub-aperture views as reference views for a disparity calculation, and calculate an integer disparity for the reference views. The processor is also to refine the integer disparity to sub-pixel disparity accuracy for the reference views and propagate the sub-pixel disparity from the reference views to other views of the plurality of sub-aperture views.
    Type: Grant
    Filed: December 23, 2016
    Date of Patent: November 10, 2020
    Assignee: Intel Corporation
    Inventors: Yi Wu, Shaojun Yao, Yong Jiang
  • Patent number: 10824237
    Abstract: A screen display control method includes: by using a wearable terminal to be attached to a head of an operator to capture an image, capturing, with an image of a display having a rectangular frame and a viewport, an image of a hand portion with which the operator points to the display; by using a computer, extracting positions of vertexes of the rectangular frame in the captured image by the wearable terminal and a position pointed by the hand portion; determining, based on a position relation of the extracted positions of the vertexes and the extracted pointed position, whether a position in the viewport corresponding to the hand portion is present; and causing a pointer to be displayed at the position if present.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: November 3, 2020
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Yoshinori Murakami
  • Patent number: 10818020
    Abstract: The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: October 27, 2020
    Assignee: INTERDIGITAL CE PATENT HOLDINGS
    Inventors: Julien Fleureau, Pierre Hellier, Benoit Vandame
  • Patent number: 10768435
    Abstract: Disclosed are methods, circuits, optical assemblies, devices, systems and associated computer executable code for estimating for three dimensional imaging. According to some embodiments, there may be provided a projector operable to project a bi-dimensionally coded pattern to provide a first projection of the bi-dimensionally coded pattern and a second projection of the bi-dimensionally coded pattern. The first projection and the second projection may be offset or rigidly shifted with respect to one another, such that a first reflection off an object which is associated with the first projection and a second reflection off the object which is associated with the second projection are provided. A signal corresponding to the first reflection and a signal corresponding to the second reflection may be co-processed.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: September 8, 2020
    Assignee: MANTISVISION LTD.
    Inventor: Eyal Gordon
  • Patent number: 10750101
    Abstract: A single pixel of a video display can display respective individual pixels of multiple views. In other words, a video display can include more views for an autostereoscopic image than the physical pixels of the video display would ordinarily support. The physical pixel is time-multiplexed in that the physical pixel displays a pixel of one view for a given time interval and a view multiplexer deflects the light from the physical pixel by a predetermined angle to make the pixel appear in a location corresponding to the pixel of the view. In another time interval, the physical pixel displays a pixel of a different view and the view multiplexer deflects light from the physical pixel by a different predetermined angle to make the pixel appear in a location corresponding to the pixel of the different view.
    Type: Grant
    Filed: December 18, 2016
    Date of Patent: August 18, 2020
    Assignee: SOLIDDD CORP.
    Inventors: Richard A. Muller, Neal Weinstock
  • Patent number: 10735706
    Abstract: Disclosed is a method for compensating for motion blur when performing a 3D scanning of at least a part of an object by means of a 3D scanner, where the motion blur occurs because the scanner and the object are moved relative to each other while the scanning is performed, and where the motion blur compensation comprises: —determining whether there is a relative motion between the scanner and the object during the acquisition of the sequence of focus plane images; —if a relative motion is determined, performing a motion compensation based on the determined motion; and —generating a 3D surface from the sequence of focus plane images.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: August 4, 2020
    Assignee: 3Shape A/S
    Inventors: Rune Fisker, Henrik Ojelund, Mike Van Der Poel, Kristian Evers Hansen, Anders Gaarde
  • Patent number: 10715953
    Abstract: Systems and methods for improving a location search process are provided. In example embodiments, a networked system receives an indication of a search being performed at a user device. The networked system detects a location of the user device. Based on the location of the user device, the networked system identifies a dynamically generated region in which to perform the search that corresponds to the location of the user device. Based on a search term, the networked system performs the search in the dynamically generated region corresponding to the location of the user device. A result of the search is presented on the user device.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: July 14, 2020
    Assignee: Uber Technologies, Inc.
    Inventors: Yu Zhang, Ye Fan
  • Patent number: 10602127
    Abstract: A 3D imaging apparatus with enhanced depth of field to obtain electronic images of an object for use in generating a 3D digital model of the object. The apparatus includes a housing having mirrors positioned to receive an image from an object external to the housing and provide the image to an image sensor. The optical path between the object and the image sensor includes an aperture element having apertures for providing the image along multiple optical channels with a lens positioned within each of the optical channels. The apparatus also includes a transparent cover positioned within the optical path and having a plurality of fiducials. The depth of field of the apparatus includes the cover, allowing the fiducials to be used to calibrate the apparatus or verify and correct the existing calibration of it.
    Type: Grant
    Filed: October 16, 2019
    Date of Patent: March 24, 2020
    Assignee: 3M INNOVATIVE PROPERTIES COMPANY
    Inventors: David B. Stegall, Vladimir Kryzhniy, Eric S. Hansen, Aya Eid, Shannon D. Scott, Zhisheng Yun, James L. Graham, II
  • Patent number: 10572737
    Abstract: Suspicious activity detection methods and systems serve to notify persons of suspicious activity, including potential threats. According to one method, a video processing system (VPS) receives video data in real time/near real time from at least one camera. The VPS determines whether received data representing a first set of video frames includes data representing both an image of a person to be notified and one or more predefined patterns. If so, the VPS tracks the person's image and the predefined pattern(s) within the video data, and determines whether data representing a second set of later-in-time video frames includes data representing the person's image. If the second set of frames excludes the person's image, the VPS continues tracking the predefined pattern(s) in data representing a third set of later-in-time video frames and alerts the person if the tracked pattern(s) is positioned suspiciously relative to the person's current or prior position.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: February 25, 2020
    Inventors: Gustavo D. Leizerovich, Kolja S. Hegelich, Ralf Niebecker
  • Patent number: 10572738
    Abstract: Suspicious activity detection methods and systems serve to notify persons of suspicious activity, including potential threats. According to one embodiment, a video processing system (VPS) receives video data in real time or near real time from at least one video camera. Each video camera captures images of a respective video capture area proximate a person. The VPS determines whether received data representing a first set of video frames includes data representing one or more predefined patterns. If so, the VPS tracks the predefined pattern(s) within the video data, and determines whether data representing a second set of later-in-time video frames includes data representing the one or more predefined patterns. If the second set of video frames includes data representing the one or more predefined patterns, the VPS determines whether the one or more tracked patterns have changed position in a suspicious manner. If so, the VPS communicates an alert.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: February 25, 2020
    Inventors: Gustavo D. Leizerovich, Kolja S. Hegelich, Ralf Niebecker, Claudio Santiago Ribeiro
  • Patent number: 10572740
    Abstract: A processor of a video processing system receives video data from a video camera pivotally mounted within a motor vehicle. The processor also receives sensor data from a motion-sensing subsystem mounted in or to the vehicle. The processor determines, based upon the sensor data, a reference longitudinal axis and an orientation of an optical axis of the camera's lens. The processor then determines an angular difference between the orientation of the camera lens' optical axis and the reference longitudinal axis. The processor further determines, based upon the angular difference, a location of a target capture area within horizontal and vertical fields of view of the camera's lens. The processor then selects a portion of the received video data corresponding to the target capture area, determines whether the selected video data includes data representing one or more predefined patterns, and if so, tracks the predefined pattern(s) within the selected video data.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: February 25, 2020
    Inventors: Claudio Santiago Ribeiro, Kolja S. Hegelich, Ralf Niebecker, Gustavo D. Leizerovich
  • Patent number: 10572739
    Abstract: A video processing system (VPS) receives video data from at least one video camera included with an emergency vehicle. The VPS also receives audio data from at least one microphone operating in conjunction with the video camera(s). The VPS determines whether received data representing a first set of video frames includes a predefined image pattern. If so, the VPS tracks the image pattern within the video data and determines whether data representing a second set of later-in-time video frames includes the tracked image pattern. If the second set of video frames includes the tracked image pattern, the VPS determines whether the tracked image pattern has changed position suspiciously. If so, the VPS communicates an alert. The VPS also determines whether received audio data includes a predefined audio pattern. If so, the VPS inserts a digital marker within the video data at the time at which the audio pattern commenced.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: February 25, 2020
    Inventors: Gustavo D. Leizerovich, Kolja S. Hegelich, Ralf Niebecker, Claudio Santiago Ribeiro
  • Patent number: 10564392
    Abstract: An imaging apparatus includes: a distance measurement unit that measures distance values of a plurality of points in a first area which has a focus point as a reference point; a statistical unit that calculates statistics indicating a variation in the measured distance values of the plurality of points in the first area; a size determination unit that determines the size of a second area which has the focus point as a reference point, on the basis of the calculated statistics; a contrast evaluation value calculation unit that calculates a contrast evaluation value on the basis of an image of the second area; and a focusing unit that moves a focus lens to a lens position determined on the basis of the calculated contrast evaluation value.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: February 18, 2020
    Assignee: FUJIFILM Corporation
    Inventor: Mikio Watanabe
  • Patent number: 10552963
    Abstract: An imaging device, an imaging method, a program, and a non-transitory recording medium capable of easily coping with interference and suppressing an increase in cost due to countermeasures for preventing the interference such as providing a light shielding band are provided. In an imaging device according to an aspect of the present invention, an imaging unit includes an imaging optical system including a first optical system and a second optical system provided in a different area and having different imaging characteristics, and a directivity sensor, and first and second true movement vectors in first and second images are extracted on the basis of first and second possibilities of movement vectors calculated according to first and second movement vectors that are detected movement vectors of a subject in first and second images obtained via the first and second optical systems.
    Type: Grant
    Filed: January 15, 2018
    Date of Patent: February 4, 2020
    Assignee: FUJIFILM Corporation
    Inventor: Shuji Ono
  • Patent number: 10542920
    Abstract: [Object] To more simply measure a scattering coefficient of an in-vivo component at any measurement location of a living body. [Solution] A measurement device according to the present disclosure includes: a light source configured to emit at least one kind of measurement light belonging to a predetermined wavelength band toward a measurement region formed by at least a part of a living body; a detection unit in which a plurality of sensors are arranged regularly in a predetermined disposition, the detection unit being provided on a same side as the light source with respect to the measurement region and configured to detect reflected light from the living body of the measurement light transmitted through a part of the living body with the plurality of sensors; and an analysis unit configured to analyze scattering characteristics of an in-vivo component present in the living body using a detection result of the reflected light detected by the detection unit.
    Type: Grant
    Filed: February 9, 2015
    Date of Patent: January 28, 2020
    Assignee: Sony Corporation
    Inventor: Hideo Sato
  • Patent number: 10547822
    Abstract: The present disclosure relates to an image processing apparatus and a method capable of generating high-definition viewpoint interpolation images at high speed. A space reconstruction unit reconstructs a space in which viewpoint images are photographed according to each viewpoint image and each disparity (pixel shift amount) map and supplying reconstruction data of the space to an interpolation position setting unit. The interpolation position setting unit sets an interpolation position in the reconstructed space while changing (an inclination of) a beam and supplies interpolation target coordinates indicating the set interpolation position to a data search unit. The data search unit generates an interpolation image at any viewpoint by sampling RGB values at interpolation target coordinates supplied from the interpolation position setting unit and outputs the generated interpolation image to a subsequent stage.
    Type: Grant
    Filed: May 8, 2015
    Date of Patent: January 28, 2020
    Assignee: SONY CORPORATION
    Inventors: Kengo Hayasaka, Katsuhisa Ito
  • Patent number: 10521702
    Abstract: A method for estimating and forecasting an energy production indicator for a solar system. The method comprises, in particular, the steps of: a) receiving images of the sky taken from the ground, each image comprising an optical marker; b) extracting values of pixels and locating of image pixels from the received images; c) determining distances between the located pixels and the optical marker of the image; d) generating a vector of parameters from a pixel classification, according to the extracted values and the determined distances; e) comparing parameters of the generated vector with predetermined parameters, the predetermined parameters being respectively associated with energy production indicators; f) estimating the energy production indicator of the solar system from energy production indicators of the predetermined parameters compared to the generated vector.
    Type: Grant
    Filed: June 7, 2016
    Date of Patent: December 31, 2019
    Assignee: ELECTRICITE DE FRANCE
    Inventors: Charlotte Gauchet, Nicolas Paul, Stephanie Dubost
  • Patent number: 10504949
    Abstract: A solid-state imaging device includes pixels each of which includes a photoelectric converter configured to generate charges by photoelectric conversion, a holding unit configured to hold charges generated by the photoelectric converter, and a transfer unit configured to transfer charges from the photoelectric converter to the holding unit, and outputs a signal based on charges in the holding unit, a transfer control unit configured to control the transfer unit to transfer charges generated by the photoelectric converter during one exposure period to the holding unit by a variable number, which is one or greater, of transfer operations, an amplifier unit configured to amplify the signal, and a control unit configured to control a gain of the amplifier unit to be a first gain when the number of transfer operations is first number and to be a second gain when the number of transfer operations is a second number.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: December 10, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Daisuke Kobayashi, Toru Koizumi, Kazuhiro Saito
  • Patent number: 10491878
    Abstract: An image synthesizing method and system include capturing a first image using a first aperture, which corresponds to a first depth of field (DOF); capturing a second image using a second aperture, which corresponds to a second DOF and is different from the first aperture; and receiving the first image and the second image, on which an image processing is performed to obtain a synthesized image, which has a DOF being between the first DOF and the second DOF.
    Type: Grant
    Filed: August 13, 2018
    Date of Patent: November 26, 2019
    Assignee: Wistron Corporation
    Inventors: Yao-Tsung Chang, Chia Ling Hsu
  • Patent number: 10469803
    Abstract: A system and method for communicating between a first person at a first location and one or more people at remote locations. A production set is established at the first location where the first person is imaged with stereoscopic video cameras. The stereoscopic footage is digitally enhanced with 3D effects to create a production video file. The production video file is transmitted to an electronic device at one or more remote locations. The production video file is played and creates images of the first person at the first location. On a display screen at the remote locations, the images appear three dimensional to the remote viewers. Furthermore, the images appear to extend in front of, or above, the display screen of the electronic device.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: November 5, 2019
    Assignee: Maxx Media Group, LLC
    Inventors: Richard S. Freeman, Scott A. Hollinger
  • Patent number: 10469730
    Abstract: An imaging device including an imaging element configured to output an image pickup signal and a parallax image signal is provided. The imaging device selects a subject area on the basis of the image pickup signal and performs a control to read the parallax image signal from a reading area of the imaging element corresponding to the selected subject area. In this control, the imaging device selects a subject area on the basis of a result of comparing the number of lines configuring the reading area corresponding to the subject area and a threshold value.
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: November 5, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masaaki Kano
  • Patent number: 10456040
    Abstract: The fusion element of the imaging processing element 31 generates the fused image by combining: the corrected image generated by using; at least one parameter relative to the color space including RGB value of each pixel, luminance, value, saturation and hue of the visible image, and each pixel value of the near-infrared image imaging fluorescences from indocyanine green; and the second corrected image that is the near-infrared image after colored.
    Type: Grant
    Filed: July 8, 2015
    Date of Patent: October 29, 2019
    Assignee: SHIMADZU CORPORATION
    Inventor: Hiroyuki Tsumatori
  • Patent number: 10462352
    Abstract: A focus detection apparatus includes a determination unit configured to determine a degree of effect of noise included in a pair of parallax image signals, and an acquisition unit configured to acquire information about a phase difference between the pair of parallax images based on a calculation of correlation between the pair of parallax image signals. The acquisition unit selects a filter used to acquire the information about the phase difference from among a plurality of filters having different frequency characteristics based on a determination result of the determination unit, and outputs, as a focus detection result, the information about the phase difference acquired by the correlation calculation based on the pair of parallax image signals applied to the selected filter.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: October 29, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Kawarada, Hirokazu Ishii
  • Patent number: 10425631
    Abstract: An apparatus including: a 2D control unit comprising a single camera processor; and a horizontal line switch downstream from a camera head and upstream of the single camera processor.
    Type: Grant
    Filed: October 17, 2017
    Date of Patent: September 24, 2019
    Assignee: CONMED CORPORATION
    Inventors: Yuri Kazakevich, Mark Nelson, Eric Peterson
  • Patent number: 10412355
    Abstract: Disclosed is an endoscope including: a four-color separation prism configured to separate light from an object into three primary colors of light and infrared light; four image sensors configured to convert optical images of the separated three primary colors of light and an optical image of the separated infrared light into electrical signals; and an output device configured to output the converted electrical signals.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: September 10, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Yuuichi Takenaga, Haruyasu Katahira
  • Patent number: 10366586
    Abstract: Threat detection methods and systems serve to alert persons of potential dangers. According to one exemplary method, a video processing system (VPS) receives video data in real time or near real time from at least one camera positioned to capture images of a video capture area proximate a person. The video data includes data representing a series of time-sequenced video frames. The VPS determines whether data representing a first video frame includes data representative of one or more predefined patterns. If so, the VPS commences tracking of the predefined pattern(s) within the video data to produce one or more tracked patterns. After pattern tracking has begun, the VPS determines whether data representing one or more subsequent video frames includes data representative of the tracked pattern(s). If so, the VPS determines whether the tracked pattern(s) is/are positioned suspiciously relative to a position of the person and, if so, alerts the person.
    Type: Grant
    Filed: May 16, 2018
    Date of Patent: July 30, 2019
    Inventors: Gustavo D. Leizerovich, Kolja S. Hegelich, Ralf Niebecker
  • Patent number: 10362295
    Abstract: A method for projection includes projecting a pattern toward a target by directing optical radiation, which is collimated along an optical axis by projection optics, through a diffractive optical element (DOE). An optical signal that is indicative of a shift of the projected pattern is detected. An actuator is driven to translate the projection lens in a direction transverse to the optical axis responsively to the detected optical signal.
    Type: Grant
    Filed: May 17, 2017
    Date of Patent: July 23, 2019
    Assignee: APPLE INC.
    Inventors: Denis G. Chen, Meng Zhang
  • Patent number: 10356388
    Abstract: It is the object of the present invention to provide a stereoscopic video distribution system, a stereoscopic video distribution method, a stereoscopic video distribution apparatus, a stereoscopic video viewing system, a stereoscopic video viewing method, and a stereoscopic video viewing apparatus. In the stereoscopic video distribution system according to this invention, stereoscopic video signals provided by a plurality of video distribution source servers for distributing stereoscopic videos are once received by a transcoding server, so that the stereoscopic video signals can be reproduced by a BD player and a TV for stereoscopic viewing.
    Type: Grant
    Filed: January 27, 2014
    Date of Patent: July 16, 2019
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Masato Nagasawa, Yuichiro Haruyama
  • Patent number: 10347100
    Abstract: A similarity computation unit (130) derives a first probability P indicating that a first moving body appearing in the first video is the same as a second moving body appearing in the second video on the basis of similarity of feature value of the moving bodies. A non-appearance probability computation unit (140) derives a second probability Q indicating that the first moving body is not the same as the second moving body on the basis of an elapsed time after the first moving body exits from the first video. A person determination unit (150) determines whether the first moving body is the same as the second moving body by comparing the probability P and Q.
    Type: Grant
    Filed: April 23, 2014
    Date of Patent: July 9, 2019
    Assignee: NEC Corporation
    Inventor: Hiroyoshi Miyano
  • Patent number: 10334151
    Abstract: A light-field camera may have enhanced autofocus functionality that does not require a dedicated optical pathway or dedicated sensors, and yet brings the camera rapidly into focus for image capture. According to one method, light may be received through the aperture of a light-field camera, with the main lens of the light-field camera at a first focus setting. The light may be directed to a sensor of the light-field camera via an optical pathway. The sensor may capture the light to generate preliminary light-field data. In a processor, the preliminary light-field data may be used to generate an offset, which may be used to refocus the main lens to a second focus setting. Additional light may be directed along the same optical pathway and captured with the main lens at the second focus setting to capture a focused light-field image.
    Type: Grant
    Filed: May 23, 2016
    Date of Patent: June 25, 2019
    Assignee: GOOGLE LLC
    Inventors: Yuriy Romanenko, Edmond Chung, Joachim Deguara
  • Patent number: 10235774
    Abstract: A method for calibrating an image capturing device mounted on a machine is provided. The image capturing device is configured to capture one or more images of a calibration target. The one or more images include a set of reference points corresponding to the calibration target. The method includes receiving a first positional data and a second positional data associated with the image capturing device and the calibration target respectively. The method includes generating, through the processor, a set of augmented reality points based on the first positional data and the second positional data. The method further includes overlaying, through the processor, the set of augmented reality points on the set of reference points displayed on the display. The method includes iteratively adjusting, through the processor, at least one of a roll, a yaw, or a pitch of the image capturing device until the set of augmented reality points align with the corresponding set of reference points.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: March 19, 2019
    Assignee: Caterpillar Inc.
    Inventors: David Paul Gitz, Paul Russell Friend, Maikel Orlando Torres Pineiro, Qi Chen
  • Patent number: 10182218
    Abstract: Disclosed is an endoscope including: a four-color separation prism configured to separate light from an object into three primary colors of light and infrared light; four image sensors configured to convert optical images of the separated three primary colors of light and an optical image of the separated infrared light into electrical signals; and an output device configured to output the converted electrical signals.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: January 15, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Yuuichi Takenaga, Haruyasu Katahira
  • Patent number: 10148863
    Abstract: Provided is an information processing apparatus having an aberration information obtaining unit configured to obtain first aberration information of an image capturing optical system associated with the first pupil region and second aberration information of the image capturing optical system associated with the second pupil region; a calculation unit configured to calculate a first defocus information based on at least one of the first image signal and the second image signal; and a correction unit configured to correct the first defocus information based on the first aberration information and the second aberration information to generate a second defocus information.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: December 4, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Yumi Takao
  • Patent number: 10136056
    Abstract: Provided are a panoramic imaging apparatus, a panoramic imaging system, a method of generating a panoramic image using the panoramic imaging system, a computer-readable recording medium, and a computer program stored in a computer-readable recording medium The panoramic imaging apparatus includes a first camera module capturing an omnidirectional image, a second camera module positioned a certain distance away from the first camera module and capturing an omnidirectional image, and a controller generating and storing an image frame based on the omnidirectional image captured by at least one of the first camera module and the second camera module Each of the first camera module and the second camera module includes two lenses having a viewing angle greater than or equal to 180°, sharing an optical axis, and formed to be convex in opposite directions of each other to capture the omnidirectional image.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: November 20, 2018
    Assignee: TwoEyes Tech, Inc.
    Inventor: Hun Joo Song
  • Patent number: 10089716
    Abstract: An apparatus for generating precision maps of an area is disclosed. The apparatus receives sensor data, where the sensor data includes sensor readings each indicating a level of a parameter in one of a plurality of first portions of an area, and video data representing an aerial view of the area. The sensor data may be received from sensors that are each deployed in one of the first portions of the area. The video data may be received from an aerial vehicle. An orthomosaic may be generated from the video data, and the orthomosaic and the sensor data used to generate a predication model. The prediction model may then be used to extrapolate the sensor data to determine a level of the parameter in each of a plurality of second portions of the area. A precision map of the area may be generated using the extrapolated sensor readings.
    Type: Grant
    Filed: September 3, 2016
    Date of Patent: October 2, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ranveer Chandra, Ashish Kapoor, Sudipta Sinha, Deepak Vasisht
  • Patent number: 10070118
    Abstract: Techniques for controlling optical behavior of a multi-view display apparatus comprising a first layer comprising first optical elements and a second layer comprising second optical elements.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: September 4, 2018
    Assignee: Lumii, Inc.
    Inventors: Thomas Anthony Baran, Matthew Waggener Hirsch, Daniel Leithinger
  • Patent number: 10063767
    Abstract: An image pickup device includes a first pixel region including image pixels and phase difference pixels and a second pixel region including image pixels and including no pixel configured to output a valid phase difference pixel signal, wherein a part of the plurality of phase difference pixels in the first pixel region is arranged at a regular position at which a G filter is formed in a Bayer array and another part is arranged at an irregular position at which a filter that is other than the G filter is formed, and a basic arrangement pattern of filters in the second pixel region is equal to a basic arrangement pattern of filters in the first pixel region.
    Type: Grant
    Filed: June 16, 2017
    Date of Patent: August 28, 2018
    Assignee: Olympus Corporation
    Inventor: Yoshinao Shimada
  • Patent number: 10045005
    Abstract: Provided is a 3D camera module, comprising: a first camera lens group for forming a light path of a first light bundle so as to be one of a left-eye lens group and a right-eye lens group in the 3D camera module; a second camera lens group, disposed apart from the first camera lens group, for forming a light path of a second light bundle so as to be the other of the left-eye lens group and the right-eye lens group in the 3D camera module; an image sensor disposed on the movement path of the first and second light bundles so as to sense a first image by the first light bundle and a second image by the second light bundle; and a movement control unit configured to move the first camera lens group and the second camera lens group in at least one direction of a forward and backward direction and a left and right direction so as to control the first and second images.
    Type: Grant
    Filed: December 10, 2013
    Date of Patent: August 7, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Changhwan Lee, Gwanmo Koo, Youngwoo Park, Donghwa Yun
  • Patent number: 10021282
    Abstract: A multi-aperture camera system includes a first aperture introducing an RGB optical signal, a second aperture distinguished from the first aperture and introducing an optical signal, which is different from the RGB optical signal in wavelength, an image sensor processing the RGB optical signal, which is introduced through the first aperture, and obtaining a first image to an object and configured to process an optical signal, which is introduced through the second aperture and is different from the RGB optical signal in wavelength, and obtaining a second image for the object, and a distance determining part using a disparity between the first image and the second image and determining a distance between the image sensor and the object. The first aperture and the second aperture are formed on a unitary optical system to have different centers each other.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: July 10, 2018
    Assignee: CENTER FOR INTEGRATED SMART SENSORS FOUNDATION
    Inventors: Chong Min Kyung, Jun Ho Mun
  • Patent number: 10013378
    Abstract: The present disclosure relates to a dedicated ASIC chip system for optical three-dimensional sensing, including a DEPTH ENGINE module, a REGISTER PROCESSOR module, a controller module, a register module, an RGB CMOS driving module, an IR CMOS driving module, an AXI bus interface module, an APB bus interface module, an AXI/APB bridge module, a Flash storage driving module and a DDR3 storage driving module; and when non-optical three-dimensional data is processed, the control module sends an instruction to connect an external Flash memory for processing the non-optical three-dimensional data. When optical three-dimensional data is processed, the control module sends an instruction to simultaneously connect the external Flash memory and an external DDR3 memory for processing the optical three-dimensional data, so as to quickly process high-precision optical three-dimensional data, the resolution of an optical three-dimensional depth image obtained from the processing is high, and the delay is short.
    Type: Grant
    Filed: May 21, 2015
    Date of Patent: July 3, 2018
    Assignee: SHENZHEN ORBBEC CO., LTD.
    Inventors: Zhenzhong Xiao, Honghuai Xu, Long Liu, Yuanhao Huang
  • Patent number: 10003734
    Abstract: An image capturing apparatus comprising: an image sensor that has a plurality of photoelectric conversion portions corresponding to each of a plurality of microlenses arranged in two-dimensions, and outputs an image signal corresponding to a quantity of incident light; a detection unit configured to detect a moving direction of a subject; a determination unit configured to, in a case where the subject is moving in a main scanning direction, determine to perform divided readout in every predetermined number of rows, and to perform added readout in the rows except for the every predetermined number of rows; and a control unit configured to control the image sensor by switching between the divided readout and the added readout in units of rows based on the determination result.
    Type: Grant
    Filed: May 26, 2016
    Date of Patent: June 19, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hiroshi Kaibara
  • Patent number: 9948918
    Abstract: A stereoscopic control method includes: establishing a specific mapping relation between a specific disparity value and a specific set of a first focal setting value of a first sensor of a stereo camera and a second focal setting value of a second sensor of the stereo camera; and controlling stereoscopic focus of the stereo camera according to the specific mapping relation. Besides, a stereoscopic control apparatus includes a mapping unit and a focus control unit. The mapping unit is arranged for establishing at least a specific mapping relation between a specific disparity value and a specific set of a first focal setting value of a first sensor of a stereo camera and a second focal setting value of a second sensor of the stereo camera. The focus control unit is arranged for controlling stereoscopic focus of the stereo camera according to the specific mapping relation.
    Type: Grant
    Filed: December 10, 2012
    Date of Patent: April 17, 2018
    Assignee: MEDIATEK INC.
    Inventor: Chia-Ming Cheng
  • Patent number: 9819926
    Abstract: A camera system comprising: stereoscopic optics; a right image sensor for acquiring a right image from the stereoscopic optics and a left image sensor for acquiring a left image from the stereoscopic optics; a horizontal line switch for receiving the right image from the right image sensor and the left image from the left image sensor and creating a composite image wherein the horizontal line signals from the right image sensor are alternated with the horizontal line signals from the left image sensor; and a single camera processor for receiving the composite image from the horizontal line switch for presenting to a display.
    Type: Grant
    Filed: November 26, 2014
    Date of Patent: November 14, 2017
    Assignee: ConMed Corporation
    Inventors: Yuri Kazakevich, Mark Nelson, Eric Peterson
  • Patent number: 9686479
    Abstract: Methods for stitching multiple sub-images together to form a substantially seamless composite image are disclosed. Overlap regions formed by each pair of neighboring sub-images are periodically examined and key features common to the overlap regions in each sub-image of the pair are identified. A transformation is determined for each sub-image pair based on the positions of these key features. The transformation is split between the sub-images and applied to distort the overlap regions in each sub-image pair such that they are substantially aligned. Applying the transformations to each overlap region in the overall image enables creation of a substantially seamless composite image. In some embodiments, the process wherein the transformations are determined is run as a feedback loop to enable continuing refinement of the transformations.
    Type: Grant
    Filed: September 16, 2014
    Date of Patent: June 20, 2017
    Assignee: Duke University
    Inventors: Daniel Marks, David Jones Brady
  • Patent number: 9591287
    Abstract: A lens module includes a first wafer level lens group, a second wafer level lens group, a first sensor, and a second sensor. The first wafer level lens group has a first optical axis. The second wafer level lens group has a second optical axis. The first optical axis is parallel with the second optical axis, and the first wafer level lens group and the second wafer level lens group are integrally formed. The first sensor is disposed corresponding to the first wafer level lens group, and the first sensor is disposed on the first optical axis. The second sensor is disposed corresponding to the second wafer level lens group, and the second sensor is disposed on the second optical axis.
    Type: Grant
    Filed: January 21, 2015
    Date of Patent: March 7, 2017
    Assignee: HIMAX TECHNOLOGIES LIMITED
    Inventors: Yin-Dong Lu, Han-Yi Kuo
  • Patent number: 9544570
    Abstract: A 3D image capture device according to an embodiment includes: a light transmitting section 1 with a transmitting area 1a, of which the spectral transmittance characteristic varies in a first direction; an image sensor 2a which is arranged to receive light that has been transmitted through the light transmitting section 1 and which outputs a photoelectrically converted signal representing the light received; and an image processing section which extracts an edge of a subject in the first direction, which is included in an image that has been generated based on the photoelectrically converted signal supplied from the image sensor 2a, and which estimates information about the depth of the subject based on a lightness or hue pattern of a background in the vicinity of the edge extracted.
    Type: Grant
    Filed: April 11, 2012
    Date of Patent: January 10, 2017
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Masao Hiramoto, Yasunori Ishii
  • Patent number: 9488836
    Abstract: A binocular display includes a waveguide. A convex spherical mount has a fixed position relative to the waveguide. A light engine includes a concave spherical mount that adjustably mates with the convex spherical mount.
    Type: Grant
    Filed: May 2, 2013
    Date of Patent: November 8, 2016
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: David D. Bohn, Steve Robbins
  • Patent number: 9451175
    Abstract: An imaging apparatus comprises: an image pickup element including a two-dimensional array of a plurality of photoelectric conversion elements, for outputting an electric signal of an optical image; a focus adjustment unit for adjusting a focus state of a photographing optical system; an image pickup control unit for obtaining electric signals from the image pickup element in a plurality of different focus states while changing the focus state by the focus adjustment unit; and a light ray determination unit for obtaining incident position information and incident angle information, which are light field information of the optical image of an object, by using the electric signals obtained in the a plurality of different focus states by the image pickup control unit.
    Type: Grant
    Filed: February 5, 2014
    Date of Patent: September 20, 2016
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masafumi Kimura
  • Patent number: 9451148
    Abstract: An image recording unit obtains image data which is obtained by a photographing operation, and can reconstruct a refocus image, and photographing information, generates a parameter used to reconstruct a refocus image in relation to an object included in an image based on the obtained photographing information, and records the generated parameter in a recording medium as meta data of the image data together with the obtained image data. An image reproducing apparatus reads out the recorded image data and parameter from the recording medium, reconstructs a refocus image from the readout image data using the readout parameter, edits the reconstructed refocus image according to an editing instruction, and edits a parameter of the edited refocus image.
    Type: Grant
    Filed: June 7, 2013
    Date of Patent: September 20, 2016
    Assignee: Canon Kabushiki Kaisha
    Inventor: Atsushi Sugawara