Multiple Cameras Patents (Class 348/47)
  • Patent number: 10244225
    Abstract: A method is provided for generating a three dimensional frame. The method comprises the steps of: retrieving information that relates to a plurality of images of a target captured by two image capturing devices; determining data that will be applied for analyzing objects of interests included in the captured images; calculating disparity between groups of corresponding frames, wherein each of said groups comprises frames taken essentially simultaneously by the two image capturing devices; determining an initial estimation of a disparity range for the frames included in the groups of the corresponding frames; evaluating a disparity range value for each proceeding group based on information retrieved on a dynamic basis from frames included therein, and changing the value of said disparity range when required; and applying a current value of the disparity range in a stereo matching algorithm, and generating a three-dimensional frame for each proceeding group of corresponding frames.
    Type: Grant
    Filed: June 4, 2015
    Date of Patent: March 26, 2019
    Assignee: INUITIVE LTD.
    Inventor: Orna Bregman Amitai
  • Patent number: 10234873
    Abstract: A flight device includes a processor and a memory storing instructions which are executed by the processor causes the processor to: acquire an image; determine a scene; determine a height of the flight device; calculate an image first and second direction offsets of a second image frame relative to a first image frame of two adjacent image frames; acquire an acceleration and an angular velocity of the flight device in three dimensions; compensate for the image first and second direction offsets, according to the acceleration and the angular velocity, to obtain image correction offsets; calculate an first and second direction offsets in world coordinates corresponding to the image correction offsets; and derive a velocity of the flight device according to a time interval between time points at which the two adjacent image frames are captured and according to the first direction offset and the second direction offset.
    Type: Grant
    Filed: June 16, 2017
    Date of Patent: March 19, 2019
    Assignee: AUTEL ROBOTICS CO., LTD.
    Inventor: Zuoguang Li
  • Patent number: 10225488
    Abstract: A terminal having a camera and a method of processing an image in the camera are disclosed. The method includes collecting, using a camera, a user image captured at a user focal length and a link image captured at a selective focal length, and storing the user image and the link image by linking the link image with the user image. Using this method, a user can capture a subject and circumstances around the subject when the image is captured.
    Type: Grant
    Filed: June 3, 2013
    Date of Patent: March 5, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Han Chul Jung, Sun Ae Kim
  • Patent number: 10212408
    Abstract: The techniques described herein segment objects represented in images using one or more depth maps, regardless of whether an initial depth map is of a threshold quality. To do so, the techniques contemporaneously generate, by a depth sensor, a depth map of an environment and capture, by an RGB camera, a color image of the environment. The techniques then determine whether the initial depth map is of the threshold quality. If so, the techniques use this depth map for performing segmentation on an image. If not, then the techniques generate a new depth in part by comparing an image captured by the depth sensor to the color image and performing block-matching between these images. That is, the techniques use the depth sensor and the RGB camera as stereo pair and fill in holes of the initial depth map based on the block-matching.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: February 19, 2019
    Assignee: Amazon Technologies, Inc.
    Inventors: Evangelos Pappas-Katsiafas, Ilya Vladimirovich Brailovskiy, Naushirwan N Patuck
  • Patent number: 10209773
    Abstract: The present specification describes methods and systems for modifying a media, such as Virtual Reality, Augmented Reality, or Mixed Reality (VR/AR/MxR) media based on a vision profile and a target application. In embodiments of the specification, a Sensory Data Exchange (SDE) is created that enables identification of various vision profiles for users and user groups. The SDE may be utilized to modify one or more media in accordance with each type of user and/or user group.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: February 19, 2019
    Assignee: Vizzario, Inc.
    Inventors: Syed Khizer Rahim Khaderi, Mohan Komalla Reddy, Kyle Christopher McDermott
  • Patent number: 10200608
    Abstract: An image processing system, panoramic camera, and method use multiple image processors to process image data from an image sensor to provide a panoramic image output of different resolutions depending on a mode of operation. None of the image processors are capable of outputting an image at a full resolution of the image sensor's output image data. Depending on the mode of operation, each image processor can process a portion of the image data output by the image sensor to produce a respective image that may be joined with the image(s) produced by the other processor(s) to create a full resolution image, or a less than a full resolution image can be produced by turning off one or more of the image processors.
    Type: Grant
    Filed: July 25, 2016
    Date of Patent: February 5, 2019
    Assignee: 360FLY, INC.
    Inventor: Gustavo D. Leizerovich, Jr.
  • Patent number: 10198868
    Abstract: An information processing apparatus comprises a luminance value obtaining unit for respectively obtaining first and second luminance values of first and second captured images of a physical space, wherein the first and second captured images are respectively captured by first and second image capturing units; a parameter obtaining unit for respectively obtaining first and second tracking parameters of automatic exposure control corresponding to a change in brightness of the physical space for the first and second image capturing units; and a setting unit for setting a first image capturing parameter for the first image capturing unit based on the first luminance value and the obtained first tracking parameter and a second image capturing parameter for the second image capturing unit based on the second luminance value and the obtained second tracking parameter.
    Type: Grant
    Filed: May 19, 2016
    Date of Patent: February 5, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hiroichi Yamaguchi
  • Patent number: 10194140
    Abstract: A binocular stereo vision device, adjusting method and apparatus thereof and a display device are provided.
    Type: Grant
    Filed: November 23, 2015
    Date of Patent: January 29, 2019
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Shuo Chen
  • Patent number: 10191285
    Abstract: A head mounted display that is mounted on the head of a user and used includes an irradiation unit that irradiates the eyes of the user with invisible light, a monitor that displays an image for the user to view wearing a glass for display that transmits visible light and reflects invisible light, an imaging device capable of capturing an image formed by the invisible light, and an output unit that outputs an image captured by the imaging device as an image for gaze detection, and the imaging device images the eyes of the user using the invisible light radiated from the irradiation unit, reflected by the eyes of the user, and reflected by the glass for display.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: January 29, 2019
    Assignee: FOVE, INC.
    Inventors: Lochlainn Wilson, Keiichi Seko
  • Patent number: 10194135
    Abstract: A three-dimensional depth perception apparatus includes a synchronized trigger module, an MIPI receiving/transmitting module, and a multiplexing core computing module, a storage controller module, a memory, and an MUX selecting module. The synchronized trigger module is for generating a synchronized trigger signal transmitted to an image acquiring module; the MIPI receiving/transmitting module is for supporting input/output of the MIPI video streams and other formats of video streams; the multiplexing core computing module is for selecting a monocular structured or a binocular structured light depth perception working mode. The apparatus flexibly adopts a monocular or binocular structured-light depth sensing manner, so as to leverage the advantages of different modes: the MIPI in, MIPI out working manner is nearly transparent to the user, so as to facilitate the user to employ the apparatus, directly obtaining the depth graph.
    Type: Grant
    Filed: July 20, 2016
    Date of Patent: January 29, 2019
    Inventors: Chenyang Ge, Nanning Zheng, Yanhui Zhou
  • Patent number: 10194130
    Abstract: An image processing apparatus includes an image obtaining unit configured to obtain an image including an object, a distance obtaining unit configured to obtain distance information indicating an object distance corresponding to each pixel in the image, each pixel having a pixel value to be combined with the object distance thereof into a combination, a determination unit configured to determine a correction target pixel subjected to correction of the distance information based on the combination of each pixel in image with the combinations of the other pixels, and a correction unit configured to correct the distance information of the correction target pixel determined by the determination unit.
    Type: Grant
    Filed: April 6, 2016
    Date of Patent: January 29, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kina Itakura
  • Patent number: 10186234
    Abstract: A mirror device with a display function includes a room mirror with a display function, a direction detection unit, and a switching unit. The room mirror with a display function includes a display panel that displays an image and a half mirror that is provided on a display surface of the display panel. The direction detection unit detects a direction of the room mirror with a display function. The switching unit performs, according to the direction of the room mirror with a display function detected by the direction detection unit, switching between a mirror mode operation, in which the display of the image on the display panel is stopped and a mirror surface of the half mirror is used, and a display mode operation in which the image is displayed on the display panel.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: January 22, 2019
    Assignee: JVC KENWOOD CORPORATION
    Inventor: Tomoko Kimura
  • Patent number: 10149110
    Abstract: Method and system for tracking a plurality of communication devices. One system includes a plurality of communication devices that each include a respective electronic processor, a respective camera, a respective location component, and a respective network interface. At least one of the plurality of communication devices is configured to receive location information from each of the other of the plurality of communication devices, generate a tracking map, and transmit the tracking map to each of the other of the plurality of communication devices. The tracking map assigns each of the plurality of communication devices only one of the other of the plurality of communication devices. Each of the plurality of communication devices is configured to control, with its respective electronic processor, its respective camera based on the tracking map to include in its field of view its respectively assigned one of the other of the plurality of communication devices.
    Type: Grant
    Filed: June 6, 2016
    Date of Patent: December 4, 2018
    Assignee: MOTOROLA SOLUTIONS, INC.
    Inventors: Lan-Jian Cao, Quan-Wen Du, Shervin Sabripour, Ji-Feng Zheng
  • Patent number: 10148870
    Abstract: An image capturing apparatus includes a main image capturing system configured to capture an object image formed by a main optical system that can vary a magnification, a first sub capturing system configured to capture an object image formed by a first sub optical system having an angle of view equal to or wider than that at a wide-angle end of the main optical system, and a second sub capturing system configured to capture an object image formed by a second sub optical system having an angle of view narrower than that at a wide-angle end and equal to or wider than that at a telephoto end of the main optical system. An optical barrel configured to hold the main optical system can be retracted relative to a body of the image capturing apparatus. A predetermined condition is satisfied.
    Type: Grant
    Filed: July 14, 2016
    Date of Patent: December 4, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Chiaki Inoue
  • Patent number: 10139631
    Abstract: Tracking a user head position detects a change to a new head position and, in response, a remote camera is instructed to move to a next camera position. A camera image frame, having an indication of camera position, is received from the camera. Upon the camera position not aligning with the next camera position, an assembled image frame is formed, using image data from past views, and rendered to appear to the user as if the camera moved in 1:1 alignment with the user's head to the next camera position.
    Type: Grant
    Filed: June 5, 2017
    Date of Patent: November 27, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Alexandre Da Veiga, Roger Sebastian Kevin Sylvan, Kenneth Liam Kiemele, Nikolai Michael Faaland, Aaron Mackay Burns
  • Patent number: 10133347
    Abstract: A near-eye display includes a human eye-oriented display screen, a microlens array located on the side of the display screen close to human eyes, and an image adjustment unit. The display screen has multiple display regions that are separate from each other. Each display region correspondingly displays a subimage, and the subimages displayed on the display regions combine a complete, gap-free and overlap-free image presented to a user. The microlens array focuses the image displayed on the display screen into a near-eye image that can be clearly seen by human eyes, each microlens being corresponding to one of the display region. The image adjustment unit adjusts in real time a displayed image size of each display region according to a visual acuity state of the user and/or the image adjustment unit moves in real time the position of each display region according to a gaze direction of the user.
    Type: Grant
    Filed: March 28, 2017
    Date of Patent: November 20, 2018
    Assignee: BEIJING ANTVR TECHNOLOGY CO., LTD.
    Inventor: Zheng Qin
  • Patent number: 10132616
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: November 20, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Yibing Michelle Wang
  • Patent number: 10129530
    Abstract: An activity recording system is provided. The activity recording system includes a three-dimensional camera, a sensor arrangement that is fitted to a subject being recorded, and an activity recording device. The activity recording device receives image information from the three-dimensional camera and sensor arrangement information from the sensor arrangement. Both the image information and the sensor arrangement information include location measurements. The sensor arrangement information is generated by location sensors that are positioned at target features of the subject to be tracked. The sensor arrangement information is a key to the image information that specifies where, in any given image, the target features of the subject lie. Activity data having these characteristics may be applied to solve a variety of system development problems. Such activity data can be used to training machine learning components or test computer vision components for a fraction of the cost of using conventional techniques.
    Type: Grant
    Filed: September 25, 2015
    Date of Patent: November 13, 2018
    Assignee: INTEL CORPORATION
    Inventor: Amit Bleiweiss
  • Patent number: 10121350
    Abstract: An information device includes a position detector, a communication unit, and a controller. The position detector detects specific position information indicating at least one of a fact that the information device is positioned at a specific location and a fact that the information device is away from the specific location. When the position detector detects the specific position information, the communication unit communicates with an electronic device and acquires from the electronic device remaining capacity information regarding at least one of a remaining battery capacity and a remaining memory capacity of the electronic device. The controller outputs a notification signal indicating that at least one of the remaining battery capacity and the remaining memory capacity indicated by the remaining capacity information is below a threshold set in advance in a case where at least one of the remaining battery capacity and the remaining memory capacity is below the threshold.
    Type: Grant
    Filed: January 24, 2017
    Date of Patent: November 6, 2018
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Kiyoshi Ohgishi, Tatsuaki Mitsumata
  • Patent number: 10116874
    Abstract: Examples are disclosed that relate to adapting image output from a camera based on output from an orientation sensor. One example provides a display device comprising a display, a movable mount, a camera having an optical field-of-view, an orientation sensor, and a controller. The controller may be configured to receive image output from the camera, generate, based on the image output, a first clipped field-of-view of the camera comprising a target, and in response to a change in an orientation of the camera identified by output from the orientation sensor, generate, based on the image output and the output from the orientation sensor, a second clipped field-of-view comprising the target, the first and second clipped field-of-views being subsets of the optical field-of-view.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: October 30, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventor: Charlie W. Case, Jr.
  • Patent number: 10109056
    Abstract: A method and device for eye gaze estimation with regard to a sequence of images. The method comprises receiving a sequence of first video images and a corresponding sequence of first eye images of a user watching at the first video images; determining first saliency maps associated with at least a part of the first video images; estimating associated first gaze points from the first saliency maps associated with the video images associated with the first eye images; storing of pairs of first eye images/first gaze points in a database; for a new eye image, called second eye image, estimating an associated second gaze point from the estimated first gaze points and from a second saliency map associated with a second video image associated with the second eye image; storing the second eye image and its associated second gaze point in the database.
    Type: Grant
    Filed: March 29, 2013
    Date of Patent: October 23, 2018
    Assignee: Thomson Licensing
    Inventors: Phi Bang Nguyen, Julien Fleureau, Christel Chamaret, Philippe Guillotel
  • Patent number: 10104364
    Abstract: Methods and apparatus for sharing a bus between multiple imaging sensors, include, in some aspects, a device having at least two imaging sensors, an electronic hardware processor, and an imaging sensor controller. The imaging sensor controller includes first clock and data lines, operably coupling the electronic hardware processor to the imaging sensor controller, and a second clock line, operably coupling the imaging sensor controller to the first imaging sensor and the second imaging sensor. A second data line operably couples the imaging sensor controller to the first imaging sensor. A third data line operably couples the sensor controller to the second imaging sensor. The imaging sensor controller is configured to use the second clock line, and second data line to send a first command to the first imaging sensor, and, use the second clock line, and third data line to send a second command to the second imaging sensor.
    Type: Grant
    Filed: February 29, 2016
    Date of Patent: October 16, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Sergiu R Goma, Kalin Mitkov Atanassov, Vikas Ramachandra
  • Patent number: 10091489
    Abstract: An image capturing device includes at least two image sensors and an image processing unit that performs image processing on image information that is captured by image sensors and an image display unit that displays the image information on which the image processing is performed by the image processing unit. The image processing unit displays two base points on the image display unit in a same direction as a direction in which the two image sensors are arranged, calculates a disparity value between a first base point and a second base point that are the two base points with the two image sensors, calculates a length between the first base point and the second base point, and displays a result of calculation of the length between the first base point and the second base point on the image display unit.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: October 2, 2018
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Daisuke Murayama, Kenichi Iwauchi, Kei Tokui, Yasutaka Wakabayashi, Shinichi Arita, Nao Shibuhisa
  • Patent number: 10083522
    Abstract: A Quantified Image Measurement System that creates accurate physical measurement data from digital pictures is disclosed. The system can use any image format and enhances the image file with measurement data and data transformation information that enables the creation of any type of geometrical or dimensional measurement from the stored photograph. This file containing the original digital image along with the supplemental data is referred to as a Quantified Image File or QIF. The QIF can be shared with other systems via email, cloud syncing or other types of sharing technology. Once shared, existing systems such as CAD applications or web/cloud servers can use the QIF and the associated QIF processing software routines to extract physical measurement data and use the data for subsequent processing or building geometrically accurate models of the objects or scene in the image.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: September 25, 2018
    Assignee: SMART PICTURE TECHNOLOGIES, INC.
    Inventors: Dejan Jovanovic, Keith Beardmore, Kari Myllykoski, Mark O Freeman
  • Patent number: 10083352
    Abstract: A system configured to improve human presence detection and/or localization by generating aggregate confidence values. The system may aggregate confidence values corresponding to overlapping regions of interest. The system may perform human presence detection by comparing the aggregate confidence values to a universal threshold, with aggregate confidence values above the universal threshold indicating that human presence is detected. The system may use the aggregate confidence values to generate a heatmap, may identify a strongest cluster of pixels in the heatmap and determine a bounding box surrounding the strongest cluster. To reduce false positive detections, the system may track the false positive detections as heatmap base data and may remove the heatmap base data from the heatmap. Thus, pixel intensity values corresponding to the false positive detections may be reduced to improve an accuracy of the human presence detection.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: September 25, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Mashhour Solh, Lelin Zhang, Jinglun Gao
  • Patent number: 10070116
    Abstract: A method for scanning and measuring an environment is provided. The method includes providing a three-dimensional (3D) measurement device having a controller. Images of the environment are recorded and a 3D scan of the environment is produced with a three-dimensional point cloud. A video image of the environment is recorded. The video image is displayed on a first portion of a display. A portion of the three-dimensional point cloud is displayed on a second portion of the display, the second portion of the display being arranged about the periphery of the first portion of the display. Wherein a portion of the 3D point cloud displayed in the second portion represents a portion of the environment outside of a field of view of the video image.
    Type: Grant
    Filed: May 15, 2015
    Date of Patent: September 4, 2018
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Gerrit Hillebrand, Rasmus Debitsch, Rolf Heidemann
  • Patent number: 10063845
    Abstract: A 3D display is characterized by a quality of viewing experience (QVE) mapping which represents a display-specific input-output relationship between input depth values and output QVE values. Examples of QVE mappings based on a metric of “viewing blur” are presented. Given reference depth data generated for a reference display and a representation of an artist's mapping function, which represents an input-output relationship between original input depth data and QVE data generated using a QVE mapping for a reference display, a decoder may reconstruct the reference depth data and apply an inverse QVE mapping for a target display to generate output depth data optimized for the target display.
    Type: Grant
    Filed: March 17, 2014
    Date of Patent: August 28, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Gopi Lakshminarayan, Samir Hulyalkar, Tao Chen, Hariharan Ganapathy, Santosh Chilkunda
  • Patent number: 10055816
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Grant
    Filed: September 21, 2017
    Date of Patent: August 21, 2018
    Assignee: GoPro, Inc.
    Inventors: Yajie Sun, Timothy Macmillan, Elizabeth Torres Edwards, Sumit Chawla
  • Patent number: 10055027
    Abstract: A natural user interface (NUI) computer processor is provided herein. The NUI computer processor may include: at least one computer processing module; and a plurality of sensors, connected with direct, high bandwidth connectors to the at least one computer processing module, wherein the computer processing module is configured to support a full extent of processing power required for simultaneous multi-modal high resolution information handling gathered by said sensors, wherein the computer processing module and the high bandwidth connectors are cooperatively configured to eliminate any non-vital delays, to reduce latency between human user actions captured by said sensors and response by the NUI computer processor.
    Type: Grant
    Filed: February 5, 2015
    Date of Patent: August 21, 2018
    Assignee: INUITIVE LTD
    Inventors: Dor Zepeniuk, Shlomo Gadot, Ziv Tsoref
  • Patent number: 10057961
    Abstract: There is provided a control device, a control method, and a program through which it is possible to implement a more suitable imaging environment even under a situation in which auxiliary light is emitted from a plurality of light sources, the control device including: an acquisition unit configured to acquire a light emission state of a first light source; and a control unit configured to control an operation of light emission of a second light source that is different from the first light source according to the acquired light emission state of the first light source.
    Type: Grant
    Filed: June 17, 2015
    Date of Patent: August 21, 2018
    Assignee: SONY CORPORATION
    Inventors: Masaharu Nagata, Satoshi Suzuki, Seishi Tomonaga, Yasuhiro Matsui
  • Patent number: 10049439
    Abstract: The image processing method includes acquiring multiple parallax images produced by image capturing of an object, the parallax images having a parallax to one another. The method further includes acquiring, by using the respective parallax images as base images, relative difference information on a relative difference between each of the base images and at least one other parallax image in the multiple parallax images, and detecting an unwanted component contained in each of the parallax images by using the relative difference information.
    Type: Grant
    Filed: May 19, 2017
    Date of Patent: August 14, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Chiaki Inoue
  • Patent number: 10044937
    Abstract: An electronic device is provided. The electronic device includes a first camera module including a first lens and a first image sensor configured to photograph an image through the first lens, a processor configured to determine a motion of a pixel included in the image photographed by the first image sensor, and a second camera module including a second lens, a gyro sensor configured to detect a motion of the electronic device, and an image stabilization module configured to calculate a correction value using motion information of the electronic device and motion information of the pixel and to perform image stabilization based on the correction value.
    Type: Grant
    Filed: November 2, 2016
    Date of Patent: August 7, 2018
    Assignee: Samsung Electronics Co., Ltd
    Inventor: Jae Mu Yun
  • Patent number: 10043275
    Abstract: An image processing apparatus includes: a distance calculation unit configured to calculate distance information on the basis of a first image and a second image; and a blur addition unit configured to add a blur to original images based on the first image and the second image, using the distance information calculated by the distance calculation unit and to move a focus plane by a predetermined refocus distance. The blur addition unit adds the blur to a first original image when the refocus distance is equal to or less than a threshold and adds the blur to a second original image, which is an image having an effective F-number greater than an effective F-number of the first original image, when the refocus distance is greater than the threshold.
    Type: Grant
    Filed: November 11, 2014
    Date of Patent: August 7, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Aihiko Numata
  • Patent number: 10044446
    Abstract: A device for linearizing non-linear signal transmission characteristics of an optical communication system. A non-linearity introducing part is between an input port and an output port of the optical communication system. The non-linearity introducing part at least partly causes said non-linear signal transmission characteristics. The device is configured for connection between said input port and the non-linearity introducing part, in parallel with the non-linearity introducing part, and comprises a pair of Junction Field Effect Transistors (JFETs), configured to operate in an anti-parallel configuration.
    Type: Grant
    Filed: September 4, 2014
    Date of Patent: August 7, 2018
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: János Ladvánszky, Boris Dortschy
  • Patent number: 10038740
    Abstract: Systems and methods of delegating media capturing functionality from one device to another are presented. A first device configured with an object recognition engine captures a media representation of an environment and identifies an object within that environment. Then based on matched object traits from a database, the engine selects a delegation rules set, and delegates certain media capturing functionality to a second device according to the selected delegation rules set.
    Type: Grant
    Filed: August 19, 2014
    Date of Patent: July 31, 2018
    Assignee: Nant Holdings IP, LLC
    Inventor: Patrick Soon-Shiong
  • Patent number: 10019838
    Abstract: The present invention relates to the technical field of three-dimensional imaging, and provides a human body three-dimensional imaging method and system, and a method for simultaneously calibrating multiple control base stations. According to the present invention, provided that the effective view fields of the various distributed sensors are subjected to no spatial overlap, the structural parameters and the global matching parameters of all the sensors are calibrated; a corresponding point search method utilizing phase shift in combination with the random structured light reduces image collection time for acquiring single view point depth data; by using the concept of time reuse, the overall data collection time is shortened, and meanwhile the design of distributed computation enhances the computing capability of the entire system; automatic matching of the depth data of different sensors is implemented according to the calibrated global matching parameters of the different sensors.
    Type: Grant
    Filed: June 13, 2016
    Date of Patent: July 10, 2018
    Assignee: SHENZHEN UNIVERSITY
    Inventors: Xiaoli Liu, Dong He, Xiang Peng, Ameng Li
  • Patent number: 10021373
    Abstract: A method for distributing video in a display system equipped with at least one camera. The video is distributed among multiple display zones, which are movable with respect to each other. The method includes acquiring optically, with the camera, a calibration image of a display zone of a display-enabled electronic device. The method includes computing, based on the calibration image, a coordinate transform responsive to dimensions, position, and orientation of the display zone relative to the camera, the coordinate transform being usable to effect video rendering on the display zone. The method includes transmitting to the display-enabled electronic device one or more of the coordinate transform and video rendered for display on the display zone based on the coordinate transform.
    Type: Grant
    Filed: January 11, 2016
    Date of Patent: July 10, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventor: John C. Gordon
  • Patent number: 10008005
    Abstract: Measurement system and method for measuring multi-dimensions of an object are provided. A two-dimensional (2D) image capturing device captures at least one macro-2D image of the object. A three-dimensional (3D) information acquisition device acquires micro-3D measured data of the object. A integration and estimation device performs 2D and 3D image correction on macro-2D image and micro-3D measured data to map micro-3D measured data into macro-2D image to output 3D-topography data corresponding to macro-2D image of the object, and based on machine learning mechanism, performs matching procedure on at least one connection feature between any two positions in 3D-topography data with a database to elect an adapted model. Based on its corresponding to at least one fitting function, the integration and estimation device estimates the connection features of 3D-topography data to output at least one estimated feature amount, thereby obtaining measurement results corresponding to the object.
    Type: Grant
    Filed: November 16, 2016
    Date of Patent: June 26, 2018
    Assignee: Industrial Technology Research Institute
    Inventors: Yueh-Yi Lai, Kun-Lung Tseng, Zih-Jian Jhang
  • Patent number: 9986222
    Abstract: Provided is an image processing method in an image processing device for performing image processing on first and second perspective images forming a 3D display image and specified via selection from a group of images obtained by capturing a subject from at least three different perspectives. Adjustment processing is performed on the first perspective image based on a prescribed reference position and a capturing position related to the first perspective image, and shifts the subject in the first perspective image to a position in which the subject would appear if the capturing position were the reference position. Adjustment processing is performed on the second perspective image based on the reference position and a capturing position related to the second perspective image, and shifts the subject in the second perspective image to a position in which the subject would appear if the capturing position were the reference position.
    Type: Grant
    Filed: September 17, 2015
    Date of Patent: May 29, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Hiromichi Ono, Takeshi Ito
  • Patent number: 9983685
    Abstract: An electronic apparatus includes at least two camera devices and a processing device. The processing device determines a first distance to a surface formed by the two camera devices and a second distance to the surface in response to detecting an object positioned at a first time by the two camera devices, and determines a third distance from the object positioned at a second time to the surface, wherein the second time is later than the first time, and the third distance is longer than the first distance and shorter than the second distance. Also, the processing device determines a depth in a virtual space corresponding to the object positioned at the second time according to the first distance, the second distance, and the third distance.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: May 29, 2018
    Assignee: MEDIATEK INC.
    Inventors: Yueh-Wei Hu, Cheng-Che Chen, Ting Chiou, Yu-Pao Tsai
  • Patent number: 9978145
    Abstract: A system and method are provided for use in the assessment of an attentional deficit. During the assessment, a test image is presented to a subject on a display. A camera image is obtained from a camera which is indicative of a geometric relation between the head of the subject and the display during the assessment. The camera image is analyzed to determine a deviation in the geometric relation between the head of the subject and the display from a reference geometric relation. Deviation data is then generated and output which is indicative of the deviation. Advantageous uses of the deviation data include providing visual feedback to the user, adjusting the test image, and taking the deviation into account when processing test data of the assessment. Advantageously, the need for a trained professional to be present during the assessment is reduced or avoided.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: May 22, 2018
    Assignee: Koninklijke Philips N.V.
    Inventors: Murray Fulton Gillies, Laura Klaming, Daisy Van Minde
  • Patent number: 9978147
    Abstract: A method and apparatus for performing inbuilt calibration of camera system that performs three-dimensional measurements and depth reconstruction are described. In one embodiment, the method includes displaying, using a projector of a capture device, a fiducial projection pattern in response to calibration of the capture device. The method may also include capturing, with a camera of the capture, an image of the fiducial projection pattern. The method may also include determining calibration coefficient values indicative of relative physical relationships of one or more components of the depth camera system based on analysis of the captured image of the fiducial projection pattern.
    Type: Grant
    Filed: December 23, 2015
    Date of Patent: May 22, 2018
    Assignee: INTEL CORPORATION
    Inventors: Sundeep Raniwala, Bidhan P. Chaudhuri, Anders Grunnet-Jepsen
  • Patent number: 9952495
    Abstract: A virtual field-of-view frame or reference window in a field of view of a stereo camera, and projected in a reduced manner by left and right shooting lenses to form an image on each of a left and right image pickup devices. Standard image data and stereoscopic video data is sent. The standard stereoscopic video data is displayed on a display screen having positions of left and right screens exactly matching each other and having the position and size for reproducing and displaying the reference window as a reference dimension display equivalent to the reference window, simultaneously with left and right polarizations. With eyeglasses for field-of-view separation left and right videos are separately viewed.
    Type: Grant
    Filed: January 19, 2009
    Date of Patent: April 24, 2018
    Inventor: Minoru Inaba
  • Patent number: 9953432
    Abstract: Motion is detected within a defined proximity of a vehicle or fixed location equipped with a recording system by correlating frame-to-frame changes in the video streams of two or more cameras with converging views.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: April 24, 2018
    Inventor: David M. Smith
  • Patent number: 9953403
    Abstract: A stereoscopic camera and associated method for capturing a stereoscopic image pair are provided. As an example, a stereoscopic camera includes first and second lenses defining parallel optical axes. The stereoscopic camera also includes first and second image sensors for receiving optical signals from the first and second lenses. The first and second fields of view are defined so as to overlap to define a first area of coincidence when the first and second lenses are spaced apart by a first distance. The first and second lenses are configured to be repositioned to be spaced apart by a second distance with the first and second image sensors being correspondingly repositioned to alter a space therebetween such that the first and second fields of view overlap to define a second area of coincidence when the first and second lenses are spaced apart by the second distance.
    Type: Grant
    Filed: June 10, 2016
    Date of Patent: April 24, 2018
    Assignee: The Boeing Company
    Inventor: Gregg W. Podnar
  • Patent number: 9952432
    Abstract: An apparatus for electro-optically reading targets is mounted in an orientation on a head of a human operator having eyes for directly viewing a calibration target along a sightline. A light source directs a visible light beam away from the apparatus. A calibration assembly adjustably moves the light source, no matter the orientation of the apparatus, to visually position the light beam on the calibration target that is simultaneously being directly viewed along the sightline in a calibration mode of operation. A data capture assembly is operative, subsequent to the calibration mode, for electro-optically reading the targets on which the light beam is visually positioned in a reading mode of operation.
    Type: Grant
    Filed: April 8, 2016
    Date of Patent: April 24, 2018
    Assignee: Symbol Technologies, LLC
    Inventors: Michael J. Giannetta, Matthew L. Kowalski, Nicole D. Tricoukes
  • Patent number: 9948869
    Abstract: An image fusion method for multiple lenses and device thereof, which includes the following steps: taking parallax images with different focal distances through a plurality of lenses; analyzing feature points of the parallax images; calculating the matching relationships among the feature points of the parallax images; moving each of the parallax images according to the matching relationships to adjust the same image portion of each parallax image to the same image position; fusing the moved result of the parallax images to generate a fusion image; and removing unnecessary images configured in the edge of the fusion image to generate a corrected fusion image. Therefore, the image fusion method for multiple lenses and device thereof can make the result of the image fusion better.
    Type: Grant
    Filed: July 4, 2016
    Date of Patent: April 17, 2018
    Inventor: Yuan-Ting Fang
  • Patent number: 9934451
    Abstract: A method of object detection includes receiving a first image taken by a first stereo camera, receiving a second image taken by a second stereo camera, and offsetting the first image relative to the second image by an offset distance selected such that each corresponding pixel of offset first and second images depict a same object locus if the object locus is at an assumed distance from the first and second stereo cameras. The method further includes locating a target object in the offset first and second images.
    Type: Grant
    Filed: June 25, 2013
    Date of Patent: April 3, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: David Nister, Piotr Dollar, Wolf Kienzle, Mladen Radojevic, Matthew S. Ashman, Ivan Stojiljkovic, Magdalena Vukosavljevic
  • Patent number: 9936189
    Abstract: The present application discloses a method for predicting stereoscopic depth comprising capturing object images of a target scene; generating a stereoscopic depth image associated with the object images; identifying a no-depth-data region in the stereoscopic depth image; identifying a depth-data region correlated to the no-depth-data region; and assigning a depth data to the no-depth-data region based on a depth data of the depth-data region correlated to the no-depth-data region.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: April 3, 2018
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Xingxing Zhao
  • Patent number: 9918065
    Abstract: Example embodiments may help multi-camera devices determine disparity information scene, and use the disparity information in an autofocus process. An example method involves: (a) receiving image data of a scene that comprises at least one image of the scene captured by each of two or more image-capture systems of a computing device that includes a plurality of image-capture systems; (b) using the image data captured by the two or more image-capture systems as a basis for determining disparity information for the scene; and (c) performing, by the computing system, an autofocus process based at least in part on the disparity information, wherein the autofocus process provides a focus setting for at least one of the image-capture systems of the computing device.
    Type: Grant
    Filed: December 23, 2016
    Date of Patent: March 13, 2018
    Assignee: Google LLC
    Inventors: Ryan Geiss, Roman Lewkow