Multiple Cameras Patents (Class 348/47)
  • Patent number: 9030530
    Abstract: A variety of implementations are described. At least one implementation modifies one or more images from a stereo-image pair in order to produce a new image pair that has a different disparity map. The new disparity map satisfies a quality condition that the disparity of the original image pair did not. In one particular implementation, a first image and a second image that form a stereo image pair are accessed. A disparity map is generated for a set of features from the first image that are matched to features in the second image. The set of features is less than all features in the first image. A quality measure is determined based on disparity values in the disparity map. The first image is modified, in response to the determined quality measure, such that disparity for the set of features in the first image is also modified.
    Type: Grant
    Filed: December 13, 2010
    Date of Patent: May 12, 2015
    Assignee: Thomson Licensing
    Inventors: Izzat Izzat, Feng Li
  • Patent number: 9032084
    Abstract: A conditional access system generating a permission packet in response to the content request. The permission packet has information for a user device to access content through a connection of a content delivery network so that in response to the permission packet, a first connection from the content delivery network to the user device may be opened by the user device.
    Type: Grant
    Filed: January 9, 2013
    Date of Patent: May 12, 2015
    Assignee: The DIRECTV Group, Inc.
    Inventors: Raynold M. Kahn, Deanna R. Kidd, Hanno Basse, Tokunbo Labisi, Frank A. Palase
  • Patent number: 9030529
    Abstract: A depth image acquiring device is provided, which includes at least one projecting device and at least one image sensing device. The projecting device projects a projection pattern to an object. The image sensing device senses a real image. In addition, the projecting device also serves as a virtual image sensing device. The depth image acquiring device generates a disparity image by matching three sets of dual-images formed by two real images and one virtual image, and generates a depth image according to the disparity image. In addition, the depth image acquiring device also generates a depth image by matching two real images, or a virtual image and a real image without verification.
    Type: Grant
    Filed: April 10, 2012
    Date of Patent: May 12, 2015
    Assignee: Industrial Technology Research Institute
    Inventors: Chia-Chen Chen, Wen-Shiou Luo, Tung-Fa Liou, Yu-Tang Li, Chang-Sheng Chu, Shuang-Chao Chung
  • Publication number: 20150124059
    Abstract: An apparatus comprising: an image analyser configured to analyse at least two images to determine at least one matched feature; a camera definer configured to determine at least two difference parameters between the at least two images; and a rectification determiner configured to determine values for the at least two difference parameters in an error search using an error criterion based on the at least one matched feature in the at least two images and an estimated difference parameter value, wherein the value for each difference parameter is determined serially.
    Type: Application
    Filed: June 8, 2012
    Publication date: May 7, 2015
    Inventors: Mihail Georgiev, Atanas Gotchev, Miska Hannuksela
  • Publication number: 20150124060
    Abstract: A technique is capable of improving the precision of a distance measurement made using a stereo camera, and is capable of reducing the size of a stereo camera device. The stereo camera is equipped with left and right imaging systems having left and right optical systems and left and right imaging elements, and derives the distance to an imaging target on the basis of an image signal acquired by imaging the imaging target by means of the left and right imaging systems. The light receiving surface of the left and right imaging elements in the left and right imaging systems is caused to bend in the direction of the optical axis so as to correct an aberration in the left and right optical systems.
    Type: Application
    Filed: November 3, 2014
    Publication date: May 7, 2015
    Inventors: Takayoshi Hasegawa, Katsuhisa Tanaka, Makoto Tsunoda
  • Patent number: 9025008
    Abstract: A stereoscopic image capturing apparatus includes an objective optical system that has a function of forming a subject as a real image or an imaginary image, a plurality of image forming optical systems that respectively form a plurality of subject light beams emitted from different paths of the objective optical system as parallax images again, using a plurality of independent optical systems, a plurality of imaging devices that convert the parallax images formed by the plurality of image forming optical system into image signals, and a control unit that adjusts a formation position of a convergence point such that a ratio of a focal length of the objective optical system and a distance in an optical axis direction of the objective optical system between a focal point of the objective optical system and a primary principal point of the image forming optical system is substantially constant.
    Type: Grant
    Filed: February 17, 2012
    Date of Patent: May 5, 2015
    Assignee: Sony Corporation
    Inventors: Sunao Aoki, Masahiro Yamada
  • Patent number: 9025007
    Abstract: A computer-implemented method for configuring stereo cameras includes detecting, in a computer system, a relocation of a manipulator in a virtual set. The manipulator defined in the computer system to specify an aspect of the virtual set. The method includes receiving an input in the computer system, the input specifying an aspect of a projection environment. The method includes configuring, using the relocation and the input, first and second cameras to capture a stereo view of a scene such that the stereo view is compatible for being projected in the projection environment.
    Type: Grant
    Filed: April 28, 2009
    Date of Patent: May 5, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Jed Parsons, Arkell Rasiah, Douglas Moore, Tom Martinek
  • Patent number: 9025009
    Abstract: An exemplary technique is provided for obtaining an improved depth precision for a stereo image of an object of interest. The technique includes imaging a first image of the object of interest from a first position, imaging a second image of the object of interest from a second position different from the first position, determining a rough estimate of a depth for the object of interest based on the first image and the second image, determining an improved set of imaging positions corresponding to an improved depth precision for the object of interest based on the rough estimate of the depth, imaging improved images from the improved set of imaging positions, and determining an improved depth based on the improved images.
    Type: Grant
    Filed: November 23, 2010
    Date of Patent: May 5, 2015
    Assignee: Alcatel Lucent
    Inventors: Sammy Lievens, Donny Tytgat, Jean-Francois Macq, Maarten Aerts
  • Publication number: 20150116463
    Abstract: A method and a multi-camera portable device for producing stereo images. The device has at least two image sensors, at least one of which is arranged on a first face of the portable device and a second one of which is arranged on a second face of the portable device opposite to the first face thereof. The method involves substantially simultaneously recording a first image containing a picture of an object and a second image containing a picture of a mirrored view of the object, obtaining the direction and the length of a mirroring vector from the distance ratio of a first distance in reality and a corresponding second distance in the second image, obtaining a capturing focal length of the second image sensor, and transforming the coordinate system of the first image sensor into the coordinate system of the virtual second image sensor to generate a stereo image pair.
    Type: Application
    Filed: October 26, 2014
    Publication date: April 30, 2015
    Applicant: LATERAL REALITY KFT.
    Inventor: Péter TORMA
  • Publication number: 20150116462
    Abstract: A vehicle control system executes a distance calculation process of detecting, corresponding points between a pair of captured images obtained by stereo-imaging , working out a coordinate shift between the corresponding points as a parallax, and calculating a distance up to each corresponding point based on the parallax; and a representative distance calculation process of dividing a distance image, in which a distance of each corresponding point is represented, into multiple strip regions that partition the image in a vertical direction, and working out, for each strip region, a distance for which a frequency is equal to or higher than a predefined value, as a representative distance. The system further executes a determination process of counting the number of representative distances within a monitoring region, and determining a magnitude relationship between the count value and a threshold value, to determine thereby the presence or absence of reflection.
    Type: Application
    Filed: October 22, 2014
    Publication date: April 30, 2015
    Inventor: Shunsuke MAKABE
  • Patent number: 9019350
    Abstract: A method for stereo rectifying a pair of images include: for each image of the pair of images, determining a position of an epipole in an image plane associated with a first camera orientation of a camera that captures the image; for each image of the pair of images, positioning the epipole in a center of a virtual image plane associated with a second camera orientation of the camera; subsequent to the positioning, aligning the pair of images relative to each other by rotating around a stereo base line that intersects the epipoles of the pair of images, and rotating the virtual image planes to position the virtual image plane substantially parallel to the stereo base line and their normal vectors substantially parallel to each other so as to obtain a stereo rectified pair of image planes. An embodiment of the invention also relates to a method and system for accurately determining the epipoles when they are unknown.
    Type: Grant
    Filed: April 12, 2012
    Date of Patent: April 28, 2015
    Assignee: Raytheon Company
    Inventor: Chet L. Richards
  • Patent number: 9019349
    Abstract: A motion-capture system is provided. The motion-capture system includes a host computing system and a plurality of motion-capture cameras that are operatively coupled with the host computing system. Each of the motion-capture cameras is disposed in a different location and orientation relative to a motion-capture space and includes a marker-tracking optical filter to provide a marker-tracking mode and thereby relatively enhance light from markers on a moving body in the motion-capture space. One or more of the motion-capture cameras is remotely controllable to selectively interchange the marker-tracking optical filter with a scene-view optical component, so as to selectively transition the motion-capture camera between the marker-tracking mode and a scene mode, in which light from the markers is less enhanced than in the marker-tracking mode.
    Type: Grant
    Filed: July 30, 2010
    Date of Patent: April 28, 2015
    Assignee: NaturalPoint, Inc.
    Inventor: James D. Richardson
  • Publication number: 20150109419
    Abstract: A method of balancing colors of three-dimensional (3D) points measured by a scanner from a first location and a second location. The scanner measures 3D coordinates and colors of first object points from a first location and second object points from a second location. The scene is divided into local neighborhoods, each containing at least a first object point and a second object point. An adapted second color is determined for each second object point based at least in part on the colors of first object points in the local neighborhood.
    Type: Application
    Filed: October 17, 2014
    Publication date: April 23, 2015
    Inventors: Joachim E. Vollrath, Martin Ossig
  • Publication number: 20150109418
    Abstract: A method for three-dimensional data acquisition, adapted to acquire three-dimensional data of an object, includes the following steps. A laser light is projected onto a plurality of regions on the surface of the object so as to form a plurality of features within each of the regions. For each of the regions, the object and the features are captured from a first direction and a second direction simultaneously so as to generate a first object image corresponding to the first direction and a second object image corresponding to the second direction. For each of the regions, the first object image and the second object image are processed so as to obtain the two-dimensional coordinates of the features therein. The three-dimensional data of the object is obtained according to the two-dimensional data of the features in the first object image and the second object image corresponding to each of the regions.
    Type: Application
    Filed: February 19, 2014
    Publication date: April 23, 2015
    Applicant: National Taiwan University of Science and Technology
    Inventor: Tzung-Han Lin
  • Publication number: 20150109420
    Abstract: Three-dimensional measurement apparatus comprises first and second imaging units with baseline length, feature point detector for detecting feature points in image, corresponding point detector for detecting corresponding points corresponding to the feature points, rotation matrix calculator, translation matrix calculator, distance calculator, and data calculator. Based on the feature points and the corresponding points, the rotation matrix calculator calculates a rotation matrix representing direction and amount of rotation of a second image capture position relative to a first image capture position and the translation matrix calculator calculates a translation matrix representing a translation direction of the second image capture position relative to the first image capture position. Based on the rotation matrix, the translation matrix, and the baseline length, the distance calculator calculates a translation distance to the second image capture position relative to the first image capture position.
    Type: Application
    Filed: December 22, 2014
    Publication date: April 23, 2015
    Applicant: FUJIFILM Corporation
    Inventor: Tomonori MASUDA
  • Publication number: 20150109421
    Abstract: Disclosed a stereo-approach distance and speed meter system comprising: video camera module consisting of at least two video cameras focused on the analyzed object primary interface module for video camera module interface conversion into data for processing; primary image normalization and rectification module; updating data container module; attribute extraction module; attribute ranking module; primary attribute reorganization module; primary frame matching module; primary hypothesis generation module; primary hypothesis filter module; attribute post-organization module; secondary attribute matching module; secondary hypothesis generation module; secondary filter module; buffer improvement module, stereo refinement module; sequence refinement module; triangulation module; secondary rectification module; previous frame data and attribute container module; secondary interface module.
    Type: Application
    Filed: December 29, 2014
    Publication date: April 23, 2015
    Inventors: Alexandr A. PIMINOV, Vladimir V. UFNAROVSKY, Timofey A. BRYKSIN, Andrey N. TEREKHOV
  • Patent number: 9013556
    Abstract: A 3D image capturing device and a controller chip thereof. The controller chip includes a first and a second sensor interface, a pixel data synchronization module, a 3D image generator and an output interface. The first and second sensor interfaces are coupled to a first and a second 2D image capturing device, respectively, to receive a first and a second image. The pixel data synchronization module synchronizes the pixel data of the first and second images. Based on the synchronized first and second images, the 3D image generator generates a 3D-image. By the output interface, the 3D-image capturing device transmits the generated 3D image to be received by a host.
    Type: Grant
    Filed: August 31, 2011
    Date of Patent: April 21, 2015
    Assignee: Silicon Motion, Inc.
    Inventor: Yung-Wei Chen
  • Patent number: 9013558
    Abstract: Systems and methods according to principles disclosed here provide a screen space transform, e.g., implemented as a node, that may be employed to correct alignment issues between left and right eyes of a native stereo plate. The transformations may be in a number of homographic ways, including via translation, rotation, and scaling. By properly aligning stereographic images, subsequent images are properly aligned throughout the animation pipeline. In addition, the viewer experience is significantly improved.
    Type: Grant
    Filed: July 2, 2012
    Date of Patent: April 21, 2015
    Assignees: Sony Corporation, Sony Pictures Technologies Inc.
    Inventor: Benjamin Hendricks
  • Publication number: 20150103146
    Abstract: Methods, apparatuses, and devices are described for converting non-stereo cameras into a stereo camera. At least one optical element may be used to temporarily change an effective position and an effective orientation of a first non-stereo camera. The changed effective position may be displaced from an effective position of a second non-stereo camera by a predetermined distance, and the changed effective orientation may provide the first non-stereo camera with a field of view that overlaps a field of view of the second non-stereo camera. The at least one optical element may be used to capture a first image with the first non-stereo camera. A second image may be captured with the second non-stereo camera. The second image may have a frame of reference displaced from a frame of reference of the first image by the predetermined distance.
    Type: Application
    Filed: October 16, 2013
    Publication date: April 16, 2015
    Applicant: QUALCOMM Incorporated
    Inventors: Gregory Gordon Rose, Franklin Peter Antonio, Chong Uk Lee
  • Publication number: 20150103148
    Abstract: A three-dimensional measurement apparatus comprises first and second imaging units, with a baseline length, a feature point detector, a corresponding point detector, a rotation matrix calculator, a translation matrix calculator, an epipolar line calculator, an evaluator, and a data calculator. The rotation matrix calculator and the translation matrix calculator calculate matrices representing directions of rotation and translation between the imaging positions A and B. The epipolar line calculator calculates an epipolar line, which is supposed to be passing through a specific feature point, on an image based on the rotation and translation matrices, and an assumed virtual translation distance. The evaluator evaluates whether the epipolar lines, calculated based on different virtual translation distances, pass through a corresponding point.
    Type: Application
    Filed: December 19, 2014
    Publication date: April 16, 2015
    Applicant: FUJIFILM CORPORATION
    Inventor: Tomonori MASUDA
  • Publication number: 20150103147
    Abstract: A calibration method of a stereo camera includes controlling a left eye image capture unit and a right eye image capture unit of the stereo camera to execute an image capture operation on a calibration pattern with a plurality of feature points to generate a left eye image and a right eye image, respectively; extracting a plurality of first feature points and a plurality of second feature points corresponding to the plurality of feature points from the left eye image and the right eye image, respectively; calculating camera calibration parameters corresponding to extrinsic parameters of the stereo camera according to the plurality of first feature points, the plurality of second feature points, and intrinsic parameters of the stereo camera; and executing an camera calibration process on the left eye image capture unit and the right eye image capture unit according to the camera calibration parameters, respectively.
    Type: Application
    Filed: October 14, 2014
    Publication date: April 16, 2015
    Inventors: Ming-Che Ho, Wen-Kuo Lin
  • Patent number: 9007441
    Abstract: A system of stereo imagers, including image processing units and methods of blurring an image, is presented. The image is received from an image sensor. For each pixel of the image, a depth filter component is determined based on a focal area of the image and a depth map associated with the image. For each pixel of the image, a trilateral filter is generated that includes a spatial filter component, a range filter component and the depth filter component. The respective trilateral filter is applied to corresponding pixels of the image to blur the image outside of the focal area. A refocus area or position may be determined by imaging geometry or may be selected manually via a user interface.
    Type: Grant
    Filed: January 31, 2012
    Date of Patent: April 14, 2015
    Assignee: Semiconductor Components Industries, LLC
    Inventors: Yajie Sun, David R. Pope, Elaine Wenying Jin
  • Publication number: 20150097930
    Abstract: A first camera for capturing an image of a subject, a second camera for capturing an image of a subject, an optical component disposed on an optical path when the first camera images a subject, and on an optical path when the second camera images a subject, and an adjuster for adjusting a distance between an optical axis of the first camera and an optical axis of the second camera by moving at least one of the first camera and the second camera horizontally are included. The adjuster can move at least one of the first camera and the second camera horizontally in a wider range when a zoom ratio of the first camera and the second camera is a first ratio than when the zoom ratio is a second ratio that is lower than the first ratio.
    Type: Application
    Filed: December 12, 2014
    Publication date: April 9, 2015
    Inventors: Takashi MASUNO, Tatsuro JURI, Hiroaki SHIMAZAKI, Kenjiro TSUDA, Yuji NAGAISHI
  • Publication number: 20150097768
    Abstract: The technology disclosed relates to enhancing the fields of view of one or more cameras of a gesture recognition system for augmenting the three-dimensional (3D) sensory space of the gesture recognition system. The augmented 3D sensory space allows for inclusion of previously uncaptured of regions and points for which gestures can be interpreted i.e. blind spots of the cameras of the gesture recognition system. Some examples of such blind spots include areas underneath the cameras and/or within 20-85 degrees of a tangential axis of the cameras. In particular, the technology disclosed uses a Fresnel prismatic element and/or a triangular prism element to redirect the optical axis of the cameras, giving the cameras fields of view that cover at least 45 to 80 degrees from tangential to the vertical axis of a display screen on which the cameras are mounted.
    Type: Application
    Filed: October 3, 2014
    Publication date: April 9, 2015
    Applicant: Leap Motion, Inc.
    Inventors: David S. HOLZ, Paul DURDIK
  • Publication number: 20150097929
    Abstract: Disclosed are various embodiments for rendering multiple video streams in a display. A mobile computing device configured to perform a scan of an object utilizing the at least one imaging device may generate a first video stream utilizing the at least one imaging device. The mobile computing device may access a second video stream comprising at least a three-dimensional reconstruction of the object subject to the scan and may render the first video stream and the second video stream in a display in data communication with the mobile computing device.
    Type: Application
    Filed: October 9, 2013
    Publication date: April 9, 2015
    Inventors: Harris Bergman, Giorgos Hatzilias, Karol Hatzilias, Ruizhi Hong, Wess Eric Sharpe, Amy Stone
  • Patent number: 9001186
    Abstract: In order to make it possible to reduce stereographic disturbances without image processing methods, it is proposed that pixels in the images each be associated with a distance from a distance model. The distance is an assumed distance from an object, which is imaged at that pixel, to at least one predetermined point, the distance model associates the distance in dependence on the position of the pixels in the recorded image. The image fusion is carried out using the associated distances.
    Type: Grant
    Filed: May 18, 2012
    Date of Patent: April 7, 2015
    Assignee: Diehl BGT Defence GmbH & Co. KG
    Inventor: Florian Gagel
  • Publication number: 20150092020
    Abstract: An ambulatory system to communicate visual projections. An embodiment of an apparatus for ambulatory communication includes: a propulsion system to enable the apparatus to fly, including to hover in place and to follow a user; a stereo camera to record an image of a user of the apparatus or a scene nearby the user of the apparatus; a transmitter to transmit video data generated by the stereo camera to a second apparatus via network for a communication with a remote user; a receiver to receive video data via the network from the remote user; and a video projection mechanism to project an image including the received video to the user.
    Type: Application
    Filed: September 27, 2013
    Publication date: April 2, 2015
    Inventor: Robert L. Vaughn
  • Publication number: 20150092021
    Abstract: First and second images are captured at first and second focal lengths, the second focal length being longer than the first focal length. Element sets are defined with a first element of the first image and a corresponding second element of the second image. Element sets are identified as background if the second element thereof is more in-focus than or as in-focus as the first element. Background elements are subtracted from further analysis. Comparisons are based on relative focus, e.g. whether image elements are more or less in-focus. Measurement of absolute focus is not necessary, nor is measurement of absolute focus change; images need not be in-focus. More than two images, multiple element sets, and/or multiple categories and relative focus relationships also may be used.
    Type: Application
    Filed: December 8, 2014
    Publication date: April 2, 2015
    Inventors: Mohamed Nabil Hajj Chehade, Sina Fateh, Sleiman Itani, Allen Yang Yang
  • Patent number: 8994807
    Abstract: A system (100) and method for creating three dimensional images using probe molecules is disclosed and described. A sample is mounted on a stage (160). The sample has a plurality of probe molecules. The sample is illuminated with light, causing the probe molecules to luminesce. The probe luminescence can be split into at least four paths corresponding to at least four detection planes corresponding to object planes in the sample. The at least four detection planes are detected via a camera (155). Object planes in corresponding recorded regions of interest are recorded in the camera (155). A signal from the regions of interest is combined into a three dimensional image.
    Type: Grant
    Filed: March 18, 2010
    Date of Patent: March 31, 2015
    Assignees: University of Utah Research Foundation, University of Maine System Board of Trustees, The Jackson Laboratory
    Inventors: Brian Thomas Bennett, Joerg Bewersdorf, Erik Jorgensen, Sam Hess, Travis Gould, Mudalige Siyath Gunewardene
  • Patent number: 8994826
    Abstract: Portable wireless mobile device motion capture and analysis system and method configured to display motion capture/analysis data on a mobile device. System obtains data from motion capture elements and analyzes the data. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Ratings associated with the captured motion can also be displayed. Predicted ball flight path data can be calculated and displayed. Data shown on a time line can also be displayed to show the relative peaks of velocity for various parts of the user's body. Based on the display of data, the user can determine the equipment that fits the best and immediately purchase the equipment, via the mobile device. Custom equipment may be ordered through an interface on the mobile device from a vendor that can assemble-to-order customer built equipment and ship the equipment.
    Type: Grant
    Filed: August 26, 2010
    Date of Patent: March 31, 2015
    Assignee: Blast Motion Inc.
    Inventor: Michael Bentley
  • Patent number: 8994775
    Abstract: A handheld communication device is used to capture video streams and generate a multiplexed video stream. The handheld communication device has at least two cameras facing in two opposite directions. The handheld communication device receives a first video stream and a second video stream simultaneously from the two cameras. The handheld communication device detects a speech activity of a person captured in the video streams. The speech activity may be detected from direction of sound or lip movement of the person. Based on the detection, the handheld communication device automatically switches between the first video stream and the second video stream to generate a multiplexed video stream. The multiplexed video stream interleaves segments of the first video stream and segments of the second video stream. Other embodiments are also described and claimed.
    Type: Grant
    Filed: May 15, 2013
    Date of Patent: March 31, 2015
    Assignee: Apple Inc.
    Inventors: Jae Han Lee, E-Cheng Chang
  • Patent number: 8995712
    Abstract: A method for automatically detecting and tracking multiple targets in a multi-camera surveillance zone and system thereof. In each camera view of the system only a simple object detection algorithm is needed. The detection results from multiple cameras are fused into a posterior distribution, named TDP, based on the Bayesian rule. This TDP distribution represents a likelihood of presence of some moving targets on the ground plane. To properly handle the tracking of multiple moving targets with time, a sample-based framework which combines Markov Chain Monte Carlo (MCMC), Sequential Monte Carlo (SMC), and Mean-Shift Clustering, is provided. The detection and tracking accuracy is evaluated by both synthesized videos and real videos. The experimental results show that this method and system can accurately track a varying number of targets.
    Type: Grant
    Filed: June 10, 2009
    Date of Patent: March 31, 2015
    Assignee: National Chiao Tung University
    Inventors: Ching-Chun Huang, Sheng-Jyh Wang
  • Publication number: 20150085080
    Abstract: Disclosed is a structured light 3D scanner based on the principle of triangulation with a light source for generating a light pattern, two cameras with two-dimensional sensors recording the reflection of the light pattern from a target object, and one axis moving the cameras. Wherein the cameras are arranged with at least partly overlapping fields of view and where the sensors in the cameras are read out partially and concurrently during at least some period of the scanning process, thus providing partial images and where the partial images are merged prior to performing the triangulation calculations.
    Type: Application
    Filed: April 17, 2013
    Publication date: March 26, 2015
    Inventors: Karl-Josef Hollenbeck, Stefan Elmsted Jensen, Thomas Allin Højgaard, Henrik Öjelund
  • Publication number: 20150085081
    Abstract: A medical three-dimensional observation apparatus includes at least a pair of imaging units, a three-dimensional image processing unit, a calculating unit, and an index superimposing unit. The imaging units image a .specimen from different viewpoints. The three-dimensional image processing unit displays a three-dimensional image of the specimen on a display in accordance with images of the specimen. The calculating unit calculates a region of a three-dimensional reproduction space of the display in which the three-dimensional image of the specimen is to be reproduced. The index superimposing unit superimposes an annotation image on a depth position corresponding to the region in which the three-dimensional image is reproduced.
    Type: Application
    Filed: December 1, 2014
    Publication date: March 26, 2015
    Inventor: Keiji SHIODA
  • Patent number: 8988509
    Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
    Type: Grant
    Filed: March 20, 2014
    Date of Patent: March 24, 2015
    Assignee: GoPro, Inc.
    Inventors: Timothy Macmillan, Scott Patrick Campbell, David A. Newman, Yajie Sun
  • Patent number: 8988507
    Abstract: A camera includes a lens assembly and a stereoscopic display for displaying an image captured by the camera, and automatically determines a correct focus for the camera using the stereoscopic display to show an icon on the image appearing to move perpendicularly, relative to a first plane corresponding to a surface of the stereoscopic display, from different perceived depths corresponding to different planes parallel to the first plane.
    Type: Grant
    Filed: November 19, 2009
    Date of Patent: March 24, 2015
    Assignees: Sony Corporation, Sony Mobile Communications AB
    Inventor: Mats Wernersson
  • Patent number: 8988508
    Abstract: An embodiment of the invention provides an active illumination imaging system comprising a first camera and a second camera, each having an optical axis and a field of view (FOV) characterized by a view angle in a plane that contains the optical axis and wherein the optical axes of the cameras intersect at an intersection region common to their FOVs at an angle substantially equal to half a sum of their view angles.
    Type: Grant
    Filed: September 24, 2010
    Date of Patent: March 24, 2015
    Assignee: Microsoft Technology Licensing, LLC.
    Inventors: Giora Yahav, David Cohen
  • Publication number: 20150077520
    Abstract: An information processor includes a detection plane definition portion defining a detection plane in a 3D space of a camera coordinate system of a first camera and calculates vertex coordinates of a detection area by projecting the detection plane onto a plane of a left image shot by the first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area. The parallax correction area is obtained by moving, to a left, an area of a right image identical to the detection area of the left image by as much as the parallax appropriate to a position of the detection plane in a depth direction. A matching portion performs block matching for the feature point images of each area, thus deriving a highly rated feature point.
    Type: Application
    Filed: April 11, 2013
    Publication date: March 19, 2015
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada
  • Publication number: 20150077519
    Abstract: An endoscope with a stereoscopic optical channel is held and positioned by a robotic surgical system. A capture unit captures (1) a visible first image and (2) a visible second image combined with a fluorescence second image from the light. An intelligent image processing system receives (1) the visible first image and (2) the visible second image combined with the fluorescence second image and generates at least one fluorescence image of a stereoscopic pair of fluorescence images and a visible second image. An augmented stereoscopic display system outputs a real-time stereoscopic image including a three-dimensional presentation including in one eye, a blend of the at least one fluorescence image of a stereoscopic pair of fluorescence images and one of the visible first and second images; and in the other eye, the other of the visible first and second images.
    Type: Application
    Filed: July 16, 2014
    Publication date: March 19, 2015
    Inventors: David Scott, Wenyi Zhao, Brian D. Hoffman, John D. Stern, Tao Zhao
  • Publication number: 20150077521
    Abstract: In an exemplary embodiment, a method for producing a stereo film is provided, wherein a first image that is supplied (10) by a first camera rig having at least two cameras is followed (50) by a second image from a second camera rig, wherein furthermore a disparity table for definition of the displacement of a defined image point in a first sub-frame supplied by a first camera of the first camera rig relative to an image point similar thereto in a second sub-frame supplied by a second camera of the first camera rig is determined (20, 30) in order to obtain information about the depth of the first image composed of the first sub-frame and the second sub-frame, wherein the depth information of the disparity table of the first image of the first camera rig is used (60) for processing of the second image of the second camera rig. The invention also relates to controlling (means) or regulating means for a plurality of 3D cameras configured to carry out said method.
    Type: Application
    Filed: September 22, 2014
    Publication date: March 19, 2015
    Inventors: Martin Borchert, Howard Postley
  • Publication number: 20150077522
    Abstract: According to one embodiment, a solid state imaging device includes a first imaging device, a second imaging device, and a calculating unit. The first imaging device includes a first optical system, a first imaging unit, and a second optical system provided between the first optical system and the first imaging unit. The second imaging device includes a third optical system, a second imaging unit, and a fourth optical system provided between the third optical system and the second imaging unit. The calculating unit is configured to perform a first calculation and a second calculation. The first calculation includes deriving a first distance from stereo disparity. The second calculation includes deriving a second distance from a parallax image. The calculating unit is configured to estimate a target distance based on at least one selected from the first distance and the second distance.
    Type: Application
    Filed: August 5, 2014
    Publication date: March 19, 2015
    Applicant: Kabushiki Kaisha Toshiba
    Inventors: Kazuhiro SUZUKI, Risako UENO, Mitsuyoshi KOBAYASHI, Honam KWON, Hideyuki FUNAKI
  • Patent number: 8982189
    Abstract: A stereoscopic video reproduction device comprising a first acquisition unit; a second acquisition unit; a decision unit; a parallax correction unit configured to correct a parallax when the binocular fusion is impossible, such that the binocular fusion becomes possible in the stereoscopic video in a predetermined interval in which the binocular fusion is decided to be impossible; and an output unit configured to: when outputting the acquired stereoscopic video to the stereoscopic display, output, to the stereoscopic display, the stereoscopic video in which the parallax is corrected in the stereoscopic video by the parallax correction unit in the predetermined interval in which the binocular fusion is decided to be impossible in a case where the decision unit decides that the binocular fusion is impossible; and output the acquired stereoscopic video as is to the stereoscopic display in a case where the decision unit decides that the binocular fusion is possible.
    Type: Grant
    Filed: July 30, 2013
    Date of Patent: March 17, 2015
    Assignee: FUJIFILM Corporation
    Inventor: Satoshi Nakamura
  • Patent number: 8984061
    Abstract: The conferencing system is composed of computers, a moderator's computer, and a projector connected on a network. The moderator's computer receives image data from the computers, and generates synthesized image data therefrom, which is transmitted to the projector for display of the synthesized image. The moderator's computer has the capability to switch the image being projected by the projector from the synthesized image to an image handled by one of the computers or by the moderator's computer. With such an arrangement, utilizing existing hardware resources it will be possible to display in a single split-screen display the images handled by the terminals connected on the network. Additionally, it will be possible to switch smoothly between on-screen displays, and to reduce the burden on the on-screen display operator in a networked conferencing system.
    Type: Grant
    Filed: August 6, 2008
    Date of Patent: March 17, 2015
    Assignee: Seiko Epson Corporation
    Inventor: Noboru Inoue
  • Publication number: 20150070471
    Abstract: Methods and devices acquire images using a stereo camera or camera network aimed at a first location. The first location comprises multiple parallel primary lanes merging into a reduced number of at least one secondary lane, and moving items within the primary lanes initiate transactions while in the primary lanes and complete the transactions while in the secondary lane. Such methods and devices calculate distances of the moving items from the camera to identify in which of the primary lanes each of the moving items was located before merging into the secondary lane. These methods and devices then order the transactions in a merge order corresponding to a sequence in which the moving items entered the secondary lane from the primary lanes. Also, the methods and devices output the transactions in the merge.
    Type: Application
    Filed: September 10, 2013
    Publication date: March 12, 2015
    Applicant: XEROX CORPORATION
    Inventors: Robert P. Loce, Wencheng Wu, Thomas F. Wade, Daniel S. Hann, Peter Paul, Aaron M. Burry
  • Publication number: 20150070472
    Abstract: The present invention provides measuring apparatus and method for three-dimensional profilometry of an object, wherein a random-speckle beam and a structured fringe beam are projected onto the object and reflected therefrom for forming deformed random-speckle beam and structured fringe beams that are separately acquired by an image acquiring device thereby obtaining a random-speckle image utilized to determine an absolute phase information of each position on the surface of the object, and a structured fringe image utilized to determine a relative phase information for each position of the surface of the object. Each absolute phase information and each relative phase information corresponding to each position are converted into an absolute depth and a relative depth, respectively. Finally, the depth information of each position on the surface of the object is calculated by combining the corresponding absolute depth and the relative depth whereby the surface profile of the object can be established.
    Type: Application
    Filed: September 11, 2014
    Publication date: March 12, 2015
    Inventors: Liang-Chia CHEN, Chung-An HSIEH, Ming-Xuan WENG
  • Publication number: 20150062303
    Abstract: An exemplary embodiment of a 3D camera system for a patient positioning and monitoring system is described. In the system a pair of image detectors are provided where the image detectors are each associated with a heater thermally connected to conducting pads provided at the periphery of the image detectors. The heaters and conducting pads act to contain the image detectors in a substantially constant temperature micro climate thereby preventing external temperature variations from causing the relative positions of the image detectors to change so as to record portions of images as different pixels and hence reduce the consistency with which the identification of matching portions of images obtained by the image detectors can be utilized to determine the 3D positions of imaged objects.
    Type: Application
    Filed: April 25, 2013
    Publication date: March 5, 2015
    Inventors: Peter Hanson, Gideon Hale
  • Publication number: 20150062304
    Abstract: An imaging system for a vehicle may include a first image capture device having a first field of view and configured to acquire a first image relative to a scene associated with the vehicle, the first image being acquired as a first series of image scan lines captured using a rolling shutter. The imaging system may also include a second image capture device having a second field of view different from the first field of view and that at least partially overlaps the first field of view, the second image capture device being configured to acquire a second image relative to the scene associated with the vehicle, the second image being acquired as a second series of Image scan lines captured using a rolling shutter. As a result of overlap between the first field of view and the second field of view, a first overlap portion of the first image corresponds with a second overlap portion of the second image.
    Type: Application
    Filed: November 6, 2014
    Publication date: March 5, 2015
    Applicant: MOBILEYE VISION TECHNOLOGIES LTD.
    Inventors: Gideon STEIN, Efim BELMAN
  • Patent number: 8970677
    Abstract: A system for the vergence of images from a plurality of cameras, the system provides a first camera; a second camera disposed at some distance from that first camera; a focus adjustment whereby the focus of the first camera can be adjusted by a user; the focus adjustment being configured with a range finder whereby the distance from the first camera to a target is ascertained; a look up chart wherein divergence distance of images generated from the first camera from images of the second camera are provided for pre-calculated ranges; and a processor whereby the images generated by the first camera are superimposed on the images generated by the second camera by the divergence distance determined from the lookup.
    Type: Grant
    Filed: February 19, 2008
    Date of Patent: March 3, 2015
    Assignee: BAE Systems Information and Electronic Systems Integration Inc.
    Inventor: Francis M Feda
  • Patent number: 8970680
    Abstract: A monoscopic low-power mobile device is capable of creating real-time stereo images and videos from a single captured view. The device uses statistics from an autofocusing process to create a block depth map of a single capture view. Artifacts in the block depth map are reduced and an image depth map is created. Stereo three-dimensional (3D) left and right views are created from the image depth map using a Z-buffer based 3D surface recover process and a disparity map which is a function of the geometry of binocular vision.
    Type: Grant
    Filed: August 1, 2006
    Date of Patent: March 3, 2015
    Assignee: Qualcomm Incorporated
    Inventors: Haohong Wang, Hsiang-Tsun Li, Sharath Manjunath
  • Patent number: 8970679
    Abstract: A three dimensional camera device and a method of controlling the same are provided. The three dimensional camera device and the method enable a user to photograph a three dimensional image suitable for a photographing angle. Since a swing hinge rotates a left camera element and a right camera element about a mid-point between the left camera element and the right camera element, a user may photograph a three dimensional image suitable for a photographing angle.
    Type: Grant
    Filed: December 2, 2011
    Date of Patent: March 3, 2015
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Bo Ram Namgoong, Hwang Joon Lee