Picture Signal Generators (epo) Patents (Class 348/E13.074)
  • Patent number: 11924542
    Abstract: An accuracy estimation apparatus includes at least one processor and/or at least one circuit that functions as an obtainment unit configured to obtain a shooting condition for a plurality of parallax images that mutually exhibit parallax, and an estimation unit configured based on the shooting condition, to estimate an accuracy of dimension measurement that is performed using the plurality of parallax images.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: March 5, 2024
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Satoru Komatsu, Yosuke Eguchi, Takuya Ishibashi
  • Patent number: 11917276
    Abstract: Provided are an imaging device and an imaging method that can generate images between which a difference in appearance caused by a difference between the polarization directions of received light is suppressed in a case in which different images are generated on the basis of light having different polarization directions.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: February 27, 2024
    Assignee: FUJIFILM Corporation
    Inventor: Shuji Ono
  • Patent number: 11908077
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Grant
    Filed: January 27, 2023
    Date of Patent: February 20, 2024
    Assignee: HOVER Inc.
    Inventors: Ajay Mishra, Manish Upendran, A. J. Altman, William Castillo
  • Patent number: 11893695
    Abstract: A VR (Virtual Reality) simulator projects or displays a virtual space image on a screen installed at a position distant from a user in a real space and not integrally moving with the user. More specifically, the VR simulator acquires a real user position being a position of the user's head in the real space. The VR simulator acquires a virtual user position being a position in a virtual space corresponding to the real user position. Then, the VR simulator acquires the virtual space image by imaging the virtual space by using a camera placed at the virtual user position in the virtual space, based on virtual space configuration information indicating a configuration of the virtual space. Here, the VR simulator performs adjusts a focal length of the camera such that perspective corresponding to a distance between the real user position and the screen is cancelled.
    Type: Grant
    Filed: May 26, 2022
    Date of Patent: February 6, 2024
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventor: Wataru Kaku
  • Patent number: 11895170
    Abstract: Embodiments for virtual reality (VR) and augmented reality (AR) scenes updates at VR/AR devices in a network are described. Network traffic for the scene updates is divided into traffic layers such as coarse grain (CG) layer traffic and a fine grain (FG) layer traffic for a give VR/AR scene update. The CG layer traffic is scheduled first in resource units (RUs) of a plurality a transmission opportunity (TXOP) for a VR device and FG layer traffic is scheduled in remaining RUs during the TXOP to provide synchronous viewing experiences to users of the VR/AR devices.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: February 6, 2024
    Assignee: Cisco Technology, Inc.
    Inventors: Sergio Mena, Lorenzo Granai, Malcolm M. Smith, Jerome Henry
  • Patent number: 11882260
    Abstract: Cost-effective, spatially representative image data is recording in a stereoscopic or photogrammetric image of an environment by a camera apparatus having three holographic-optical elements arranged as coupling regions at different positions on a carrier medium to capture the environment from different perspectives. Light from the environment is coupled by the coupling regions into the carrier medium which provides a light guide that transfers the light to an additional holographic-optical element which provides a decoupling region to decouple the light from the carrier medium. An image capture device captures the decoupled light and produces image data therefrom. A separating device produces the spatially representative image data from the image data by capturing the light incident on the coupling regions in a manner separated temporally or by color.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: January 23, 2024
    Assignee: AUDI AG
    Inventors: Markus Klug, Tobias Moll, Johannes Scheuchenpflug
  • Patent number: 11877076
    Abstract: Provided are an imaging device and an imaging method that can suppress a difference in appearance caused by a difference between the polarization directions of received light in a case in which different images are generated on the basis of light having different polarization directions, have flexibility in the design of the polarization direction of light forming different images, and can generate a plurality of images having a uniform amount of light.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: January 16, 2024
    Assignee: FUJIFILM Corporation
    Inventor: Shuji Ono
  • Patent number: 11843894
    Abstract: An electronic apparatus includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic apparatus to perform control to display an image in a display unit based on a third image including a first image captured through a first optical system, and a second image having a parallax with respect to the first image, captured through a second optical system, receive an enlargement instruction for enlarging a part of the image displayed in the display unit, and perform control, upon reception of the enlargement instruction while the third image is displayed, to display in the display unit an enlarged image including an enlarged portion of either one of the first image and the second image.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: December 12, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Koichi Nakagawa
  • Patent number: 11831857
    Abstract: A structured light scanning method includes a light projector projecting a group of structured light to an object, an image capturing device capturing a group of images generated by the object reflecting the group of structured light, an image processor obtaining a pixel luminosity distribution of an image in the group of images, the image processor determining a reflection state of the image from the pixel luminosity distribution, the image processor determining whether to include the image in generating a depth map according to the reflection state, and the image processor decoding at least one image from the group of images to generate the depth map.
    Type: Grant
    Filed: June 1, 2022
    Date of Patent: November 28, 2023
    Assignee: Qisda Corporation
    Inventors: Chuang-Wei Wu, Yen-Tsun Lin
  • Patent number: 11769293
    Abstract: A camera motion estimation method for an augmented reality tracking algorithm according to an embodiment is a camera motion estimation method for an augmented reality tracking algorithm performed by a sequence production application executed by a processor of a computing device, which includes a step of displaying a target object on a sequence production interface, a step of setting a virtual camera trajectory on the displayed target object, a step of generating an image sequence by rendering images obtained when the target object is viewed along the set virtual camera trajectory, and a step of reproducing the generated image sequence.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: September 26, 2023
    Assignee: VIRNECT CO., LTD.
    Inventors: Ki Young Kim, Benjamin Holler
  • Patent number: 11651538
    Abstract: An approach for creating instructional 3D animated videos, without physical access to the object or to the object CAD models as a prerequisite is disclosed. The approach allows the user to submit some images or a video of the object and a knowledge about the required procedure. The required procedures includes, adding the instructions and text annotations. The approach will build a 3D model based on the submitted images and/or video. The approach will generate the instructional animated video based on the 3D model and the required procedure.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: May 16, 2023
    Assignee: International Business Machines Corporation
    Inventors: Adi Raz Goldfarb, Tal Drory, Oded Dubovsky
  • Patent number: 11457202
    Abstract: Provided is an imaging device that can acquire three independent high-quality images using one imaging element. An imaging device includes: an optical system (10) including three optical regions (12A, 12B, 12C) that transmit light in different polarization directions; an imaging element (100) including a plurality of pixel units each of which is a set of three pixels that receive light in different polarization directions; and an image processing unit (200) that calculates three pixel signals (X1, X2, X3) corresponding to each of the optical regions (12A, 12B, 12C) of the optical system (10) from three pixel signals (x1, x2, x3) obtained from each pixel unit of the imaging element (100) to generate an image of each of the optical regions (12A, 12B, 12C).
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: September 27, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Shuji Ono
  • Patent number: 11435297
    Abstract: Provided is an image capture method including: illuminating an object having known label data, capturing images of the object using illumination parameters, and acquiring captured images; generating an estimated image of the object at the time of illumination based on the illumination parameter on the basis of an image data set obtained by associating a captured image with an illumination parameter; setting a maximum number of captured images permitted for the object; and performing learning with a machine learning model for each number of images equal to or smaller than the maximum number of captured images, optimizing illumination parameters and inspection algorithm parameters on the basis of a result of comparison between a result of estimation of the machine learning model and the label data of the object, calculating an index representing inspection performance expected when the each number of images is captured, and presenting the index to a user.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: September 6, 2022
    Assignee: OMRON Corporation
    Inventor: Yosuke Naruse
  • Patent number: 11416972
    Abstract: A system and method for reflection removal of an image from a dual-pixel sensor. The image including a left view and a right view. The method including: determining a first gradient of the left view and a second gradient of the right view; determining disparity between the first gradient and the second gradient using a sum of squared differences (SSD); determining a confidence value at each pixel using the SSD; determining a weighted gradient map using the confidence values; minimizing a cost function to estimate the background layer, the cost function including the weighted gradient map, wherein the image includes the background layer added to a reflection layer; and outputting at least one of the background layer and the reflection layer.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: August 16, 2022
    Inventors: Abhijith Punnappurath, Michael Brown
  • Patent number: 11410275
    Abstract: A video super resolution (SR) method based on video coding for machine (VCM) is provided for an electronic device. The method includes obtaining a lower resolution (LR) video; generating feature representations of the LR video based on a deep neural network (DNN); encoding the feature representations of the LR video, based on a VCM standard, and the LR video to form encoded feature representations of the LR video and an encoded LR video, wherein the feature representations of the LR video contain both space and temporal information on the LR video for creating a high resolution (HR) video corresponding to the LR video; and storing and transferring the encoded feature representations of the LR video and an encoded LR video for decoding.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: August 9, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Jiang, Wei Wang, Shan Liu
  • Patent number: 9036010
    Abstract: A digital display interface (40) connects a first audio-visual device (10) to a second audio-visual device (20). Stereoscopic image data is transmitter over the display interface (40). Components of stereoscopic image data are multiplexed and inserted into an image data carrying element. An existing deep color mode can be re-used for this purpose. Signaling information to help identify or decode the stereoscopic image data is carried in auxiliary data carrying elements. Stereoscopic image data can be distributed between image data carrying data elements and auxiliary data carrying data elements. Auxiliary data carrying elements can be transmitted in horizontal or vertical blanking periods, and can comprise HDMI Data Island Packets. Stereoscopic image data can be sent over an auxiliary data channel. The auxiliary data channel can form part of the same cable as is used to carry a primary channel of the display interface, a separate cable, or a wireless link.
    Type: Grant
    Filed: December 15, 2008
    Date of Patent: May 19, 2015
    Assignee: Koninklijke Philips N.V.
    Inventor: Nicoll Burleigh Shepherd
  • Patent number: 9013553
    Abstract: In embodiments, a virtual advertising platform may use a three-dimensional mapping algorithm to insert a virtual image within a digital video stream. The virtual advertising platform may apply a three-dimensional mapping algorithm to the virtual digital image, wherein the three-dimensional mapping algorithm causes the virtual digital image to be recomposited within a plurality of frames within a received two-dimensional digital data feed in place of a spatial region within the two-dimensional data feed. The mapping algorithm may enable application of analogous geometric changes to the virtual digital image that are present in the spatial region within the plurality of video frames within the two-dimensional digital video data feed, and may send the recomposited digital data feed for display to a user, wherein the recomposited digital data feed is a virtualized digital data feed that includes the virtual digital image in place of the spatial region.
    Type: Grant
    Filed: February 24, 2012
    Date of Patent: April 21, 2015
    Assignee: Rocks International Group Pte Ltd.
    Inventor: Karel Paul Stephan
  • Patent number: 9013547
    Abstract: The disclosure is disclosed an apparatus of processing an image and a method thereof. According to the present invention, the method of transmitting a broadcast signal for 3-dimensional, 3D, service, may include encoding video data for a 3D service into a stream, generating first service information including a first descriptor including first information for specifying that a type of the stream is a video stream and second information for specifying a type of a component included in the video stream is a 3D video component and transmitting a broadcast signal including the encoded stream and the generated service information.
    Type: Grant
    Filed: April 29, 2011
    Date of Patent: April 21, 2015
    Assignee: LG Electronics Inc.
    Inventors: Jong Yeul Suh, Jin Pil Kim, Jee Hyun Choe, Ho Taek Hong, Kwan Suk Kim
  • Patent number: 9007443
    Abstract: A camera objective for a camera includes a mask having a plurality of masking sections which are permeable for radiation of a first spectral range and are impermeable for radiation of a second spectral range different from the first spectral range. A camera system includes a digital camera for taking images. The camera system includes such a camera objective and an optoelectronic sensor arrangement having a plurality of sensor elements for generating exposure-dependent received signals which form a respective image. The plurality of sensor elements includes a first group of sensor elements for generating received signals in dependence only on radiation of the first spectral range and a second group of sensor elements for generating received signals in dependence on radiation of the second spectral range.
    Type: Grant
    Filed: January 13, 2014
    Date of Patent: April 14, 2015
    Assignee: Arnold & Richter Cine Technik GmbH & Co. Betriebs KG
    Inventor: Johannes Steurer
  • Patent number: 8988510
    Abstract: A three-dimensional (3D) image display device includes a liquid crystal display panel alternately displaying a left eye image and a right eye image every unit frame period, a data driving circuit, a gate driving circuit, a timing controller that divides the unit frame period into first and second sub-frame periods, repeatedly supply the same frame data to the data driving circuit during the first and second sub-frame periods, and control operations of the data and gate driving circuits using a frame frequency higher than an input frame frequency, backlight light sources generating light to be provided to the liquid crystal display panel, and a light source driving circuit that sequentially turns on the backlight light sources when liquid crystals of the liquid crystal display panel are kept in a saturation state.
    Type: Grant
    Filed: September 10, 2010
    Date of Patent: March 24, 2015
    Assignee: LG Display Co., Ltd.
    Inventors: Byungsam Min, Kiduk Kim, Sunhwa Lee, Jinwoo Hong
  • Patent number: 8970671
    Abstract: Embodiments of the present invention relate a nondiffracting beam detection module for generating three-dimensional image data that has a surface layer having a first surface and a light transmissive region, a microaxicon, and a light detector. The microaxicon receives light through the light transmissive region from outside the first surface and generates one or more detection nondiffracting beams based on the received light. The light detector receives the nondiffracting beams and generates three-dimensional image data associated with an object located outside the first surface based on the one or more detection nondiffracting beams received. In some cases, the light detector can localize a three-dimensional position on the object associated with each detection nondiffracting beam received.
    Type: Grant
    Filed: February 22, 2011
    Date of Patent: March 3, 2015
    Assignee: California Institute of Technology
    Inventors: Sri Rama Prasanna Pavani, Changhuei Yang
  • Patent number: 8947510
    Abstract: A method for 3D imaging of a biologic object (1) in an optical tomography system where a subcellular structure of a biological object (1) is labeled by introducing at least one nanoparticle-biomarker. The labeled biological object (1) is moved relatively to a microscope objective (62) to present varying angles of view and the labeled biological object (1) is illuminated with radiation having wavelengths between 150 nm and 900 nm. Radiation transmitted through the labeled biological object (1) and the microscope objective (62) within at least one wavelength bands is sensed with a color camera, or with a set of at least four monochrome cameras. A plurality of cross-sectional images of the biological object (1) from the sensed radiation is formed and reconstructed to make a 3D image of the labeled biological object (1).
    Type: Grant
    Filed: June 8, 2009
    Date of Patent: February 3, 2015
    Assignee: Visiongate, Inc.
    Inventors: Michael G. Meyer, J. Richard Rahn, Anna V. Tourovskaia, Julia Oi Yan Yu, Christy A Lancaster, Thomas Neumann, Mark E. Fauver
  • Patent number: 8933992
    Abstract: The invention relates to an image recording device, an image reproduction device and a system with such a recording and reproduction device. The recording device comprises an optical axis (1) and a concave mirror (10), whereas through the use of said concave mirror (10) an image of an object (12) can be generated through reflection, the object being located at or projected onto the optical axis (1) near the focal point (11) of the concave mirror (10).
    Type: Grant
    Filed: March 12, 2010
    Date of Patent: January 13, 2015
    Assignee: Deutsche Telekom AG
    Inventor: Stefanus Roemer
  • Publication number: 20150009300
    Abstract: The present invention relates to a method and system for detecting and mapping three-dimensional information pertaining to one or more target objects. More particularly, the invention consists of selecting one or more target objects, illuminating the one or more target objects using a first light source and capturing an image of the one or more target objects, then, illuminating the same one or more target objects using a second light source and capturing an image of the one or more target objects and lastly calculating the distance at the midpoint between the two light sources and the one or more target objects based on the decay of intensities of light over distance by analyzing the ratio of the image intensities on a pixel by pixel basis.
    Type: Application
    Filed: March 3, 2008
    Publication date: January 8, 2015
    Inventor: Keigo Iizuka
  • Patent number: 8928738
    Abstract: A combination of a 3D optical adapter and corresponding digital process methods attached and updated to a conventional 2D digital camera so the digital camera can capture, save and transfer 3D stereoscopic digital images as well.
    Type: Grant
    Filed: February 16, 2014
    Date of Patent: January 6, 2015
    Inventor: Wenge David An
  • Patent number: 8922624
    Abstract: An optical observation instrument has two optical transmission channels for transmitting two partial ray bundles (9A, 9B). The optical observation instrument has a main objective (1) common to the optical transmission channels, an electronic image sensor (7) for sequentially recording the partial ray bundles (9A, 9B), an intermediate imaging optical system (3) between the main objective (1) and the image sensor (7) and common to the optical transmission channels, and a tilting mirror matrix (5) between the main objective (1) and the image sensor (7). The intermediate imaging optical system (3) is arranged so that the respective partial ray bundle (9A, 9B) is deflected toward the image sensor (7) and passes the intermediate imaging optical system (3) both on the way from the main objective (1) to the tilting mirror matrix (5) and on the way from the tilting mirror matrix (5) to the image sensor (7).
    Type: Grant
    Filed: January 26, 2012
    Date of Patent: December 30, 2014
    Assignee: Carl Zeiss Meditec AG
    Inventors: Marco Pretorius, Enrico Geissler, Guenter Rudolph, Christoph Nieten, Bryce Anton Moffat, Artur Hoegele
  • Patent number: 8909326
    Abstract: The present invention provides systems and methods for obtaining a three-dimensional (3D) representation of one or more light sources inside a sample, such as a mammal. Mammalian tissue is a turbid medium, meaning that photons are both absorbed and scattered as they propagate through tissue. In the case where scattering is large compared with absorption, such as red to near-infrared light passing through tissue, the transport of light within the sample is described by diffusion theory. Using imaging data and computer-implemented photon diffusion models, embodiments of the present invention produce a 3D representation of the light sources inside a sample, such as a 3D location, size, and brightness of such light sources.
    Type: Grant
    Filed: November 16, 2010
    Date of Patent: December 9, 2014
    Assignee: Xenogen Corporation
    Inventors: Daniel G. Stearns, Bradley W. Rice, Michael D. Cable
  • Patent number: 8902289
    Abstract: A method for capturing a three dimensional (3D) image by using a single-lens camera is provided. First, a first image is captured. According to a focus distance of the single-lens camera in capturing the first image and an average distance between two human eyes, an overlap width between the first image and a second image required for capturing the second image of the 3D image is calculated. Then, the first image and a real-time image captured by the single-lens camera are displayed, and an overlap area is marked on the first image according to the calculated overlap width. A horizontal shift of the single-lens camera is adjusted, to locate the real-time image in the overlap area. Finally, the real-time image is captured as the second image, and the first and second images are output as the 3D image.
    Type: Grant
    Filed: July 31, 2011
    Date of Patent: December 2, 2014
    Assignee: Altek Corporation
    Inventors: Yun-Chin Li, Chan-Min Chou, Chin-Lung Yang
  • Patent number: 8902295
    Abstract: A 3D camera comprises first and second laterally displaced optical imaging systems each comprising one or more lenses. The optical imaging systems also each comprise one or more actuators arranged to move one or more lenses of the respective optical imaging system, and a digital image analyzer configured to evaluate the respective field of view of first and second images of a stereoscopic image pair obtained respectively from the first and second optical imaging systems and to generate a disparity value based on a disparity between the respective fields of view. The 3D camera is arranged in operation to adjust the field of view of one or more images generated by the first and second optical imaging systems responsive to the disparity value so as to reduce the disparity between the respective fields of view of stereoscopic image pairs obtained from the first and second optical imaging systems.
    Type: Grant
    Filed: May 18, 2011
    Date of Patent: December 2, 2014
    Assignee: Sony Computer Entertainment Europe Limited
    Inventors: Ian Bickerstaff, Simon Benson, Nigel Kershaw, Ian Michael Hocking
  • Patent number: 8896669
    Abstract: An image adjustment apparatus for processing images output by two image capturing devices arranged with respect to one another so as to capture images representing different respective views of a scene comprises a noise combiner for combining a noise signal with one or both of a pair of corresponding images captured by the two image capturing devices; a difference detector for detecting differences in color properties between the pair of corresponding images output by the noise combiner; and a color property adjuster for adjusting color properties of images from at least one of the image capturing devices on the basis of the differences detected by the difference detector, so as to reduce the differences in color properties between corresponding images captured by the two image capturing devices.
    Type: Grant
    Filed: August 15, 2011
    Date of Patent: November 25, 2014
    Assignee: Sony Corporation
    Inventor: Katsuakira Moriwake
  • Patent number: 8890935
    Abstract: A capturing device includes a display section that changes between and displays a three-dimensional (3D) image and a two-dimensional (2D) image, and a controller that performs an image display control for the display section, wherein the controller changes a display mode of an image displayed on the display section, from a 3D image display to a 2D image display, in accordance with preset setting information, at the time of performing a focus control process.
    Type: Grant
    Filed: September 30, 2010
    Date of Patent: November 18, 2014
    Assignee: Sony Corporation
    Inventor: Mitsuru Shibata
  • Patent number: 8872898
    Abstract: Methods and systems for capturing and displaying multiple-angle imagery of physical objects are presented. With respect to capturing, multiple images of an object are captured from varying angles in response to user input. The images are analyzed to determine whether at least one additional image is desirable to allow generation of a visual presentation of the object. The user is informed to initiate capturing of the at least one more image based on the analysis. The additional image is captured in response to second user input. The presentation is generated based on the multiple images and the additional image. For displaying, a visual presentation of an object is accessed, the presentation having multiple images of the object from varying angles. The presentation is presented to the user of a mobile device according to user movement of the device. The user input determines a presentation speed and order of the images.
    Type: Grant
    Filed: December 14, 2011
    Date of Patent: October 28, 2014
    Assignee: eBay Inc.
    Inventor: Rolf Skyberg
  • Patent number: 8866884
    Abstract: An image processing apparatus includes an image input unit that inputs a two-dimensional image signal, a depth information output unit that inputs or generates depth information of image areas constituting the two-dimensional image signal, an image conversion unit that receives the image signal and the depth information from the image input unit and the depth information output unit, and generates and outputs a left eye image and a right eye image for realizing binocular stereoscopic vision, and an image output unit that outputs the left and right eye images. The image conversion unit extracts a spatial feature value of the input image signal, and performs an image conversion process including an emphasis process applying the feature value and the depth information with respect to the input image signal, thereby generating at least one of the left eye image and the right eye image.
    Type: Grant
    Filed: December 3, 2010
    Date of Patent: October 21, 2014
    Assignee: Sony Corporation
    Inventors: Atsushi Ito, Toshio Yamazaki, Seiji Kobayashi
  • Patent number: 8860787
    Abstract: A method and apparatus for telepresence sharing is described. The method may include providing an indication of a plurality of remote vehicles that are available for telepresence sharing to a user. The method may also include receiving a selection from the user to engage a remote vehicle from the plurality of remote vehicles in a telepresence sharing session. Furthermore, the method may also include providing a live video feed captured by the remote vehicle to a mobile device associated with the user.
    Type: Grant
    Filed: May 11, 2011
    Date of Patent: October 14, 2014
    Assignee: Google Inc.
    Inventor: Hartmut Neven
  • Publication number: 20140285624
    Abstract: One exemplary embodiment involves receiving a plurality of three-dimensional (3D) track points for a plurality of frames of a video, wherein the 3D track points are extracted from a plurality of two-dimensional source points. The embodiment further involves rendering the 3D track points across a plurality of frames of the video on a two-dimensional (2D) display. Additionally, the embodiment involves coloring each of the 3D track points wherein the color of each 3D track point visually distinguishes the 3D track point from a plurality of surrounding 3D track points, and wherein the color of each 3D track point is consistent across the frames of the video. The embodiment also involves sizing each of the 3D track points based on a distance between a camera that captured the video and a location of the 2D source points referenced by the respective one of the 3D track points.
    Type: Application
    Filed: June 25, 2012
    Publication date: September 25, 2014
    Applicant: Adobe Systems Incorporated
    Inventors: James Acquavella, David Simons, Daniel M. Wilk
  • Patent number: 8836776
    Abstract: There is provided an endoscope apparatus capable of stably and precisely measuring a distance to an object by suppressing variations in measured values of the distance to the object depending on the presence or absence of pigment dispersion or the like and capable of enabling observations based on clear and high quality images. The endoscope apparatus includes an optical system that condenses light from an object and simultaneously forms two optical images having the same characteristics with difference only in focal point; an imaging element that captures the two optical images formed by the optical system and acquires two images; and a calculation unit that obtains distance information corresponding to a distance to the object based on a contrast ratio of the two images in a range in which the two images acquired by the imaging element have a common contrast.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: September 16, 2014
    Assignee: Olympus Medical Systems Corp.
    Inventor: Mitsujiro Konno
  • Patent number: 8823775
    Abstract: An embodiment of the invention may provide a portable, inexpensive two-view 3D stereo vision imaging system, which acquires a 3D surface model and dimensions of an object. The system may comprise front-side and back-side stereo imagers which each have a projector and at least two digital cameras to image the object from different perspectives. An embodiment may include a method for reconstructing an image of a human body from the data of a two-view body scanner by obtaining a front scan image data point set and a back scan image data point set. A smooth body image may be gained by processing the data point sets using the following steps: (1) data resampling; (2) initial mesh generation; (3) mesh simplification; and (4) mesh subdivision and optimization.
    Type: Grant
    Filed: April 30, 2010
    Date of Patent: September 2, 2014
    Assignee: Board of Regents, The University of Texas System
    Inventors: Bugao Xu, Wurong Yu
  • Patent number: 8810634
    Abstract: A method and an apparatus for generating an image with shallow depth of field, suitable for a three-dimensional imaging system having a left lens and a right lens, are provided. First, the left lens and the right lens are used to capture a left-eye image and a right-eye image. Next, a disparity between each of a plurality of corresponding pixels in the left and right-eye images is calculated. Then, the depth information of each pixel is estimated according to a focus of the left and right lens, a lens pitch between the left lens and the right lens, and the calculated disparity of each pixel. Finally, the pixels in the left-eye image and the right-eye image are blurred according to the focus of the left lens and the right lens and the estimated depth information of each pixel, so as to obtain the image with shallow depth of field.
    Type: Grant
    Filed: July 29, 2011
    Date of Patent: August 19, 2014
    Assignee: Altek Corporation
    Inventor: Yun-Chin Li
  • Patent number: 8786682
    Abstract: A method including providing a device that projects a pattern of coherent radiation. The method further includes capturing a reference image of the pattern using an image sensor by projecting the pattern of the coherent radiation onto a reference surface and engendering a relative motion between the reference surface and the image sensor while capturing the reference image. The method also includes storing the reference image in a memory associated with the device.
    Type: Grant
    Filed: February 18, 2010
    Date of Patent: July 22, 2014
    Assignee: Primesense Ltd.
    Inventors: Alexander Shpunt, Dmitri Rais, Niv Galezer
  • Patent number: 8786675
    Abstract: A display device is mounted on and/or inside the eye. The eye mounted display contains multiple sub-displays, each of which projects light to different retinal positions within a portion of the retina corresponding to the sub-display. The projected light propagates through the pupil but does not fill the entire pupil. In this way, multiple sub-displays can project their light onto the relevant portion of the retina. Moving from the pupil to the cornea, the projection of the pupil onto the cornea will be referred to as the corneal aperture. The projected light propagates through less than the full corneal aperture. The sub-displays use spatial multiplexing at the corneal surface. Various electronic devices interface to the eye mounted display.
    Type: Grant
    Filed: January 26, 2009
    Date of Patent: July 22, 2014
    Inventor: Michael F. Deering
  • Patent number: 8780180
    Abstract: A digital camera for capturing stereoscopic images, including: an image sensor; an optical system; a user interface; a color image display; a data processing system; a buffer memory; a storage memory; and a program memory storing instructions configured to implement a method for capturing stereoscopic images. The method includes: capturing a first digital image of a scene in response to user activation of a user interface element; storing the first digital image; displaying a stream of stereoscopic preview images on the color image display, wherein the stereoscopic preview images are anaglyph stereoscopic images formed by combining the stored first digital image with a stream of evaluation digital images of the scene captured using the image sensor; capturing a second digital image of the scene in response to user activation of a user interface element; and storing a stereoscopic image based on the first digital image and the second digital image.
    Type: Grant
    Filed: May 13, 2011
    Date of Patent: July 15, 2014
    Assignee: Apple Inc.
    Inventor: Kenneth Alan Parulski
  • Patent number: 8760501
    Abstract: A stereo camera apparatus includes a first image capturing unit having first and second lens units, a first light synthesis unit, a first area-divided filter, and a first image capturing element. The first light synthesis unit and the first area-divided filter guide S-polarized and P-polarized light components to the first image capturing element. The second image capturing unit includes third and fourth lens units, a second light synthesis unit, a second area-divided filter, and a second image capturing element. The second light synthesis unit and the second area-divided filter guide S-polarized and P-polarized light components to the second image capturing element. The control unit includes first and second controllers to compute three-dimensional data of object using the S-polarized and P-polarized light component images, respectively.
    Type: Grant
    Filed: May 10, 2010
    Date of Patent: June 24, 2014
    Assignee: Ricoh Company, Ltd.
    Inventors: Shigeru Oohchida, Shin Aoki, Masahiro Fujimoto, Hideaki Hirai, Yasufumi Yamada, Nobuhiro Morita
  • Patent number: 8760502
    Abstract: A method and an apparatus for improving three dimensional (3D) effect of a 3D image collected by a 3D photographing apparatus, and reducing visual fatigue, are provided. A feature point of a left-eye image entering through a left-eye lens and of a right-eye image entering through a right-eye lens is acquired, a disparity between the left- and right-eye images is detected, a distance between the left- and right-eye lenses is controlled so that the disparity between the left- and right-eye images becomes a previously-set reference disparity, and at least one of the left- and right-eye images is shifted so that a convergence point is placed on an object located within the left- and right-eye images.
    Type: Grant
    Filed: September 23, 2011
    Date of Patent: June 24, 2014
    Assignees: Samsung Electronics Co., Ltd., Gwangju Institute of Science and Technology
    Inventors: Kuk-jin Yoon, Makoto Kimura, Jin-kyung Lee, Yasuo Takane, Tae-kyung Kim, Hyun-seok Choi, Taek-seong Jeong, Kyoung-hwan Moon, Takashima Masahiro
  • Patent number: 8743183
    Abstract: A stereo camera implements ranging of an object that includes consecutive similar patterns. In stereo matching using the stereo camera, if a plurality of corresponding point candidates are present in a sum of absolute differences (SAD) or suchlike evaluation value distribution for a target point, an evaluation value map is generated by superimposing an evaluation value distribution of a target point for which a plurality of corresponding points are determined to be present and an evaluation value distribution of each other target point present in a peripheral area of that target point. By this means, the shape of an object is represented in real space around a target point for which a plurality of corresponding points are determined to be present, and it is possible to calculate the true distance of a railing or the like that extends in a straight line by extracting a line segment with the strongest linearity in the evaluation value map.
    Type: Grant
    Filed: September 2, 2010
    Date of Patent: June 3, 2014
    Assignee: Panasonic Corporation
    Inventors: Takuya Nanri, Hirofumi Nishimura
  • Patent number: 8743179
    Abstract: Disclosed is a compact type 3D image photographing apparatus which adjusts a convergence angle with respect to a subject using two lenses in order to photograph a stereoscopic image. The compact type image photographing apparatus includes a housing; a first actuator having a first lens and disposed in the housing so as to be moved left and right; a second actuator having a second lens, disposed in the housing so as to be moved left and right, and disposed to be spaced apart from the first actuator; a left/right driving part which is disposed at each of the first and second actuators so as to move the first actuator or the second actuator left and right when power is applied; an image sensor which is disposed at each lower side of the first and second actuators so as to photograph a subject through the first and second lenses; and a control part which is disposed at a lower side of the image sensor so as to control power supplied to the left/right driving part, the first actuator and the second actuator.
    Type: Grant
    Filed: September 21, 2009
    Date of Patent: June 3, 2014
    Assignee: Hysonic Co., Ltd.
    Inventors: Jae Wook Ryu, He-Won Jung, Jae-Kyu Shim, Hye-Kyoung Ji
  • Publication number: 20140132733
    Abstract: An apparatus, system, and method for increasing points in a point cloud. In one illustrative embodiment, a two-dimensional image of a scene and the point cloud of the scene are received. At least a portion of the points in the point cloud are mapped to the two-dimensional image to form transformed points. A fused data array is created using the two-dimensional image and the transformed points. New points for the point cloud are identified using the fused data array. The new points are added to the point cloud to form a new point cloud.
    Type: Application
    Filed: November 9, 2012
    Publication date: May 15, 2014
    Applicant: THE BOEING COMPANY
    Inventor: The Boeing Company
  • Patent number: 8723922
    Abstract: An example embodiment of the present invention may include an apparatus that captures 3D images having a lens barrel, including a lens disposed at a first end of the lens barrel, an image capture element at the second end of the lens barrel, and a refracting lens positioned along the optical axis of the lens barrel. The image capture device may have an adjustable active region, the adjustable active region being a region capable of capturing an image that is smaller than the total image capture area of the image capture element. The image capture element may capture images continuously at a predetermined frame rate. The image capture element may change the adjustable active region and the set of positioning elements may be adapted to continuous change the position of the refracting lens among a series of predetermined positions at a rate corresponding to the predetermined frame rate.
    Type: Grant
    Filed: January 23, 2009
    Date of Patent: May 13, 2014
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventor: Andrew M. Berger
  • Publication number: 20140118506
    Abstract: Systems and methods are provided for synthesizing stereoscopic [that is, ā€œ3-Dā€] images from 2-D images, for example, 2-D video or 2-D still images. The method includes capturing a series of images exhibiting at least some relative movement to provide a first series of images; generating a second series of temporally modified images from the first series of images by varying the relative timing of at least some of the images of the first series of images; and displaying the first series of images with at least some of the second series of temporally modified images to produce a series of stereoscopic images. The stereoscopic images may then be viewed with appropriate stereoscopic devices, for example, 3-D glasses. Methods and systems for capturing the images whereby the stereoscopic appearance of the images is enhanced are also disclosed.
    Type: Application
    Filed: October 26, 2012
    Publication date: May 1, 2014
    Inventor: Christopher L. UHL
  • Publication number: 20140118495
    Abstract: Embodiments alter the swoop trajectory depending on the terrain within the view of the virtual camera. To swoop into a target, a virtual camera may be positioned at an angle relative to the upward normal vector from the target. That angle may be referred to as a tilt angle. According to embodiments, the tilt angle may increase more quickly in areas of high terrain variance (e.g., mountains or cities with tall buildings) than in areas with less terrain variance (e.g., flat plains). To determine the level of terrain variance in an area, embodiments may weigh terrain data having higher detail more heavily than terrain data having less detail.
    Type: Application
    Filed: June 27, 2012
    Publication date: May 1, 2014
    Applicant: Google Inc.
    Inventor: Greg Coombe
  • Publication number: 20140104394
    Abstract: A system and method for combining depth images taken from multiple depth cameras into a composite image are described. The volume of space captured in the composite image is configurable in size and shape depending upon the number of depth cameras used and the shape of the cameras' imaging sensors. Tracking of movements of a person or object can be performed on the composite image. The tracked movements can subsequently be used by an interactive application.
    Type: Application
    Filed: October 15, 2012
    Publication date: April 17, 2014
    Applicant: INTEL CORPORATION
    Inventors: Yaron Yanai, Maoz Madmoni, Gilboa Levy, Gershom Kutliroff