Pseudo Patents (Class 348/44)
  • Patent number: 10558343
    Abstract: Systems and techniques are described for interaction plane rotation for manipulation of three-dimensional objects. A three-dimensional object can be displayed as a two-dimensional representation of the object, represented on an interaction plane and intersected by an object view vector that represents a point of view of the object through a viewing plane. An angle between the object view vector and the interaction plane is calculated and compared to a threshold value. A determination is made that the calculated angle is less than the threshold value, and a rotation magnitude that defines an amount of rotation of the interaction plane relative to a constant vector is calculated. The interaction plane is rotated relative to the constant vector in a rotation direction by the rotation magnitude. The rotated interaction plane can then be used to determine an intended relative movement between the object view vector and the three-dimensional object.
    Type: Grant
    Filed: November 15, 2018
    Date of Patent: February 11, 2020
    Assignee: Adobe Inc.
    Inventor: Alex John Fischer
  • Patent number: 10540590
    Abstract: A method for generating spatial-temporal consistency depth map sequences based on convolutional neural networks for 2D-3D conversion of television works includes steps of: 1) collecting a training set, wherein each training sample thereof includes a sequence of continuous RGB images, and a corresponding depth map sequence; 2) processing each image sequence in the training set with spatial-temporal consistency superpixel segmentation, and establishing a spatial similarity matrix and a temporal similarity matrix; 3) establishing the convolution neural network including a single superpixel depth regression network and a spatial-temporal consistency condition random field loss layer; 4) training the convolution neural network; and 5) recovering a depth maps of a RGB image sequence of unknown depth through forward propagation with the trained convolution neural network; which avoids that clue-based depth recovery method is greatly depended on scenario assumptions, and inter-frame discontinuity between depth maps g
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: January 21, 2020
    Inventors: Xun Wang, Xuran Zhao
  • Patent number: 10512508
    Abstract: An imagery system includes: a camera having a field of view; a light source including a source of structured light, the light source movable relative to the camera; and at least one processor. The at least one processor is programmed to determine, at least, estimated locations of points on a surface exposed to the structured light according to image data received from the field of view of the camera. The light source may include at least one fiducial marker, and the at least one processor may be programmed to determine the estimated position of the source of structured light according to the at least one fiducial marker in the image data. Also, the camera may be a stereoscopic camera.
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: December 24, 2019
    Assignee: The University of British Columbia
    Inventors: Robert Rohling, Philip Edgcumbe, Christopher Nguan
  • Patent number: 10380714
    Abstract: An ambient animation system, including an image sensor configured to capture an image of an environment outside of a vehicle, a display interface configured to display information to a driver of the vehicle, and a controller in communication with the image sensor and the display interface and configured to generate a virtual spherical lighting object, shape the image to fit around the virtual spherical lighting object, and project a portion of the image fitted around the virtual spherical lighting object onto the display interface.
    Type: Grant
    Filed: September 26, 2017
    Date of Patent: August 13, 2019
    Assignees: DENSO International America, Inc., DENSO CORPORATION
    Inventors: Gareth Webb, Dustin Garrett, Cary Horvath
  • Patent number: 10371500
    Abstract: A lens device for an illumination assembly. The lens device has light-entry and light-exit surfaces and comprises at least one ring region. Each ring region extends along a circumferential direction about a central axis of the lens device, and comprises a plurality of area segments. Each area segment forms a circular arc portion of a respective ring region and comprises a first end in the circumferential direction and a second end opposite to the first end in the circumferential direction. At the first end, the light-exit surface is inclined in the direction of the central axis by an arbitrary first angle in relation to the light-entry surface, and at the second end, the light-exit surface is inclined in the direction of the central axis by an arbitrary second angle in relation to the light-entry surface differing from the first angle.
    Type: Grant
    Filed: October 6, 2017
    Date of Patent: August 6, 2019
    Inventors: Dominik Seitz, Nils Haverkamp
  • Patent number: 10339812
    Abstract: A camera monitoring system for a vehicle includes a plurality of cameras disposed around an exterior of a vehicle. An image processing module communicates with the plurality of cameras, generating overhead view images from raw images taken by at least one of the plurality of cameras. A histogram module communicates with the image processing module, generating at least one histogram from the overhead view images. A likelihood module communicates with the histogram module and determines a likelihood of blockage for at least one of the plurality of cameras. A line alignment module communicates with the likelihood module and the image processing module to determine whether a trajectory of detected feature points in a selected camera aligns with a trajectory of detected feature points in an adjacent camera. A reporting module communicates with the line alignment module and reports a camera blockage status to at least one vehicle system or controller.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: July 2, 2019
    Assignees: DENSO International America, Inc., DENSO CORPORATION
    Inventors: Malok Alamir Tamer, Kenji Okano
  • Patent number: 9906769
    Abstract: Methods and apparatus for producing multi-view 3D renderings of a scene, and collaboratively sharing information related to the renderings to facilitate producing synthetic viewpoints of the scene. In one example, a method of producing a 3D synthetic viewpoint of the scene includes receiving an image of the scene from a local camera, analyzing the image to determine a context of the scene and to extract at least one surface feature of the scene, developing an initial set of planar world coordinates for the image based on the at least one surface feature to estimate an initial local perspective projection matrix, and mapping image pixels of the image to a world plane to produce the 3D synthetic viewpoint of the scene by using the initial local perspective projection matrix to map image space coordinates to world coordinates.
    Type: Grant
    Filed: July 31, 2014
    Date of Patent: February 27, 2018
    Inventor: Darrell L. Young
  • Patent number: 9866817
    Abstract: A camera module is provided. The camera module includes a number of camera assembles. Each of the camera assembles includes a lens unit and an electromagnetic driving unit. The electromagnetic driving unit includes at least one magnetic element for controlling the movement of the corresponding lens unit. The distance between two of the magnetic elements, which are closest to each other and respectively positioned in two of the camera assemblies, is greater than the distance between two of the light through holes, to which the two of the camera assemblies are arranged to correspond.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: January 9, 2018
    Assignee: TDK Taiwan Corp.
    Inventors: Chen-Er Hsu, Chih-Wei Weng, Chao-Chang Hu
  • Patent number: 9811942
    Abstract: An image processing system according to the present embodiment includes a generating unit and a display controlling unit. The generating unit generates a group of different types of parallax image sets that are to three-dimensionally display an object onto the display surface of the displaying unit, from different types of three-dimensional medical image data generated by performing different types of image processing onto imaging data of the object collected by a medical image diagnosis apparatus. The display controlling unit performs control so that display conditions of the group of different types of parallax image sets are switched in accordance with the switching of the viewpoint position around the object displayed on the display surface and that the group of different types of parallax image sets are superimposed and displayed.
    Type: Grant
    Filed: October 16, 2013
    Date of Patent: November 7, 2017
    Assignee: Toshiba Medical Systems Corporation
    Inventor: Yasuhiro Noshi
  • Patent number: 9681122
    Abstract: Systems and methods for enhancement of a coupled zone of a 3D stereoscopic display. The method may include determining a size and a shape of the coupled zone. The coupled zone may include a physical volume specified by the user's visual depth of field with respect to screen position of the 3D stereoscopic display and the user's point of view. Content may be displayed at a first position with a virtual 3D space and the first position may correspond to a position within the coupled zone. It may be determined that the content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone and, in response, display of the content may be adjusted such that the content has a second position in the virtual 3D space that corresponds to another position within the coupled zone.
    Type: Grant
    Filed: April 21, 2014
    Date of Patent: June 13, 2017
    Assignee: zSpace, Inc.
    Inventors: Mark P. Wilson, Douglas C. Twilleager, David J. Borel
  • Patent number: 9668013
    Abstract: A display device includes a display portion, an input portion that receives an instruction to select a program in a program list such that the display portion displays the program with a distinguishable expression, and a controller that links a first program having a program duration shorter than a predetermined threshold with at least one second program arranged relative to the first program along a time axis of the program list as a linked program, and that controls the display portion to display the linked program with the distinguishable expression.
    Type: Grant
    Filed: February 10, 2015
    Date of Patent: May 30, 2017
    Assignee: FUNAI ELECTRIC CO., LTD.
    Inventor: Kenichi Fukunaka
  • Patent number: 9224206
    Abstract: An exemplary method includes prompting a user to capture video data at a location. The location is associated with navigation directions for the user. Information representing visual orientation and positioning information associated with the captured video data is received by one or more computing devices, and a stored data model representing a 3D geometry depicting objects associated with the location is accessed. Between corresponding images from the captured video data and projections of the 3D geometry, one or more candidate change regions are detected. Each candidate change region indicates an area of visual difference between the captured video data and projections. When it is detected that a count of the one or more candidate change regions is below a threshold, the stored model data is updated with at least part of the captured video data based on the visual orientation and positioning information associated with the captured video data.
    Type: Grant
    Filed: July 24, 2014
    Date of Patent: December 29, 2015
    Assignee: Google Inc.
    Inventors: Andrew Lookingbill, Steven Maxwell Seitz
  • Patent number: 9223025
    Abstract: Systems and methods for conducting autonomous underwater inspections of subsea and other underwater structures using a 3D laser mounted on an underwater platform such as AUV, an ROV or a tripod. The systems and methods described herein can be used for scanning underwater structures to gain a better understanding of the underwater structures, such as for example, for the purpose of avoiding collision of an underwater vehicle with the underwater structures and for directing inspection, repair, and manipulation of the underwater structures.
    Type: Grant
    Filed: April 4, 2014
    Date of Patent: December 29, 2015
    Assignee: Lockheed Martin Corporation
    Inventors: Christian H. Debrunner, Alan K. Fettinger, Philip A. Bouxsein
  • Patent number: 9111375
    Abstract: A system adapted to implement a learning rule in a three-dimensional (3D) environment is described. The system includes: a renderer adapted to generate a two-dimensional (2D) image based at least partly on a 3D scene; a computational element adapted to generate a set of appearance features based at least partly on the 2D image; and an attribute classifier adapted to generate at least one set of learned features based at least partly on the set of appearance features and to generate a set of estimated scene features based at least partly on the set of learned features. A method labels each image from among the set of 2D images with scene information regarding the 3D scene; selects a set of learning modifiers based at least partly on the labeling of at least two images; and updates a set of weights based at least partly on the set of learning modifiers.
    Type: Grant
    Filed: January 7, 2013
    Date of Patent: August 18, 2015
    Inventor: Philip Meier
  • Patent number: 9041772
    Abstract: A three dimensional (3D) video data processing method in a broadcast transmitter includes encoding, by an encoder, 3D video data which carries a first image and a second image in separate video streams; generating, by a system information processor, system information comprising 3D video composition information about the 3D video data; multiplexing, by a multiplexer, the system information and the 3D video data; and transmitting, by a transmitting unit, a broadcast signal carrying the 3D video data and the system information. The 3D video composition information includes first information on resolution of the 3D video data.
    Type: Grant
    Filed: January 19, 2010
    Date of Patent: May 26, 2015
    Inventors: Jong Yeul Suh, Jeong Hyu Yang
  • Patent number: 9036015
    Abstract: A method of rendering views for a multi-view display device (100) is disclosed. The multi-view display device (100) comprises a number of display means (104, 110) for displaying respective views in mutually different directions relative to the multi-view display device (100). The method comprises: computing a first motion vector field on basis of a first input image of a time sequence of input images and a second input image of the time sequence of input images; computing a first motion compensated intermediate image on basis of the first motion vector field, the first input image and/or the second input image; and providing the first motion compensated intermediate image to a first one of the number of display means (104, 110).
    Type: Grant
    Filed: November 17, 2006
    Date of Patent: May 19, 2015
    Inventors: Reinout Verburgh, Ralph Braspenning
  • Patent number: 9030533
    Abstract: Adjusting overlay positioning in stereoscopic video, including: receiving overlay data including a plurality of overlays, each overlay having a lateral axis value, a vertical axis value, and a depth value; receiving and displaying the stereoscopic video to a user as at least one of a video preview display and a stereoscopic display, each display including an overlay from the overlay data, wherein a position of the overlay in each display is based on the lateral axis value, the vertical axis value, and the depth value of the overlay, and wherein the video preview display includes interfaces for adjusting the position of the overlay in each display; receiving input from the user related to the depth value of the overlay; and adjusting the position of the overlay in the video preview display based on the input from the user.
    Type: Grant
    Filed: November 2, 2010
    Date of Patent: May 12, 2015
    Assignees: Sony Corporation, Sony Corporation of America, Sony Pictures Entertainment Inc.
    Inventors: Robert Aubey, Jr., Peter Avventi, Dennis Adams, Yoshikazu Takashima, John Ying, Tommy Choy, George Reis, Michael Thompson, Kiruthika Krishnadevarajan, Don C. Eklund, II
  • Patent number: 8963995
    Abstract: [Object] To maintain perspective consistency among individual objects in an image in superimposition display of a caption (caption unit) in an ARIB method. [Solution] A multiplexed data stream including a video data stream and a caption data stream is transmitted from a broadcast station to a set top box. A video data stream supplied from a video encoder 113 includes stereo image data. A caption data stream supplied from a caption encoder 133 includes data of captions (caption units) in the ARIB method serving as superimposition information and disparity information (disparity information set). In the caption data stream, the pieces of data of a certain number of captions that are to be displayed on the same screen are sequentially arranged via a separator.
    Type: Grant
    Filed: June 22, 2010
    Date of Patent: February 24, 2015
    Assignee: Sony Corporation
    Inventor: Ikuo Tsukagoshi
  • Patent number: 8953023
    Abstract: Provided is a method and apparatus for linear depth mapping. Linear depth mapping includes using algorithms to correct the distorted depth mapping of stereoscopic capture and display systems.
    Type: Grant
    Filed: October 29, 2012
    Date of Patent: February 10, 2015
    Assignee: RealD Inc.
    Inventor: Michael G. Robinson
  • Patent number: 8947422
    Abstract: Implementations of the present invention involve methods and systems for creating depth and volume in a 2-D planar image to create an associated 3-D image by utilizing a plurality of layers of the 2-D image, where each layer comprises one or more portions of the 2-D image. Each layer may be reproduced into a corresponding left eye and right eye layers, with one or both layers including a pixel offset corresponding to a perceived depth. Further, a depth model may be created for one or more objects of the 2-D image to provide a template upon which the pixel offset for one or more pixels of the 2-D image may be adjusted to provide the 2-D image with a more nuanced 3-D effect. In this manner, the 2-D image may be converted to a corresponding 3-D image with a perceived depth.
    Type: Grant
    Filed: September 30, 2009
    Date of Patent: February 3, 2015
    Assignee: Disney Enterprises, Inc.
    Inventors: Tara Handy Turner, Evan M. Goldberg, Matthew F. Schnittker, Joseph W. Longson, Robert M. Neuman
  • Patent number: 8942547
    Abstract: The recorder apparatus includes the controller that sets conversion mode used when input stream is processed and converted into recording stream to any of two-dimensional mode that converts the input stream into two-dimensional recording stream and three-dimensional mode that converts the input stream into three-dimensional recording stream, the controller that sets one recording mode that can be used when the video signal is converted and processed in the two-dimensional mode and the three-dimensional mode and specifies recording rate, and the signal processor that processes the video signal based on the set conversion mode and the set recording mode to convert the video signal into recording video signal. The controller sets the recording modes such that combination of the recording modes that can be set when the two-dimensional mode is set is different from combination of recording modes that can be set when the three-dimensional mode is set.
    Type: Grant
    Filed: January 2, 2013
    Date of Patent: January 27, 2015
    Assignee: Panasonic Corporation
    Inventors: Yuki Maruyama, Kazuhito Kimura
  • Patent number: 8937646
    Abstract: Stereo imaging can be provided on an electronic device without the need for two matched, high resolution, large format cameras. In various embodiments, two or more cameras of disparate types can be used to capture stereoscopic images. Various processing algorithms can be used to adjust aspects such as the effective pixel size and depth of focus in order to provide for sufficient information to generate three-dimensional images without significant artifacts resulting from differences in the mismatched cameras.
    Type: Grant
    Filed: October 5, 2011
    Date of Patent: January 20, 2015
    Assignee: Amazon Technologies, Inc.
    Inventor: Leo B. Baldwin
  • Patent number: 8933999
    Abstract: Margins are prevented from being produced when the amount of parallax of a stereoscopic image has been enlarged. A parallax adjustment command is applied if a stereoscopic image is displayed in an image compositing area that has been defined on a page constituting an electronic album. The amount of parallax is enlarged in response to application of a command to enlarge the amount of parallax. If enlarging the amount of parallax will cause margins to be produced when the stereoscopic image is displayed in the image compositing area on the page, then this page is replaced by a page on which an image compositing area that will not produce margins has been formed.
    Type: Grant
    Filed: August 26, 2011
    Date of Patent: January 13, 2015
    Assignee: Fujifilm Corporation
    Inventor: Kei Yamaji
  • Patent number: 8934002
    Abstract: Disclosed is an LCD device which facilitates to improve picture quality of two-dimensional (2D) and three-dimensional (3D) images by automatically converting an image driving mode (2D/3D) in accordance with a viewing distance, and a method for driving the same, wherein the device comprises a distance measuring unit which measures a viewing distance between the LCD device and a viewer; an image mode controller which sets a 2D image mode or 3D image mode in accordance with a comparison result between the viewing distance and a preset reference distance; a timing controller which aligns externally-provided image signals in accordance with the 2D image mode or 3D image mode set by the image mode controller, and converts the aligned image signals into image data by frame unit; and a liquid crystal panel which displays an image based on the 2D image mode or 3D image mode.
    Type: Grant
    Filed: June 8, 2011
    Date of Patent: January 13, 2015
    Assignee: LG Display Co., Ltd.
    Inventors: Jung Hyun Ham, Heume Il Baek
  • Patent number: 8902288
    Abstract: A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.
    Type: Grant
    Filed: June 16, 2011
    Date of Patent: December 2, 2014
    Assignee: Google Inc.
    Inventors: Zhe Fan, Mark Limber, Brian Gammon Brown, Tilman Reinhardt, Matthew Robert Simpson
  • Patent number: 8885025
    Abstract: A processor includes: an imaging control unit which causes an imaging unit for capturing an image with changing a focused object distance, to change the focused object distance with a first change width in the case of a first focused object distance, and to change the focused object distance with a second change width that is smaller than the first change width in the case of a second focused object distance that is shorter than the first focused object distance; and an image processing unit which extracts focused object image data from captured image data for each of the focused object distances, and generates image data by shifting the extracted object image data by parallax amounts corresponding to the respective focused object distances, and by synthesizing the extracted object image data.
    Type: Grant
    Filed: February 23, 2011
    Date of Patent: November 11, 2014
    Assignee: Fujitsu Semiconductor Limited
    Inventors: Hiroshi Iwabuchi, Kazuaki Ito, Hiroaki Kusaba, Hiroto Ito, Masafumi Oikawa, Masaaki Takagi
  • Patent number: 8867826
    Abstract: A disparity vector for a pixel in a right image corresponding to a pixel in a left image in a pair of stereo images is determined. The disparity vector is based on a horizontal disparity and a vertical disparity and the pair of stereo images is unrectified. First, a set of candidate horizontal disparities is determined. For each candidate horizontal disparity, a cost associated with a particular horizontal disparity and corresponding vertical disparities is determined. The vertical disparity associated with a first optimal cost is assigned to each candidate horizontal disparity, so that the candidate horizontal disparity and the vertical disparity yield a candidate disparity vector. Lastly, the candidate disparity vector with a second optimal cost is selected as the disparity vector of the pixel in the right image.
    Type: Grant
    Filed: November 26, 2012
    Date of Patent: October 21, 2014
    Assignee: Mitusbishi Electric Research Laboratories, Inc.
    Inventors: Richard Rzeszutek, Dong Tian, Anthony Vetro
  • Patent number: 8866883
    Abstract: Tools are described for preparing digital dental models for use in dental restoration production processes, along with associated systems and methods. Dental modeling is improved by supplementing views of three-dimensional models with still images of the modeled subject matter. Video data acquired during a scan of the model provides a source of still images that can be displayed alongside a rendered three-dimensional model, and the two views (model and still image) may be synchronized to provide a common perspective of the model's subject matter. This approach provides useful visual information for disambiguating surface features of the model during processing steps such as marking a margin of a prepared tooth surface for a restoration.
    Type: Grant
    Filed: June 27, 2008
    Date of Patent: October 21, 2014
    Assignee: 3M Innovative Properties Company
    Inventors: Janos Rohaly, Robert N. Nazzal, Edward K. Tekeian, Ilya A. Kriveshko, Eric B. Paley
  • Patent number: 8854434
    Abstract: There is provided a demultiplexer that receives video data for one of a three-dimensional display and a two-dimensional display. There is also provided an HDMI transmission portion that transmits the video data and display information that pertains to one of the three-dimensional display and the two-dimensional display of the video data to a television receiver through TMDS channels #0, #1, and #2 of an HDMI cable. There is also provided a transmission/receiving portion that transmits the display information to the television receiver through a CEC line of the HDMI cable.
    Type: Grant
    Filed: August 11, 2010
    Date of Patent: October 7, 2014
    Assignee: Sony Corporation
    Inventors: Takehiko Saito, Ichiro Hamada
  • Patent number: 8854426
    Abstract: A time-of-flight 3D camera and related method for illuminating a camera field of view and capturing return image light are disclosed herein. In one example, the time-of-flight 3D camera includes a light source that emits source light along an optical axis, and a collimator that receives and collimates the source light to create collimated light. A refractive diffuser is tuned to the camera field of view and receives and diffuses the collimated light to create refracted light having a varying intensity profile. The refractive diffuser guides the refracted light to illuminate the camera field of view to reduce wasted source light.
    Type: Grant
    Filed: November 7, 2011
    Date of Patent: October 7, 2014
    Assignee: Microsoft Corporation
    Inventors: Asaf Pellman, David Cohan, Giora Yahav
  • Patent number: 8842163
    Abstract: Objects within two-dimensional (2D) video data are modeled by three-dimensional (3D) models as a function of object type and motion through manually calibrating a 2D image to the three spatial dimensions of a 3D modeling cube. Calibrated 3D locations of an object in motion in the 2D image field of view of a video data input are computed and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the computed 3D locations. The 2D object image is replaced in the video data input with an object-type 3D polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.
    Type: Grant
    Filed: June 7, 2011
    Date of Patent: September 23, 2014
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Rogerio S. Feris, Yun Zhai
  • Patent number: 8836758
    Abstract: A 3D image processing apparatus includes: L and R graphic decoders which decode coded stream data to generate left-eye and right-eye image data; an image output control unit which outputs the generated image data; and a control unit which, when a decoding error occurs in generating one of the image data, and a successful decode occurs in generating the other of the image data, (i) shifts, by a preset offset, a pixel position of the other of the image data, to generate pseudo image data as the one of the image data, and (ii) outputs the pseudo image data to an image output control unit, wherein the image output control unit outputs the other of the image data and the pseudo image data, when the decoding error occurs in generating the one of the image data and the successful decode occurs in generating the other of the image data.
    Type: Grant
    Filed: August 26, 2011
    Date of Patent: September 16, 2014
    Assignee: Panasonic Corporation
    Inventors: Nobutaka Kitajima, Akifumi Yamana, Atsushi Nishiyama, Tsutomu Hashimoto, Makoto Hirai
  • Patent number: 8817066
    Abstract: A mirror assembly adapted for use in a panoramic imaging system for capturing a panoramic image includes a mirror for optically coupling to a fisheye lens having a first field of view, the mirror configured for reflecting an image of a second field of view through the fisheye lens. A housing has a first end and a second end, the mirror being secured proximate to the first end, and the second end having an engagement portion for securing the mirror assembly to the panoramic imaging system. When the mirror assembly is secured to the panoramic imaging system, the mirror is optically coupled to the fisheye lens and a detector for capturing a first portion of the panoramic image and a second portion of the panoramic image, the first portion of the panoramic image having a portion overlapping the second portion of the panoramic image.
    Type: Grant
    Filed: April 22, 2011
    Date of Patent: August 26, 2014
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Gurunandan Krishnan, Shree K. Nayar
  • Patent number: 8805020
    Abstract: According to one embodiment, a depth signal generating apparatus includes following units. The calculating unit is configured to calculate a statistic value for pixel values for each of predefined areas in the first image, and calculate, for each of predetermined base depth models, a first evaluation value based on the calculated statistic value. The correcting unit is configured to correct, based on a second evaluation value previously derived for the second image and a first degree of similarity indicating a similarity between the predetermined base depth models, the first evaluation value to derive second evaluation values for the predetermined base depth models. The selecting unit is configured to select a base depth model having the highest second evaluation value from the predetermined base depth models. The generating unit is configured to generate a depth signal based on the selected base depth model.
    Type: Grant
    Filed: March 21, 2011
    Date of Patent: August 12, 2014
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Takeshi Mita, Nao Mishima, Kenichi Shimoyama, Ryusuke Hirai
  • Publication number: 20140192157
    Abstract: In an example, a method of decoding video data includes determining whether a reference index for a current block corresponds to an inter-view reference picture, and when the reference index for the current block corresponds to the inter-view reference picture, obtaining, from an encoded bitstream, data indicating a view synthesis prediction (VSP) mode of the current block, where the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture.
    Type: Application
    Filed: January 9, 2014
    Publication date: July 10, 2014
    Applicant: QUALCOMM Incorporated
    Inventors: Ying Chen, Ye-Kui Wang, Li Zhang
  • Patent number: 8773508
    Abstract: An apparatus and method for computing a three dimensional model of a surface of an object are disclosed. At least one directional energy source (106-109) directionally illuminates the object (101). An imaging assembly (104), having at least two spatially separated viewpoints (111,112) at fixed positions relative to each other, records a series of images of the object at each viewpoint when the object is illuminated by the source. At least one localisation template (102,103) having predetermined geometrical features is visible to at least one of the viewpoints simultaneously with the object. The images recorded at the viewpoints are analysed so as to determine the location and pose of each viewpoint relative to the template for each image in the series of images. Photometric data for the object is generated using the calculated location and pose of the viewpoints and the image data.
    Type: Grant
    Filed: March 27, 2009
    Date of Patent: July 8, 2014
    Assignee: Fuel 3D Technologies Limited
    Inventors: Ronald Daniel, James Paterson, David H. Auty
  • Patent number: 8767047
    Abstract: An image processing system includes at least two, complementary, angle sensitive pixel (ASP) structures, having a spatial frequency domain ASP output including a background output and a plurality of ASP response outputs, in response to an optical input; an ASP response output subtractor component, which functions to suppress the background output and perform a subtraction of at least two of the ASP response outputs; and a processing component that can process the subtracted spatial frequency domain ASP response outputs. An optical domain image processing method includes the steps of providing at least two, complementary, angle sensitive pixel (ASP) structures; obtaining a spatial frequency domain ASP output including a plurality of complementary ASP response outputs, in response to an optical input; performing a wavelet-like transform of the ASP response outputs in the optical domain prior to performing any operation in a digital domain; and obtaining a desired output of the optical input.
    Type: Grant
    Filed: August 3, 2011
    Date of Patent: July 1, 2014
    Assignee: Cornell University
    Inventors: Alyosha Molnar, Albert Wang, Patrick Gill
  • Patent number: 8743184
    Abstract: A photographing apparatus is provided that accurately determines focus positions of two photographing sections in the same degree of time as in the past and a focus position determining method. A search range setting section 121 calculates one boundary value Pn? of a second search area and calculates the other boundary value Pf? of the second search area on the basis of a focus position P1 of a first focus lens FLA detected by an AF detecting section 120 and a boundary value N of a search area on a near side and a boundary value F of a search area on a far side. The AF detecting section 120 searches for a focus position P2 while instructing a second F lens driving section 104B to move a second focus lens FLB in a second search area (Pn? to Pf?) narrower than a first search area.
    Type: Grant
    Filed: December 17, 2009
    Date of Patent: June 3, 2014
    Assignee: FUJIFILM Corporation
    Inventor: Yi Pan
  • Patent number: 8743187
    Abstract: Techniques and technologies are described herein for motion parallax three-dimensional (3D) imaging. Such techniques and technologies do not require special glasses, virtual reality helmets, or other user-attachable devices. More particularly, some of the described motion parallax 3D imaging techniques and technologies generate sequential images, including motion parallax depictions of various scenes derived from clues in views obtained of or created for the displayed scene.
    Type: Grant
    Filed: June 6, 2012
    Date of Patent: June 3, 2014
    Assignee: Microsoft Corporation
    Inventors: Dinei Afonso Ferreira Florencio, Cha Zhang
  • Patent number: 8736669
    Abstract: From a stereo image having at least 2 perspectives additional virtual perspectives are produced, wherein the processing time for the virtual perspectives is less than a specified value and simultaneously the multi-view image quality is maximized by identifying image areas that have not changed between two stereo images of the image sequence. In these areas the associated disparity map also did not change and the disparity values are reused. In addition, the processing parameters for calculating the virtual perspectives are continuously adjusted through continuous time measurement during processing such that the quality is always at a maximum. An adaptive method is obtained, which is also able to respond to load fluctuations of the underlying hardware device.
    Type: Grant
    Filed: December 27, 2007
    Date of Patent: May 27, 2014
    Assignee: Sterrix Technologies UG
    Inventor: Rolf-Dieter Naske
  • Patent number: 8736670
    Abstract: In accordance with one aspect, the present invention provides a real-time 3D visualization system. The system includes means for conveying electromagnetic energy emanating from one or more 3D surfaces including a scene and means for sensing spatial phase characteristics of the electromagnetic energy as the configuration of the 3D surfaces relative to the system changes. The system includes means for creating a 3D scene model utilizing the spatial phase characteristics sensed in a plurality of configurations and means for displaying the 3D scene model in real-time. The means for displaying includes means for synthesizing depth cues.
    Type: Grant
    Filed: December 7, 2010
    Date of Patent: May 27, 2014
    Assignee: Photon-X, Inc.
    Inventors: Blair Allen Barbour, David Scott Ackerson
  • Publication number: 20140118494
    Abstract: A combined depth map is generated for a monoscopic image based on a weighted combination of a color depth map, a spatial depth map, and a motion depth map for the image, each describing the depth of pixels in the image relative to the image plane. The color depth map determines the depth of pixels according to their color, the spatial depth map determines the depth of pixels according to their location in the image, and the motion depth map determines the depth of pixels according to their motion in the image. Each of the depth maps is associated with a weight that is used to generate the weighted combination. The weights are adaptive to account for variation between different monoscopic images.
    Type: Application
    Filed: November 1, 2012
    Publication date: May 1, 2014
    Applicant: Google Inc.
    Inventors: Chen Wu, Debargha Mukherjee, Meng Wang
  • Patent number: 8704878
    Abstract: An image display apparatus for displaying an image of an object on a screen by using a projector includes a three-dimensional image display unit having a plurality of screens overlaid but spaced apart from one another, each of the screens diffusing and reflecting part of the light incident thereon and transmitting the remainder of the light, and an image projection unit having a plurality of projectors, each of the projectors is assigned to the corresponding one of the screens and projects an image of the object on the screen. The image projection unit displays a three-dimensional image of the object in the three-dimensional image display unit by projecting on the screens the shapes of the object in sectioning positions corresponding to the positions of the screens.
    Type: Grant
    Filed: April 20, 2009
    Date of Patent: April 22, 2014
    Assignee: Seiko Epson Corporation
    Inventors: Hiroshi Hasegawa, Akihiko Yamamoto
  • Patent number: 8684531
    Abstract: An image signal storing unit stores an image signal provided from the outside. An image processing unit appropriately processes the image signal stored in the image signal storing unit in accordance with the instruction from an adjusting unit. A projecting unit projects, onto a display area, light corresponding to an image created by the image processing unit. A display size determination unit computes the display size of the picture plane displayed on a screen based on an image captured by the camera provided adjacent to the projection-type video-image display device. The display size determination unit then determines whether or not the display size of the picture plane is equal to or larger than a predetermined upper-limit size.
    Type: Grant
    Filed: December 28, 2010
    Date of Patent: April 1, 2014
    Assignee: Vision3D Technologies, LLC
    Inventors: Ken Mashitani, Masutaka Inoue, Hideyuki Kanayama, Takashi Ikeda, Takahisa Ando, Kazuhiro Arai, Ryuhei Amano
  • Patent number: 8675042
    Abstract: A distance to an object is measured for each of a series of left images, and the count of a distance range including the calculated distance increases. A distance range with the highest frequency of appearance is specified from the counter information of a distance table counter, and a left image in which the distance included in the specified distance range is measured is selected. The adjustment amount of the parallax amount adjusted for the selected left image and a corresponding right image is determined to be the adjustment amount of the parallax amount of a panorama image. A series of left images is combined to generate a panorama image and a series of right images is combined to generate a panorama image. A panorama image displayed in stereoscopic view is generated based on the determined adjustment amount of the parallax amount.
    Type: Grant
    Filed: March 28, 2011
    Date of Patent: March 18, 2014
    Assignee: FUJIFILM Corporation
    Inventor: Hiroshi Shimaya
  • Patent number: 8633967
    Abstract: A method and a device enable the creation of three-dimensional images with more than two perspectives (e.g. pseudo-holographic images), especially to be reproduced with the aid of an autostereoscopic display or an autostereoscopic screen, from fed images having, in particular, only two perspectives, e.g., a left and a right image channel. Also, a related device creates and reproduces three-dimensional images having more than two perspectives, especially in the form of an autostereoscopic multi-user visualization system.
    Type: Grant
    Filed: April 23, 2007
    Date of Patent: January 21, 2014
    Assignee: Expert Treuhand GmbH
    Inventors: Sigrid Kamins-Naske, Ivo-Henning Naske, Valerie Antonia Naske
  • Patent number: 8628196
    Abstract: A display device and its display method are provided. The display method includes: first, inputting image message, then generating laser beams for forming an image according to the input image message to display an image. The image message includes angular message of each image pixels.
    Type: Grant
    Filed: October 14, 2008
    Date of Patent: January 14, 2014
    Assignee: Ocean of Peace Scientific Beijing Ltd.
    Inventors: Xuefeng Song, Jiangliang Li
  • Patent number: 8624961
    Abstract: The present invention relates to a method and an apparatus for 3-D display based on random constructive interference. It produces a number of discrete secondary light sources by using an amplitude-phase-modulator-array, which helps to create 3-D images by means of constructive interference. Next it employs a random-secondary-light-source-generator-array to shift the position of each secondary light source to a random place, eliminating multiple images due to high order diffraction. It could be constructed with low resolution liquid crystal screens to realize large size real-time color 3-D display, which could widely be applied to 3-D computer or TV screens, 3-D human-machine interaction, machine vision, and so on.
    Type: Grant
    Filed: January 23, 2009
    Date of Patent: January 7, 2014
    Inventor: Zhiyang Li
  • Patent number: 8619124
    Abstract: A video data processing system comprises a control module coupled with a source module for receiving video data from the source module, the video data being associated with at least one source viewpoint; and a view adjustment module coupled with the control module for generating at least one adjusted viewpoint of the video data based on at least one of a set viewpoint number and a number of the at least one source viewpoint. The set viewpoint number is associated with at least one of a viewpoint number of at least one previously received video data and a viewpoint number of at least one previously coupled player module.
    Type: Grant
    Filed: December 28, 2010
    Date of Patent: December 31, 2013
    Assignee: Industrial Technology Research Institute
    Inventors: Ya-Chi Tsai, Meng-Han Tsai, Chih-Chun Yang, Ji-Da Chen
  • Patent number: 8620064
    Abstract: A method is provided for imaging a workpiece by capturing successive frames of an elongate stationary field of view transverse to a workpiece transit path of a robot, while the workpiece is transported by the robot. The robot transit path is illuminated with an elongate illumination pattern transverse to the transit path to obtain a workpiece image of successive frames. Motion-induced image distortion is prevented or reduced adjusting the camera frame rate in real time in proportion to changes in robot velocity profile of the workpiece along the transit path.
    Type: Grant
    Filed: February 17, 2010
    Date of Patent: December 31, 2013
    Assignee: Applied Materials, Inc.
    Inventors: Abraham Ravid, Todd Egan, Karen Lingel