Patents by Inventor Frederik ZILLY

Frederik ZILLY has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10803624
    Abstract: An apparatus comprises a first interface for receiving a plurality of partially overlapping images of an object from a corresponding plurality of cameras being arranged along a first and a second direction according to a camera pattern. The apparatus comprises an analyzing unit configured for selecting at least one corresponding reference point in an overlap area of a set of images, and for determining displacement information along the first and the second direction of the reference point in each of the other images of the set of images. A misalignment of the plurality of images along the first and the second direction is compensated by the displacement information so as to obtain aligned images. The apparatus comprises a determining unit configured for determining offset information between principal points of the plurality of cameras using at least three aligned images.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: October 13, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Matthias Ziegler, Frederik Zilly, Joachim Keinert
  • Patent number: 10776902
    Abstract: Image processing device for producing in real-time a digital composite image from a sequence of digital images recorded by a camera device, in particular an endoscopic camera device, the image processing device including a selecting unit, a key point detection unit, a transforming unit and a joining unit, wherein the key point detection unit includes a maximum detection unit configured for executing following steps separately for the filter response for the reference image and for the filter response for the further image, wherein a variable threshold is used: i) creating blocks by dividing the respective filter response, ii) calculating the variable threshold for each of the blocks, iii) discarding those blocks of the blocks from further consideration, in which the respective filter response at a reference point of the respective block is less than the respective variable threshold.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: September 15, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Tobias Bergen, Michaela Benz, Andreas Ernst, Thomas Wittenberg, Christian Muenzenmayer, Frederik Zilly, Malte Avenhaus
  • Publication number: 20200027243
    Abstract: An apparatus comprises a first interface for receiving a plurality of partially overlapping images of an object from a corresponding plurality of cameras being arranged along a first and a second direction according to a camera pattern. The apparatus comprises an analyzing unit configured for selecting at least one corresponding reference point in an overlap area of a set of images, and for determining displacement information along the first and the second direction of the reference point in each of the other images of the set of images. A misalignment of the plurality of images along the first and the second direction is compensated by the displacement information so as to obtain aligned images. The apparatus comprises a determining unit configured for determining offset information between principal points of the plurality of cameras using at least three aligned images.
    Type: Application
    Filed: September 27, 2019
    Publication date: January 23, 2020
    Inventors: Matthias ZIEGLER, Frederik ZILLY, Joachim KEINERT
  • Patent number: 10511787
    Abstract: The invention provides a light-field camera for capturing multiple views of a scene, representing samples of a light-field, having: a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array having a plurality of secondary cameras, each of the secondary cameras being configured for capturing a secondary digital two-dimensional image of the scene to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged such that an incident light beam originating from the scene is split up in a first partial light beam, directed to the primary camera, and a second partial light beam, directed to the camera array; and a processing unit configured for receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corr
    Type: Grant
    Filed: February 11, 2016
    Date of Patent: December 17, 2019
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Frederik Zilly, Joachim Keinert, Matthias Ziegler, Michael Schoeberl
  • Publication number: 20190279338
    Abstract: Image processing device for producing in real-time a digital composite image from a sequence of digital images recorded by a camera device, in particular an endoscopic camera device, the image processing device including a selecting unit, a key point detection unit, a transforming unit and a joining unit, wherein the key point detection unit includes a maximum detection unit configured for executing following steps separately for the filter response for the reference image and for the filter response for the further image, wherein a variable threshold is used: i) creating blocks by dividing the respective filter response, ii) calculating the variable threshold for each of the blocks, iii) discarding those blocks of the blocks from further consideration, in which the respective filter response at a reference point of the respective block is less than the respective variable threshold.
    Type: Application
    Filed: May 30, 2019
    Publication date: September 12, 2019
    Inventors: Tobias BERGEN, Michaela BENZ, Andreas ERNST, Thomas WITTENBERG, Christian MUENZENMAYER, Frederik ZILLY, Malte AVENHAUS
  • Publication number: 20160248987
    Abstract: The invention provides a light-field camera for capturing multiple views of a scene, representing samples of a light-field, having: a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array having a plurality of secondary cameras, each of the secondary cameras being configured for capturing a secondary digital two-dimensional image of the scene to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged such that an incident light beam originating from the scene is split up in a first partial light beam, directed to the primary camera, and a second partial light beam, directed to the camera array; and a processing unit configured for receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corr
    Type: Application
    Filed: February 11, 2016
    Publication date: August 25, 2016
    Inventors: Frederik ZILLY, Joachim KEINERT, Matthias ZIEGLER, Michael SCHOEBERL
  • Patent number: 9361677
    Abstract: A filter structure for filtering a disparity map includes a first filter, a second filter, and a filter selector. The first filter is for filtering a contemplated section of the disparity map according to a first measure of central tendency. The second filter is for filtering the contemplated section of the disparity maps according to a second measure of central tendency. The filter selector is provided for selecting the first filter or the second filter for filtering the contemplated section of the disparity map, the selection being based on at least one local property of the contemplated section. A corresponding method for filtering a disparity map includes determining a local property of the contemplated section and selecting a filter. The contemplated section is then filtered using the first filter or the second filter depending on a result of the selection.
    Type: Grant
    Filed: May 27, 2014
    Date of Patent: June 7, 2016
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Peter Kauff, Christian Riechert, Frederik Zilly, Marcus Mueller
  • Patent number: 9158994
    Abstract: An apparatus for estimating a disparity map based on at least two images is provided. The apparatus includes at least two processing units, which include a pixel recursion unit configured to determine a disparity value as a pixel recursion disparity candidate based on a plurality of pixel values of the at least two images and a selector configured to select a selected disparity candidate to determine at least one of the disparity map values of the disparity map. The selector is adapted to select the selected disparity candidate from a candidate group assigned to the selector. The candidate group assigned to the selector includes the pixel recursion disparity candidate, a second disparity candidate and a third disparity candidate. Moreover, the selector is adapted to select the selected disparity candidate independently from a different selector of a different processing unit of the at least two processing units.
    Type: Grant
    Filed: May 7, 2014
    Date of Patent: October 13, 2015
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Oliver Schreer, Frederik Zilly, Peter Kauff, Christian Riechert, Marcus Mueller
  • Publication number: 20140270485
    Abstract: A filter structure for filtering a disparity map includes a first filter, a second filter, and a filter selector. The first filter is for filtering a contemplated section of the disparity map according to a first measure of central tendency. The second filter is for filtering the contemplated section of the disparity maps according to a second measure of central tendency. The filter selector is provided for selecting the first filter or the second filter for filtering the contemplated section of the disparity map, the selection being based on at least one local property of the contemplated section. A corresponding method for filtering a disparity map includes determining a local property of the contemplated section and selecting a filter. The contemplated section is then filtered using the first filter or the second filter depending on a result of the selection.
    Type: Application
    Filed: May 27, 2014
    Publication date: September 18, 2014
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Peter KAUFF, Christian RIECHERT, Frederik ZILLY, Marcus MUELLER
  • Publication number: 20140241637
    Abstract: An apparatus for estimating a disparity map based on at least two images is provided. The apparatus includes at least two processing units, which include a pixel recursion unit configured to determine a disparity value as a pixel recursion disparity candidate based on a plurality of pixel values of the at least two images and a selector configured to select a selected disparity candidate to determine at least one of the disparity map values of the disparity map. The selector is adapted to select the selected disparity candidate from a candidate group assigned to the selector. The candidate group assigned to the selector includes the pixel recursion disparity candidate, a second disparity candidate and a third disparity candidate. Moreover, the selector is adapted to select the selected disparity candidate independently from a different selector of a different processing unit of the at least two processing units.
    Type: Application
    Filed: May 7, 2014
    Publication date: August 28, 2014
    Applicant: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Oliver SCHREER, Frederik ZILLY, Peter KAUFF, Christian RIECHERT, Marcus MUELLER