Patents by Inventor Bjorn Stenger

Bjorn Stenger has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190005715
    Abstract: Processing load on a computer can be reduced while saving the labor of photographing an object to estimate a size of the object. Photographed image acquiring means of a 3D model generating system acquires a photographed image in which a first object and a second object are disposed in a real space. Virtual image generating means generates a virtual image in which a first model representing the first object that is a standard size and a second model representing the second object that is not the standard size are disposed in a virtual space. Parameter determining means determines a size parameter indicating a size of the second object based on a result of comparing the photographed image with the virtual image.
    Type: Application
    Filed: May 27, 2016
    Publication date: January 3, 2019
    Inventors: Tony TUNG, Jiu XU, Bjorn STENGER
  • Patent number: 10097813
    Abstract: A system for capturing 3D image data of a scene, including three light sources, each configured to emit light at a different wavelength to the other two sources and to illuminate the scene to be captured; a first video camera configured to receive light from the light sources which has been reflected from the scene, to isolate light received from each of the light sources, and to output data relating to the image captured for each of the three light sources; a depth sensor configured to capture depth map data of the scene; and an analysis unit configured to receive data from the first video camera and process the data to obtain data relating to a normal field obtained from the images captured for each of the three light sources, and to combine the normal field data with the depth map data to capture 3D image data of the scene.
    Type: Grant
    Filed: February 29, 2012
    Date of Patent: October 9, 2018
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Bjorn Stenger, Atsuto Maki, Frank Perbet, Oliver Woodford, Roberto Cipolla, Robert Anderson
  • Publication number: 20180182163
    Abstract: A 3D model generating system for accurately estimating a shape of an entire space surrounded by a plurality of surfaces is provided. Image acquiring means of the 3D model generating system acquires a plurality of images respectively capturing different directions in a space surrounded by a plurality of surfaces. Partial model generating means generates a plurality of partial models respectively corresponding to the images, each of the partial models representing a portion of the surfaces captured in the images. Overall model generating means generates an overall model representing an entire surface based on the partial models generated by the partial model generating means.
    Type: Application
    Filed: May 27, 2016
    Publication date: June 28, 2018
    Inventors: Tony TUNG, Jiu XU, Bjorn STENGER
  • Patent number: 9959657
    Abstract: A method of animating a computer generation of a head, the head having a mouth which moves in accordance with speech to be output by the head, said method comprising: providing an input related to the speech which is to be output by the movement of the lips; dividing said input into a sequence of acoustic units; selecting expression characteristics for the inputted text; converting said sequence of acoustic units to a sequence of image vectors using a statistical model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to an image vector, said image vector comprising a plurality of parameters which define a face of said head; and outputting said sequence of image vectors as video such that the mouth of said head moves to mime the speech associated with the input text with the selected expression, wherein a parameter of a predetermined type of each probability distribution in said selected expression is expressed as a weighted sum of pa
    Type: Grant
    Filed: January 29, 2014
    Date of Patent: May 1, 2018
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Javier Latorre-Martinez, Vincent Ping Leung Wan, Bjorn Stenger, Robert Anderson, Roberto Cipolla
  • Patent number: 9905047
    Abstract: In one embodiment a method of generating a three dimensional model of a subject is disclosed. The method comprises receiving point cloud data for a subject; receiving user inputs indicating a plurality of cubes, and a grouping of the cubes into a plurality of blocks to form a representation of a class of subjects; generating a first mesh comprising a plurality of quadrilaterals by subdividing patches corresponding to faces of blocks of the plurality of blocks; fitting the first mesh to the point cloud data to generate a fitted mesh; iteratively generating further meshes, each comprising a plurality of quadrilaterals by subdividing patches of the fitted mesh from the previous iteration and fitting the further mesh to the point cloud data; and outputting as the three dimensional model of the subject the iteratively generated fitted mesh.
    Type: Grant
    Filed: October 23, 2015
    Date of Patent: February 27, 2018
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Frank Perbet, Bjorn Stenger, Minh-Tri Pham
  • Patent number: 9767604
    Abstract: A method of object recognition and/or registration includes receiving a point cloud, arranging the points of the point cloud into a hierarchical search tree, and determining geometric information of the points located within a region, by identifying a highest level tree nodes where all of descendent leaf nodes are contained within the region and selecting the leaf nodes for the points where no sub-tree is entirely contained within the region, such that the points falling within the region are represented by the smallest number of nodes and performing statistical operations on the nodes representing the points in the region. The geometric information includes descriptors of features in the point cloud. The method further includes comparing the feature descriptors with a database of feature descriptors for a plurality of objects.
    Type: Grant
    Filed: July 23, 2015
    Date of Patent: September 19, 2017
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Minh-Tri Pham, Riccardo Gherardi, Frank Perbet, Bjorn Stenger, Sam Johnson, Oliver Woodford, Pablo Alcantarilla, Roberto Cipolla
  • Publication number: 20170147874
    Abstract: In a method of generating a three dimensional representation of a human body shape from a depth image of a clothed human subject is disclosed.
    Type: Application
    Filed: June 19, 2014
    Publication date: May 25, 2017
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Frank PERBET, Minh-Tri PHAM, Bjorn STENGER, Sam JOHNSON
  • Patent number: 9646408
    Abstract: According to one embodiment, a method of generating a three dimensional representation of a subject from a depth image, comprises comparing a depth image of the subject with a plurality of representative images, wherein each representative image is associated with a respective parametric model of a subject; identifying a representative image of the plurality of representative images as a closest representative image to the depth image of the subject; selecting the parametric model associated with the closest representative image to the depth image; and generating a three dimensional representation of the subject by fitting the selected parametric model to the depth image of the subject.
    Type: Grant
    Filed: May 6, 2014
    Date of Patent: May 9, 2017
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Sam Johnson, Frank Perbet, Bjorn Stenger, Minh-Tri Pham, Oliver Woodford, Riccardo Gherardi, Roberto Cipolla
  • Patent number: 9361722
    Abstract: A method of animating a computer generation of a head and displaying the text of an electronic book, such that the head has a mouth which moves in accordance with the speech of the text of the electronic book to be output by the head and a word or group of words from the text is displayed while simultaneously being mimed by the mouth, wherein input text is divided into a sequence of acoustic units, which are converted to a sequence of image vectors and into a sequence of text display indicators. The sequence of image vectors is outputted as video such that the mouth of said head moves to mime the speech associated with the input text with a selected expression, and the sequence of text display indicators is output as video which is synchronized with the lip movement of the head.
    Type: Grant
    Filed: August 8, 2014
    Date of Patent: June 7, 2016
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Javier Latorre-Martinez, Vincent Ping Leung Wan, Balakrishna Venkata Jagannadha Kolluru, Ioannis Stylianou, Robert Arthur Blokland, Norbert Braunschweiler, Kayoko Yanagisawa, Langzhou Chen, Ranniery Maia, Robert Anderson, Bjorn Stenger, Roberto Cipolla, Neil Baker
  • Publication number: 20160148393
    Abstract: A method of calculating a similarity measure between first and second image patches, which include respective first and second intensity values associated with respective elements of the first and second image patches, and which have a corresponding size and shape such that each element of the first image patch corresponds to an element on the second image patch. The method: determines a set of sub-regions on the second image patch corresponding to elements of the first image patch and having first intensity values within a range defined for that sub-region; calculates variance, for each sub-region of the set over all of the elements of that sub-region, of a function of the second intensity value associated with that element and the first intensity value associated with the corresponding element of the first image patch; and calculates similarity measure as the sum over all sub-regions of the calculated variances.
    Type: Application
    Filed: November 5, 2013
    Publication date: May 26, 2016
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Atsuto MAKI, Riccardo GHERARDI, Oliver WOODFORD, Frank PERBET, Minh-Tri PHAM, Bjorn STENGER, Sam JOHNSON, Roberto CIPOLLA
  • Publication number: 20160117859
    Abstract: In one embodiment a method of generating a three dimensional model of a subject is disclosed. The method comprises receiving point cloud data for a subject; receiving user inputs indicating a plurality of cubes, and a grouping of the cubes into a plurality of blocks to form a representation of a class of subjects; generating a first mesh comprising a plurality of quadrilaterals by subdividing patches corresponding to faces of blocks of the plurality of blocks; fitting the first mesh to the point cloud data to generate a fitted mesh; iteratively generating further meshes, each comprising a plurality of quadrilaterals by subdividing patches of the fitted mesh from the previous iteration and fitting the further mesh to the point cloud data; and outputting as the three dimensional model of the subject the iteratively generated fitted mesh.
    Type: Application
    Filed: October 23, 2015
    Publication date: April 28, 2016
    Applicant: Kabushiki Kaisha Toshiba
    Inventors: Frank PERBET, Bjorn STENGER, Minh-Tri PHAM
  • Publication number: 20160027208
    Abstract: A method for analysing a point cloud, the method comprising: receiving a point cloud, comprising a plurality of points, each point representing a spatial point in an image; arranging the points into a hierarchical search tree, with a lowest level comprising a plurality of leaf nodes, where each leaf node corresponds to a point of the point cloud, the search tree comprising a plurality of hierarchical levels with tree nodes in each of the hierarchical levels, the nodes being vertically connected to each other though the hierarchy by branches, wherein at least one moment of the property of the descendant nodes is stored in each tree node; and determining geometric information of the points located within a region, by identifying the highest level tree nodes where all of the descendent leaf nodes are contained within the region and selecting the leaf nodes for the points where no sub-tree is entirely contained within the region, such that such that the points falling within the region are represented by the s
    Type: Application
    Filed: July 23, 2015
    Publication date: January 28, 2016
    Applicant: Kabushiki Kaisha Toshiba
    Inventors: Minh-Tri PHAM, Riccardo GHERARDI, Frank PERBET, Bjorn STENGER, Sam JOHNSON, Oliver WOODFORD, Pablo ALCANTARILLA, Roberto CIPOLLA
  • Patent number: 9014422
    Abstract: A moving feature is recognized in a video sequence by comparing its movement with a characteristic pattern. Possible trajectories through the video sequence are generated for an object by identifying potential matches of points in pairs of frames of the video sequence. When looking for the characteristic pattern, a number of possible trajectories are analyzed. The possible trajectories may be selected so that they are suitable for analysis. This may include selecting longer trajectories that can be easier to analyze. Thereby where the object being tracked is momentarily behind another object a continuous trajectory is generated.
    Type: Grant
    Filed: August 6, 2009
    Date of Patent: April 21, 2015
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Frank Perbet, Atsuto Maki, Bjorn Stenger
  • Patent number: 9008439
    Abstract: A method of comparing two object poses, wherein each object pose is expressed in terms of position, orientation and scale with respect to a common coordinate system, the method comprising: calculating a distance between the two object poses, the distance being calculated using the distance function: d sRt ? ( X , Y ) = d s 2 ? ( X , Y ) ? s 2 + d r 2 ? ( X , Y ) ? r 2 + d t 2 ? ( X , Y ) ? t 2 .
    Type: Grant
    Filed: August 14, 2014
    Date of Patent: April 14, 2015
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Minh-Tri Pham, Oliver Woodford, Frank Perbet, Atsuto Maki, Bjorn Stenger, Roberto Cipolla
  • Publication number: 20150042662
    Abstract: A method of animating a computer generation of a head and displaying the text of an electronic book, such that the head has a mouth which moves in accordance with the speech of the text of the electronic book to be output by the head and a word or group of words from the text is displayed while simultaneously being mimed by the mouth, said method comprising: inputting the text of said book; dividing said input text into a sequence of acoustic units; determining expression characteristics for the inputted text; calculating a duration for each acoustic unit using a duration model; converting said sequence of acoustic units to a sequence of image vectors using a statistical model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to an image vector, said image vector comprising a plurality of parameters which define a face of said head; converting said sequence of acoustic units into a sequence of text display indicators using an text dis
    Type: Application
    Filed: August 8, 2014
    Publication date: February 12, 2015
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Javier Latorre-Martinez, Vincent Ping Leung Wan, Balakrishna Venkata Jagannadha Kolluru, Ioannis Stylianou, Robert Arthur Blokland, Norbert Braunschweiler, Kayoko Yanagisawa, Langzhou Chen, Ranniery MAIA, Robert Anderson, Bjorn Stenger, Roberto Cipolla, Neil Baker
  • Publication number: 20150036918
    Abstract: A method of comparing two object poses, wherein each object pose is expressed in terms of position, orientation and scale with respect to a common coordinate system, the method comprising: calculating a distance between the two object poses, the distance being calculated using the distance function: d sRt ? ( X , Y ) = d s 2 ? ( X , Y ) ? s 2 + d r 2 ? ( X , Y ) ? r 2 + d t 2 ? ( X , Y ) ? t 2 .
    Type: Application
    Filed: August 14, 2014
    Publication date: February 5, 2015
    Applicant: Kabushiki Kaisha Toshiba
    Inventors: Minh-Tri Pham, Oliver Woodford, Frank Perbet, Atsuto Maki, Bjorn Stenger, Roberto Cipolla
  • Publication number: 20140375635
    Abstract: According to one embodiment, a method of generating a three dimensional representation of a subject from a depth image, comprises comparing a depth image of the subject with a plurality of representative images, wherein each representative image is associated with a respective parametric model of a subject; identifying a representative image of the plurality of representative images as a closest representative image to the depth image of the subject; selecting the parametric model associated with the closest representative image to the depth image; and generating a three dimensional representation of the subject by fitting the selected parametric model to the depth image of the subject.
    Type: Application
    Filed: May 6, 2014
    Publication date: December 25, 2014
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: SAM JOHNSON, FRANK PERBET, BJORN STENGER, MINH-TRI PHAM, OLIVER WOODFORD, RICCARDO GHERARDI, ROBERTO CIPOLLA
  • Patent number: 8849039
    Abstract: A method of comparing two object poses, wherein each object pose is expressed in terms of position, orientation and scale with respect to a common coordinate system, the method comprising: calculating a distance between the two object poses, the distance being calculated using the distance function: d sRt ? ( X , Y ) = d s 2 ? ( X , Y ) ? s 2 + d r 2 ? ( X , Y ) ? r 2 + d t 2 ? ( X , Y ) ? t 2 .
    Type: Grant
    Filed: February 28, 2012
    Date of Patent: September 30, 2014
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Minh-Tri Pham, Oliver Woodford, Frank Perbet, Atsuto Maki, Bjorn Stenger, Roberto Cipolla
  • Patent number: 8811666
    Abstract: A characteristic motion in a video is identified by determining pairs of moving features that have an indicative relationship between the motions of the two moving features in the pair. For example, the motion of a pedestrian is identified by an indicative relationship between the motions of the pedestrian's feet. This indicative relationship may be that one of the feet moves relative to the surroundings while the other remains stationary.
    Type: Grant
    Filed: August 6, 2009
    Date of Patent: August 19, 2014
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Atsuto Maki, Frank Perbet, Bjorn Stenger
  • Publication number: 20140210830
    Abstract: A method of animating a computer generation of a head, the head having a mouth which moves in accordance with speech to be output by the head, said method comprising: providing an input related to the speech which is to be output by the movement of the lips; dividing said input into a sequence of acoustic units; selecting expression characteristics for the inputted text; converting said sequence of acoustic units to a sequence of image vectors using a statistical model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to an image vector, said image vector comprising a plurality of parameters which define a face of said head; and outputting said sequence of image vectors as video such that the mouth of said head moves to mime the speech associated with the input text with the selected expression, wherein a parameter of a predetermined type of each probability distribution in said selected expression is expressed as a weighted sum of pa
    Type: Application
    Filed: January 29, 2014
    Publication date: July 31, 2014
    Applicant: Kabushiki Kaisha Toshiba
    Inventors: Javier LATORRE-MARTINEZ, Vincent Ping Leung Wan, Bjorn Stenger, Robert Anderson, Roberto Cipolla