Patents by Inventor Bjorn Stenger

Bjorn Stenger has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10832437
    Abstract: A computer implemented method using artificial intelligence for matching images with locations and directions by acquiring a plurality of panoramic images, detecting objects and their locations in each of the panoramic images, acquiring a floorplan image, detecting objects and their locations in the floorplan image, comparing the objects and locations detect in each of the panoramic image to the objects and locations detected in the floorplan image, and determining a location in the floorplan image where each panoramic image was taken.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: November 10, 2020
    Assignee: RAKUTEN, INC.
    Inventors: Bjorn Stenger, Tomoyuki Mukasa, Jiu Xu, Lu Yan
  • Patent number: 10777002
    Abstract: A 3D model generating system for accurately estimating a shape of an entire space surrounded by a plurality of surfaces is provided. Image acquiring means of the 3D model generating system acquires a plurality of images respectively capturing different directions in a space surrounded by a plurality of surfaces. Partial model generating means generates a plurality of partial models respectively corresponding to the images, each of the partial models representing a portion of the surfaces captured in the images. Overall model generating means generates an overall model representing an entire surface based on the partial models generated by the partial model generating means.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: September 15, 2020
    Assignee: RAKUTEN, INC.
    Inventors: Tony Tung, Jiu Xu, Bjorn Stenger
  • Publication number: 20200169791
    Abstract: Voice storage data acquisition means of a display timing determination device acquires voice storage data storing a plurality of voices to be output sequentially. Timing data acquisition means acquires timing data on provisional display timings of a plurality of pieces of character information, which are to be sequentially displayed during reproduction of the voice storage data and represent content of the respective voices. Waveform analysis means analyzes a voice waveform of the voice storage data to acquire an output timing of each of the voices. Display timing determination means determines a definitive display timing of each of the pieces of character information based on the output timing of each of the voices acquired by the waveform analysis means and the provisional display timings of the respective pieces of character information determined based on the timing data.
    Type: Application
    Filed: September 8, 2016
    Publication date: May 28, 2020
    Inventor: Bjorn STENGER
  • Patent number: 10652623
    Abstract: Voice storage data acquisition means of a display timing determination device acquires voice storage data storing a plurality of voices to be output sequentially. Timing data acquisition means acquires timing data on provisional display timings of a plurality of pieces of character information, which are to be sequentially displayed during reproduction of the voice storage data and represent content of the respective voices. Waveform analysis means analyzes a voice waveform of the voice storage data to acquire an output timing of each of the voices. Display timing determination means determines a definitive display timing of each of the pieces of character information based on the output timing of each of the voices acquired by the waveform analysis means and the provisional display timings of the respective pieces of character information determined based on the timing data.
    Type: Grant
    Filed: September 8, 2016
    Date of Patent: May 12, 2020
    Assignee: RAKUTEN, INC.
    Inventor: Bjorn Stenger
  • Patent number: 10607405
    Abstract: Processing load on a computer can be reduced while saving the labor of photographing an object to estimate a size of the object. Photographed image acquiring means of a 3D model generating system acquires a photographed image in which a first object and a second object are disposed in a real space. Virtual image generating means generates a virtual image in which a first model representing the first object that is a standard size and a second model representing the second object that is not the standard size are disposed in a virtual space. Parameter determining means determines a size parameter indicating a size of the second object based on a result of comparing the photographed image with the virtual image.
    Type: Grant
    Filed: May 27, 2016
    Date of Patent: March 31, 2020
    Assignee: RAKUTEN, INC.
    Inventors: Tony Tung, Jiu Xu, Bjorn Stenger
  • Publication number: 20200082617
    Abstract: A 3D model generating system for accurately estimating a shape of an entire space surrounded by a plurality of surfaces is provided. Image acquiring means of the 3D model generating system acquires a plurality of images respectively capturing different directions in a space surrounded by a plurality of surfaces. Partial model generating means generates a plurality of partial models respectively corresponding to the images, each of the partial models representing a portion of the surfaces captured in the images. Overall model generating means generates an overall model representing an entire surface based on the partial models generated by the partial model generating means.
    Type: Application
    Filed: November 12, 2019
    Publication date: March 12, 2020
    Inventors: Tony TUNG, Jiu XU, Bjorn STENGER
  • Publication number: 20200074668
    Abstract: A computer implemented method using artificial intelligence for matching images with locations and directions by acquiring a plurality of panoramic images, detecting objects and their locations in each of the panoramic images, acquiring a floorplan image, detecting objects and their locations in the floorplan image, comparing the objects and locations detect in each of the panoramic, image to the objects and locations detected in the floorplan image, and determining a location in the floorplan image where each panoramic image was taken.
    Type: Application
    Filed: September 5, 2018
    Publication date: March 5, 2020
    Inventors: Bjorn STENGER, Tomoyuki MUKASA, Jiu XU, Lu YAN
  • Patent number: 10580205
    Abstract: A 3D model generating system for accurately estimating a shape of an entire space surrounded by a plurality of surfaces is provided. Image acquiring means of the 3D model generating system acquires a plurality of images respectively capturing different directions in a space surrounded by a plurality of surfaces. Partial model generating means generates a plurality of partial models respectively corresponding to the images, each of the partial models representing a portion of the surfaces captured in the images. Overall model generating means generates an overall model representing an entire surface based on the partial models generated by the partial model generating means.
    Type: Grant
    Filed: May 27, 2016
    Date of Patent: March 3, 2020
    Assignee: Rakuten, Inc.
    Inventors: Tony Tung, Jiu Xu, Bjorn Stenger
  • Patent number: 10540814
    Abstract: A 3D model generating system for accurately estimating a shape of an entire space surrounded by a plurality of surfaces is provided. Image acquiring means of the 3D model generating system acquires a plurality of images respectively capturing different directions in a space surrounded by a plurality of surfaces. Partial model generating means generates a plurality of partial models respectively corresponding to the images, each of the partial models representing a portion of the surfaces captured in the images. Overall model generating means generates an overall model representing an entire surface based on the partial models generated by the partial model generating means.
    Type: Grant
    Filed: May 27, 2016
    Date of Patent: January 21, 2020
    Assignee: Rakuten, Inc.
    Inventors: Tony Tung, Jiu Xu, Bjorn Stenger
  • Patent number: 10460158
    Abstract: In a method of generating a three dimensional representation of a human body shape from a depth image of a clothed human subject is disclosed.
    Type: Grant
    Filed: June 19, 2014
    Date of Patent: October 29, 2019
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Frank Perbet, Minh-Tri Pham, Bjorn Stenger, Sam Johnson
  • Patent number: 10410350
    Abstract: A method of using a computer to semantically segment an image using a convolutional neural network system where a processor configured to convolve an input image with a plurality of filters and outputting a first output volume, pool the first output volume and creating a first activation map, determine the level of influence of the first activation map on the semantic segmentation, up-pool the first activation map to form an output image having a same number of pixels as the input image, output a probabilistic segmentation result, labeling each pixel's probability that it is a particular label, and the determination of the level of influence of the first activation map on the semantic segmentation is done using a gate layer that is positioned between a pooling layer and an up-pooling layer.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: September 10, 2019
    Assignee: Rakuten, Inc.
    Inventors: Jiu Xu, Bjorn Stenger
  • Patent number: 10395147
    Abstract: A system for and method for improved computer vision image processing and image segmentation and recognition is disclosed. The system and method utilizes a cost function approach for improved image segmentation and recognition. In particular, a global cost function is defined and then the global cost function is minimized. This global cost function takes into account two processing pipelines of data determined by the operation of two different processing technologies upon the target input image. Constraints are utilized to ensure data consistency across the model and between the data pipelines. The system and method are useful for processing low quality images containing alphanumeric data such as floorplan images.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: August 27, 2019
    Assignee: RAKUTEN, INC.
    Inventors: Bjorn Stenger, Jiu Xu
  • Patent number: 10348938
    Abstract: First ratio acquisition means of a display timing determination device acquires, for each voice, a first ratio that relates to intervals between output timings of voices. Second ratio acquisition means acquires, for each piece of character information, a second ratio that relates to intervals between provisional display timings of pieces of character information. Identification means identifies, based on the first ratio of each voice and the second ratio of each piece of character information, an association relationship between the voice and the piece of character information. Display timing determination means determines a definitive display timing of each piece of character information based on the association relationship.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: July 9, 2019
    Assignee: Rakuten, Inc.
    Inventor: Bjorn Stenger
  • Publication number: 20190130233
    Abstract: A system for and method for improved computer vision image processing and image segmentation and recognition is disclosed. The system and method utilizes a cost function approach for improved image segmentation and recognition. In particular, a global cost function is defined and then the global cost function is minimized. This global cost function takes into account two processing pipelines of data determined by the operation of two different processing technologies upon the target input image. Constraints are utilized to ensure data consistency across the model and between the data pipelines. The system and method are useful for processing low quality images containing alphanumeric data such as floorplan images.
    Type: Application
    Filed: October 30, 2017
    Publication date: May 2, 2019
    Inventors: Bjorn STENGER, Jiu XU
  • Publication number: 20190130573
    Abstract: A method of using a computer to semantically segment an image using a convolutional neural network system where a processor configured to convolve an input image with a plurality of filters and outputting a first output volume, pool the first output volume and creating a first activation map, determine the level of influence of the first activation map on the semantic segmentation, up-pool the first activation map to form an output image having a same number of pixels as the input image, output a probabilistic segmentation result, labeling each pixel's probability that it is a particular label, and the determination of the level of influence of the first activation map on the semantic segmentation is done using a gate layer that is positioned between a pooling layer and an up-pooling layer.
    Type: Application
    Filed: October 30, 2017
    Publication date: May 2, 2019
    Inventors: Jiu XU, Bjorn STENGER
  • Publication number: 20190132491
    Abstract: First ratio acquisition means of a display timing determination device acquires, for each voice, a first ratio that relates to intervals between output timings of voices. Second ratio acquisition means acquires, for each piece of character information, a second ratio that relates to intervals between provisional display timings of pieces of character information. Identification means identifies, based on the first ratio of each voice and the second ratio of each piece of character information, an association relationship between the voice and the piece of character information. Display timing determination means determines definitive display timing of each piece of character information based on the association relationship.
    Type: Application
    Filed: August 31, 2017
    Publication date: May 2, 2019
    Inventor: Bjorn STENGER
  • Publication number: 20190005715
    Abstract: Processing load on a computer can be reduced while saving the labor of photographing an object to estimate a size of the object. Photographed image acquiring means of a 3D model generating system acquires a photographed image in which a first object and a second object are disposed in a real space. Virtual image generating means generates a virtual image in which a first model representing the first object that is a standard size and a second model representing the second object that is not the standard size are disposed in a virtual space. Parameter determining means determines a size parameter indicating a size of the second object based on a result of comparing the photographed image with the virtual image.
    Type: Application
    Filed: May 27, 2016
    Publication date: January 3, 2019
    Inventors: Tony TUNG, Jiu XU, Bjorn STENGER
  • Patent number: 10097813
    Abstract: A system for capturing 3D image data of a scene, including three light sources, each configured to emit light at a different wavelength to the other two sources and to illuminate the scene to be captured; a first video camera configured to receive light from the light sources which has been reflected from the scene, to isolate light received from each of the light sources, and to output data relating to the image captured for each of the three light sources; a depth sensor configured to capture depth map data of the scene; and an analysis unit configured to receive data from the first video camera and process the data to obtain data relating to a normal field obtained from the images captured for each of the three light sources, and to combine the normal field data with the depth map data to capture 3D image data of the scene.
    Type: Grant
    Filed: February 29, 2012
    Date of Patent: October 9, 2018
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Bjorn Stenger, Atsuto Maki, Frank Perbet, Oliver Woodford, Roberto Cipolla, Robert Anderson
  • Publication number: 20180182163
    Abstract: A 3D model generating system for accurately estimating a shape of an entire space surrounded by a plurality of surfaces is provided. Image acquiring means of the 3D model generating system acquires a plurality of images respectively capturing different directions in a space surrounded by a plurality of surfaces. Partial model generating means generates a plurality of partial models respectively corresponding to the images, each of the partial models representing a portion of the surfaces captured in the images. Overall model generating means generates an overall model representing an entire surface based on the partial models generated by the partial model generating means.
    Type: Application
    Filed: May 27, 2016
    Publication date: June 28, 2018
    Inventors: Tony TUNG, Jiu XU, Bjorn STENGER
  • Patent number: 9959657
    Abstract: A method of animating a computer generation of a head, the head having a mouth which moves in accordance with speech to be output by the head, said method comprising: providing an input related to the speech which is to be output by the movement of the lips; dividing said input into a sequence of acoustic units; selecting expression characteristics for the inputted text; converting said sequence of acoustic units to a sequence of image vectors using a statistical model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to an image vector, said image vector comprising a plurality of parameters which define a face of said head; and outputting said sequence of image vectors as video such that the mouth of said head moves to mime the speech associated with the input text with the selected expression, wherein a parameter of a predetermined type of each probability distribution in said selected expression is expressed as a weighted sum of pa
    Type: Grant
    Filed: January 29, 2014
    Date of Patent: May 1, 2018
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Javier Latorre-Martinez, Vincent Ping Leung Wan, Bjorn Stenger, Robert Anderson, Roberto Cipolla