Patents by Inventor Bjorn Stenger

Bjorn Stenger has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250029297
    Abstract: An information processing apparatus includes: a region detection unit configured to input a first image containing an object and additional information to a first machine learning model and cause the first machine learning model to detect a region of the additional information; a mask generation unit configured to generate a mask to be applied to the region of the additional information from information of the region of the additional information; and an image output unit configured to input the mask generated by the mask generation unit and the first image to a second machine learning model and cause the second machine learning mode to output a second image that is different from the first image, the second image being an image in which the additional information is erased from the first image and a region in the first image from which the additional information has been erased is inpainted.
    Type: Application
    Filed: July 20, 2023
    Publication date: January 23, 2025
    Applicant: Rakuten Group, Inc.
    Inventors: Bjorn STENGER, Hiya Roy
  • Patent number: 12159374
    Abstract: Provided is an information-processing device including: a CPU; and a memory storing instructions for causing the information-processing device, when executed by the CPU, to: select M (M?N) images from N (N>1) images; generate a combined image by arranging the selected M images in M frames defined in advance, respectively; and determine a total assessment value in association with the generated combined image, the total assessment value including at least a linear sum of a selection assessment value being a linear sum of single image assessment values of the selected M images and a combination assessment value being a single image assessment value of the combined image.
    Type: Grant
    Filed: November 5, 2021
    Date of Patent: December 3, 2024
    Assignee: RAKUTEN GROUP, INC.
    Inventors: Mitsuru Nakazawa, Bjorn Stenger
  • Publication number: 20240371129
    Abstract: A learning system, comprising at least one processor configured to: acquire a first training image relating to a first object having a first numerical value; acquire a second training image relating to a second object having a second numerical value; and execute learning processing of a learning model which estimates a numerical value to be estimated relating to an object to be estimated included in an estimation-target image, based on metric learning using the first training image and the second training image.
    Type: Application
    Filed: March 24, 2022
    Publication date: November 7, 2024
    Inventors: Yeongnam CHAE, Preetham PRAKASHA, Mijung KIM, Poulami RAHA, Bjorn STENGER
  • Publication number: 20240362885
    Abstract: Provided is an information-processing device including a CPU; and a memory storing instructions for causing the information-processing device, when executed by the CPU, to: include at least a machine learning model configured to receive an input image and an attribute as input, and to output at least one region in the input image and an evaluation value for each of the at least one region, wherein, for a common input image, the region and the evaluation value output when one attribute is given are different from the region and the evaluation value output when another attribute different from the one attribute is given.
    Type: Application
    Filed: September 30, 2021
    Publication date: October 31, 2024
    Inventors: Hiya ROY, Mitsuru NAKAZAWA, Bjorn STENGER
  • Publication number: 20240362915
    Abstract: A computer vision system, with at least one processor configured to: acquire, from a sports match video, moving image data of a first period and moving image data of a second period; by using a first machine learning model, generate, based on the moving image data of the first period, first estimation data and second estimation data for an estimation period; by using a second machine learning model, generate, based on the moving image data of the second period, the first estimation data and the second estimation data for the estimation period; and generate determination data based on the first estimation data and the second estimation data that are output from the first machine learning model and the first estimation data and the second estimation data that are output from the second machine learning model.
    Type: Application
    Filed: June 27, 2022
    Publication date: October 31, 2024
    Inventors: Takayoshi YAMASHITA, Hironobu FUJIYOSHI, Tsubasa HIRAKAWA, Mitsuru NAKAZAWA, Yeongnam CHAE, Bjorn STENGER
  • Publication number: 20240362831
    Abstract: Provided is an information-processing device including: a CPU; and a memory storing instructions for causing the information-processing device, when executed by the CPU, to: output an intermediate heatmap for input of an input image by using at least one of a plurality of machine learning models; and generate a heatmap based on an attribute of the input image, which is provided independently of the input image, and the intermediate heatmaps.
    Type: Application
    Filed: September 30, 2021
    Publication date: October 31, 2024
    Inventors: Hiya ROY, Mitsuru NAKAZAWA, Bjorn STENGER
  • Patent number: 12131579
    Abstract: An information processing device extracts, from an image taken by an imaging device, a human area in which it is determined that a human is present, acquires a representative value of first feature values, the first feature values being calculated by inputting, to a conversion function, each color of pixels included in a part of the human area, corrects, based on the representative value, a skin range indicating that a color indicated by a feature value acquired with the conversion function is a color of human skin, and determines whether a human is present in a part of the image acquired by the imaging device, based on whether a second feature value calculated with the conversion function for each of a plurality of pixels forming the part of the image is within the corrected skin range.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: October 29, 2024
    Assignee: RAKUTEN GROUP, INC.
    Inventors: Yeongnam Chae, Bjorn Stenger
  • Publication number: 20240338930
    Abstract: A computer vision system, with at least one processor configured to: acquire, from a sports match video, a plurality of pieces of consecutive image data indicating a portion of the sports match video, the plurality of pieces of consecutive image data including a plurality of pieces of first consecutive image data that are consecutive; and execute an estimation, by using a machine learning model, of whether the portion is of a predetermined scene type, wherein, in the estimation, the at least one processor is configured to.
    Type: Application
    Filed: March 28, 2022
    Publication date: October 10, 2024
    Inventors: Takayoshi YAMASHITA, Hironobu FUJIYOSHI, Tsubasa HIRAKAWA, Mitsuru NAKAZAWA, Yeongnam CHAE, Bjorn STENGER
  • Publication number: 20240320956
    Abstract: A computer vision system, with at least one processor configured to: acquire, from a sports match video, a plurality of pieces of consecutive image data indicating a portion of the sports match video, the plurality of pieces of consecutive image data including a plurality of pieces of first consecutive image data that are consecutive and a plurality of pieces of second consecutive image data that are consecutive after the plurality of pieces of first consecutive image data; and execute an estimation, by using a machine learning model, of whether the portion is of a predetermined scene type.
    Type: Application
    Filed: March 28, 2022
    Publication date: September 26, 2024
    Inventors: Takayoshi YAMASHITA, Hironobu FUJIYOSHI, Tsubasa HIRAKAWA, Mitsuru NAKAZAWA, Yeongnam CHAE, Bjorn STENGER
  • Publication number: 20240281468
    Abstract: Provided is an information-processing device for extracting an important image from target information including images and a text, the information-processing device including: a CPU; and a memory storing instructions for causing the information-processing device, when executed by the CPU, to: determine a category indicating an attribute of each image; extract a category for each division of the text; determine a score of the category based on the text; and extract, as a most important image, one of the images corresponding to the category selected based on the score.
    Type: Application
    Filed: October 26, 2021
    Publication date: August 22, 2024
    Inventors: Mitsuru NAKAZAWA, Bjorn STENGER
  • Publication number: 20240249387
    Abstract: Provided is an information-processing device including: a CPU; and a memory storing instructions for causing the information-processing device, when executed by the CPU, to: select M (M?N) images from N (N>1) images; generate a combined image by arranging the selected M images in M frames defined in advance, respectively; and determine a total assessment value in association with the generated combined image, the total assessment value including at least a linear sum of a selection assessment value being a linear sum of single image assessment values of the selected M images and a combination assessment value being a single image assessment value of the combined image.
    Type: Application
    Filed: November 5, 2021
    Publication date: July 25, 2024
    Inventors: Mitsuru NAKAZAWA, Bjorn STENGER
  • Publication number: 20240221415
    Abstract: Described herein is an information processing apparatus, including: a graph image acquisition unit configured to acquire a graph image; a graph classification unit configured to classify the graph image acquired by the graph image acquisition unit by graph type; a probability map generation unit configured to generate, from the graph image, a probability map that is of a different type by the graph type using a single neural network; a component extraction unit configured to extract a component in the graph image based on the probability map generated by the probability map generation unit; a value extraction unit configured to extract a value of the component of the graph image extracted by the component extraction unit; and an output unit configured to output the value of the component extracted by the value extraction unit.
    Type: Application
    Filed: June 1, 2021
    Publication date: July 4, 2024
    Applicant: Rakuten Group Group, Inc.
    Inventors: Hajime KATO, Mitsuru NAKAZAWA, Bjorn STENGER
  • Publication number: 20240221354
    Abstract: To analyze images of more diverse graphs at higher speed and accuracy, disclosed herein is an information processing apparatus, comprising: a graph image acquisition unit configured to acquire a graph image; a graph classification unit configured to classify the graph image acquired by graph type; a probability map generation unit configured to generate, from the graph image, a probability map that is of a different type by the graph type; a component extraction unit configured to extract a plurality of components in the graph image based on the probability map generated by the probability map generation unit, and trace a graph with the plurality of components extracted; a value extraction unit configured to extract values of the components of the graph image extracted by the component extraction unit; and an output unit configured to output the values of the components extracted.
    Type: Application
    Filed: June 1, 2021
    Publication date: July 4, 2024
    Applicant: Rakuten Group, Inc.
    Inventors: Hajime KATO, Mitsuru NAKAZAWA, Bjorn STENGER
  • Publication number: 20240221050
    Abstract: An information processing apparatus (10): sets a plurality of styles that each indicate a moving-image composition of a moving image which relates to a predetermined item and in which a plurality of pieces of image content corresponding to the predetermined item are used; acquires an attribute of a target user; estimates the most-suitable style for the target user among the plurality of styles based on the plurality of pieces of image content and the attribute of the target user; and provides a moving image that is in accordance with the estimated style to the user.
    Type: Application
    Filed: December 21, 2021
    Publication date: July 4, 2024
    Applicant: Rakuten Group, Inc.
    Inventors: Bjorn STENGER, Mitsuru MAKAZAWA
  • Publication number: 20240212102
    Abstract: Provided is an image processing system with at least one processor being configured to: calculate a color-adjusted pixel value vector, which is output of a transformation function defined by a formula including a term of a product of a pixel value vector and a transformation matrix, wherein the pixel value vector indicates a color of each of one or more adjustment pixels, which are at least the one or more target pixels out of pixels of the first image, and the transformation matrix has, as elements, a plurality of transformation parameters set to each of one or more adjustment pixels in a first parameter map, which is the second parameter map increased in resolution and which has the first resolution; and acquire a color-adjusted image including a color-adjusted pixel, the color-adjusted pixel having a color indicated by the color-adjusted pixel value vector.
    Type: Application
    Filed: December 20, 2023
    Publication date: June 27, 2024
    Inventors: Julian Jorge ANDRADE GUERREIRO, Mitsuru NAKAZAWA, Bjorn STENGER
  • Patent number: 11989943
    Abstract: Disclosed herein is an image frame extraction apparatus that acquires a video image; extracts features of each of a plurality of image frames of the acquired video image; analyzes the extracted features of each of the plurality of image frames, and extracts candidates of a representative frame from the plurality of image frames; and, for each of the extracted candidates of the representative frame, calculates a displacement in a shape space of a pose of an object in the image frame with respect to a reference pose, and select the representative frame from the candidates of the representative frame based on the calculated displacement in the shape space.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: May 21, 2024
    Assignee: Rakuten Group, Inc.
    Inventors: Bjorn Stenger, Geethu Jacob
  • Publication number: 20240037386
    Abstract: A method, system, apparatus, and non-transitory computer-readable medium for image processing using a multi-task neural network framework may be provided. The method be executed by one or more processors, and may include receiving an input image; and generating one or more image patches based on the input image. The method may include performing an image processing task based on the input image using the multi-task neural network framework, wherein the multi-task neural network framework is trained using an adaptive feature distillation function, and wherein the adaptive feature distillation function is based on a comparison of intermediate features of the multi-task neural network framework and intermediate features of a plurality of single-task neural network models. The method may include generating an output of the image processing task based on up sampling an output of the multi-task neural network framework.
    Type: Application
    Filed: July 28, 2022
    Publication date: February 1, 2024
    Applicant: Rakuten Group, Inc.
    Inventors: Geethu JACOB, Vishal AGARWAL, Bjorn STENGER
  • Publication number: 20240037930
    Abstract: A method, system, apparatus, and non-transitory computer-readable medium for image processing using a multi-task neural network framework may be provided. The method be performed by one or more processors and may include receiving an input image, and performing an image processing task based on the input image using the multi-task neural network framework, wherein the multi-task neural network framework is trained using a combination of task specific losses, the task specific losses including a plurality of first losses associated with the multi-task neural network framework and a plurality of second losses associated with a plurality of single-task neural network models. The method may also include generating an output of the image processing task based on up sampling an output of the multi-task neural network framework.
    Type: Application
    Filed: July 29, 2022
    Publication date: February 1, 2024
    Applicant: Rakuten Group, Inc.
    Inventors: Geethu JACOB, Vishal AGARWAL, Bjorn STENGER
  • Publication number: 20240029471
    Abstract: An information processing device extracts, from an image taken by an imaging device, a human area in which it is determined that a human is present, acquires a representative value of first feature values, the first feature values being calculated by inputting, to a conversion function, each color of pixels included in a part of the human area, corrects, based on the representative value, a skin range indicating that a color indicated by a feature value acquired with the conversion function is a color of human skin, and determines whether a human is present in a part of the image acquired by the imaging device, based on whether a second feature value calculated with the conversion function for each of a plurality of pixels forming the part of the image is within the corrected skin range.
    Type: Application
    Filed: March 22, 2021
    Publication date: January 25, 2024
    Inventors: Yeongnam CHAE, Bjorn STENGER
  • Publication number: 20220207874
    Abstract: Disclosed herein is an image frame extraction apparatus that acquires a video image; extracts features of each of a plurality of image frames of the acquired video image; analyzes the extracted features of each of the plurality of image frames, and extracts candidates of a representative frame from the plurality of image frames; and, for each of the extracted candidates of the representative frame, calculates a displacement in a shape space of a pose of an object in the image frame with respect to a reference pose, and select the representative frame from the candidates of the representative frame based on the calculated displacement in the shape space.
    Type: Application
    Filed: December 13, 2021
    Publication date: June 30, 2022
    Applicant: Rakuten Group, Inc.
    Inventors: Bjorn STENGER, Geethu JACOB