Patents by Inventor Tomoyuki MUKASA

Tomoyuki MUKASA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240104754
    Abstract: [Problem] The present disclosure has an object of correcting the orientation of a captured image captured during flight. [Solving Means] An information processing system includes: a captured image acquisition unit that acquires a captured image captured during flight by an imaging device mounted on an airplane; a relevant information acquisition unit that acquires information detected using a sensor mounted on the airplane; and an image correction unit that acquires, by correcting the captured image on a basis of information acquired using the relevant information, a correction image in which a predetermined direction in a state where the image is erected and a reference direction in the image are matched to each other.
    Type: Application
    Filed: December 27, 2021
    Publication date: March 28, 2024
    Applicant: Rakuten Group, Inc.
    Inventors: Tomoyuki MUKASA, Mitsuru NAKAZAWA
  • Patent number: 11494915
    Abstract: To simplify a configuration for increasing an amount of information on an observation space, taken image acquisition means of an image processing system acquires taken images that have been taken by image taking means, which is movable in a real space. Observation space information acquisition means acquires, based on changes in position of a feature point cloud in the taken images, observation space information including three-dimensional coordinates of the feature point cloud in an observation space. Machine learning means acquires, based on machine learning data on a feature of an object, additional information on a feature of a photographed object shown in the taken images. Integration means integrates the observation space information and the additional information.
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: November 8, 2022
    Assignee: RAKUTEN GROUP, INC.
    Inventor: Tomoyuki Mukasa
  • Patent number: 11308705
    Abstract: Acquisition means of a display control device acquires taken images taken at a predetermined frame rate by image taking means, which is movable in a real space. First display control means estimates a current position and orientation of the image taking means based on the taken images, and combines a virtual image with one of the taken images to be displayed, the virtual image showing a view of a virtual three-dimensional object as seen from a virtual viewpoint based on a result of the estimation. Second display control means processes, in a frame subsequent to a frame on which the first display control means has performed display control, the virtual image based on movement information on a movement of the image taking means, and combines the processed virtual image with another one of the taken images to be displayed.
    Type: Grant
    Filed: March 29, 2017
    Date of Patent: April 19, 2022
    Assignee: RAKUTEN GROUP, INC.
    Inventor: Tomoyuki Mukasa
  • Patent number: 11010422
    Abstract: An image display system includes an acquisition means for acquiring operation information containing a moving direction and a moving amount of an input position in an input operation on a first display object, the input operation being performed when the first display object is displayed on a display device, an extraction means for, when the moving amount of the input position in a predetermined first direction exceeds a predetermined threshold, acquiring a first attribute parameter of the first display object which corresponds to the first direction, and extracting a second display object associated with the first display object and having a first attribute parameter different from the first display object from a storage means where a plurality of display objects are associated with attribute parameters, and a display control means for displaying the second display object extracted by the extraction means, instead of the first display object, on the display device.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: May 18, 2021
    Assignee: Rakuten, Inc.
    Inventors: Soh Masuko, Tomoyuki Mukasa
  • Patent number: 10832437
    Abstract: A computer implemented method using artificial intelligence for matching images with locations and directions by acquiring a plurality of panoramic images, detecting objects and their locations in each of the panoramic images, acquiring a floorplan image, detecting objects and their locations in the floorplan image, comparing the objects and locations detect in each of the panoramic image to the objects and locations detected in the floorplan image, and determining a location in the floorplan image where each panoramic image was taken.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: November 10, 2020
    Assignee: RAKUTEN, INC.
    Inventors: Bjorn Stenger, Tomoyuki Mukasa, Jiu Xu, Lu Yan
  • Publication number: 20200184651
    Abstract: To simplify a configuration for increasing an amount of information on an observation space, taken image acquisition means of an image processing system acquires taken images that have been taken by image taking means, which is movable in a real space. Observation space information acquisition means acquires, based on changes in position of a feature point cloud in the taken images, observation space information including three-dimensional coordinates of the feature point cloud in an observation space. Machine learning means acquires, based on machine learning data on a feature of an object, additional information on a feature of a photographed object shown in the taken images. Integration means integrates the observation space information and the additional information.
    Type: Application
    Filed: August 14, 2017
    Publication date: June 11, 2020
    Inventor: Tomoyuki MUKASA
  • Publication number: 20200074668
    Abstract: A computer implemented method using artificial intelligence for matching images with locations and directions by acquiring a plurality of panoramic images, detecting objects and their locations in each of the panoramic images, acquiring a floorplan image, detecting objects and their locations in the floorplan image, comparing the objects and locations detect in each of the panoramic, image to the objects and locations detected in the floorplan image, and determining a location in the floorplan image where each panoramic image was taken.
    Type: Application
    Filed: September 5, 2018
    Publication date: March 5, 2020
    Inventors: Bjorn STENGER, Tomoyuki MUKASA, Jiu XU, Lu YAN
  • Publication number: 20200027281
    Abstract: Acquisition means of a display control device acquires taken images taken at a predetermined frame rate by image taking means, which is movable in a real space. First display control means estimates a current position and orientation of the image taking means based on the taken images, and combines a virtual image with one of the taken images to be displayed, the virtual image showing a view of a virtual three-dimensional object as seen from a virtual viewpoint based on a result of the estimation. Second display control means processes, in a frame subsequent to a frame on which the first display control means has performed display control, the virtual image based on movement information on a movement of the image taking means, and combines the processed virtual image with another one of the taken images to be displayed.
    Type: Application
    Filed: March 29, 2017
    Publication date: January 23, 2020
    Inventor: Tomoyuki MUKASA
  • Publication number: 20180253446
    Abstract: An image display system includes an acquisition means for acquiring operation information containing a moving direction and a moving amount of an input position in an input operation on a first display object, the input operation being performed when the first display object is displayed on a display device, an extraction means for, when the moving amount of the input position in a predetermined first direction exceeds a predetermined threshold, acquiring a first attribute parameter of the first display object which corresponds to the first direction, and extracting a second display object associated with the first display object and having a first attribute parameter different from the first display object from a storage means where a plurality of display objects are associated with attribute parameters, and a display control means for displaying the second display object extracted by the extraction means, instead of the first display object, on the display device.
    Type: Application
    Filed: August 31, 2016
    Publication date: September 6, 2018
    Applicant: Rakuten, Inc.
    Inventors: Soh MASUKO, Tomoyuki MUKASA