Patents by Inventor Tsutomu Mukai

Tsutomu Mukai has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10521668
    Abstract: A display method is for a display apparatus to display an image, and includes: obtaining a captured display image by an image sensor included in a terminal device; obtaining a light ID by visible light communication with a subject; obtaining an AR image and recognition information which are associated with the light ID from a memory included in the terminal device; recognizing a target region within the captured display image using the recognition information; and displaying the captured display image in which the AR image is superimposed on the target region.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: December 31, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Hideki Aoyama, Mitsuaki Oshima, Koji Nakanishi, Toshiyuki Maeda, Akihiro Ueki, Kengo Miyoshi, Tsutomu Mukai
  • Patent number: 10523876
    Abstract: An information communication method obtains information from a subject using a terminal device that includes an image sensor having a plurality of exposure lines. The method includes setting an exposure time of the image sensor so that, in an image obtained by capturing the subject by the image sensor, a bright line corresponding to each of the plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image by capturing the subject that changes in luminance by the image sensor with the set exposure time, and obtaining identification information of the subject. An exposure time of each of the plurality of exposure lines partially overlaps with an exposure time of an adjacent one of the plurality of exposure lines, and the subject includes a first area and a second area.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: December 31, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Patent number: 10516832
    Abstract: An information communication method obtains information from a subject using a terminal device that includes an image sensor having a plurality of exposure lines. The method includes setting an exposure time of the image sensor so that a bright line corresponding to each of the plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image including a plurality of bright lines, and obtaining identification information of the subject. In obtaining of the bright line image, an exposure time of each of the plurality of exposure lines partially overlaps with an exposure time of an adjacent one of the plurality of exposure lines. A pattern of a change in luminance of the subject is the same as a pattern of a change in luminance of another adjacent subject.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: December 24, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Patent number: 10498954
    Abstract: The imaging device includes: an imaging unit that generates image data from the optical information input through an optical system unit; an image processor that performs a predetermined process to the image data; and a controller that controls the optical system unit, the imaging unit, and the image processor based on a set value relating to video capturing. The controller sets the set value to a corresponding value relating to the video capturing in each of a first and a second video mode, and automatically sets the set value in the second video mode to a value more suitable for recording a still image so that image quality of a still image in the second video mode is greater than image quality of a still image in the first video mode. The video in the second video mode is captured from start to end of a video recording.
    Type: Grant
    Filed: April 4, 2017
    Date of Patent: December 3, 2019
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Tsutomu Mukai, Yoshinori Okazaki
  • Patent number: 10455161
    Abstract: A method includes setting an exposure time of an image sensor included in a terminal device so that a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects. The method also includes obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, and obtaining a plurality of identification information from the plurality of subjects. The method further includes specifying locations of the plurality of subjects, determining directions of arrival of lights from the plurality of subjects, calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights, and calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.
    Type: Grant
    Filed: April 25, 2019
    Date of Patent: October 22, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Patent number: 10447390
    Abstract: A recoding medium storing a computer program, which, when executed by a processor, cause the processor to perform operations including: determining a pattern of a change in luminance, by modulating the signal to be transmitted; and transmitting the signal, by at least one light emitter changing in luminance according to the determined pattern of the change in luminance. The signal has a plurality of blocks, each block of the plurality of blocks includes (i) address information that indicates a position of a data segment in the signal and (ii) the data segment. In the transmitting, the signal is transmitted repeatedly at different times. The address information is used to identify a same location of the block data segment in the signal transmitted at a first time and in the signal transmitted at a second time, which is different from the first time. The signal has a check signal.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: October 15, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Publication number: 20190297243
    Abstract: An information communication method obtains information from a subject using a terminal device that includes an image sensor having a plurality of exposure lines. The method includes setting an exposure time of the image sensor so that, in an image obtained by capturing the subject by the image sensor, a bright line corresponding to each of the plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image by capturing the subject that changes in luminance by the image sensor with the set exposure time, and obtaining identification information of the subject. An exposure time of each of the plurality of exposure lines partially overlaps with an exposure time of an adjacent one of the plurality of exposure lines, and the subject includes a first area and a second area.
    Type: Application
    Filed: April 10, 2019
    Publication date: September 26, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Patent number: 10389446
    Abstract: A method includes capturing images with an image sensor while switching the shutter speed of the image sensor between a first speed and a second, higher speed. When a captured subject is a barcode, a barcode image is obtained when the shutter speed is the first speed, and barcode information is obtained by decoding the barcode in the image. When a captured subject is a light source, a bright line image including bright lines corresponding to a plurality of exposure lines included in the image sensor is obtained when the shutter speed is the second speed, and a visible light signal is obtained as visible light information by decoding a pattern of the bright lines in the obtained bright line image. The method also includes displaying an image obtained through capturing performed when the shutter speed is the first speed.
    Type: Grant
    Filed: October 15, 2018
    Date of Patent: August 20, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Hideki Aoyama, Mitsuaki Oshima, Koji Nakanishi, Toshiyuki Maeda, Akihiro Ueki, Kengo Miyoshi, Tsutomu Mukai
  • Publication number: 20190253599
    Abstract: An information communication method obtains information from a subject using a terminal device that includes an image sensor. The method includes setting an exposure time of the image sensor having a plurality of exposure lines so that a bright line corresponding to each of the plurality of exposure lines appears according to a change in luminance of the subject. The method also includes obtaining a bright line image including a plurality of bright lines, by capturing the subject that changes in luminance by the image sensor, and obtaining identification information of the subject. The subject has a rectangular shape, is captured with an around view of the subject. Each of the plurality of bright lines appears within the rectangular shape of the subject in the bright line image, and follows a direction between long sides of the rectangular shape of the subject in the bright line image.
    Type: Application
    Filed: April 25, 2019
    Publication date: August 15, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Publication number: 20190253598
    Abstract: An information communication method obtains information from a subject using a terminal device that includes an image sensor. The method includes setting an exposure time of the image sensor having a plurality of exposure lines so that a bright line corresponding to each of the plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image including a plurality of bright lines, and obtaining identification information of the subject. In the obtaining of the bright line image, an exposure time of each of the plurality of exposure lines partially overlaps with an exposure time of an adjacent one of the plurality of exposure lines. During asynchronous communication, a minimum width of the stripe pattern corresponds to at least two bright lines in the obtained bright line image.
    Type: Application
    Filed: April 25, 2019
    Publication date: August 15, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Publication number: 20190253600
    Abstract: A method includes setting an exposure time of an image sensor included in a terminal device so that a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of each of the plurality of subjects. The method also includes obtaining a bright line image including a plurality of bright lines corresponding to each of the plurality of subjects, and obtaining a plurality of identification information from the plurality of subjects. The method further includes specifying locations of the plurality of subjects, determining directions of arrival of lights from the plurality of subjects, calculating distances between the terminal device and each of the plurality of subjects using each of the directions of the arrival of lights, and calculating a location of the terminal device using the locations of the plurality of the subjects and the distances.
    Type: Application
    Filed: April 25, 2019
    Publication date: August 15, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Publication number: 20190238740
    Abstract: An information communication method selectively obtains a location of a terminal device. Determining the location of the terminal device by wireless communication with a wireless access point includes receiving a radio signal including a first identification information to identify a location of the wireless access point, and calculating the location of the terminal device using the identified location of the wireless access point, which is identified by the first identification information. Determining the location of the terminal device by visible light communication with a subject provides higher accuracy and includes setting an exposure time of an image sensor having a plurality to exposure lines so that a bright line corresponding to each of the plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject, obtaining a bright line image by capturing the subject, and demodulating data from the bright line image.
    Type: Application
    Filed: April 10, 2019
    Publication date: August 1, 2019
    Applicant: Panasonic Intellectual Property Corporation of America
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Publication number: 20190238739
    Abstract: An information communication method obtains information from a subject using a terminal device that includes an image sensor having a plurality of exposure lines. The method includes setting an exposure time of the image sensor so that a bright line corresponding to each of the plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image including a plurality of bright lines, and obtaining identification information of the subject. In obtaining of the bright line image, an exposure time of each of the plurality of exposure lines partially overlaps with an exposure time of an adjacent one of the plurality of exposure lines. A pattern of a change in luminance of the subject is the same as a pattern of a change in luminance of another adjacent subject.
    Type: Application
    Filed: April 10, 2019
    Publication date: August 1, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Publication number: 20190236369
    Abstract: A display method is for a display apparatus to display an image, and includes: obtaining a captured display image by an image sensor included in a terminal device; obtaining a light ID by visible light communication with a subject; obtaining an AR image and recognition information which are associated with the light ID from a memory included in the terminal device; recognizing a target region within the captured display image using the recognition information; and displaying the captured display image in which the AR image is superimposed on the target region.
    Type: Application
    Filed: April 12, 2019
    Publication date: August 1, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Hideki AOYAMA, Mitsuaki OSHIMA, Koji NAKANISHI, Toshiyuki MAEDA, Akihiro UEKI, Kengo MIYOSHI, Tsutomu MUKAI
  • Patent number: 10368006
    Abstract: A method includes obtaining a destination of a user of a terminal device, and setting an exposure time of an image sensor included in the terminal device so that, in an image obtained by capturing a subject by the image sensor, a bright line corresponding to each of a plurality of exposure lines appears according to a change in luminance of the subject. The method also includes obtaining a bright line image including a plurality of bright lines, by capturing the subject that changes in luminance by the image sensor with the set exposure time, and obtaining identification information of the subject, by demodulating data specified by a pattern of the plurality of bright lines. The method includes obtaining a position of the terminal device, and displaying an arrow that indicates a direction from the position of the terminal device toward the destination on a map on the terminal device.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: July 30, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Patent number: 10368005
    Abstract: A method includes setting an exposure time of an image sensor included in a terminal device so that, in an image obtained by capturing a subject by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image, including a plurality of bright lines, by capturing the subject, obtaining identification information of the subject, and obtaining an angle of light of the subject. The method further includes calculating a distance between the terminal device and the subject using the angle, obtaining a position of the subject that is specified by the identification information, and calculating a position of the terminal device using the distance and the position of the subject.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: July 30, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Patent number: 10361780
    Abstract: A receiving method includes: setting a first exposure time for at least one exposure line of exposure lines in an image sensor, setting a second exposure time for a remainder of the exposure lines in the image sensor, and causing the image sensor to capture an image of a light transmitter, to obtain a normal image from the at least one exposure line with the first exposure time, and to obtain a bright line image from the remainder of the exposure lines with the second exposure time. The second exposure time is shorter than the first exposure time. The bright line image includes a plurality of bright lines, each of which corresponds to a different one of the remainder of the exposure lines in the image sensor. Information is obtained by decoding a pattern of the plurality of the bright lines included in the obtained bright line image.
    Type: Grant
    Filed: November 15, 2017
    Date of Patent: July 23, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Hideki Aoyama, Mitsuaki Oshima, Koji Nakanishi, Toshiyuki Maeda, Akihiro Ueki, Kengo Miyoshi, Tsutomu Mukai
  • Patent number: 10334177
    Abstract: A method is provided that includes obtaining a first image by image capture with a first exposure time, and obtaining a second image, including a plurality of bright lines, by capturing a subject changing in luminance with a second exposure. The method also includes obtaining information by demodulating data specified by a pattern of the plurality of bright lines included in the obtained second image, and sending the information to a server. The method further includes obtaining augmented reality information related to the information from the server, and displaying the first image of the display a second time, instead of displaying the second image, when the image sensor receives the first image followed by the second image, wherein the augmented reality information is superposed in both (i) the first image that is displayed at a first time, and (ii) the first image that is displayed at a second time.
    Type: Grant
    Filed: January 3, 2019
    Date of Patent: June 25, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki Oshima, Koji Nakanishi, Hideki Aoyama, Ikuo Fuchigami, Hidehiko Shin, Tsutomu Mukai, Yosuke Matsushita, Shigehiro Iida, Kazunori Yamada
  • Publication number: 20190166295
    Abstract: A method includes setting an exposure time of an image sensor included in a terminal device so that, in an image obtained by capturing a subject by the image sensor, a bright line corresponding to each of a plurality of exposure lines included in the image sensor appears according to a change in luminance of the subject. The method also includes obtaining a bright line image, including a plurality of bright lines, by capturing the subject, obtaining identification information of the subject, and obtaining an angle of light of the subject. The method further includes calculating a distance between the terminal device and the subject using the angle, obtaining a position of the subject that is specified by the identification information, and calculating a position of the terminal device using the distance and the position of the subject.
    Type: Application
    Filed: January 31, 2019
    Publication date: May 30, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA
  • Publication number: 20190166296
    Abstract: A method includes obtaining a destination of a user of a terminal device, and setting an exposure time of an image sensor included in the terminal device so that, in an image obtained by capturing a subject by the image sensor, a bright line corresponding to each of a plurality of exposure lines appears according to a change in luminance of the subject. The method also includes obtaining a bright line image including a plurality of bright lines, by capturing the subject that changes in luminance by the image sensor with the set exposure time, and obtaining identification information of the subject, by demodulating data specified by a pattern of the plurality of bright lines. The method includes obtaining a position of the terminal device, and displaying an arrow that indicates a direction from the position of the terminal device toward the destination on a map on the terminal device.
    Type: Application
    Filed: January 31, 2019
    Publication date: May 30, 2019
    Applicant: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Mitsuaki OSHIMA, Koji NAKANISHI, Hideki AOYAMA, Ikuo FUCHIGAMI, Hidehiko SHIN, Tsutomu MUKAI, Yosuke MATSUSHITA, Shigehiro IIDA, Kazunori YAMADA