Patents by Inventor NOBUHIKO WAKAI

NOBUHIKO WAKAI has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11948462
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Grant
    Filed: February 16, 2023
    Date of Patent: April 2, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Ayako Maruyama, Kunio Nobori, Takeo Azuma, Satoshi Sato, Nobuhiko Wakai
  • Publication number: 20240007727
    Abstract: A depth acquisition device includes memory and processor performing: acquiring, from the memory, intensities of infrared light emitted from a light source and measured by imaging with the infrared light reflected on a subject by pixels in an imaging element; generating a depth image by calculating a distance to the subject as a depth for each pixel based on an intensity received by the pixel; acquiring, from the memory, a visible light image generated by imaging, with visible light, a substantially same scene with a substantially same viewpoint and at a substantially same timing as those of imaging the infrared light image; detecting, from the visible light image, an edge region including an edge along a direction perpendicular to a direction of movement of the visible light image; and correcting, in the depth image, a depth of a target region corresponding to the edge region in the depth image.
    Type: Application
    Filed: July 26, 2023
    Publication date: January 4, 2024
    Inventors: Takeo AZUMA, Satoshi SATO, Nobuhiko WAKAI, Kohsuke YOSHIOKA, Noritaka SHIMIZU, Yoshinao KAWAI, Takaaki AMADA, Yoko KAWAI, Takeshi MURAI, Hiroki TAKEUCHI
  • Publication number: 20230410368
    Abstract: Provided is a method for learning a network parameter of a neural network including, by an information processor: acquiring a learning image; acquiring a true camera parameter related to the learning image; calculating a true two-dimensional coordinate point by projecting a three-dimensional coordinate point on a unit spherical surface onto a predetermined plane by using the true camera parameter; calculating an estimated two-dimensional coordinate point by projecting the three-dimensional coordinate point onto the predetermined plane by using the estimated camera parameter estimated by the neural network; and learning the network parameter of the neural network based on a distance between the true two-dimensional coordinate point and the estimated two-dimensional coordinate point.
    Type: Application
    Filed: August 28, 2023
    Publication date: December 21, 2023
    Applicant: Panasonic Intellectual Property Corporation of America
    Inventor: Nobuhiko WAKAI
  • Publication number: 20230341831
    Abstract: An appliance control method includes: acquiring a user action of a user; predicting a plurality of action information items about future user actions of the user based on the user action, the plurality of action information items including a plurality of actions and predicted times at which the plurality of actions are predicted to be performed; determining appliance control operations corresponding to the plurality of actions based on the plurality of actions and the predicted times; and performing the appliance control operations based on the predicted times.
    Type: Application
    Filed: June 29, 2023
    Publication date: October 26, 2023
    Inventors: Ryota FUJIMURA, Shigehiro IIDA, Toshiyuki SHIMIZU, Nobuhiko WAKAI, Yumiko SHINOHARA
  • Patent number: 11758247
    Abstract: A depth acquisition device includes memory and processor performing: acquiring, from the memory, intensities of infrared light emitted from a light source and measured by imaging with the infrared light reflected on a subject by pixels in an imaging element; generating a depth image by calculating a distance to the subject as a depth for each pixel based on an intensity received by the pixel; acquiring, from the memory, a visible light image generated by imaging, with visible light, a substantially same scene with a substantially same viewpoint and at a substantially same timing as those of imaging the infrared light image; detecting, from the visible light image, an edge region including an edge along a direction perpendicular to a direction of movement of the visible light image; and correcting, in the depth image, a depth of a target region corresponding to the edge region in the depth image.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: September 12, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD
    Inventors: Takeo Azuma, Satoshi Sato, Nobuhiko Wakai, Kohsuke Yoshioka, Noritaka Shimizu, Yoshinao Kawai, Takaaki Amada, Yoko Kawai, Takeshi Murai, Hiroki Takeuchi
  • Publication number: 20230215029
    Abstract: A depth acquisition device includes a memory and a processor. The processor performs: acquiring timing information indicating a timing at which a light source irradiates a subject with infrared light; acquiring, from the memory, an infrared light image generated by imaging a scene including the subject with the infrared light according to the timing indicated by the timing information; acquiring, from the memory, a visible light image generated by imaging a substantially same scene as the scene of the infrared light image, with visible light from a substantially same viewpoint as a viewpoint of imaging the infrared light image at a substantially same time as a time of imaging the infrared light image; detecting a flare region from the infrared light image; and estimating a depth of the flare region based on the infrared light image, the visible light image, and the flare region.
    Type: Application
    Filed: March 9, 2023
    Publication date: July 6, 2023
    Inventors: Satoshi SATO, Takeo AZUMA, Nobuhiko WAKAI, Kohsuke YOSHIOKA, Noritaka SHIMIZU, Yoshinao KAWAI, Takaaki AMADA, Yoko KAWAI, Takeshi MURAI, Hiroki TAKEUCHI
  • Publication number: 20230196921
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Application
    Filed: February 16, 2023
    Publication date: June 22, 2023
    Inventors: Ayako MARUYAMA, Kunio NOBORI, Takeo AZUMA, Satoshi SATO, Nobuhiko WAKAI
  • Publication number: 20230127086
    Abstract: Provided is a behavior recognition device that selects a candidate behavior as a recognition candidate from among target behaviors based on position information on an image sensor and room layout information, acquires image data detected by the image sensor, determines one or more recognizers corresponding to the candidate behavior, calculates a feature value of the image data using the one or more recognizers, and recognizes the candidate behavior based on the feature value.
    Type: Application
    Filed: December 27, 2022
    Publication date: April 27, 2023
    Applicant: Panasonic Intellectual Property Corporation of America
    Inventors: Nobuhiko WAKAI, Kazuki KOZUKA, Shigehiro IIDA, Yohei NAKATA, Yumiko SHINOHARA
  • Patent number: 11636615
    Abstract: A depth acquisition device includes a memory and a processor. The processor performs: acquiring timing information indicating a timing at which a light source irradiates a subject with infrared light; acquiring, from the memory, an infrared light image generated by imaging a scene including the subject with the infrared light according to the timing indicated by the timing information; acquiring, from the memory, a visible light image generated by imaging a substantially same scene as the scene of the infrared light image, with visible light from a substantially same viewpoint as a viewpoint of imaging the infrared light image at a substantially same time as a time of imaging the infrared light image; detecting a flare region from the infrared light image; and estimating a depth of the flare region based on the infrared light image, the visible light image, and the flare region.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: April 25, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Sato, Takeo Azuma, Nobuhiko Wakai, Kohsuke Yoshioka, Noritaka Shimizu, Yoshinao Kawai, Takaaki Amada, Yoko Kawai, Takeshi Murai, Hiroki Takeuchi
  • Patent number: 11615709
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: March 28, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Ayako Maruyama, Kunio Nobori, Takeo Azuma, Satoshi Sato, Nobuhiko Wakai
  • Patent number: 11615552
    Abstract: A crossing point detector includes memory and a crossing point detection unit that reads out a square image from a captured image in the memory, and detects a crossing point of two boundary lines in a checker pattern depicted in the square image. The crossing point detection unit decides multiple parameters of a function model treating two-dimensional image coordinates as variables, the parameters optimizing an evaluation value based on a difference between corresponding pixel values represented by the function model and the square image, respectively, and computes the position of a crossing point of two straight lines expressed by the decided multiple parameters to thereby detect the crossing point with subpixel precision. The function model uses a curved surface that is at least first-order differentiable to express pixel values at respective positions in a two-dimensional coordinate system at the boundary between black and white regions.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: March 28, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Nobuhiko Wakai, Takeo Azuma, Kunio Nobori, Satoshi Sato, Ayako Maruyama
  • Patent number: 11514595
    Abstract: A depth acquisition device includes a memory and a processor. The processor performs; acquiring timing information indicating a timing at which a light source irradiates a subject with infrared light; acquiring an infrared light image stored in the memory, the infrared light image being generated by imaging a scene including the subject with the infrared light according to the timing indicated by the timing information; acquiring a visible light image stored in the memory, the visible light image being generated by imaging a substantially same scene as that of the infrared light image, with visible light from a substantially same viewpoint and at a substantially same imaging time of those of the infrared light image; detecting a dust region showing dust from the infrared light image; and estimating a depth of the dust region based on the infrared light image, the visible light image, and the dust region.
    Type: Grant
    Filed: January 25, 2021
    Date of Patent: November 29, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Sato, Takeo Azuma, Nobuhiko Wakai, Kohsuke Yoshioka, Noritaka Shimizu, Yoshinao Kawai, Takaaki Amada, Yoko Kawai, Takeshi Murai, Hiroki Takeuchi
  • Patent number: 11373324
    Abstract: A depth acquisition device includes a memory and a processor performing: acquiring, from the memory, intensities of infrared light measured by imaging with infrared light emitted from a light source and reflected on a subject by pixels in an imaging element; generating a depth image by calculating the distance for each pixel based on the intensities; acquiring, from the memory, a visible light image generated by imaging, with visible light, the substantially same scene from the substantially same viewpoint at the substantially same timing as those of the infrared light image; detecting a lower reflection region showing an object having a lower reflectivity from the infrared light image in accordance with the infrared light image and the visible light image; correcting a corresponding lower reflection region in the depth image in accordance with the visible light image; and outputting the depth image with the corrected lower reflection region.
    Type: Grant
    Filed: January 19, 2021
    Date of Patent: June 28, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Takeo Azuma, Satoshi Sato, Nobuhiko Wakai, Kohsuke Yoshioka, Noritaka Shimizu, Yoshinao Kawai, Takaaki Amada, Yoko Kawai, Takeshi Murai, Hiroki Takeuchi
  • Patent number: 11277571
    Abstract: An image generation device includes: a voltage generator that generates a plurality of voltages each having a different voltage value; an image capturer that includes an organic photoconductive film, and performs imaging every time each of the plurality of voltages is applied; a luminance data obtainer that obtains a plurality of luminance data items corresponding to the plurality of voltages applied, each of the plurality of luminance data items being obtained from the imaging performed by the image capturer; and a color image generator that generates a color image based on the plurality of luminance data items.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: March 15, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Kunio Nobori, Satoshi Sato, Takeo Azuma, Nobuhiko Wakai, Mitsuru Harada, Shinichi Machida, Masumi Izuchi
  • Patent number: 11233983
    Abstract: A camera-parameter-set calculation apparatus includes a three-dimensional point group calculator that calculates a plurality of three-dimensional coordinates, based on first and second images respectively captured by first and second cameras and first and second camera parameter sets of the first and second cameras; an evaluation value calculator that determines a plurality of pixel coordinates in the second image, based on the plurality of three-dimensional coordinates and the second camera parameter set, determines a plurality of third pixel coordinates in a third image captured by a third camera, based on the plurality of three-dimensional coordinates and a third camera parameter set of the third camera, and calculates an evaluation value, based on pixel values at the plurality of second and third pixel coordinates in the second and third images; and a camera-parameter-set determiner that determines a fourth camera parameter set for the third camera, based on the evaluation value.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: January 25, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Kunio Nobori, Nobuhiko Wakai, Takeo Azuma, Satoshi Sato, Ayako Maruyama, Mikiya Nakata
  • Publication number: 20210398430
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Application
    Filed: August 31, 2021
    Publication date: December 23, 2021
    Inventors: Ayako MARUYAMA, Kunio NOBORI, Takeo AZUMA, Satoshi SATO, Nobuhiko WAKAI
  • Patent number: 11195061
    Abstract: An image generation apparatus includes a processing circuit and a memory storing at least one computational image. The at least one computational image is a light-field image, a compressive sensing image, or a coded image. The processing circuit (a1) identifies a position of an object in the at least one computational image using a classification device, (a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and (a3) outputs the display image.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: December 7, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Sato, Masahiko Saito, Takeo Azuma, Kunio Nobori, Nobuhiko Wakai
  • Patent number: 11183067
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: November 23, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Ayako Maruyama, Kunio Nobori, Takeo Azuma, Satoshi Sato, Nobuhiko Wakai
  • Patent number: 11138887
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: October 5, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Ayako Maruyama, Kunio Nobori, Takeo Azuma, Satoshi Sato, Nobuhiko Wakai
  • Patent number: 11056001
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Grant
    Filed: May 30, 2017
    Date of Patent: July 6, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Ayako Maruyama, Kunio Nobori, Takeo Azuma, Satoshi Sato, Nobuhiko Wakai