Patents by Inventor Soma Shiraishi

Soma Shiraishi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230206507
    Abstract: The present invention provides a processing apparatus (10) including: an acquisition unit (11) that acquires a plurality of time-series images including a display area; a product detection unit (12) that detects a product from each of a plurality of the time-series images; an identity determination unit (13) that determines identity of products detected from the images that are different from each other; a display time management unit (14) that manages a display time of each detected product, based on a result of the detection and a result of the identity determination; and an output unit (15) that outputs information related to the display time of each detected product.
    Type: Application
    Filed: May 29, 2020
    Publication date: June 29, 2023
    Applicant: NEC Corporation
    Inventors: Yu Nabeto, Soma Shiraishi, Takami Sato, Katsumi Kikuchi
  • Publication number: 20230205816
    Abstract: An information processing device 1X mainly includes an inference means 15X, an input reception means 16X, and a digest candidate generation means 17X. The inference means 15X acquires an inference result for each inference engine to video material data by a plurality of inference engines which perform respective inferences concerning a degree of importance with respect to video data being input. The input reception means 16X receives an input indicating parameters concerning the inference result for each inference engine. The digest candidate generation means 17X generates a digest candidate which is a candidate of a digest of the video material data, based on the parameters and the inference result for each inference engine.
    Type: Application
    Filed: May 28, 2020
    Publication date: June 29, 2023
    Applicant: NEC Corporation
    Inventors: Yu Nabeto, Katsumi Kikuchi, Soma Shiraishi, Haruna Watanabe
  • Publication number: 20230199194
    Abstract: In the video processing device, the video acquisition means acquires a material video. The audience scene extraction means extracts an audience scene showing an audience from the material video. The important scene extraction means extracts an important scene from the material video. The association means associates the audience scene with the important scene. The generation means generates a digest video including the important scene and the audience scene associated with the important scene.
    Type: Application
    Filed: May 27, 2020
    Publication date: June 22, 2023
    Applicant: NEC CORPORAITON
    Inventors: Soma SHIRAISHI, Katsumi Kikuchi, Yu Nabeto, Haruna Watanabe
  • Publication number: 20230196775
    Abstract: In a video processing device, a video acquisition means acquires a material video. An importance calculation means calculates importance in the material video using a plurality of models. An importance integration means integrates the importance calculated using the plurality of models. A generation means extracts important scenes in the material video based on the integrated importance and generates a digest video including the extracted important scenes.
    Type: Application
    Filed: May 27, 2020
    Publication date: June 22, 2023
    Applicant: NEC Corporation
    Inventors: Soma SHIRAISHI, Katsumi Kikuchi, Yu Nabeto, Haruna Watanabe
  • Publication number: 20230186736
    Abstract: An image acquisition unit (11) acquires a recognition processing image. A recognition unit (12) recognizes a product in the recognition processing image based on an estimation model. A registration unit (13) registers a result of the recognition in recognized product information. An output unit (14) outputs a result of the recognition. A correction reception unit (16) receives an input for correcting a result of the recognition. A correction unit (17) changes a result of the recognition to a result of the recognition after a correction, and also stores correction information in which a result of the recognition after a correction and the recognition processing image are associated with each other. A learning unit (18) performs relearning by using the recognition processing image stored as the correction information and updates the estimation model, when a number of the recognition processing image stored exceeds a predetermined value.
    Type: Application
    Filed: May 20, 2020
    Publication date: June 15, 2023
    Applicant: NEC Corporation
    Inventors: Yu NABETO, Soma SHIRAISHI, Takami SATO, Katsumi KIKUCHI
  • Publication number: 20230188855
    Abstract: An installation assistance apparatus (100) includes a first image capture unit and a second image capture unit that are placed in such a way as to face each other in a plan view, an acquisition unit (102) acquiring a first image from the first image capture unit, a detection unit (104) detecting a position of at least part of the second image capture unit in the first image by processing the first image, a determination unit (106) determining whether the position of the second image capture unit satisfies a criterion, and an output processing unit (108) causing a determination result by the determination unit (106) to be output.
    Type: Application
    Filed: May 21, 2020
    Publication date: June 15, 2023
    Applicant: NEC Corporation
    Inventors: Katsumi KIKUCHI, Soma SHIRAISHI, Yu NABETO, Takami SATO
  • Publication number: 20230186271
    Abstract: The present invention provides a processing apparatus (10) including: an acquisition unit (11) that acquires a plurality of images, captured by a plurality of cameras, of a product held by a customer with a hand; a detection unit (12) that detects an object from each of the plurality of images; a positional information generation unit (13) that generates positional information indicating a position in the image, for the each detected object; a product kind-related information generation unit (14) that generates product kind-related information that determines a product kind, for the each detected object; an extraction unit (15) that extracts a group of a plurality of objects which satisfies conditions with each other, the conditions being related to the positional information and the product kind-related information; and a product recognition result output unit (16) that outputs a product recognition result for the each extracted group.
    Type: Application
    Filed: May 22, 2020
    Publication date: June 15, 2023
    Applicant: NEC Corporation
    Inventors: Soma SHIRAISHI, Katsumi KIKUCHI, Takami SATO, Yu NABETO
  • Publication number: 20230179817
    Abstract: An information processing apparatus generates structural information of a digest video from a video material. In the information processing apparatus, a video acquisition means acquires a video material. A condition acquisition means acquires a generation condition for generating the digest video from the creator. A generation means generates structural information indicating a structure of the digest video that is generated based on the video material based on the generation condition, and outputs the generated structural information.
    Type: Application
    Filed: May 18, 2020
    Publication date: June 8, 2023
    Applicant: NEC Corporation
    Inventors: Katsumi KIKUCHI, Haruna WATANABE, Yu NABETO, Soma SHIRAISHI
  • Publication number: 20230154039
    Abstract: The present invention provides a processing apparatus (10) including: an acquisition unit (11) that acquires an image of a product held in a hand of a customer; an image analysis unit (12) that generates time-series information on a position of the product, based on the image; a determination unit (13) that determines whether the customer has performed a specific action for the product, based on a movement status of the product indicated by the generated time-series information; and a registration unit (14) that registers that the customer has performed the specific action.
    Type: Application
    Filed: April 24, 2020
    Publication date: May 18, 2023
    Applicant: NEC Corporation
    Inventors: Hiroshi HASHIMOTO, Soma SHIRAISHI, Takami SATO, Yu NABETO, Kan ARAI, Kei SHIBUYA, Azusa FURUKAWA, Ken HANAZAWA, Makiko AKIGUCHI
  • Publication number: 20230141150
    Abstract: The present invention provides a processing apparatus (10) including: an acquisition unit (11) that acquires an image generated by a plurality of cameras for photographing a product picked up by a customer; a recognition unit (12) that recognizes the product, based on each of a plurality of images generated by the plurality of cameras; and a determination unit (13) that determines a final recognition result, based on a plurality of recognition results based on each of the plurality of images, and a size of a region where the product is present within each of the plurality of images.
    Type: Application
    Filed: April 21, 2020
    Publication date: May 11, 2023
    Applicant: NEC Corporation
    Inventors: Yu NABETO, Katsumi KIKUCHI, Takami SATO, Soma SHIRAISHI
  • Publication number: 20230129862
    Abstract: Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.
    Type: Application
    Filed: December 21, 2022
    Publication date: April 27, 2023
    Applicant: NEC Corporation
    Inventor: Soma SHIRAISHI
  • Publication number: 20230087980
    Abstract: A product detection apparatus (10) includes an acquisition unit (110), an image processing unit (120), and an output unit (130). The acquisition unit (110) acquires a plurality of images (one example of a first image) generated by an image capture unit (20) in association with a date and a time when the image is generated. These plurality of images are generated at different timings from each other. The image processing unit (120) detects a state (hereinafter, described as a first state) in which a new product is present on a product shelf (40) continuously for a reference time or longer by processing the plurality of images. The output unit (130) performs a first output when the first state is detected. The first output indicates that a product (50) has been returned to the product shelf (40) after the product (50) is taken out of the product shelf (40) by a customer.
    Type: Application
    Filed: March 9, 2020
    Publication date: March 23, 2023
    Applicant: NEC Corporation
    Inventors: Yu NABETO, Katsumi KIKUCHI, Takami SATO, Soma SHIRAISHI
  • Publication number: 20230092640
    Abstract: A body height estimating apparatus (10) includes an acquisition unit (110), an image processing unit (120), and an estimation unit (130). The acquisition unit (110) acquires an image generated by an image capture unit (20). The image processing unit (120) processes the image generated by the image capture unit (20), and thereby generates analysis data. The analysis data include a height of a palm and an angle of an arm of a person included in the image. The estimation unit (130) computes an estimated value of a body height of the person by using the height of the palm and the angle of the arm included in the analysis data.
    Type: Application
    Filed: March 19, 2020
    Publication date: March 23, 2023
    Applicant: NEC Corporation
    Inventors: Soma SHIRAISHI, Katsumi KIKUCHI, Takami SATO, Yu NABETO
  • Patent number: 11610334
    Abstract: According to the some non-limiting embodiments, there is provided an information processing apparatus including a display control unit 13 that causes a display provided on a surface on which an object is placed, to display a first image including a predetermined display element, and a conversion rule generation unit 15 that acquires a second image generated by an imaging apparatus having an imaging range including the display and generates a conversion rule for converting coordinates in the image of the imaging apparatus into coordinates in the display, by using a detection result of the display element in the second image.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: March 21, 2023
    Assignee: NEC CORPORATION
    Inventors: Kota Iwamoto, Soma Shiraishi, Hideo Yokoi, Tsugunori Takata
  • Patent number: 11599867
    Abstract: An image identification register system (1) includes an image identification register apparatus (10), an image capturing apparatus (30), and a touch panel display (40). The touch panel display (40) is also used as a placement surface of a product. The image capturing apparatus (30) captures a product (P) placed on the touch panel display (40), and generates an image of the product (P). The image identification register apparatus (10) includes an image acquisition unit (110) that acquires an image of the product (P) placed on the touch panel display (40), a product identification unit (120) that identifies the product captured in the image, a display control unit (130) that causes a user interface that receives an input needed for checkout processing of the product to be displayed on the touch panel display according to an identification result of the product, and a processing execution unit (140) that executes processing based on an input to the user interface.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: March 7, 2023
    Assignee: NEC CORPORATION
    Inventors: Soma Shiraishi, Kota Iwamoto, Hideo Yokoi, Tsugunori Takata, Emi Kitagawa
  • Publication number: 20230064123
    Abstract: An article determination apparatus (10) is used with two image capture units (20). One image capture unit (20), an article shelf (40), and the other image capture unit (20) are arranged in this order. The acquisition unit (110) acquires images generated by the two image capture units (20). The image processing unit (120) generates first size data and second size data by processing the images acquired by the acquisition unit (110). The first size data and the second size data indicate the size of an area in which an article is captured in an image generated by one image capture unit (20) and by the other image capture unit (20), respectively. The determination unit (130) determines that an estimation result of the article name of the article by image processing is correct when a relation between the first size data and the second size data satisfies a criterion.
    Type: Application
    Filed: February 20, 2020
    Publication date: March 2, 2023
    Applicant: NEC Corporation
    Inventors: Yu Nabeto, Katsumi Kikuchi, Soma Shiraishi, Takami Sato
  • Publication number: 20230051817
    Abstract: An object recognition device (10) includes a holding body (100), a light source (200), and an optical sensor (300). The holding body (100) extends in one direction. The light source (200) is attached to the holding body (100) along the one direction. The light source (200) applies light toward at least a part of a space (S) located on a side of the holding body (100) with respect to the one direction of the holding body (100), a front of the space (S), and a back of the space (S). The optical sensor (300) is attached to the holding body (100). At least a part of a visual field of the optical sensor (300) faces in at least a part of the space (S), the front of the space (S), and the back of the space (S).
    Type: Application
    Filed: January 23, 2020
    Publication date: February 16, 2023
    Applicant: NEC Corporation
    Inventors: Soma SHIRAISHI, Katsum KIKUCHI, Takami SATO, Yu NABETO
  • Publication number: 20230048407
    Abstract: A housing device (20) includes a housing portion (22), a light source (200), and an optical sensor (300). The housing portion (22) includes a holding body (100). An article is housed in the housing portion (22). The holding body (100) extends in one direction. The light source (200) is attached to the holding body (100) along the one direction. The light source (200) applies light toward at least a part of a space (S) located on a side of the holding body (100) with respect to the one direction of the holding body (100), a front of the space (S), and a back of the space (S). The optical sensor (300) is attached to the holding body (100). At least a part of a visual field of the optical sensor (300) faces in at least a part of the space (S), the front of the space (S), and the back of the space (S).
    Type: Application
    Filed: January 23, 2020
    Publication date: February 16, 2023
    Applicant: NEC Corporation
    Inventors: Soma SHIRAISHI, Katsumi KIKUCHI, Takami SATO, Yu NABETO
  • Publication number: 20230039355
    Abstract: In an object recognition apparatus, a storage unit stores a table in that a plurality of feature amounts are associated with each object having feature points of respective feature amounts. An object region detection unit detects object regions of a plurality of objects from an input image. A feature amount extraction unit extracts feature amounts of feature points from the input image. A refining unit refers to the table, and refines from all objects of recognition subjects to object candidates corresponding to the object regions based on feature amounts of feature points belonging to the object regions. A matching unit recognizes the plurality of objects by matching the feature points belonging to each of the object regions with feature points for each of the object candidates, and outputs a recognition result.
    Type: Application
    Filed: January 31, 2020
    Publication date: February 9, 2023
    Applicant: NEC Corporation
    Inventors: Yu NABETO, Soma Shiraishi
  • Patent number: 11562559
    Abstract: Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: January 24, 2023
    Assignee: NEC CORPORATION
    Inventor: Soma Shiraishi