Patents by Inventor Hayato ITSUMI

Hayato ITSUMI has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240135560
    Abstract: To provide a technique which makes it possible to suitably estimate an important region and a non-important region in an image, an information processing apparatus includes: an obtaining means for obtaining input data which includes at least one of image data and point cloud data; an estimating means for estimating levels of importance with respect to a respective plurality of regions which are included in a frame indicated by the input data; a replacing means for generating replaced data by replacing at least one of the plurality of regions, which are included in the input data, with alternative data in accordance with the levels of importance; an evaluating means for deriving an evaluation value by referring to the replaced data; and a training means for training the estimating means with reference to the evaluation value.
    Type: Application
    Filed: February 14, 2022
    Publication date: April 25, 2024
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Koichi NIHEI, Florian BEYE, Charvi VITTHAL, Takanori IWAI, Yusuke SHINOHARA
  • Publication number: 20240137508
    Abstract: To provide a technique which makes it possible to suitably estimate an important region and a non-important region in an image, an information processing apparatus (1) includes: an obtaining means (10) for obtaining input data which includes at least one of image data and point cloud data; an estimating means (11) for estimating levels of importance with respect to a respective plurality of regions which are included in a frame indicated by the input data; a replacing means (12) for generating replaced data by replacing at least one of the plurality of regions, which are included in the input data, with alternative data in accordance with the levels of importance; an evaluating means (13) for deriving an evaluation value by referring to the replaced data; and a training means (14) for training the estimating means with reference to the evaluation value.
    Type: Application
    Filed: February 24, 2021
    Publication date: April 25, 2024
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Koichi NIHEI, Taranori IWAI, Yusuke SHINOHARA, Florian BEYE, Charvi VITTHAL
  • Publication number: 20240129514
    Abstract: Provided is an image processing apparatus which makes it possible to, during remote control, carry out suitable monitoring while suitably suppressing a transmission load. An image processing apparatus includes: an obtaining means for obtaining an image which has been captured from a movable body; an importance level estimating means for estimating levels of importance with respect to a respective plurality of regions included in the image; and a quality parameter determining means for determining quality parameters with respect to the respective plurality of regions with reference to the levels of importance.
    Type: Application
    Filed: February 24, 2021
    Publication date: April 18, 2024
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Koichi NIHEI, Takanori IWAI, Yusuke SHINOHARA, Florian BEYE, Charvi VITTHAL
  • Publication number: 20240078411
    Abstract: A first distribution estimating device determines a first probability distribution of quantized values in a predetermined value range corresponding to an input value, by using a first machine learning model. A first sampling device samples the quantized values and determines a first sample value, using the first probability distribution. A second distribution estimating device determines a second probability distribution corresponding to the first sample value, by using a second machine learning model. A second sampling device samples the quantized values in the value range and determines a second sample value, using the second probability distribution. It can be implemented in the form of any of an information processing system, an encoding device, a decoding device, a model learning device, an information processing method, an encoding method, a decoding method, a model learning method, and a program storage medium.
    Type: Application
    Filed: March 9, 2021
    Publication date: March 7, 2024
    Applicant: NEC Corporation
    Inventors: Florian BEYE, Hayato ITSUMI, Yusuke SHINOHARA, Charvi VITTHAL, Koichi NIHEI, Takanori IWAI
  • Publication number: 20240062507
    Abstract: An information processing device receives communication data based on feature data that indicates a feature of presented content of target data; restores the feature data on the basis of the received communication data; restores the target data on the basis of the restored feature data; performs a recognition process on the presented content of the target data on the basis of the restored feature data; and outputs information that indicates the presented content of the restored target data and a recognition result of the recognition process.
    Type: Application
    Filed: January 15, 2021
    Publication date: February 22, 2024
    Applicant: NEC Corporation
    Inventors: Florian Beye, Yusuke Shinohara, Hayato Itsumi, Koichi Nihei, Charvi Vitthal, Takanori Iwai
  • Publication number: 20240048703
    Abstract: Estimating determines, on the basis of processed quantized values, a quantization interval for quantizing input element values, which are elements of input values serving as a processing object and determines, on the basis of the processed quantized values, a probability distribution of quantization value candidates, which are candidates of quantized values of the input element values; quantizing uses the quantization interval to quantize the input element values and determine a quantized value; and entropy encoding uses the probability distribution to perform entropy encoding of a quantization time sequence which includes quantized value codes indicating the quantized values of the input element values.
    Type: Application
    Filed: December 15, 2020
    Publication date: February 8, 2024
    Applicant: NEC Corporation
    Inventors: Florian BEYE, Hayato ITSUMI, Koichi NIHEI, Charvi VITTHAL, Yusuke SHINOHARA, Takanori IWAI
  • Publication number: 20230367311
    Abstract: A monitoring person can rapidly take a countermeasure against a situation occurring in a moving object. Image reception means (31) receives image data obtained by imaging the outside of the moving object. Candidate acquisition means (32) acquires control content candidates of autonomous driving of the moving object. Monitoring screen display means (33) causes a display apparatus to display a monitoring screen. The monitoring screen includes a region where the image data is displayed and a region where the control content candidates are displayed. When one control content is selected from the control content candidates, control content transmission means (34) transmits a control signal representing the selected control content to the moving object.
    Type: Application
    Filed: October 2, 2020
    Publication date: November 16, 2023
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Koichi NIHEI, Takanori IWAI, Yusuke SHINOHARA, Florian BEYE, Charvi VITTHAL
  • Publication number: 20230360405
    Abstract: An information processing device includes: an image acquisition unit configured to acquire an image captured by an imaging unit mounted on a vehicle; a target detection unit configured to detect a target region including a target in the acquired image; a classification identification unit configured to identify classification including a type of the detected target and a size of the detected target region; and a region determination unit configured to determine a region obtained by adding a margin corresponding to the identified classification to the target region as an image processing region.
    Type: Application
    Filed: October 5, 2020
    Publication date: November 9, 2023
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Yusuke SHINOHARA, Koichi NIHEI, Takanori IWAI, Florian BEYE, Charvi VITTHAL
  • Patent number: 11809297
    Abstract: Provided is a data analysis device comprising: an analysis subject acquisition part for acquiring data to be analyzed (analysis subject data); a precision estimation part for estimating the analysis precision of the analysis subject data; a selection part for selecting an analysis module to be used in analyzing the analysis subject data on the basis of the result of estimating the analysis precision of the analysis subject data and information indicating the analysis time of the analysis subject data; and an analysis execution part for analyzing the analysis subject data using the analysis module having been selected by the selection part. According to this configuration, in cases where a data analysis device configures a data analysis processing method, the operator of the data analysis device does not have to preset a determination standard for configuring the processing method.
    Type: Grant
    Filed: April 19, 2019
    Date of Patent: November 7, 2023
    Assignee: NEC CORPORATION
    Inventors: Hayato Itsumi, Masaharu Morimoto
  • Publication number: 20230343106
    Abstract: The present disclosure provides an information processing apparatus and the like capable of specifying an object in an image that may affect traveling of a vehicle. An information processing apparatus includes: an acquisition unit that acquires an image captured by an image capturing unit mounted on a vehicle; an object detection unit that detects one or more objects in the acquired image; a traveling region specifying unit that specifies a traveling region, in which the vehicle is traveling, from regions in the acquired image; and a determination unit that determines, based on the traveling region, an image processing region, which is subjected to image processing, among regions of the one or more objects.
    Type: Application
    Filed: October 2, 2020
    Publication date: October 26, 2023
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Yusuke SHINOHARA, Koichi NIHEI, Takanori IWAI, Florian BEYE, Charvi VITTHAL
  • Publication number: 20230334672
    Abstract: A region prediction unit predicts the target region in the second image frame based on the target region detected in a first image frame and a time interval between the first and second image frames. The region prediction unit predicts the target region in the third image frame based on the target region detected in the second image frame and a time interval between the second and third image frames. A region determination unit determines, as an image-processing region, a region obtained by adding a margin to the target prediction region in the third image frame in accordance with an overlapping portion between the detected target region in the second image frame and the prediction region in the second image frame.
    Type: Application
    Filed: October 5, 2020
    Publication date: October 19, 2023
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Koichi Nihei, Yusuke Shinohara, Takanori Iwai, Florian Beye, Charvi Vitthal
  • Patent number: 11764806
    Abstract: A system includes a non-transitory computer readable medium configured to store instructions thereon; and a processor connected to the non-transitory computer readable medium. The processor is configured to execute the instructions for generating a mask based on received data from a sensor, wherein the mask includes a plurality of importance values, and each region of the received data is designated a corresponding importance value of the plurality of importance values. The processor is configured to execute the instructions for encoding the received data based on the mask; and transmitting the encoded data to a decoder for defining reconstructed data. The processor is configured to execute the instructions for computing a loss based on the reconstructed data, the received data and the mask. The processor is configured to execute the instructions for providing training to an encoder for encoding the received data based on the computed loss.
    Type: Grant
    Filed: September 6, 2021
    Date of Patent: September 19, 2023
    Assignee: NEC CORPORATION
    Inventors: Charvi Vitthal, Florian Beye, Koichi Nihei, Hayato Itsumi, Takanori Iwai
  • Publication number: 20230177701
    Abstract: A video analysis apparatus and the like with improved video analysis accuracy are provided. The video analysis apparatus includes a first video analysis unit and a second video analysis unit. The first video analysis unit is configured to distribute frames to the first video analysis unit or the second video analysis unit, detect a target object in frames which are distributed to be analyzed in the first video analysis unit, and acquire information on movement associated with the detected target object, and transmitting the information on the movement and a detection result in the first detection unit to the second video analysis unit. The second video analysis unit is configured to detect a target object in frames from the distribution unit, and adjust the detection result of the first detection unit based on a detection result in the second detection unit and the information on the movement.
    Type: Application
    Filed: February 19, 2021
    Publication date: June 8, 2023
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Takanori IWAI, Yusuke SHINOHARA, Florian BEYE
  • Patent number: 11620812
    Abstract: The image analysis apparatus includes: a first analysis unit that analyzes image frames by using a first image analysis model; a second analysis unit that can analyze the image frames by using a second image analysis model an analysis accuracy of which is lower; a storage unit that stores therein analyzed frames, which are already analyzed by using the first and second image analysis models, in association with an evaluation value for evaluating a result of an analysis performed with the second image analysis model; an extraction unit that extracts an analyzed frame that satisfies an extraction condition based on the evaluation value; and an update unit that updates the second image analysis model by using a result of an analysis performed with the first image analysis model on the extracted analyzed frame, and a result of an analysis performed with the first image analysis model on a new frame.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: April 4, 2023
    Assignee: NEC CORPORATION
    Inventors: Hayato Itsumi, Florian Beye, Yusuke Shinohara, Takanori Iwai
  • Publication number: 20230070944
    Abstract: A system includes a non-transitory computer readable medium configured to store instructions thereon; and a processor connected to the non-transitory computer readable medium. The processor is configured to execute the instructions for generating a mask based on received data from a sensor, wherein the mask includes a plurality of importance values, and each region of the received data is designated a corresponding importance value of the plurality of importance values. The processor is configured to execute the instructions for encoding the received data based on the mask; and transmitting the encoded data to a decoder for defining reconstructed data. The processor is configured to execute the instructions for computing a loss based on the reconstructed data, the received data and the mask. The processor is configured to execute the instructions for providing training to an encoder for encoding the received data based on the computed loss.
    Type: Application
    Filed: September 6, 2021
    Publication date: March 9, 2023
    Inventors: Charvi VITTHAL, Florian BEYE, Koichi NIHEI, Hayato ITSUMI, Takanori IWAI
  • Publication number: 20220375189
    Abstract: An estimation unit of a visual object tracking apparatus estimates a plurality of estimated bounding boxes and estimated object IDs respectively corresponding to the estimated bounding boxes based on a plurality of predicted bounding boxes and a plurality of detected bounding boxes. For example, the “detected bounding boxes” are “bounding boxes (bounded areas)” detected by a detector in each of a plurality of frames in a time series such as moving images. The “bounding box” is a frame surrounding an image of an object detected in a frame. For example, the “predicted bounding box” is a “bounding box” predicted by a predictor based on an estimated bounding box(es) estimated for one or a plurality of frames in the past.
    Type: Application
    Filed: October 7, 2019
    Publication date: November 24, 2022
    Applicant: NEC Corporation
    Inventors: Florian BEYE, Takanori IWAI, Yusuke SHINOHARA, Hayato ITSUMI
  • Publication number: 20220368860
    Abstract: A transmission method, a transmission system, and a system control device that are capable of transmitting a high-quality video suitable for remote operation while suppressing loss and delay are provided. The transmission method is a transmission method of transmitting an image photographed by a plurality of cameras (10) mounted on a vehicle (5), via a network (30), and includes a bandwidth estimation step (S11) of estimating an available bandwidth of the network, and a camera bandwidth allocation step (S12) of allocating a bandwidth to each camera according to the available bandwidth and an importance degree of each camera.
    Type: Application
    Filed: October 7, 2019
    Publication date: November 17, 2022
    Applicant: NEC Corporation
    Inventors: Yusuke SHINOHARA, Takanori IWAI, Hayato ITSUMI, Florian BEYE
  • Publication number: 20220345590
    Abstract: According to the present disclosure, a video analysis method and a video analysis system in which video analysis accuracy at a cloud server and an edge is improved is provided. The video analysis method includes a first image analysis step of analyzing an input image frame on the edge side, a difference value estimation step of estimating a difference value between an evaluation value of an analysis result in the first image analysis step and an evaluation value of an analysis result being predicted when the input image frame is analyzed by the cloud server, and a filtering step of determining whether to transmit the input image frame to the cloud server, based on the difference value.
    Type: Application
    Filed: October 7, 2019
    Publication date: October 27, 2022
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Takanori IWAI, Florian BEYE, Yusuke SHINOHARA
  • Patent number: 11470248
    Abstract: A data compression apparatus includes: a compression unit that performs a compression process on output data that is sequentially outputted as time series data by a monitoring apparatus for monitoring a monitoring target range; an output unit that outputs the output data on which the compression process is performed, to a data processing apparatus that performs an object detection process for detecting an object that exists in the monitoring target range by using the output data; and a setting unit that sets a compression ratio used in the compression unit, on the basis of an accuracy information indicating a relationship between a compression ratio at which the output data is compressed and a detection accuracy of the object by the object detection process performed by using the output data compressed at the compression ratio.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: October 11, 2022
    Assignee: NEC CORPORATION
    Inventors: Yusuke Shinohara, Takanori Iwai, Hayato Itsumi, Florian Beye
  • Publication number: 20220051413
    Abstract: In an object tracking device, an object detection unit detects an object from video data using a plurality of object detection programs of different detection accuracy. The object tracking unit tracks the object from the detected position of the object by the object detection unit. The control unit controls the object detection programs used by the object detection unit based on the detection result of the object by the object detection unit and the tracking result of the object by the object tracking unit.
    Type: Application
    Filed: March 10, 2020
    Publication date: February 17, 2022
    Applicant: NEC Corporation
    Inventors: Hayato ITSUMI, Masaharu MORIMOTO