Patents by Inventor Tamaki Kojima
Tamaki Kojima has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11734868Abstract: Provided is a system that receives a three-dimensional (3D) skinned model of a first object and a set of images of a second object. The second object is same as or structurally similar to the first object in appearance. The system executes a differentiable rendering operation to generate a first image which includes a contour of the 3D skinned model. The system further generates a reference image which includes a contour of the second object, based on the received set of images. The system updates first values of bone parameters associated with the 3D skinned model based on a difference between the generated first image and the generated reference image. The system updates the 3D skinned model based on the updated first values of the bone parameters.Type: GrantFiled: July 19, 2021Date of Patent: August 22, 2023Assignee: SONY GROUP CORPORATIONInventor: Tamaki Kojima
-
Publication number: 20230015037Abstract: A system and method for motion retargeting based on differentiable rendering is provided. The system receives a three-dimensional (3D) skinned model of a first object and a set of images of a second object. The second object is same as or structurally similar to the first object in appearance. The system executes a differentiable rendering operation to generate a first image which includes a contour of the 3D skinned model. The system further generates a reference image which includes a contour of the second object, based on the received set of images. The system updates first values of bone parameters associated with the 3D skinned model based on a difference between the generated first image and the generated reference image. The system updates the 3D skinned model based on the updated first values of the bone parameters.Type: ApplicationFiled: July 19, 2021Publication date: January 19, 2023Inventor: TAMAKI KOJIMA
-
Patent number: 11380121Abstract: Recent progress of neural networks has shown significant progress over human pose estimation tasks. Pose estimation could be categorized into monocular 2D pose estimation, multi-view 3D pose estimation, and single view 3D pose estimation, where recently 3D pose is getting more attention to be applied to AR/VR, game and human computer interaction applications. However, current academic benchmarks on human 3D pose estimation only respect performance on their relative pose. The root positioning over the time, in another word, the “trajectory” of the whole body in 3D space is not considered well enough. Applications such as motion capture, not only require precise relative pose of the body but also the root position of the whole body in 3D space. Therefore, an efficient monocular full 3D pose recovery model from 2D pose input is described herein, which is able to be applied to the above applications.Type: GrantFiled: August 25, 2020Date of Patent: July 5, 2022Assignee: Sony Group CorporationInventor: Tamaki Kojima
-
Patent number: 11281712Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: GrantFiled: January 13, 2020Date of Patent: March 22, 2022Inventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Publication number: 20220067357Abstract: Recent progress of neural networks has shown significant progress over human pose estimation tasks. Pose estimation could be categorized into monocular 2D pose estimation, multi-view 3D pose estimation, and single view 3D pose estimation, where recently 3D pose is getting more attention to be applied to AR/VR, game and human computer interaction applications. However, current academic benchmarks on human 3D pose estimation only respect performance on their relative pose. The root positioning over the time, in another word, the “trajectory” of the whole body in 3D space is not considered well enough. Applications such as motion capture, not only require precise relative pose of the body but also the root position of the whole body in 3D space. Therefore, an efficient monocular full 3D pose recovery model from 2D pose input is described herein, which is able to be applied to the above applications.Type: ApplicationFiled: August 25, 2020Publication date: March 3, 2022Inventor: Tamaki Kojima
-
Patent number: 11188799Abstract: A system and method for semantic segmentation with a soft cross-entropy loss is provided. The system inputs a first color image to an input layer of a semantic segmentation network for a multi-class classification task. The semantic segmentation network generates, at an auxiliary stride, a first feature map as an output of an auxiliary layer of the semantic segmentation network based on the input first color image. The system extracts the generated first feature map from the auxiliary layer and computes a probability map as a set of soft labels over a set of classes of the multi-class classification task, based on the extracted first feature map. The system further computes an auxiliary cross-entropy loss between the computed probability map and a ground truth probability map for the auxiliary stride and trains the semantic segmentation network for the multi-class classification task based on the computed auxiliary cross-entropy loss.Type: GrantFiled: September 17, 2019Date of Patent: November 30, 2021Assignee: SONY CORPORATIONInventor: Tamaki Kojima
-
Patent number: 11182903Abstract: An electronic device and method for image mask generation using a deep neural network is provided. The electronic device stores an input image that includes an object of interest generates a pilot mask for the input image by application of a trained deep neural network (DNN) on the input image. The electronic device extracts, from the input image, a region of interest that includes the object of interest, based on the generated pilot mask and resizes the extracted region of interest such that a size of the resized region of interest equals a threshold scaling size. The electronic device further generates a final mask by reapplication of the trained DNN on the resized region of interest.Type: GrantFiled: August 5, 2019Date of Patent: November 23, 2021Assignee: SONY CORPORATIONInventors: Hiroyuki Takeda, Tamaki Kojima, Mohammad Gharavi-Alkhansari
-
Publication number: 20210107143Abstract: There is provided a recording medium having a program recorded thereon, the program causing a computer to function as: a learning section configured to learn an action model for deciding an action of an action body on a basis of environment information indicating a first environment, and action cost information indicating a cost when the action body takes an action in the first environment; and a decision section configured to decide the action of the action body in the first environment on a basis of the environment information and the action model.Type: ApplicationFiled: March 12, 2019Publication date: April 15, 2021Inventors: JUNJI OTSUKA, TAMAKI KOJIMA
-
Publication number: 20210042928Abstract: An electronic device and method for image mask generation using a deep neural network is provided. The electronic device stores an input image that includes an object of interest generates a pilot mask for the input image by application of a trained deep neural network (DNN) on the input image. The electronic device extracts, from the input image, a region of interest that includes the object of interest, based on the generated pilot mask and resizes the extracted region of interest such that a size of the resized region of interest equals a threshold scaling size. The electronic device further generates a final mask by reapplication of the trained DNN on the resized region of interest.Type: ApplicationFiled: August 5, 2019Publication date: February 11, 2021Inventors: HIROYUKI TAKEDA, TAMAKI KOJIMA, MOHAMMAD GHARAVI-ALKHANSARI
-
Publication number: 20200151210Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: ApplicationFiled: January 13, 2020Publication date: May 14, 2020Applicant: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Publication number: 20200151497Abstract: A system and method for semantic segmentation with a soft cross-entropy loss is provided. The system inputs a first color image to an input layer of a semantic segmentation network for a multi-class classification task. The semantic segmentation network generates, at an auxiliary stride, a first feature map as an output of an auxiliary layer of the semantic segmentation network based on the input first color image. The system extracts the generated first feature map from the auxiliary layer and computes a probability map as a set of soft labels over a set of classes of the multi-class classification task, based on the extracted first feature map. The system further computes an auxiliary cross-entropy loss between the computed probability map and a ground truth probability map for the auxiliary stride and trains the semantic segmentation network for the multi-class classification task based on the computed auxiliary cross-entropy loss.Type: ApplicationFiled: September 17, 2019Publication date: May 14, 2020Inventor: TAMAKI KOJIMA
-
Patent number: 10650090Abstract: A content management apparatus includes a content storage section configured to store a piece of content together with a content unique identifier; a content transmitter configured to transmit the piece of content together with the content unique identifier to a Web server; an intra-server management identifier receiver configured to receive an intra-server management identifier corresponding to the content unique identifier from the Web server; a management table for storing the content unique identifier and the intra-server management identifier; a content information updating message receiver configured to receive content information on the piece of content and a content information updating message containing the intra-server management identifier from the Web server; an identifier converter configured to convert the intra-server management identifier contained in the content information updating message into the content unique identifier; and a content management section configured to allow the content sType: GrantFiled: September 15, 2015Date of Patent: May 12, 2020Assignee: Sony CorporationInventor: Tamaki Kojima
-
Patent number: 10579669Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: GrantFiled: March 8, 2019Date of Patent: March 3, 2020Assignee: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Publication number: 20190314983Abstract: There is provided a recording medium having a program recorded thereon, the program causing a computer to function as: a learning section configured to learn an action model for deciding an action of an action body on a basis of environment information indicating a first environment, and action cost information indicating a cost when the action body takes an action in the first environment; and a decision section configured to decide the action of the action body in the first environment on a basis of the environment information and the action model.Type: ApplicationFiled: July 26, 2018Publication date: October 17, 2019Inventors: JUNJI OTSUKA, TAMAKI KOJIMA
-
Publication number: 20190205335Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: ApplicationFiled: March 8, 2019Publication date: July 4, 2019Applicant: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Patent number: 10289698Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: GrantFiled: April 3, 2018Date of Patent: May 14, 2019Assignee: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Publication number: 20180225308Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: ApplicationFiled: April 3, 2018Publication date: August 9, 2018Applicant: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Patent number: 9965493Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: GrantFiled: September 15, 2017Date of Patent: May 8, 2018Assignee: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Publication number: 20180004773Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: ApplicationFiled: September 15, 2017Publication date: January 4, 2018Applicant: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu
-
Patent number: 9805064Abstract: An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.Type: GrantFiled: December 6, 2016Date of Patent: October 31, 2017Assignee: Sony CorporationInventors: Tamaki Kojima, Yoshihiro Yamaguchi, Mikio Sakemoto, Katsuhiro Takematsu