Patents by Inventor Xiang Ruan

Xiang Ruan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9904868
    Abstract: A visual attention detector includes a feature extraction unit configured to extract a spatiotemporal feature from a local region in a video; a hashing unit configured to convert a spatiotemporal feature value for the local region into a hash value, and to select a training value mapped to the hash using a hash table; and an attention measure determining unit configured to determine an attention measure on the basis of the distance between a spatiotemporal feature value for the local region and the selected training value such that the larger the distance the larger the attention measure.
    Type: Grant
    Filed: August 16, 2016
    Date of Patent: February 27, 2018
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Huchuan Lu
  • Publication number: 20170351934
    Abstract: An object recognition device includes an acquisition unit configured to acquire a recognition target image that serves as an object to be recognized; a retrieval unit configured to search an image database storing a plurality of image data in association with tag information and retrieve a similar image that matches the recognition target image; and a recognition unit configured to recognize the object included in the recognition target image on the basis of tag information associated with a similar image obtained by the retrieval unit. The recognition may select the tag information that appears most frequently among the tag information associated with the similar images as a recognition result. The recognition unit may also compute a tag information reliability score from the similar image in the retrieval result and recognize an object taking into account said reliability score.
    Type: Application
    Filed: August 24, 2017
    Publication date: December 7, 2017
    Applicant: OMRON Corporation
    Inventors: Xiang RUAN, Naru YASUDA, Yanping LU
  • Publication number: 20170352162
    Abstract: A region-of-interest extraction device is provided with an extraction unit configured to extract one or a plurality of local regions from an input image; a retrieval unit configured to search an image database storing a plurality of images and retrieve an image matching a local region for each of the local regions extracted by the extraction unit; and a relevance score determination unit configured to determine a relevance score for each of the local regions on the basis of the retrieval result from the retrieval unit.
    Type: Application
    Filed: August 23, 2017
    Publication date: December 7, 2017
    Applicant: OMRON Corporation
    Inventors: Xiang RUAN, Naru YASUDA, Yanping LU, Huchuan LU
  • Patent number: 9824294
    Abstract: A saliency information acquisition device has a local saliency acquisition unit configured to calculate a saliency measure for each pixel in an input image on the basis of information obtained from a local region surrounding each pixel, a candidate-region setting unit configured to set a plurality of candidate regions in the input image, a global saliency acquisition unit configured to calculate a saliency measure for each candidate region in the plurality of candidate regions on the basis of information including a local saliency feature representing an attribute of the saliency measure for each pixel within a candidate region, and a global feature representing an attribute of the candidate regions in relation to the entire input image, and an integration unit configured to combine the saliency measure for each candidate region in the plurality of candidate regions obtained by the global saliency acquisition unit to generate saliency information.
    Type: Grant
    Filed: March 28, 2016
    Date of Patent: November 21, 2017
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Huchuan Lu
  • Publication number: 20170091573
    Abstract: A visual attention detector includes a feature extraction unit configured to extract a spatiotemporal feature from a local region in a video; a hashing unit configured to convert a spatiotemporal feature value for the local region into a hash value, and to select a training value mapped to the hash using a hash table; and an attention measure determining unit configured to determine an attention measure on the basis of the distance between a spatiotemporal feature value for the local region and the selected training value such that the larger the distance the larger the attention measure.
    Type: Application
    Filed: August 16, 2016
    Publication date: March 30, 2017
    Applicant: OMRON Corporation
    Inventors: Xiang RUAN, Huchuan LU
  • Patent number: 9600746
    Abstract: An image processing apparatus has an image acquisition unit that acquires an image that is to be subjected to processing, a learning sample extraction unit that extracts data of a plurality of learning samples from the image, a classifier learning unit that performs learning of a plurality of classifiers using the plurality of learning samples, a strong classifier generation unit that generates a strong classifier by combining the plurality of learned classifiers, and a saliency map generation unit that generates a saliency map of the image using the strong classifier.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: March 21, 2017
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Huchuan Lu, Na Tong
  • Publication number: 20160358035
    Abstract: A saliency information acquisition device has a local saliency acquisition unit configured to calculate a saliency measure for each pixel in an input image on the basis of information obtained from a local region surrounding each pixel, a candidate-region setting unit configured to set a plurality of candidate regions in the input image, a global saliency acquisition unit configured to calculate a saliency measure for each candidate region in the plurality of candidate regions on the basis of information including a local saliency feature representing an attribute of the saliency measure for each pixel within a candidate region, and a global feature representing an attribute of the candidate regions in relation to the entire input image, and an integration unit configured to combine the saliency measure for each candidate region in the plurality of candidate regions obtained by the global saliency acquisition unit to generate saliency information.
    Type: Application
    Filed: March 28, 2016
    Publication date: December 8, 2016
    Applicant: OMRON Corporation
    Inventors: Xiang Ruan, Huchuan Lu
  • Patent number: 9367762
    Abstract: An image processing device and a method performed by a computer, the image processing device comprising: a processing unit configured to operate as an image acquisition unit configured to acquire an image; a similarity map generator configured to calculate, with a region constructed with one or a plurality of pixels in the image as a constituent unit, a first similarity map based on a first algorithm, the first similarity map representing a degree of similarity between the region and a marginal region of the image, and calculate a second similarity map based on a second algorithm, the second similarity map representing a degree of similarity between the region and the marginal region of the image; and a saliency map generator configured to integrate the first similarity map and the second similarity map to generate a saliency map.
    Type: Grant
    Filed: November 24, 2014
    Date of Patent: June 14, 2016
    Assignee: OMRON CORPORATION
    Inventors: Xiang Ruan, Huchuan Lu, Lihe Zhang, Xiaohui Li
  • Patent number: 9189861
    Abstract: An image processing device has an affinity calculating unit that handles each pixel in an image or each region including a plurality of pixels joined together, as a unit component, and determines a first affinity between each of the unit components and one of the unit components which is located in a periphery region of the image, a foreground region identifying unit that identifies, as a foreground region, a region made up of one or more of the unit components whose first affinities calculated by the affinity calculating unit are lower than a preset threshold, and a saliency measure output unit that determines a second affinity between each of the unit components in the image and the foreground region identified by the foreground region identifying unit, and outputs the second affinity as a saliency measure for each unit component.
    Type: Grant
    Filed: February 27, 2014
    Date of Patent: November 17, 2015
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Lu Huchuan, Yang Chuan, Zhang Lihe
  • Patent number: 9177205
    Abstract: An attribute of image data can accurately be discriminated. An image attribute discrimination apparatus includes a heterogeneous region extracting unit that specifies a heterogeneous region from image data. The heterogeneous region includes a heterogeneous matter whose attribute is different from that of a content originally produced by the image data. An image attribute discrimination apparatus further includes a scene discrimination unit that discriminates the attribute of the image data based on a feature quantity extracted from a pixel group except each pixel in the heterogeneous region in each pixel of the image data.
    Type: Grant
    Filed: February 23, 2011
    Date of Patent: November 3, 2015
    Assignee: OMRON Corporation
    Inventors: Tomoyoshi Aizawa, Xiang Ruan, Motoo Yamamoto, Kiyoaki Tanaka
  • Publication number: 20150262068
    Abstract: An event detection apparatus determines the occurrence of an abnormal event based on input data without predefining and learning normal or abnormal patterns. A first data obtaining unit obtains first data. A feature quantity classifying unit obtains a feature quantity corresponding to the first data, generates a plurality of clusters for classifying the obtained feature quantity, and classifies the feature quantity into a corresponding one of the clusters. A learning unit learns a plurality of identifiers using feature quantities classified into the clusters. A second data obtaining unit obtains second data. An identifier unit inputs a feature quantity corresponding to the second data into the plurality of learned identifiers, and receives an identification result from each identifier. A determination unit determines whether the second data includes an identification target event based on the obtained identification result.
    Type: Application
    Filed: February 2, 2015
    Publication date: September 17, 2015
    Applicant: OMRON Corporation
    Inventors: Xiang Ruan, Huchuan Lu, Ying Zhang
  • Publication number: 20150262039
    Abstract: An image processing apparatus has an image acquisition unit that acquires an image that is to be subjected to processing, a learning sample extraction unit that extracts data of a plurality of learning samples from the image, a classifier learning unit that performs learning of a plurality of classifiers using the plurality of learning samples, a strong classifier generation unit that generates a strong classifier by combining the plurality of learned classifiers, and a saliency map generation unit that generates a saliency map of the image using the strong classifier.
    Type: Application
    Filed: December 31, 2014
    Publication date: September 17, 2015
    Inventors: Xiang Ruan, Huchuan Lu, Na Tong
  • Publication number: 20150154471
    Abstract: An image processing device and a method performed by a computer, the image processing device comprising: a processing unit configured to operate as an image acquisition unit configured to acquire an image; a similarity map generator configured to calculate, with a region constructed with one or a plurality of pixels in the image as a constituent unit, a first similarity map based on a first algorithm, the first similarity map representing a degree of similarity between the region and a marginal region of the image, and calculate a second similarity map based on a second algorithm, the second similarity map representing a degree of similarity between the region and the marginal region of the image; and a saliency map generator configured to integrate the first similarity map and the second similarity map to generate a saliency map.
    Type: Application
    Filed: November 24, 2014
    Publication date: June 4, 2015
    Applicant: OMRON Corporation
    Inventors: Xiang Ruan, Huchuan Lu, Lihe Zhang, Xiaohui Li
  • Patent number: 9020270
    Abstract: An image processing device configured to detect a salient region from an image has a pixel small-region image generating unit that generates a pixel small-region image using, as a unit, a pixel small region made of pixels adjacent to one another and whose luminance values or chromaticity are similar, from the image, a prior probability calculator that calculates prior probability of likelihood of the salient region for each of the pixels of the image, a region generating unit that generates a salient-region-containing region having high possibility of containing a salient region on the basis of a corner point extracted from the image, and a likelihood calculator.
    Type: Grant
    Filed: March 27, 2014
    Date of Patent: April 28, 2015
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Lu Huchuan, Tong Na
  • Patent number: 9014467
    Abstract: An image processing method includes a segmentation step that segments an input image into a plurality of regions by using an automatic segmentation algorithm, and a computation step that calculates a saliency value of one region of the plurality of segmented regions by using a weighted sum of color differences between the one region and all other regions. Accordingly, it is possible to automatically analyze visual saliency regions in an image, and a result of analysis can be used in application areas including significant object segmentation, object recognition, adaptive image compression, content-aware image resizing, and image retrieval.
    Type: Grant
    Filed: May 11, 2012
    Date of Patent: April 21, 2015
    Assignees: OMRON Corporation, Tsinghua University
    Inventors: Shi-Min Hu, Ming-Ming Cheng, Guo-Xin Zhang, Niloy J. Mitra, Xiang Ruan
  • Publication number: 20150071532
    Abstract: Disclosed are an image processing device, an image processing method, and a non-transitory computer-readable medium that obtain a contour image in which noise edges are eliminated from local edge information and a contour of an important object is enhanced. The image processing device includes a local contour extraction unit which generates a local edge image and a global contour extraction unit which generates a global edge image. The image processing device generates a contour image by preparing the local edge image and obtaining the weighting sum of the local edge image and the global edge image.
    Type: Application
    Filed: September 11, 2013
    Publication date: March 12, 2015
    Inventors: Xiang Ruan, Lin Chen, Ming-Hsuan Yang
  • Publication number: 20140321748
    Abstract: An image processing device has an affinity calculating unit that handles each pixel in an image or each region including a plurality of pixels joined together, as a unit component, and determines a first affinity between each of the unit components and one of the unit components which is located in a periphery region of the image, a foreground region identifying unit that identifies, as a foreground region, a region made up of one or more of the unit components whose first affinities calculated by the affinity calculating unit are lower than a preset threshold, and a saliency measure output unit that determines a second affinity between each of the unit components in the image and the foreground region identified by the foreground region identifying unit, and outputs the second affinity as a saliency measure for each unit component.
    Type: Application
    Filed: February 27, 2014
    Publication date: October 30, 2014
    Applicant: OMRON Corporation
    Inventors: Xiang Ruan, Lu Huchuan, Yang Chuan, Zhang Lihe
  • Publication number: 20140321754
    Abstract: An image processing device configured to detect a salient region from an image has a pixel small-region image generating unit that generates a pixel small-region image using, as a unit, a pixel small region made of pixels adjacent to one another and whose luminance values or chromaticity are similar, from the image, a prior probability calculator that calculates prior probability of likelihood of the salient region for each of the pixels of the image, a region generating unit that generates a salient-region-containing region having high possibility of containing a salient region on the basis of a corner point extracted from the image, and a likelihood calculator.
    Type: Application
    Filed: March 27, 2014
    Publication date: October 30, 2014
    Applicant: OMRON CORPORATION
    Inventors: Xiang Ruan, Lu Huchuan, Tong Na
  • Patent number: 8805087
    Abstract: An image processing device for identifying a characteristic of an eye from a face image comprising: a first differentiation unit configured to differentiate an eye region in at least a vertical direction of the eye to obtain a first luminance gradient; a first edge extraction unit configured to extract a first edge point according to the first luminance gradient; and a curve identification unit configured to identify a curve, which is a B-spline curve or a Bezier curve expressed by a control point and both end points and fits to the first edge point, as a curve expressing an upper-eyelid or lower-eyelid outline, the end points being an inner corner point of eye and a tail point of eye, by voting for the control point that is a voting target with respect to the first edge point using the Hough transform.
    Type: Grant
    Filed: March 22, 2011
    Date of Patent: August 12, 2014
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Takayoshi Yamashita
  • Patent number: 8750623
    Abstract: An image processing device for identifying a characteristic of an eye from a face image comprising: a first differentiation unit configured to differentiate an eye region in a crosswise direction of the eye to obtain a first luminance gradient; a first edge extraction unit configured to extract a first and a second edge points; a voting unit configured to vote for an ellipse; a pupil outline identification unit configured to identify an ellipse expressing a pupil outline; a second differentiation unit configured to obtain a second luminance gradient by differentiating in a vertical direction; a second edge extraction unit configured to extract a third edge point; a curve identification unit configured to identify a curve that fits to the third edge point as a curve expressing an eyelid outline; and a pupil region identification unit configured to identify a pupil region based on the identified ellipse and the identified curve.
    Type: Grant
    Filed: March 22, 2011
    Date of Patent: June 10, 2014
    Assignee: OMRON Corporation
    Inventors: Xiang Ruan, Takayoshi Yamashita