Patents by Inventor Bing Song

Bing Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10229342
    Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: March 12, 2019
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, Nicholas J. Witchey
  • Publication number: 20190057113
    Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
    Type: Application
    Filed: October 23, 2018
    Publication date: February 21, 2019
    Applicant: Nant Holdings IP, LLC
    Inventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
  • Publication number: 20190012557
    Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
    Type: Application
    Filed: September 6, 2018
    Publication date: January 10, 2019
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
  • Publication number: 20190012562
    Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
    Type: Application
    Filed: September 11, 2018
    Publication date: January 10, 2019
    Applicant: Nant Holdings IP, LLC
    Inventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
  • Publication number: 20180365515
    Abstract: Edge-based recognition systems and methods are presented. Edges of the object are identified from the image data based on co-circularity of edgels, and edge-based descriptors are constructed based on the identified edges. The edge-based descriptors along with additional perception metrics are used to obtain a list of candidate objects matched with the edge-based descriptors. Through various filtering processes and verification processes, false positive candidate objects are further removed from the list to determine the final candidate object.
    Type: Application
    Filed: August 24, 2018
    Publication date: December 20, 2018
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, Matheen Siddiqui
  • Patent number: 10140317
    Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: November 27, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
  • Publication number: 20180330195
    Abstract: Systems and methods of generating a compact visual vocabulary are provided. Descriptor sets related to digital representations of objects are obtained, clustered and partitioned into cells of a descriptor space, and a representative descriptor and index are associated with each cell. Generated visual vocabularies could be stored in client-side devices and used to obtain content information related to objects of interest that are captured.
    Type: Application
    Filed: July 20, 2018
    Publication date: November 15, 2018
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, David McKinnon
  • Patent number: 10102446
    Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
    Type: Grant
    Filed: July 21, 2017
    Date of Patent: October 16, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
  • Patent number: 10095945
    Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: October 9, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
  • Patent number: 10083366
    Abstract: Edge-based recognition systems and methods are presented. Edges of the object are identified from the image data based on co-circularity of edgels, and edge-based descriptors are constructed based on the identified edges. The edge-based descriptors along with additional perception metrics are used to obtain a list of candidate objects matched with the edge-based descriptors. Through various filtering processes and verification processes, false positive candidate objects are further removed from the list to determine the final candidate object.
    Type: Grant
    Filed: April 14, 2017
    Date of Patent: September 25, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, Matheen Siddiqui
  • Patent number: 10049300
    Abstract: Systems and methods of generating a compact visual vocabulary are provided. Descriptor sets related to digital representations of objects are obtained, clustered and partitioned into cells of a descriptor space, and a representative descriptor and index are associated with each cell. Generated visual vocabularies could be stored in client-side devices and used to obtain content information related to objects of interest that are captured.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: August 14, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, David McKinnon
  • Publication number: 20180189608
    Abstract: Systems and methods of generating a compact visual vocabulary are provided. Descriptor sets related to digital representations of objects are obtained, clustered and partitioned into cells of a descriptor space, and a representative descriptor and index are associated with each cell. Generated visual vocabularies could be stored in client-side devices and used to obtain content information related to objects of interest that are captured.
    Type: Application
    Filed: February 27, 2018
    Publication date: July 5, 2018
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, David McKinnon
  • Patent number: 10013612
    Abstract: A system for analyzing scene traits in an object recognition ingestion ecosystem is presented. In some embodiment, a trait analysis engine analyzes a digital representation of a scene to derive one or more features. The features are compiled into sets of similar features with respect to a feature space. The engine attempts to discover which traits of the scene (e.g., temperature, lighting, gravity, etc.) can be used to distinguish the features for purposes of object recognition. When such distinguishing traits are found, an object recognition database is populated with object information, possibly indexed according to the similar features and their corresponding distinguishing traits.
    Type: Grant
    Filed: March 16, 2017
    Date of Patent: July 3, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: David McKinnon, John Wiacek, Jeremi Sudol, Kamil Wnuk, Bing Song
  • Publication number: 20180165519
    Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
    Type: Application
    Filed: January 26, 2018
    Publication date: June 14, 2018
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
  • Publication number: 20180114317
    Abstract: A computer implemented method of generating at least one shape of a region of interest in a digital image is provided.
    Type: Application
    Filed: October 23, 2017
    Publication date: April 26, 2018
    Applicant: NantOmics, LLC
    Inventors: Bing Song, Gregory Chu
  • Publication number: 20180107894
    Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
    Type: Application
    Filed: December 15, 2017
    Publication date: April 19, 2018
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, Nicholas J. Witchey
  • Patent number: 9922270
    Abstract: Systems and methods of generating a compact visual vocabulary are provided. Descriptor sets related to digital representations of objects are obtained, clustered and partitioned into cells of a descriptor space, and a representative descriptor and index are associated with each cell. Generated visual vocabularies could be stored in client-side devices and used to obtain content information related to objects of interest that are captured.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: March 20, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, David McKinnon
  • Patent number: 9904850
    Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: February 27, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
  • Publication number: 20180046648
    Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
    Type: Application
    Filed: October 26, 2017
    Publication date: February 15, 2018
    Applicant: Nant Holdings IP, LLC
    Inventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
  • Patent number: 9864758
    Abstract: Systems and methods of verifying the results of an initial image recognition process are presented. A verification engine can receive a set of candidate images corresponding to the results of an image recognition process performed on a captured query image. The verification engine can determine an appropriate verification technique to apply to the images of the candidate set, and classify, re-rank or otherwise re-organize the candidate set such that the best match from the candidate set is confirmed as a proper match.
    Type: Grant
    Filed: May 12, 2014
    Date of Patent: January 9, 2018
    Assignee: Nant Holdings IP, LLC
    Inventors: Mustafa Jaber, Bing Song, Jeremi Sudol