Patents by Inventor Bing Song

Bing Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9582516
    Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
    Type: Grant
    Filed: October 17, 2014
    Date of Patent: February 28, 2017
    Assignee: Nant Holdings IP, LLC
    Inventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
  • Publication number: 20170046571
    Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
    Type: Application
    Filed: October 27, 2016
    Publication date: February 16, 2017
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
  • Publication number: 20170039442
    Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
    Type: Application
    Filed: October 18, 2016
    Publication date: February 9, 2017
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
  • Patent number: 9558426
    Abstract: Techniques are provided that include identifying robust features within a training image. Training features are generated by applying a feature detection algorithm to the training image, each training feature having a training feature location within the training image. At least a portion of the training image is transformed into a transformed image in accordance with a predefined image transformation. Transform features are generated by applying the feature detection algorithm to the transformed image, each transform feature having a transform feature location within the transformed image.
    Type: Grant
    Filed: April 24, 2015
    Date of Patent: January 31, 2017
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, Liwen Lin, Mustafa Jaber
  • Publication number: 20170011278
    Abstract: A sensor data processing system and method is described. Contemplated systems and methods derive a first recognition trait of an object from a first data set that represents the object in a first environmental state. A second recognition trait of the object is then derived from a second data set that represents the object in a second environmental state. The sensor data processing systems and methods then identifies a mapping of elements of the first and second recognition traits in a new representation space. The mapping of elements satisfies a variance criterion for corresponding elements, which allows the mapping to be used for object recognition. The sensor data processing systems and methods described herein provide new object recognition techniques that are computationally efficient and can be performed in real-time by the mobile phone technology that is currently available.
    Type: Application
    Filed: August 24, 2016
    Publication date: January 12, 2017
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Jeremi Sudol, Bing Song, Matheen Siddiqui, David McKinnon
  • Patent number: 9542593
    Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: January 10, 2017
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, Nicholas J. Witchey
  • Publication number: 20160371561
    Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
    Type: Application
    Filed: August 30, 2016
    Publication date: December 22, 2016
    Applicant: Nant Holdings IP, LLC
    Inventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
  • Patent number: 9508009
    Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
    Type: Grant
    Filed: May 27, 2016
    Date of Patent: November 29, 2016
    Assignee: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
  • Patent number: 9501498
    Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
    Type: Grant
    Filed: February 16, 2015
    Date of Patent: November 22, 2016
    Assignee: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
  • Publication number: 20160314339
    Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
    Type: Application
    Filed: June 30, 2016
    Publication date: October 27, 2016
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, Nicholas J. Witchey
  • Patent number: 9466009
    Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
    Type: Grant
    Filed: December 9, 2014
    Date of Patent: October 11, 2016
    Assignee: Nant Holdings IP. LLC
    Inventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
  • Patent number: 9460366
    Abstract: A sensor data processing system and method is described. Contemplated systems and methods derive a first recognition trait of an object from a first data set that represents the object in a first environmental state. A second recognition trait of the object is then derived from a second data set that represents the object in a second environmental state. The sensor data processing systems and methods then identifies a mapping of elements of the first and second recognition traits in a new representation space. The mapping of elements satisfies a variance criterion for corresponding elements, which allows the mapping to be used for object recognition. The sensor data processing systems and methods described herein provide new object recognition techniques that are computationally efficient and can be performed in real-time by the mobile phone technology that is currently available.
    Type: Grant
    Filed: February 19, 2015
    Date of Patent: October 4, 2016
    Assignee: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Jeremi Sudol, Bing Song, Matheen Siddiqui, David McKinnon
  • Publication number: 20160275353
    Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
    Type: Application
    Filed: May 27, 2016
    Publication date: September 22, 2016
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
  • Publication number: 20160259816
    Abstract: Techniques are provided that include obtaining a vocabulary including a set of content indices that reference corresponding cells in a descriptor space based on an input set of descriptors. A plurality of local features of an image are identified based on the vocabulary, the local features being represented by a plurality of local descriptors. An associated visual word in the vocabulary is determined for each of the plurality of local descriptors. A plurality of global signatures for the image are generated based on the associated visual words, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image, two or more of the different cropped versions of the image being centered at a same pixel location of the image, and an image recognition search is facilitated using the plurality of global signatures to search a document image dataset.
    Type: Application
    Filed: March 7, 2016
    Publication date: September 8, 2016
    Applicant: Nant Holdings IP, LLC
    Inventor: Bing Song
  • Publication number: 20160259815
    Abstract: Techniques are provided that include receiving one or more global signatures for a query image in response to an image recognition query, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image. A ranking order is determined for a plurality of document images based on nearest neighbor relations between document signatures corresponding to the plurality of document images and each one of the one or more global signatures for the query image. A subset of the plurality of document images is selected based on the determined ranking order. Additional document data corresponding to the selected subset of the plurality of document images is obtained, and a search result is generated based on a geometric verification between the additional document data corresponding to the selected subset of the plurality of document images and the query image.
    Type: Application
    Filed: March 7, 2016
    Publication date: September 8, 2016
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, Liwen Lin
  • Patent number: 9412176
    Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: August 9, 2016
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, Nicholas J. Witchey
  • Patent number: 9355123
    Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
    Type: Grant
    Filed: July 15, 2014
    Date of Patent: May 31, 2016
    Assignee: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
  • Publication number: 20160134931
    Abstract: A sink apparatus for receiving and playing back multimedia data receives data frames and discards data frames from its processing pipeline in order to reduce latency if it is determined that an amount of media data buffered in one or more portions of the processing pipeline during a fixed playback time period is above a threshold value. The threshold value and therefore the extent to which data frames are discarded can be varied in order to balance latency and quality of the displayed multimedia data.
    Type: Application
    Filed: April 2, 2015
    Publication date: May 12, 2016
    Inventors: Bing Song, Xiaowen Liu, Zening Wang
  • Publication number: 20160018886
    Abstract: Multiparty object recognition systems and methods are disclosed. A method of interactively manipulating virtual object data, wherein an object database is configured to store first party object data that corresponds to a first real-world object and is further configured to store second party object data that corresponds to a second real-world object, includes obtaining the first party object data and the second party object data for storage within the object database. Access to the object database is controlled such that the first party object data and the second party object data is accessible to the first party and the second party. Modification of the first party object data by the second party is facilitated to generate modified first party object data that is in accordance with at least one context parameter of the second party object data, and the modified first party object data is communicated to the first party.
    Type: Application
    Filed: July 15, 2015
    Publication date: January 21, 2016
    Applicant: NANT HOLDINGS IP, LLC
    Inventors: Bing Song, John Wiacek, David McKinnon, Matheen Siddiqui
  • Publication number: 20150324998
    Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
    Type: Application
    Filed: May 6, 2015
    Publication date: November 12, 2015
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, Nicholas J. Witchey