Patents by Inventor Bing Song
Bing Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 9582516Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.Type: GrantFiled: October 17, 2014Date of Patent: February 28, 2017Assignee: Nant Holdings IP, LLCInventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
-
Publication number: 20170046571Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.Type: ApplicationFiled: October 27, 2016Publication date: February 16, 2017Applicant: Nant Holdings IP, LLCInventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
-
Publication number: 20170039442Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.Type: ApplicationFiled: October 18, 2016Publication date: February 9, 2017Applicant: Nant Holdings IP, LLCInventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
-
Patent number: 9558426Abstract: Techniques are provided that include identifying robust features within a training image. Training features are generated by applying a feature detection algorithm to the training image, each training feature having a training feature location within the training image. At least a portion of the training image is transformed into a transformed image in accordance with a predefined image transformation. Transform features are generated by applying the feature detection algorithm to the transformed image, each transform feature having a transform feature location within the transformed image.Type: GrantFiled: April 24, 2015Date of Patent: January 31, 2017Assignee: Nant Holdings IP, LLCInventors: Bing Song, Liwen Lin, Mustafa Jaber
-
Publication number: 20170011278Abstract: A sensor data processing system and method is described. Contemplated systems and methods derive a first recognition trait of an object from a first data set that represents the object in a first environmental state. A second recognition trait of the object is then derived from a second data set that represents the object in a second environmental state. The sensor data processing systems and methods then identifies a mapping of elements of the first and second recognition traits in a new representation space. The mapping of elements satisfies a variance criterion for corresponding elements, which allows the mapping to be used for object recognition. The sensor data processing systems and methods described herein provide new object recognition techniques that are computationally efficient and can be performed in real-time by the mobile phone technology that is currently available.Type: ApplicationFiled: August 24, 2016Publication date: January 12, 2017Applicant: Nant Holdings IP, LLCInventors: Kamil Wnuk, Jeremi Sudol, Bing Song, Matheen Siddiqui, David McKinnon
-
Patent number: 9542593Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.Type: GrantFiled: June 30, 2016Date of Patent: January 10, 2017Assignee: Nant Holdings IP, LLCInventors: Bing Song, Nicholas J. Witchey
-
Publication number: 20160371561Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.Type: ApplicationFiled: August 30, 2016Publication date: December 22, 2016Applicant: Nant Holdings IP, LLCInventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
-
Patent number: 9508009Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.Type: GrantFiled: May 27, 2016Date of Patent: November 29, 2016Assignee: Nant Holdings IP, LLCInventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
-
Patent number: 9501498Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.Type: GrantFiled: February 16, 2015Date of Patent: November 22, 2016Assignee: Nant Holdings IP, LLCInventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
-
Publication number: 20160314339Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.Type: ApplicationFiled: June 30, 2016Publication date: October 27, 2016Applicant: Nant Holdings IP, LLCInventors: Bing Song, Nicholas J. Witchey
-
Patent number: 9466009Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.Type: GrantFiled: December 9, 2014Date of Patent: October 11, 2016Assignee: Nant Holdings IP. LLCInventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
-
Patent number: 9460366Abstract: A sensor data processing system and method is described. Contemplated systems and methods derive a first recognition trait of an object from a first data set that represents the object in a first environmental state. A second recognition trait of the object is then derived from a second data set that represents the object in a second environmental state. The sensor data processing systems and methods then identifies a mapping of elements of the first and second recognition traits in a new representation space. The mapping of elements satisfies a variance criterion for corresponding elements, which allows the mapping to be used for object recognition. The sensor data processing systems and methods described herein provide new object recognition techniques that are computationally efficient and can be performed in real-time by the mobile phone technology that is currently available.Type: GrantFiled: February 19, 2015Date of Patent: October 4, 2016Assignee: Nant Holdings IP, LLCInventors: Kamil Wnuk, Jeremi Sudol, Bing Song, Matheen Siddiqui, David McKinnon
-
Publication number: 20160275353Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.Type: ApplicationFiled: May 27, 2016Publication date: September 22, 2016Applicant: Nant Holdings IP, LLCInventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
-
Publication number: 20160259816Abstract: Techniques are provided that include obtaining a vocabulary including a set of content indices that reference corresponding cells in a descriptor space based on an input set of descriptors. A plurality of local features of an image are identified based on the vocabulary, the local features being represented by a plurality of local descriptors. An associated visual word in the vocabulary is determined for each of the plurality of local descriptors. A plurality of global signatures for the image are generated based on the associated visual words, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image, two or more of the different cropped versions of the image being centered at a same pixel location of the image, and an image recognition search is facilitated using the plurality of global signatures to search a document image dataset.Type: ApplicationFiled: March 7, 2016Publication date: September 8, 2016Applicant: Nant Holdings IP, LLCInventor: Bing Song
-
Publication number: 20160259815Abstract: Techniques are provided that include receiving one or more global signatures for a query image in response to an image recognition query, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image. A ranking order is determined for a plurality of document images based on nearest neighbor relations between document signatures corresponding to the plurality of document images and each one of the one or more global signatures for the query image. A subset of the plurality of document images is selected based on the determined ranking order. Additional document data corresponding to the selected subset of the plurality of document images is obtained, and a search result is generated based on a geometric verification between the additional document data corresponding to the selected subset of the plurality of document images and the query image.Type: ApplicationFiled: March 7, 2016Publication date: September 8, 2016Applicant: Nant Holdings IP, LLCInventors: Bing Song, Liwen Lin
-
Patent number: 9412176Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.Type: GrantFiled: May 6, 2015Date of Patent: August 9, 2016Assignee: Nant Holdings IP, LLCInventors: Bing Song, Nicholas J. Witchey
-
Patent number: 9355123Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.Type: GrantFiled: July 15, 2014Date of Patent: May 31, 2016Assignee: Nant Holdings IP, LLCInventors: Kamil Wnuk, Bing Song, Matheen Siddiqui, David McKinnon, Jeremi Sudol, Patrick Soon-Shiong, Orang Dialameh
-
Publication number: 20160134931Abstract: A sink apparatus for receiving and playing back multimedia data receives data frames and discards data frames from its processing pipeline in order to reduce latency if it is determined that an amount of media data buffered in one or more portions of the processing pipeline during a fixed playback time period is above a threshold value. The threshold value and therefore the extent to which data frames are discarded can be varied in order to balance latency and quality of the displayed multimedia data.Type: ApplicationFiled: April 2, 2015Publication date: May 12, 2016Inventors: Bing Song, Xiaowen Liu, Zening Wang
-
Publication number: 20160018886Abstract: Multiparty object recognition systems and methods are disclosed. A method of interactively manipulating virtual object data, wherein an object database is configured to store first party object data that corresponds to a first real-world object and is further configured to store second party object data that corresponds to a second real-world object, includes obtaining the first party object data and the second party object data for storage within the object database. Access to the object database is controlled such that the first party object data and the second party object data is accessible to the first party and the second party. Modification of the first party object data by the second party is facilitated to generate modified first party object data that is in accordance with at least one context parameter of the second party object data, and the modified first party object data is communicated to the first party.Type: ApplicationFiled: July 15, 2015Publication date: January 21, 2016Applicant: NANT HOLDINGS IP, LLCInventors: Bing Song, John Wiacek, David McKinnon, Matheen Siddiqui
-
Publication number: 20150324998Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.Type: ApplicationFiled: May 6, 2015Publication date: November 12, 2015Applicant: Nant Holdings IP, LLCInventors: Bing Song, Nicholas J. Witchey