Patents by Inventor Bing Song

Bing Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230129222
    Abstract: A computer implemented method of generating at least one shape of a region of interest in a digital image is provided.
    Type: Application
    Filed: December 23, 2022
    Publication date: April 27, 2023
    Applicant: NantOmics, LLC
    Inventors: Bing Song, Gregory Chu
  • Publication number: 20230123624
    Abstract: Methods, systems, and articles of manufacture to improve image recognition searching are disclosed. In some embodiments, a first document image of a known object is used to generate one or more other document images of the same object by applying one or more techniques for synthetically generating images. The synthetically generated images correspond to different variations in conditions under which a potential query image might be captured. Extracted features from an initial image of a known object and features extracted from the one or more synthetically generated images are stored, along with their locations, as part of a common model of the known object. In other embodiments, image recognition search effectiveness is improved by transforming the location of features of multiple images of a same known object into a common coordinate system. This can enhance the accuracy of certain aspects of existing image search/recognition techniques including, for example, geometric verification.
    Type: Application
    Filed: December 15, 2022
    Publication date: April 20, 2023
    Applicant: Nant Holdings IP, LLC
    Inventors: Bing Song, Liwen Lin
  • Publication number: 20230117712
    Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
    Type: Application
    Filed: December 6, 2022
    Publication date: April 20, 2023
    Applicant: Nant Holdings IP, LLC
    Inventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
  • Publication number: 20230031179
    Abstract: Provided is a virtual circuit-based data packet processing method, which includes that: identification information of a next-hop Provider Edge (PE) node of a routing packet and identification information of an Original PE (OPE) node of the routing packet are determined according to the routing packet corresponding to a Virtual Private Network (VPN) service instance; a context virtual circuit is determined, wherein nodes at both ends of the context virtual circuit are respectively the current PE node and the OPE node; a virtual circuit label of the context virtual circuit is determined; a final data packet to be forwarded is obtained by carrying a VPN label of the routing packet and the virtual circuit label with an initial data packet of the VPN service instance; and the final data packet to be forwarded is forwarded to the next-hop PE node.
    Type: Application
    Filed: November 3, 2020
    Publication date: February 2, 2023
    Inventors: Yubao WANG, Bing SONG
  • Patent number: 11551329
    Abstract: Methods, systems, and articles of manufacture to improve image recognition searching are disclosed. In some embodiments, a first document image of a known object is used to generate one or more other document images of the same object by applying one or more techniques for synthetically generating images. The synthetically generated images correspond to different variations in conditions under which a potential query image might be captured. Extracted features from an initial image of a known object and features extracted from the one or more synthetically generated images are stored, along with their locations, as part of a common model of the known object. In other embodiments, image recognition search effectiveness is improved by transforming the location of features of multiple images of a same known object into a common coordinate system. This can enhance the accuracy of certain aspects of existing image search/recognition techniques including, for example, geometric verification.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: January 10, 2023
    Assignee: Nant Holdings IP, LLC
    Inventors: Bing Song, Liwen Lin
  • Patent number: 11527055
    Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: December 13, 2022
    Assignee: NANT HOLDINGS IP, LLC
    Inventors: Mustafa Jaber, Jeremi M. Sudol, Bing Song
  • Publication number: 20220375602
    Abstract: A method of determining a region of interest in an image of tissue of an individual by an apparatus including processing circuitry may include executing, by the processing circuitry, instructions that cause the apparatus to partition an image of tissue of an individual into a set of areas, identify a tissue type of each area of the image, and apply a classifier to the image to determine a region of interest, the classifier being configured to determine regions of interest based on the tissue types of the set of areas of the image.
    Type: Application
    Filed: July 21, 2021
    Publication date: November 24, 2022
    Inventors: Mustafa I. JABER, Liudmila A. BEZIAEVA, Bing SONG, Christopher W. SZETO, Stephen Charles BENZ, Shahrooz RABIZADEH
  • Publication number: 20220375085
    Abstract: Techniques are provided for determining a cell count within a whole slide pathology image. The image is segmented using a global threshold value to define a tissue area. A plurality of patches comprising the tissue area are selected. Stain intensity vectors are determined within the plurality of patches to generate a stain intensity image. The stain intensity image is iteratively segmented to generate a cell mask using a local threshold value that is and gradually reduced after each iteration. A chamfer distance transform is applied to the cell mask to generate a distance map. Cell seeds are determined on the distance map. Cell segments are determined using a watershed transformation, and a whole cell count is calculated for the plurality of patches based on the cell segments. A client device may be configured for real-time cell counting based on the whole cell count.
    Type: Application
    Filed: August 4, 2022
    Publication date: November 24, 2022
    Applicant: NantOmics, LLC
    Inventors: Bing Song, Liudmila A. Beziaeva, Shahrooz Rabizadeh
  • Publication number: 20220292804
    Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
    Type: Application
    Filed: June 1, 2022
    Publication date: September 15, 2022
    Applicant: Nant Holdings IP, LLC
    Inventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
  • Patent number: 11443426
    Abstract: Techniques are provided for determining a cell count within a whole slide pathology image. The image is segmented using a global threshold value to define a tissue area. A plurality of patches comprising the tissue area are selected. Stain intensity vectors are determined within the plurality of patches to generate a stain intensity image. The stain intensity image is iteratively segmented to generate a cell mask using a local threshold value that is and gradually reduced after each iteration. A chamfer distance transform is applied to the cell mask to generate a distance map. Cell seeds are determined on the distance map. Cell segments are determined using a watershed transformation, and a whole cell count is calculated for the plurality of patches based on the cell segments. A client device may be configured for real-time cell counting based on the whole cell count.
    Type: Grant
    Filed: January 15, 2019
    Date of Patent: September 13, 2022
    Assignee: NantOmics, LLC
    Inventors: Bing Song, Liudmila A. Beziaeva, Shahrooz Rabizadeh
  • Publication number: 20220255853
    Abstract: The present disclosure provides a routing management method and apparatus, a network device, and a readable storage medium. The method comprises: a controller obtaining network topology information of a network side; the controller calculating, on the basis of the network topology information, path information of a segment routing traffic engineering (SR-TE) instance to be created, and sending the path information to a header node of the network side, wherein the path information comprises segment list information and entropy label (EL) insertion position information; and the controller creating the SR-TE instance from the header node to a tail node on the network side.
    Type: Application
    Filed: June 24, 2020
    Publication date: August 11, 2022
    Inventors: Shaofu PENG, Bing SONG
  • Patent number: 11392636
    Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: July 19, 2022
    Assignee: NANT HOLDINGS IP, LLC
    Inventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
  • Patent number: 11380050
    Abstract: A face image generation method includes: determining, according to a first face image, a three dimensional morphable model (3DMM) corresponding to the first face image as a first model; determining, according to a reference element, a 3DMM corresponding to the reference element as a second model, the reference element representing a posture and/or an expression of a target face image; determining, according to the first model and the second model, an initial optical flow map corresponding to the first face image, and deforming the first face image according to the initial optical flow map to obtain an initial deformation map; obtaining, through a convolutional neural network, an optical flow increment map and a visibility probability map that correspond to the first face image; and generating the target face image according to the first face image, the initial optical flow map, the optical flow increment map, and the visibility probability map.
    Type: Grant
    Filed: April 20, 2021
    Date of Patent: July 5, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xue Fei Zhe, Yonggen Ling, Lin Chao Bao, Yi Bing Song, Wei Liu
  • Patent number: 11380080
    Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: July 5, 2022
    Assignee: NANT HOLDINGS IP, LLC
    Inventors: Kamil Wnuk, David McKinnon, Jeremi Sudol, Bing Song, Matheen Siddiqui
  • Publication number: 20220188366
    Abstract: A method of automated database element processing includes training a wide machine learning model with historical feature vector inputs to generate a wide ranked element output. The method includes training a deep machine learning model with the historical feature vector inputs to generate a deep ranked element output. The method includes generating a set of inputs specific to an individual entity, obtaining a set of current article database elements, and creating a feature vector input according to the set of inputs and the set of current article database elements. The method includes processing the feature vector input with the wide machine learning model to generate a wide ranked element list, processing the feature vector input with the deep machine learning model to generate a deep ranked element list, and merging database elements of the wide and deep ranked element lists to generate a ranked element recommendation output.
    Type: Application
    Filed: December 13, 2021
    Publication date: June 16, 2022
    Inventors: Bing SONG, Jeffrey Michael Balbien, Hao Lu, Phillip Yang, Patrick Soon-Shiong
  • Publication number: 20220180626
    Abstract: Techniques are provided for determining classifications based on WSIs. A varied-size feature map is generated for each training WSI by generating a grid of patches for the training WSI, segmenting the training WSI into tissue and non-tissue areas, and converting patches comprising the tissue areas into tensors. Bounding boxes are generated based on the patches comprising tissue areas and segmented into feature map patches. A fixed-size feature map is generated based on a subset of the feature map patches. A classifier model is trained to process fixed-size feature maps corresponding to the training WSIs such that, for each fixed-size feature map, the classifier model is operable to assign a WSI-level tissue or cell morphology classification or regression based on the tensors. A classification engine is configured to use the trained classifier model to determine a WSI-level tissue or cell morphology classification or regression for a test WSI.
    Type: Application
    Filed: March 10, 2020
    Publication date: June 9, 2022
    Applicants: NantOmics, LLC, NantHealth, Inc.
    Inventors: Bing Song, Mustafa Jaber, Liudmila Beziaeva, Shahrooz Rabizadeh
  • Patent number: 11348678
    Abstract: Techniques are provided that include obtaining a vocabulary including a set of content indices that reference corresponding cells in a descriptor space based on an input set of descriptors. A plurality of local features of an image are identified based on the vocabulary, the local features being represented by a plurality of local descriptors. An associated visual word in the vocabulary is determined for each of the plurality of local descriptors. A plurality of global signatures for the image are generated based on the associated visual words, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image, two or more of the different cropped versions of the image being centered at a same pixel location of the image, and an image recognition search is facilitated using the plurality of global signatures to search a document image dataset.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: May 31, 2022
    Assignee: Nant Holdings IP, LLC
    Inventor: Bing Song
  • Publication number: 20220156314
    Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
    Type: Application
    Filed: January 28, 2022
    Publication date: May 19, 2022
    Applicant: Nant Holding IP, LLC
    Inventors: David McKinnon, Kamil Wnuk, Jeremi Sudol, Matheen Siddiqui, John Wiacek, Bing Song, Nicholas J. Witchey
  • Publication number: 20220092340
    Abstract: A method at a computing device for classifying elements within an input, the method including breaking the input into a plurality of patches; for each patch: creating a vector output; applying a characterization map to select a classification bin from a plurality of classification bins; and utilizing the selected classification bin to classify the vector output to create a classified output; and compiling the classified output from each patch.
    Type: Application
    Filed: December 1, 2021
    Publication date: March 24, 2022
    Applicants: NantOmics, LLC, NantHealth, Inc.
    Inventors: Mustafa Jaber, Liudmila A. Beziaeva, Christopher W. Szeto, Bing Song
  • Publication number: 20220022798
    Abstract: A computerized method of analyzing a waveform using a machine learning transformer model includes obtaining labeled waveform training data and unlabeled waveform training data, supplying the unlabeled waveform training data to the transformer model to pre-train the transformer model by masking a portion of an input to the transformer model, and supplying the labeled waveform training data to the transformer model without masking a portion of the input to the transformer model to fine-tune the transformer model. Each waveform in the labeled waveform training data includes at least one label identifying a feature of the waveform. The method also includes supplying a target waveform to the transformer model to classify at least one feature of the target waveform. The at least one classified feature corresponds to the least one label of the labeled waveform training data.
    Type: Application
    Filed: July 15, 2021
    Publication date: January 27, 2022
    Inventors: Patrick SOON-SHIONG, Bing SONG, Nicholas James WITCHEY