Patents by Inventor Biyi FANG

Biyi FANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230245178
    Abstract: A method implemented via execution of computing instructions configured to run at one or more processors and stored at one or more non-transitory computer-readable media. The method can include monitoring periodically whether a respective recommended bidding price update for a campaign type for a user is required for a respective department of campaign departments based on a respective landscape distribution of respective bidding prices for the campaign type for the respective department.
    Type: Application
    Filed: January 31, 2022
    Publication date: August 3, 2023
    Applicant: Walmart Apollo, LLC
    Inventors: Biyi Fang, Dong Xu, Stephen Dean Guo
  • Publication number: 20230245171
    Abstract: A method implemented via execution of computing instructions configured to run at one or more processors and stored at one or more non-transitory computer-readable media. The method can include receiving, via a computer network, an ad request. The method also can include retrieving ad candidates from an ad database. The method further can include determining a respective ad ranking score for each of the ad candidates, based at least in part on the ad request and respective historical retrieval scores for each of the ad candidates.
    Type: Application
    Filed: January 31, 2022
    Publication date: August 3, 2023
    Applicant: Walmart Apollo, LLC
    Inventors: Yichuan Niu, Biyi Fang, Yangbing Xue, Kritika Upreti, Ashutosh Singh, Vivek Kumar, Haibo Yan, Valeriy V. Pelyushenko, Rajesh Garigipati, Jayanth Korlimarla, Dong Xu, Musen Wen, Stephen Dean Guo
  • Publication number: 20230154218
    Abstract: A computer system is provided that includes one or more processors configured to receive user input for inked content to a digital canvas, and process the inked content to determine one or more writing regions. Each writing region includes recognized text and one or more document layout features associated with that writing region. The one or more processors are further configured to tokenize a target writing region of the one or more writing regions into a sequence of tokens, process the sequence of tokens of the target writing region using task extraction subsystem that operates on tokens representing both the recognized text and the one or more document layout features of the target writing region, segment the target writing region into one or more sentence segments, and classify each of the one or more sentence segments as a task sentence or a non-task sentence.
    Type: Application
    Filed: November 12, 2021
    Publication date: May 18, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jenna HONG, Apurva Sandeep GANDHI, Gilbert ANTONIUS, Tra My NGUYEN, Ryan SERRAO, Biyi FANG, Sheng YI
  • Publication number: 20230143969
    Abstract: Systems and methods for performing spatial line grouping on digital ink stokes. The system includes an electronic processor configured to access a set of hypothetical lines in an electronic document and determine a set of hypothetical line pairings. The electronic processor is also configured to determine, via a gradient boosting tree model, a merge confidence score for each hypothetical line pairing and compare a first merge confidence score with a merge threshold. The first merge confidence score is associated with a first hypothetical line and a first neighboring hypothetical line. The electronic processor is also configured to, in response to the first merge confidence score satisfying the merge threshold, merge the first hypothetical line and the first neighboring hypothetical line to form a first line grouping. The electronic processor is also configured to perform a digital ink stroke analysis on the electronic document based on the first line grouping.
    Type: Application
    Filed: November 9, 2021
    Publication date: May 11, 2023
    Inventors: Biyi FANG, Sheng YI, Tianyi CHEN
  • Patent number: 11631263
    Abstract: Systems and methods for performing spatial line grouping on digital ink stokes. The system includes an electronic processor configured to access a set of hypothetical lines in an electronic document and determine a set of hypothetical line pairings. The electronic processor is also configured to determine, via a gradient boosting tree model, a merge confidence score for each hypothetical line pairing and compare a first merge confidence score with a merge threshold. The first merge confidence score is associated with a first hypothetical line and a first neighboring hypothetical line. The electronic processor is also configured to, in response to the first merge confidence score satisfying the merge threshold, merge the first hypothetical line and the first neighboring hypothetical line to form a first line grouping. The electronic processor is also configured to perform a digital ink stroke analysis on the electronic document based on the first line grouping.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: April 18, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Biyi Fang, Sheng Yi, Tianyi Chen
  • Patent number: 11631262
    Abstract: A data processing system for performing a semantic analysis of digital ink stroke data implements obtaining the digital ink stroke data representing handwritten text, drawings, or both; analyzing the digital ink stroke data to extract path signature feature information from the digital ink stroke data; analyzing the path signature feature information using a convolutional neural network (CNN) trained to perform a pixel-level sematic analysis of the digital ink stroke data and to output a pixel segmentation map with semantic prediction information for each pixel of digital ink stroke data; analyzing the pixel segmentation map to generate stroke-level semantic information using a pixel-to-stroke conversion model; and processing the digital ink stroke data based on the stroke-level semantic information.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: April 18, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Tianyi Chen, Gowtham Ganesan, Biyi Fang, Sheng Yi
  • Publication number: 20220156486
    Abstract: A data processing system for performing a semantic analysis of digital ink stroke data implements obtaining the digital ink stroke data representing handwritten text, drawings, or both; analyzing the digital ink stroke data to extract path signature feature information from the digital ink stroke data; analyzing the path signature feature information using a convolutional neural network (CNN) trained to perform a pixel-level sematic analysis of the digital ink stroke data and to output a pixel segmentation map with semantic prediction information for each pixel of digital ink stroke data; analyzing the pixel segmentation map to generate stroke-level semantic information using a pixel-to-stroke conversion model; and processing the digital ink stroke data based on the stroke-level semantic information.
    Type: Application
    Filed: November 13, 2020
    Publication date: May 19, 2022
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Tianyi CHEN, Gowtham GANESAN, Biyi FANG, Sheng YI
  • Patent number: 11263409
    Abstract: A sign language translation system may capture infrared images of the formation of a sign language sign or sequence of signs. The captured infrared images may be used to produce skeletal joints data that includes a temporal sequence of 3D coordinates of skeletal joints of hands and forearms that produced the sign language sign(s). A hierarchical bidirectional recurrent neural network may be used to translate the skeletal joints data into a word or sentence of a spoken language. End-to-end sentence translation may be performed using a probabilistic connectionist temporal classification based approach that may not require pre-segmentation of the sequence of signs or post-processing of the translated sentence.
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: March 1, 2022
    Assignee: BOARD OF TRUSTEES OF MICHIGAN STATE UNIVERSITY
    Inventors: Mi Zhang, Biyi Fang
  • Publication number: 20210295174
    Abstract: Systems and methods are disclosed which allow mobile devices, and other resource constrained applications, to more efficiently and effectively utilize deep learning neural networks using only (or primarily) local resources. These systems and methods take the dynamics of runtime resources into account to enable resource-aware, multi-tenant on-device deep learning for artificial intelligence functions for use in tasks like mobile vision systems. The multi-capacity framework enables deep learning models to offer flexible resource-accuracy trade-offs and other similar balancing of performance and resources consumed. At runtime, various systems disclosed herein may dynamically select the optimal resource-accuracy trade-off for each deep learning model to fit the model's resource demand to the system's available runtime resources and the needs of the task being performed by the model.
    Type: Application
    Filed: August 9, 2019
    Publication date: September 23, 2021
    Inventors: Mi ZHANG, Biyi FANG, Xiao ZENG
  • Patent number: 10982869
    Abstract: Existing indoor air quality monitoring technologies focus on measuring which turn out to be effective in increasing people's awareness of air quality. However, the lack of identification of pollution sources is prone to lead to general and monotonous suggestions. In this disclosure, an indoor air quality analytics system is presented that is able to detect pollution events and identify pollution sources in real-time. The system can also forecast personal exposure to air pollution and provide actionable suggestions to help people improve indoor air quality.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: April 20, 2021
    Assignee: Board of Trustees of Michigan State University
    Inventors: Mi Zhang, Biyi Fang, Taiwoo Park
  • Publication number: 20210056357
    Abstract: The present disclosure describes systems and methods for implementing input-adaptive neural networks. Several approaches and systems are presented for creating flexible and computationally-efficient deep neural networks that adapt their complexity based upon input data such as video streams. The approach may use fine-grained design and an automatic approach for generating optimal network architectures based on early-exit mechanisms. A neural network modified according to such principles can be implemented in various devices including mobile vision systems such as smartphones, drones, and head-mounted augmented reality devices.
    Type: Application
    Filed: August 19, 2020
    Publication date: February 25, 2021
    Inventors: Mi Zhang, Biyi Fang, Xiao Zeng
  • Patent number: 10748310
    Abstract: Described herein is a system and method regarding an interactive drawing tutorial session for creating a drawing using a computer application. A digital image is processed to determine linework and shading information for a plurality of shading levels. A graphical user interface for an interactive drawing tutorial session for creating the drawing by displaying the determined linework to a user. User linework input is received for the drawing based upon the displayed linework information. Feedback is provided to the user regarding the received user linework input (e.g., regarding tilt and/or pressure of electronic stylus). For each of the plurality of shading levels, the determined shading information is displayed to the user. User shading input is received for the drawing based upon the displayed shading information. Feedback is provided to the user regarding the received user shading input (e.g., regarding tilt and/or pressure of electronic stylus).
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: August 18, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Blake Emory Williford, Claes-Fredrik Urban Mannby, Abhay Tanaji Doke, Biyi Fang
  • Publication number: 20200082583
    Abstract: Described herein is a system and method regarding an interactive drawing tutorial session for creating a drawing using a computer application. A digital image is processed to determine linework and shading information for a plurality of shading levels. A graphical user interface for an interactive drawing tutorial session for creating the drawing by displaying the determined linework to a user. User linework input is received for the drawing based upon the displayed linework information. Feedback is provided to the user regarding the received user linework input (e.g., regarding tilt and/or pressure of electronic stylus). For each of the plurality of shading levels, the determined shading information is displayed to the user. User shading input is received for the drawing based upon the displayed shading information. Feedback is provided to the user regarding the received user shading input (e.g., regarding tilt and/or pressure of electronic stylus).
    Type: Application
    Filed: September 12, 2018
    Publication date: March 12, 2020
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Blake Emory WILLIFORD, Claes-Fredrik Urban MANNBY, Abhay Tanaji DOKE, Biyi FANG
  • Publication number: 20190160339
    Abstract: Virtual reality and communicative sensing devices may be applied to immersive and interactive exercise. Systems and methods may be used to capture a user's movements during exercise and use captured movement information to update sensory stimuli presented to the user via a head mounted display to create an illusion of being immersed in a virtual environment in which the user can interact. This movement information may be captured using an internet of things (IoT) sensor attached to, in communication with, or integrated into exercise equipment being operated by the user. The IoT sensor may identify exercise type, count the number of repetitions, and assess the quality of the exercise being performed by the user.
    Type: Application
    Filed: November 29, 2018
    Publication date: May 30, 2019
    Inventors: Mi Zhang, Taiwoo Park, Biyi Fang
  • Publication number: 20190138607
    Abstract: A sign language translation system may capture infrared images of the formation of a sign language sign or sequence of signs. The captured infrared images may be used to produce skeletal joints data that includes a temporal sequence of 3D coordinates of skeletal joints of hands and forearms that produced the sign language sign(s). A hierarchical bidirectional recurrent neural network may be used to translate the skeletal joints data into a word or sentence of a spoken language. End-to-end sentence translation may be performed using a probabilistic connectionist temporal classification based approach that may not require pre-segmentation of the sequence of signs or post-processing of the translated sentence.
    Type: Application
    Filed: November 5, 2018
    Publication date: May 9, 2019
    Inventors: Mi Zhang, Biyi Fang
  • Publication number: 20180073759
    Abstract: Existing indoor air quality monitoring technologies focus on measuring which turn out to be effective in increasing people's awareness of air quality. However, the lack of identification of pollution sources is prone to lead to general and monotonous suggestions. In this disclosure, an indoor air quality analytics system is presented that is able to detect pollution events and identify pollution sources in real-time. The system can also forecast personal exposure to air pollution and provide actionable suggestions to help people improve indoor air quality.
    Type: Application
    Filed: September 11, 2017
    Publication date: March 15, 2018
    Inventors: Mi ZHANG, Biyi FANG, Taiwoo PARK