Patents by Inventor Biyi FANG
Biyi FANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230245178Abstract: A method implemented via execution of computing instructions configured to run at one or more processors and stored at one or more non-transitory computer-readable media. The method can include monitoring periodically whether a respective recommended bidding price update for a campaign type for a user is required for a respective department of campaign departments based on a respective landscape distribution of respective bidding prices for the campaign type for the respective department.Type: ApplicationFiled: January 31, 2022Publication date: August 3, 2023Applicant: Walmart Apollo, LLCInventors: Biyi Fang, Dong Xu, Stephen Dean Guo
-
Publication number: 20230245171Abstract: A method implemented via execution of computing instructions configured to run at one or more processors and stored at one or more non-transitory computer-readable media. The method can include receiving, via a computer network, an ad request. The method also can include retrieving ad candidates from an ad database. The method further can include determining a respective ad ranking score for each of the ad candidates, based at least in part on the ad request and respective historical retrieval scores for each of the ad candidates.Type: ApplicationFiled: January 31, 2022Publication date: August 3, 2023Applicant: Walmart Apollo, LLCInventors: Yichuan Niu, Biyi Fang, Yangbing Xue, Kritika Upreti, Ashutosh Singh, Vivek Kumar, Haibo Yan, Valeriy V. Pelyushenko, Rajesh Garigipati, Jayanth Korlimarla, Dong Xu, Musen Wen, Stephen Dean Guo
-
Publication number: 20230154218Abstract: A computer system is provided that includes one or more processors configured to receive user input for inked content to a digital canvas, and process the inked content to determine one or more writing regions. Each writing region includes recognized text and one or more document layout features associated with that writing region. The one or more processors are further configured to tokenize a target writing region of the one or more writing regions into a sequence of tokens, process the sequence of tokens of the target writing region using task extraction subsystem that operates on tokens representing both the recognized text and the one or more document layout features of the target writing region, segment the target writing region into one or more sentence segments, and classify each of the one or more sentence segments as a task sentence or a non-task sentence.Type: ApplicationFiled: November 12, 2021Publication date: May 18, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Jenna HONG, Apurva Sandeep GANDHI, Gilbert ANTONIUS, Tra My NGUYEN, Ryan SERRAO, Biyi FANG, Sheng YI
-
Publication number: 20230143969Abstract: Systems and methods for performing spatial line grouping on digital ink stokes. The system includes an electronic processor configured to access a set of hypothetical lines in an electronic document and determine a set of hypothetical line pairings. The electronic processor is also configured to determine, via a gradient boosting tree model, a merge confidence score for each hypothetical line pairing and compare a first merge confidence score with a merge threshold. The first merge confidence score is associated with a first hypothetical line and a first neighboring hypothetical line. The electronic processor is also configured to, in response to the first merge confidence score satisfying the merge threshold, merge the first hypothetical line and the first neighboring hypothetical line to form a first line grouping. The electronic processor is also configured to perform a digital ink stroke analysis on the electronic document based on the first line grouping.Type: ApplicationFiled: November 9, 2021Publication date: May 11, 2023Inventors: Biyi FANG, Sheng YI, Tianyi CHEN
-
Patent number: 11631263Abstract: Systems and methods for performing spatial line grouping on digital ink stokes. The system includes an electronic processor configured to access a set of hypothetical lines in an electronic document and determine a set of hypothetical line pairings. The electronic processor is also configured to determine, via a gradient boosting tree model, a merge confidence score for each hypothetical line pairing and compare a first merge confidence score with a merge threshold. The first merge confidence score is associated with a first hypothetical line and a first neighboring hypothetical line. The electronic processor is also configured to, in response to the first merge confidence score satisfying the merge threshold, merge the first hypothetical line and the first neighboring hypothetical line to form a first line grouping. The electronic processor is also configured to perform a digital ink stroke analysis on the electronic document based on the first line grouping.Type: GrantFiled: November 9, 2021Date of Patent: April 18, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Biyi Fang, Sheng Yi, Tianyi Chen
-
Patent number: 11631262Abstract: A data processing system for performing a semantic analysis of digital ink stroke data implements obtaining the digital ink stroke data representing handwritten text, drawings, or both; analyzing the digital ink stroke data to extract path signature feature information from the digital ink stroke data; analyzing the path signature feature information using a convolutional neural network (CNN) trained to perform a pixel-level sematic analysis of the digital ink stroke data and to output a pixel segmentation map with semantic prediction information for each pixel of digital ink stroke data; analyzing the pixel segmentation map to generate stroke-level semantic information using a pixel-to-stroke conversion model; and processing the digital ink stroke data based on the stroke-level semantic information.Type: GrantFiled: November 13, 2020Date of Patent: April 18, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Tianyi Chen, Gowtham Ganesan, Biyi Fang, Sheng Yi
-
Publication number: 20220156486Abstract: A data processing system for performing a semantic analysis of digital ink stroke data implements obtaining the digital ink stroke data representing handwritten text, drawings, or both; analyzing the digital ink stroke data to extract path signature feature information from the digital ink stroke data; analyzing the path signature feature information using a convolutional neural network (CNN) trained to perform a pixel-level sematic analysis of the digital ink stroke data and to output a pixel segmentation map with semantic prediction information for each pixel of digital ink stroke data; analyzing the pixel segmentation map to generate stroke-level semantic information using a pixel-to-stroke conversion model; and processing the digital ink stroke data based on the stroke-level semantic information.Type: ApplicationFiled: November 13, 2020Publication date: May 19, 2022Applicant: Microsoft Technology Licensing, LLCInventors: Tianyi CHEN, Gowtham GANESAN, Biyi FANG, Sheng YI
-
Patent number: 11263409Abstract: A sign language translation system may capture infrared images of the formation of a sign language sign or sequence of signs. The captured infrared images may be used to produce skeletal joints data that includes a temporal sequence of 3D coordinates of skeletal joints of hands and forearms that produced the sign language sign(s). A hierarchical bidirectional recurrent neural network may be used to translate the skeletal joints data into a word or sentence of a spoken language. End-to-end sentence translation may be performed using a probabilistic connectionist temporal classification based approach that may not require pre-segmentation of the sequence of signs or post-processing of the translated sentence.Type: GrantFiled: November 5, 2018Date of Patent: March 1, 2022Assignee: BOARD OF TRUSTEES OF MICHIGAN STATE UNIVERSITYInventors: Mi Zhang, Biyi Fang
-
Publication number: 20210295174Abstract: Systems and methods are disclosed which allow mobile devices, and other resource constrained applications, to more efficiently and effectively utilize deep learning neural networks using only (or primarily) local resources. These systems and methods take the dynamics of runtime resources into account to enable resource-aware, multi-tenant on-device deep learning for artificial intelligence functions for use in tasks like mobile vision systems. The multi-capacity framework enables deep learning models to offer flexible resource-accuracy trade-offs and other similar balancing of performance and resources consumed. At runtime, various systems disclosed herein may dynamically select the optimal resource-accuracy trade-off for each deep learning model to fit the model's resource demand to the system's available runtime resources and the needs of the task being performed by the model.Type: ApplicationFiled: August 9, 2019Publication date: September 23, 2021Inventors: Mi ZHANG, Biyi FANG, Xiao ZENG
-
Patent number: 10982869Abstract: Existing indoor air quality monitoring technologies focus on measuring which turn out to be effective in increasing people's awareness of air quality. However, the lack of identification of pollution sources is prone to lead to general and monotonous suggestions. In this disclosure, an indoor air quality analytics system is presented that is able to detect pollution events and identify pollution sources in real-time. The system can also forecast personal exposure to air pollution and provide actionable suggestions to help people improve indoor air quality.Type: GrantFiled: September 11, 2017Date of Patent: April 20, 2021Assignee: Board of Trustees of Michigan State UniversityInventors: Mi Zhang, Biyi Fang, Taiwoo Park
-
Publication number: 20210056357Abstract: The present disclosure describes systems and methods for implementing input-adaptive neural networks. Several approaches and systems are presented for creating flexible and computationally-efficient deep neural networks that adapt their complexity based upon input data such as video streams. The approach may use fine-grained design and an automatic approach for generating optimal network architectures based on early-exit mechanisms. A neural network modified according to such principles can be implemented in various devices including mobile vision systems such as smartphones, drones, and head-mounted augmented reality devices.Type: ApplicationFiled: August 19, 2020Publication date: February 25, 2021Inventors: Mi Zhang, Biyi Fang, Xiao Zeng
-
Patent number: 10748310Abstract: Described herein is a system and method regarding an interactive drawing tutorial session for creating a drawing using a computer application. A digital image is processed to determine linework and shading information for a plurality of shading levels. A graphical user interface for an interactive drawing tutorial session for creating the drawing by displaying the determined linework to a user. User linework input is received for the drawing based upon the displayed linework information. Feedback is provided to the user regarding the received user linework input (e.g., regarding tilt and/or pressure of electronic stylus). For each of the plurality of shading levels, the determined shading information is displayed to the user. User shading input is received for the drawing based upon the displayed shading information. Feedback is provided to the user regarding the received user shading input (e.g., regarding tilt and/or pressure of electronic stylus).Type: GrantFiled: September 12, 2018Date of Patent: August 18, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Blake Emory Williford, Claes-Fredrik Urban Mannby, Abhay Tanaji Doke, Biyi Fang
-
Publication number: 20200082583Abstract: Described herein is a system and method regarding an interactive drawing tutorial session for creating a drawing using a computer application. A digital image is processed to determine linework and shading information for a plurality of shading levels. A graphical user interface for an interactive drawing tutorial session for creating the drawing by displaying the determined linework to a user. User linework input is received for the drawing based upon the displayed linework information. Feedback is provided to the user regarding the received user linework input (e.g., regarding tilt and/or pressure of electronic stylus). For each of the plurality of shading levels, the determined shading information is displayed to the user. User shading input is received for the drawing based upon the displayed shading information. Feedback is provided to the user regarding the received user shading input (e.g., regarding tilt and/or pressure of electronic stylus).Type: ApplicationFiled: September 12, 2018Publication date: March 12, 2020Applicant: Microsoft Technology Licensing, LLCInventors: Blake Emory WILLIFORD, Claes-Fredrik Urban MANNBY, Abhay Tanaji DOKE, Biyi FANG
-
Publication number: 20190160339Abstract: Virtual reality and communicative sensing devices may be applied to immersive and interactive exercise. Systems and methods may be used to capture a user's movements during exercise and use captured movement information to update sensory stimuli presented to the user via a head mounted display to create an illusion of being immersed in a virtual environment in which the user can interact. This movement information may be captured using an internet of things (IoT) sensor attached to, in communication with, or integrated into exercise equipment being operated by the user. The IoT sensor may identify exercise type, count the number of repetitions, and assess the quality of the exercise being performed by the user.Type: ApplicationFiled: November 29, 2018Publication date: May 30, 2019Inventors: Mi Zhang, Taiwoo Park, Biyi Fang
-
Publication number: 20190138607Abstract: A sign language translation system may capture infrared images of the formation of a sign language sign or sequence of signs. The captured infrared images may be used to produce skeletal joints data that includes a temporal sequence of 3D coordinates of skeletal joints of hands and forearms that produced the sign language sign(s). A hierarchical bidirectional recurrent neural network may be used to translate the skeletal joints data into a word or sentence of a spoken language. End-to-end sentence translation may be performed using a probabilistic connectionist temporal classification based approach that may not require pre-segmentation of the sequence of signs or post-processing of the translated sentence.Type: ApplicationFiled: November 5, 2018Publication date: May 9, 2019Inventors: Mi Zhang, Biyi Fang
-
Publication number: 20180073759Abstract: Existing indoor air quality monitoring technologies focus on measuring which turn out to be effective in increasing people's awareness of air quality. However, the lack of identification of pollution sources is prone to lead to general and monotonous suggestions. In this disclosure, an indoor air quality analytics system is presented that is able to detect pollution events and identify pollution sources in real-time. The system can also forecast personal exposure to air pollution and provide actionable suggestions to help people improve indoor air quality.Type: ApplicationFiled: September 11, 2017Publication date: March 15, 2018Inventors: Mi ZHANG, Biyi FANG, Taiwoo PARK