Patents by Inventor Haoliang WANG

Haoliang WANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250005289
    Abstract: Dialogue state aware dialogue summarization techniques are described that enable generation of dialogue summaries from target domains with limited training data. A content processing system, for instance, generates one or more clusters based on training dialogues from one or more source domains. The clusters represent domain-specific features of the training dialogues and are further based on dialogue states of the training dialogues. The content processing system trains a machine learning model to generate summaries of dialogues by using the one or more clusters as prefixes in a prefix-tuning approach. The content processing system receives an input that includes a dialogue from a target domain. The content processing system generates an input prompt based on the dialogue and the one or more clusters, and the model generates a summary of the dialogue based on the input prompt.
    Type: Application
    Filed: June 28, 2023
    Publication date: January 2, 2025
    Applicant: Adobe Inc.
    Inventors: Haoliang Wang, Kaige Xie, Tong Yu, Junda Wu, Handong Zhao, Ruiyi Zhang, Kanak Vivek Mahadik, Ani Nenkova
  • Publication number: 20240427998
    Abstract: Contextual query generation techniques are described that enable generation of a contextual query for output to a question-answering (QA) model. A content processing system, for instance, configures a language model using in-context learning to generate queries based on semantic contexts of input documents, e.g., based on one or more linguistic cues from text of the input documents. The content processing system receives an input that includes a document having text and a reference query. The content processing system leverages the language model to generate a contextual query based on a semantic context of the text of the document and the reference query. The content processing system then outputs the contextual query and the document to a QA model. Using the QA model, the content processing system generates a response as an answer to the contextual query based on the contextual query and the document.
    Type: Application
    Filed: June 22, 2023
    Publication date: December 26, 2024
    Applicant: Adobe Inc.
    Inventors: Haoliang Wang, Tong Yu, Sungchul Kim, Ruiyi Zhang, Paiheng Xu, Junda Wu, Handong Zhao, Ani Nenkova
  • Publication number: 20240314293
    Abstract: Embodiments are disclosed for lossless image compression using block-based prediction and context adaptive entropy coding. A method of lossless image compression using block-based prediction and context adaptive entropy coding comprises dividing an input image into a plurality of blocks, determining a pixel predictor for each block based on a block strategy, determining a plurality of residual values using the pixel predictor for each block, selecting a subset of features associated with the plurality of residual values, performing context modeling on the plurality of residual values based on the subset of features to identify a plurality of residual clusters, and entropy coding the plurality of residual clusters.
    Type: Application
    Filed: May 20, 2024
    Publication date: September 19, 2024
    Applicant: Adobe Inc.
    Inventors: Stefano PETRANGELI, Viswanathan SWAMINATHAN, Haoliang WANG
  • Publication number: 20240312070
    Abstract: In implementations of systems for digital image compression using context-based pixel predictor selection, a computing device implements a compression system to receive digital image data describing pixels of a digital image. The compression system groups first differences between values of the pixels and first prediction values of the pixels into context groups. A pixel predictor is determined for each of the context groups based on a compression criterion. The compression system generates second prediction values of the pixels using the determined pixel predictor for pixels corresponding to the first differences included in each of the context groups. Second differences between the values of the pixels and the second prediction values of the pixels are grouped into different context groups. The compression system compresses the digital image using entropy coding based on the different context groups.
    Type: Application
    Filed: May 26, 2024
    Publication date: September 19, 2024
    Applicant: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang
  • Patent number: 12051175
    Abstract: Methods, system, and computer storage media are provided for novel view synthesis. An input image depicting an object is received and utilized to generate, via a neural network, a target view image. In exemplary aspects, additional view images are also generated within the same pass of the neural network. A loss is determined based on the target view image and additional view images and is used to modify the neural network to reduce errors. In some aspects, a rotated view image is generated by warping a ground truth image from an initial angle to a rotated view angle that matches a view angle of an image synthesized via the neural network, such as a target view image. The rotated view image and the synthesized image matching the rotated view angle (e.g., a target view image) are utilized to compute a rotational loss.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: July 30, 2024
    Assignee: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang, YoungJoong Kwon
  • Patent number: 12010296
    Abstract: Embodiments are disclosed for lossless image compression using block-based prediction and context adaptive entropy coding. A method of lossless image compression using block-based prediction and context adaptive entropy coding comprises dividing an input image into a plurality of blocks, determining a pixel predictor for each block based on a block strategy, determining a plurality of residual values using the pixel predictor for each block, selecting a subset of features associated with the plurality of residual values, performing context modeling on the plurality of residual values based on the subset of features to identify a plurality of residual clusters, and entropy coding the plurality of residual clusters.
    Type: Grant
    Filed: August 18, 2022
    Date of Patent: June 11, 2024
    Assignee: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang
  • Patent number: 12002246
    Abstract: In implementations of systems for digital image compression using context-based pixel predictor selection, a computing device implements a compression system to receive digital image data describing pixels of a digital image. The compression system groups first differences between values of the pixels and first prediction values of the pixels into context groups. A pixel predictor is determined for each of the context groups based on a compression criterion. The compression system generates second prediction values of the pixels using the determined pixel predictor for pixels corresponding to the first differences included in each of the context groups. Second differences between the values of the pixels and the second prediction values of the pixels are grouped into different context groups. The compression system compresses the digital image using entropy coding based on the different context groups.
    Type: Grant
    Filed: January 14, 2021
    Date of Patent: June 4, 2024
    Assignee: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang
  • Patent number: 11967049
    Abstract: The present disclosure describes multi-stage image editing techniques to improve detail and accuracy in edited images. An input image including a target region to be edited and an edit parameter specifying a modification to the target region are received. A parsing map of the input image is generated. A latent representation of the parsing map is generated. An edit is applied to the latent representation of the parsing map based on the edit parameter. The edited latent representation is input to a neural network to generate a modified parsing map including the target region with a shape change according to the edit parameter. Based on the input image and the modified parsing map, a masked image corresponding to the shape change is generated. Based on the masked image, a neural network is used to generate an edited image with the modification to the target region.
    Type: Grant
    Filed: November 19, 2021
    Date of Patent: April 23, 2024
    Assignee: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang, YoungJoong Kwon
  • Publication number: 20240070927
    Abstract: The context-aware optimization method includes training a context model by determining whether to split each node in the context by identifying a first subset of virtual context to evaluate by identifying a second subset of virtual contexts to evaluate and obtaining an encoding cost of splitting of the context model for each virtual context in the second subset and identifying the first subset of virtual contexts to evaluate by selecting a predetermined number of virtual contexts from the second subset based on the encoding cost such that the predetermined number of virtual contexts with lowest encoding cost are selected. The modified tree-traversal method includes encoding a mask or performing a speculative-based method. The modified entropy coding method includes representing data into an array of bits, using multiple coders to process each bit in the array and combining the output from the multiple coders into a data range.
    Type: Application
    Filed: August 25, 2022
    Publication date: February 29, 2024
    Inventors: Haoliang Wang, Stefano Petrangeli, Viswanathan Swaminathan
  • Publication number: 20230379507
    Abstract: Embodiments described herein provide methods and systems for facilitating actively-learned context modeling. In one embodiment, a subset of data is selected from a training dataset corresponding with an image to be compressed, the subset of data corresponding with a subset of data of pixels of the image. A context model is generated using the selected subset of data. The context model is generally in the form of a decision tree having a set of leaf nodes. Entropy values corresponding with each leaf node of the set of leaf nodes are determined. Each entropy value indicates an extent of diversity of context associated with the corresponding leaf node. Additional data from the training dataset is selected based on the entropy values corresponding with the leaf nodes. The updated subset of data is used to generate an updated context model for use in performing compression of the image.
    Type: Application
    Filed: May 20, 2022
    Publication date: November 23, 2023
    Inventors: Gang Wu, Yang Li, Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang, Ryan A. Rossi, Zhao Song
  • Patent number: 11722845
    Abstract: A first device determines relative position data representative of a position of one or more other user devices relative to the first device. To determine relative position data between the first device and a second device, the first device determines a distance between the first device and the second device at a plurality of timestamps. Additionally, the first device determines movement data at each timestamp from one or more device sensors. The movement data at each corresponding timestamp may reflect movement of the first device and/or the second device between a prior timestamp and the corresponding timestamp. The first device computes relative position data for the second device by combining the distance measurements and movement data over the plurality of timestamps, for instance, through a process of sensor fusion.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: August 8, 2023
    Assignee: ADOBE INC.
    Inventors: Haoliang Wang, Stefano Petrangeli, Viswanathan Swaminathan, Na Wang
  • Publication number: 20230213641
    Abstract: In implementations of systems for estimating three-dimensional trajectories of physical objects, a computing device implements a three-dimensional trajectory system to receive radar data describing millimeter wavelength radio waves directed within a physical environment using beamforming and reflected from physical objects in the physical environment. The three-dimensional trajectory system generates a cloud of three-dimensional points based on the radar, each of the three-dimensional points corresponds to a reflected millimeter wavelength radio wave within a sliding temporal window. The three-dimensional points are grouped into at least one group based on Euclidean distances between the three-dimensional points within the cloud. The three-dimensional trajectory system generates an indication of a three-dimensional trajectory of a physical object corresponding to the at least one group using a Kalman filter to track a position and a velocity a centroid of the at least one group in three-dimensions.
    Type: Application
    Filed: March 10, 2023
    Publication date: July 6, 2023
    Applicant: Adobe Inc.
    Inventors: Jennifer Anne Healey, Haoliang Wang, Ding Zhang
  • Patent number: 11635507
    Abstract: In implementations of systems for estimating three-dimensional trajectories of physical objects, a computing device implements a three-dimensional trajectory system to receive radar data describing millimeter wavelength radio waves directed within a physical environment using beamforming and reflected from physical objects in the physical environment. The three-dimensional trajectory system generates a cloud of three-dimensional points based on the radar, each of the three-dimensional points corresponds to a reflected millimeter wavelength radio wave within a sliding temporal window. The three-dimensional points are grouped into at least one group based on Euclidean distances between the three-dimensional points within the cloud. The three-dimensional trajectory system generates an indication of a three-dimensional trajectory of a physical object corresponding to the at least one group using a Kalman filter to track a position and a velocity a centroid of the at least one group in three-dimensions.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: April 25, 2023
    Assignee: Adobe Inc.
    Inventors: Jennifer Anne Healey, Haoliang Wang, Ding Zhang
  • Patent number: 11561750
    Abstract: This disclosure describes embodiments of methods, systems, and non-transitory-computer readable media that personalize visual content for display on digital signage near a projected location of a person by mapping visual content to physical items selected by the person. In some examples, the disclosed system identifies physical items selected by a person based on signals from the physical items, such as signals emitted by RFID tags affixed to (or other devices associated with) the physical items. The disclosed system analyzes the collection of physical items—as identified by the signals—to tailor digital signage content specific to the person. The disclosed system further tracks the location of the person as the person moves through a physical space and interacts with the physical items. Based on the tracked positions, the disclosed system determines a digital sign in proximity to a predicted location of the person to display the personalized visual content.
    Type: Grant
    Filed: November 6, 2020
    Date of Patent: January 24, 2023
    Assignee: Adobe Inc.
    Inventors: Jennifer Healey, Haoliang Wang, Georgios Theocharous
  • Publication number: 20220400253
    Abstract: Embodiments are disclosed for lossless image compression using block-based prediction and context adaptive entropy coding. A method of lossless image compression using block-based prediction and context adaptive entropy coding comprises dividing an input image into a plurality of blocks, determining a pixel predictor for each block based on a block strategy, determining a plurality of residual values using the pixel predictor for each block, selecting a subset of features associated with the plurality of residual values, performing context modeling on the plurality of residual values based on the subset of features to identify a plurality of residual clusters, and entropy coding the plurality of residual clusters.
    Type: Application
    Filed: August 18, 2022
    Publication date: December 15, 2022
    Applicant: Adobe Inc.
    Inventors: Stefano PETRANGELI, Viswanathan SWAMINATHAN, Haoliang WANG
  • Publication number: 20220283289
    Abstract: In implementations of systems for estimating three-dimensional trajectories of physical objects, a computing device implements a three-dimensional trajectory system to receive radar data describing millimeter wavelength radio waves directed within a physical environment using beamforming and reflected from physical objects in the physical environment. The three-dimensional trajectory system generates a cloud of three-dimensional points based on the radar, each of the three-dimensional points corresponds to a reflected millimeter wavelength radio wave within a sliding temporal window. The three-dimensional points are grouped into at least one group based on Euclidean distances between the three-dimensional points within the cloud. The three-dimensional trajectory system generates an indication of a three-dimensional trajectory of a physical object corresponding to the at least one group using a Kalman filter to track a position and a velocity a centroid of the at least one group in three-dimensions.
    Type: Application
    Filed: March 3, 2021
    Publication date: September 8, 2022
    Applicant: Adobe Inc.
    Inventors: Jennifer Anne Healey, Haoliang Wang, Ding Zhang
  • Patent number: 11425368
    Abstract: Embodiments are disclosed for lossless image compression using block-based prediction and context adaptive entropy coding. A method of lossless image compression using block-based prediction and context adaptive entropy coding comprises dividing an input image into a plurality of blocks, determining a pixel predictor for each block based on a block strategy, determining a plurality of residual values using the pixel predictor for each block, selecting a subset of features associated with the plurality of residual values, performing context modeling on the plurality of residual values based on the subset of features to identify a plurality of residual clusters, and entropy coding the plurality of residual clusters.
    Type: Grant
    Filed: February 17, 2021
    Date of Patent: August 23, 2022
    Assignee: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang
  • Publication number: 20220264251
    Abstract: A first device determines relative position data representative of a position of one or more other user devices relative to the first device. To determine relative position data between the first device and a second device, the first device determines a distance between the first device and the second device at a plurality of timestamps. Additionally, the first device determines movement data at each timestamp from one or more device sensors. The movement data at each corresponding timestamp may reflect movement of the first device and/or the second device between a prior timestamp and the corresponding timestamp. The first device computes relative position data for the second device by combining the distance measurements and movement data over the plurality of timestamps, for instance, through a process of sensor fusion.
    Type: Application
    Filed: February 16, 2021
    Publication date: August 18, 2022
    Inventors: Haoliang Wang, Stefano Petrangeli, Viswanathan Swaminathan, Na Wang
  • Publication number: 20220264084
    Abstract: Embodiments are disclosed for lossless image compression using block-based prediction and context adaptive entropy coding. A method of lossless image compression using block-based prediction and context adaptive entropy coding comprises dividing an input image into a plurality of blocks, determining a pixel predictor for each block based on a block strategy, determining a plurality of residual values using the pixel predictor for each block, selecting a subset of features associated with the plurality of residual values, performing context modeling on the plurality of residual values based on the subset of features to identify a plurality of residual clusters, and entropy coding the plurality of residual clusters.
    Type: Application
    Filed: February 17, 2021
    Publication date: August 18, 2022
    Inventors: Stefano PETRANGELI, Viswanathan SWAMINATHAN, Haoliang WANG
  • Publication number: 20220222866
    Abstract: In implementations of systems for digital image compression using context-based pixel predictor selection, a computing device implements a compression system to receive digital image data describing pixels of a digital image. The compression system groups first differences between values of the pixels and first prediction values of the pixels into context groups. A pixel predictor is determined for each of the context groups based on a compression criterion. The compression system generates second prediction values of the pixels using the determined pixel predictor for pixels corresponding to the first differences included in each of the context groups. Second differences between the values of the pixels and the second prediction values of the pixels are grouped into different context groups. The compression system compresses the digital image using entropy coding based on the different context groups.
    Type: Application
    Filed: January 14, 2021
    Publication date: July 14, 2022
    Applicant: Adobe Inc.
    Inventors: Stefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang