Patents by Inventor Sana Malik Lee

Sana Malik Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11946753
    Abstract: The present disclosure relates to generating and modifying recommended event sequences utilizing a dynamic user preference interface. For example, in one or more embodiments, the system generates a recommended event sequence using a recommendation model trained based on a plurality of historical event sequences. The system then provides, for display via a client device, the recommendation, a plurality of interactive elements for entry of user preferences, and a visual representation of historical event sequences. Upon detecting input of user preferences, the system can modify a reward function of the recommendation model and provide a modified recommended event sequence together with the plurality of interactive elements. In one or more embodiments, as a user enters user preferences, the system additionally modifies the visual representation to display subsets of the plurality of historical event sequences corresponding to the preferences.
    Type: Grant
    Filed: June 30, 2021
    Date of Patent: April 2, 2024
    Assignee: Adobe Inc.
    Inventors: Fan Du, Sana Malik Lee, Georgios Theocharous, Eunyee Koh
  • Patent number: 11836172
    Abstract: Methods, computer systems, computer-storage media, and graphical user interfaces are provided for facilitating data visualization generation. In one implementation, dataset intent data, visual design intent data, and insight intent data determined from a user input natural language query are obtained. A set of candidate intent recommendations is generated using various combinations of the dataset intent data, visual design intent data, and insight intent data. Each of the candidate intent recommendations is incorporated into a set of visualization templates to determine eligibility of the candidate intent recommendations. For eligible candidate intent recommendations, a score associated with a corresponding visualization template is determined. Based on the scores, a candidate intent recommendation and corresponding visualizations template is selected to use as a visual recommendation for presenting a data visualization.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: December 5, 2023
    Assignee: Adobe Inc.
    Inventors: Fan Du, Zening Qu, Vasanthi Swaminathan Holtcamp, Tak Yeon Lee, Sungchul Kim, Saurabh Mahapatra, Sana Malik Lee, Ryan A. Rossi, Nikhil Belsare, Eunyee Koh, Andrew Thomson, Sumit Shekhar
  • Patent number: 11775582
    Abstract: This disclosure describes one or more embodiments of systems, non-transitory computer-readable media, and methods that intelligently and automatically analyze input data and generate visual data stories depicting graphical visualizations from data insights determined from the input data. For example, the disclosed systems automatically extract data insights utilizing an in-depth statistical analysis of dataset groups from data-attribute categories within the input data. Based on the data insights, the disclosed systems can automatically generate exportable visual data stories to visualize the data insights, provide textual or audio-based natural language summaries of the data insights, and animate such data insights in videos. In some embodiments, the disclosed systems generate a visual-data-story graph comprising nodes representing visual data stories and edges representing similarities between the visual data stories.
    Type: Grant
    Filed: December 21, 2022
    Date of Patent: October 3, 2023
    Assignee: Adobe Inc.
    Inventors: Shenyu Xu, Eunyee Koh, Fan Du, Tak Yeon Lee, Sana Malik Lee, Ryan Rossi
  • Patent number: 11775756
    Abstract: A dataset captioning system is described that generates captions of text to describe insights identified from a dataset, automatically and without user intervention. To do so, given an input of a dataset the dataset captioning system determines which data insights are likely to support potential visualizations of the dataset, generates text based on these insights, orders the text, processes the ordered text for readability, and then outputs the text as a caption. These techniques also include adjustments made to the complexity of the text, globalization of the text, inclusion of links to outside sources of information, translation of the text, and so on as part of generating the caption.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: October 3, 2023
    Assignee: Adobe Inc.
    Inventors: Eunyee Koh, Xin Qian, Tak Yeon Lee, Sana Malik Lee, Ryan Anthony Rossi, Fan Du, Duy-Trung Trong Dinh
  • Publication number: 20230130778
    Abstract: This disclosure describes one or more embodiments of systems, non-transitory computer-readable media, and methods that intelligently and automatically analyze input data and generate visual data stories depicting graphical visualizations from data insights determined from the input data. For example, the disclosed systems automatically extract data insights utilizing an in-depth statistical analysis of dataset groups from data-attribute categories within the input data. Based on the data insights, the disclosed systems can automatically generate exportable visual data stories to visualize the data insights, provide textual or audio-based natural language summaries of the data insights, and animate such data insights in videos. In some embodiments, the disclosed systems generate a visual-data-story graph comprising nodes representing visual data stories and edges representing similarities between the visual data stories.
    Type: Application
    Filed: December 21, 2022
    Publication date: April 27, 2023
    Inventors: Shenyu Xu, Eunyee Koh, Fan Du, Tak Yeon Lee, Sana Malik Lee, Ryan Rossi
  • Patent number: 11614332
    Abstract: In implementations of systems for generating indications of traversable paths, a computing device implements a navigation system to receive map data describing a map of a physical environment that includes a destination, locations of display devices and relative orientations of the display devices in the physical environment. The navigation system forms a navigation graph by representing the destination and the locations of the display devices as nodes of the navigation graph and connecting the nodes with edges that indicate traversable path segments in the physical environment. Request data is received describing a request for navigation to the destination and a source of the request. The navigation system generates indications of a traversable path to the destination for display by the display devices based on the navigation graph and the relative orientations of the display devices.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: March 28, 2023
    Assignee: Adobe Inc.
    Inventors: Philip Charles Dasler, Sana Malik Lee, Jennifer Anne Healey
  • Publication number: 20230077829
    Abstract: In implementations of systems for generating interactive reports, a computing device implements a report system to receive input data describing a dataset and an analytics report for the dataset that depicts a result of performing analytics on the dataset. The report system generates a declarative specification that describes the analytics report in a language that encodes data as properties of graphic objects. Editing data is received describing a user input specifying a modification to the analytics report. The report system modifies the declarative specification using the language that encodes data as properties of graphic objects based on the user input and the dataset. An interactive report is generated based on the modified declarative specification that includes the analytics report having the modification.
    Type: Application
    Filed: September 14, 2021
    Publication date: March 16, 2023
    Applicant: Adobe Inc.
    Inventors: Sana Malik Lee, Zhuohao Zhang, Zhicheng Liu, Tak Yeon Lee, Shunan Guo, Ryan A. Rossi, Fan Du, Eunyee Koh
  • Patent number: 11562019
    Abstract: This disclosure describes one or more embodiments of systems, non-transitory computer-readable media, and methods that intelligently and automatically analyze input data and generate visual data stories depicting graphical visualizations from data insights determined from the input data. For example, the disclosed systems automatically extract data insights utilizing an in-depth statistical analysis of dataset groups from data-attribute categories within the input data. Based on the data insights, the disclosed systems can automatically generate exportable visual data stories to visualize the data insights, provide textual or audio-based natural language summaries of the data insights, and animate such data insights in videos. In some embodiments, the disclosed systems generate a visual-data-story graph comprising nodes representing visual data stories and edges representing similarities between the visual data stories.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: January 24, 2023
    Assignee: Adobe Inc.
    Inventors: Shenyu Xu, Eunyee Koh, Fan Du, Tak Yeon Lee, Sana Malik Lee, Ryan Rossi
  • Publication number: 20220405314
    Abstract: Methods, computer systems, computer-storage media, and graphical user interfaces are provided for facilitating data visualization generation. In one implementation, dataset intent data, visual design intent data, and insight intent data determined from a user input natural language query are obtained. A set of candidate intent recommendations is generated using various combinations of the dataset intent data, visual design intent data, and insight intent data. Each of the candidate intent recommendations is incorporated into a set of visualization templates to determine eligibility of the candidate intent recommendations. For eligible candidate intent recommendations, a score associated with a corresponding visualization template is determined. Based on the scores, a candidate intent recommendation and corresponding visualizations template is selected to use as a visual recommendation for presenting a data visualization.
    Type: Application
    Filed: June 22, 2021
    Publication date: December 22, 2022
    Inventors: Fan Du, Zening Qu, Vasanthi Swaminathan Holtcamp, Tak Yeon Lee, Sungchul Kim, Saurabh Mahapatra, Sana Malik Lee, Ryan A. Rossi, Nikhil Belsare, Eunyee Koh, Andrew Thomson, Sumit Shekhar
  • Patent number: 11494431
    Abstract: Techniques of captioning for figures includes generating a caption unit for a figure by defining a finite set of caption types. From each caption type, additional input for that caption type, as well as figure image data and figure metadata, an automated system may generate a respective caption unit, each caption unit including a sequence of words. Further, the generated caption for a figure includes a combination of the generated caption units.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: November 8, 2022
    Assignee: ADOBE INC.
    Inventors: Eunyee Koh, Xin Qian, Sungchul Kim, Sana Malik Lee
  • Patent number: 11487579
    Abstract: A system and method for automatically adjusting computing resources provisioned for a computer service or application by applying historical resource usage data to a predictive model to generate predictive resource usage. The predictive resource usage is then simulated for various service configurations, determining scaling requirements and resource wastage for each configuration. A cost value is generated based on the scaling requirement and resource wastage, with the cost value for each service configuration used to automatically select a configuration to apply to the service. Alternatively, the method for automatically adjusting computer resources provisioned for a service may include receiving resource usage data of the service, applying it to a linear quadratic regulator (LQR) to find an optimal stationary policy (treating the resource usage data as states and resource-provisioning variables as actions), and providing instructions for configuring the service based on the optimal stationary policy.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: November 1, 2022
    Assignee: ADOBE INC.
    Inventors: Kanak Vivek Mahadik, Ryan A. Rossi, Sana Malik Lee, Georgios Theocharous, Handong Zhao, Gang Wu, Youngsuk Park
  • Patent number: 11475295
    Abstract: Disclosed systems and methods predict and visualize outcomes based on past events. For example, an analysis application encodes a sequence of events into a feature vector that includes, for each event, a numerical representation of a respective category and a respective timestamp. The application applies a time-aware recurrent neural network to the feature vector, resulting in one or more of (i) a set of future events in which each event is associated with a probability and a predicted duration and (ii) a sequence embedding that contains information about predicted outcomes and temporal patterns observed in the sequence of events. The application applies a support vector model classifier to the sequence embedding. The support vector model classifier computes a likelihood of a categorical outcome for each of the events in the probability distribution. The application modifies interactive content according to the categorical outcomes and probability distribution.
    Type: Grant
    Filed: April 25, 2019
    Date of Patent: October 18, 2022
    Assignee: ADOBE INC.
    Inventors: Fan Du, Eunyee Koh, Sungchul Kim, Shunan Guo, Sana Malik Lee
  • Publication number: 20220237228
    Abstract: This disclosure describes one or more embodiments of systems, non-transitory computer-readable media, and methods that intelligently and automatically analyze input data and generate visual data stories depicting graphical visualizations from data insights determined from the input data. For example, the disclosed systems automatically extract data insights utilizing an in-depth statistical analysis of dataset groups from data-attribute categories within the input data. Based on the data insights, the disclosed systems can automatically generate exportable visual data stories to visualize the data insights, provide textual or audio-based natural language summaries of the data insights, and animate such data insights in videos. In some embodiments, the disclosed systems generate a visual-data-story graph comprising nodes representing visual data stories and edges representing similarities between the visual data stories.
    Type: Application
    Filed: January 28, 2021
    Publication date: July 28, 2022
    Inventors: Shenyu Xu, Eunyee Koh, Fan Du, Tak Yeon Lee, Sana Malik Lee, Ryan Rossi
  • Patent number: 11397843
    Abstract: In implementations of systems for suggesting content components, a computing device implements a design system to receive input data describing a feature of a content component to be included in a hypertext markup language (HTML) document. The design system represents that feature of the content component as a document object model (DOM) element and determines a hash value for the DOM element using locality-sensitive hashing. Manhattan distances are computed between the has value and has values described by a segment of content component data. The hash values were determined using the locality-sensitive hashing for DOM elements extracted from a corpus of HTML documents. The design system generates indications, for display in a user interface, of candidate content components for inclusion in the HTML document based on the Manhattan distances.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: July 26, 2022
    Assignee: Adobe Inc.
    Inventors: Tak Yeon Lee, Sana Malik Lee, Ryan A. Rossi, Qisheng Li, Fan Du, Eunyee Koh
  • Publication number: 20220196405
    Abstract: In implementations of systems for generating indications of traversable paths, a computing device implements a navigation system to receive map data describing a map of a physical environment that includes a destination, locations of display devices and relative orientations of the display devices in the physical environment. The navigation system forms a navigation graph by representing the destination and the locations of the display devices as nodes of the navigation graph and connecting the nodes with edges that indicate traversable path segments in the physical environment. Request data is received describing a request for navigation to the destination and a source of the request. The navigation system generates indications of a traversable path to the destination for display by the display devices based on the navigation graph and the relative orientations of the display devices.
    Type: Application
    Filed: December 17, 2020
    Publication date: June 23, 2022
    Applicant: Adobe Inc.
    Inventors: Philip Charles Dasler, Sana Malik Lee, Jennifer Anne Healey
  • Publication number: 20220147708
    Abstract: A dataset captioning system is described that generates captions of text to describe insights identified from a dataset, automatically and without user intervention. To do so, given an input of a dataset the dataset captioning system determines which data insights are likely to support potential visualizations of the dataset, generates text based on these insights, orders the text, processes the ordered text for readability, and then outputs the text as a caption. These techniques also include adjustments made to the complexity of the text, globalization of the text, inclusion of links to outside sources of information, translation of the text, and so on as part of generating the caption.
    Type: Application
    Filed: November 10, 2020
    Publication date: May 12, 2022
    Applicant: Adobe Inc.
    Inventors: Eunyee Koh, Xin Qian, Tak Yeon Lee, Sana Malik Lee, Ryan Anthony Rossi, Fan Du, Duy-Trung Trong Dinh
  • Publication number: 20210357255
    Abstract: A system and method for automatically adjusting computing resources provisioned for a computer service or application by applying historical resource usage data to a predictive model to generate predictive resource usage. The predictive resource usage is then simulated for various service configurations, determining scaling requirements and resource wastage for each configuration. A cost value is generated based on the scaling requirement and resource wastage, with the cost value for each service configuration used to automatically select a configuration to apply to the service. Alternatively, the method for automatically adjusting computer resources provisioned for a service may include receiving resource usage data of the service, applying it to a linear quadratic regulator (LQR) to find an optimal stationary policy (treating the resource usage data as states and resource-provisioning variables as actions), and providing instructions for configuring the service based on the optimal stationary policy.
    Type: Application
    Filed: May 5, 2020
    Publication date: November 18, 2021
    Inventors: Kanak Vivek Mahadik, Ryan A. Rossi, Sana Malik Lee, Georgios Theocharous, Handong Zhao, Gang Wu, Youngsuk Park
  • Patent number: 11157680
    Abstract: In implementations of systems for suggesting content components, a computing device implements a design system to receive input data describing a feature of a content component to be included in a hypertext markup language (HTML) document. The design system represents that feature of the content component as a document object model (DOM) element and determines a hash value for the DOM element using locality-sensitive hashing. Manhattan distances are computed between the has value and has values described by a segment of content component data. The hash values were determined using the locality-sensitive hashing for DOM elements extracted from a corpus of HTML documents. The design system generates indications, for display in a user interface, of candidate content components for inclusion in the HTML document based on the Manhattan distances.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: October 26, 2021
    Assignee: Adobe Inc.
    Inventors: Tak Yeon Lee, Sana Malik Lee, Ryan A. Rossi, Qisheng Li, Fan Du, Eunyee Koh
  • Publication number: 20210325193
    Abstract: The present disclosure relates to generating and modifying recommended event sequences utilizing a dynamic user preference interface. For example, in one or more embodiments, the system generates a recommended event sequence using a recommendation model trained based on a plurality of historical event sequences. The system then provides, for display via a client device, the recommendation, a plurality of interactive elements for entry of user preferences, and a visual representation of historical event sequences. Upon detecting input of user preferences, the system can modify a reward function of the recommendation model and provide a modified recommended event sequence together with the plurality of interactive elements. In one or more embodiments, as a user enters user preferences, the system additionally modifies the visual representation to display subsets of the plurality of historical event sequences corresponding to the preferences.
    Type: Application
    Filed: June 30, 2021
    Publication date: October 21, 2021
    Inventors: Fan Du, Sana Malik Lee, Georgios Theocharous, Eunyee Koh
  • Publication number: 20210271705
    Abstract: Techniques of captioning for figures includes generating a caption unit for a figure by defining a finite set of caption types. From each caption type, additional input for that caption type, as well as figure image data and figure metadata, an automated system may generate a respective caption unit, each caption unit including a sequence of words. Further, the generated caption for a figure includes a combination of the generated caption units.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 2, 2021
    Inventors: Eunyee Koh, Xin Qian, Sungchul Kim, Sana Malik Lee