Abstract: The disclosure herein describes generating an application from input content. Input content of a content type is obtained, such as an image file, digital document file, or the like. A content data extractor is selected from a set of content data extractors based on the content type. A set of content entities is extracted from the obtained input content using the selected content data extractor, such as text labels, text boxes, buttons, or the like. The set of content entities are normalized according to a standard interface schema and an application template is generated using the normalized set of content entities, whereby an application can be developed using the generated application template. The disclosure enables application interfaces to be designed using a variety of methods and for those different types of designs to be efficiently converted to a functional application.

Abstract: There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Abstract: Data points, calendar entries, trends, and behavioral patterns may be used to predict and pre-emptively build digital and printable products with selected collections of images without the user's active participation. The collections are selected from files on the user's device, cloud-based photo library, or other libraries shared among other individuals and grouped into thematic products. Based on analysis of the user's collections and on-line behaviors, the system may estimate types and volumes of potential media-centric products, and the resources needed for producing and distributing such media-centric products for a projected period of time. A user interface may take the form of a “virtual curator”, which is a graphical or animated persona for augmenting and managing interactions between the user and the system managing the user's stored media assets. The virtual curator can assume one of many personas with each user and can interact with the user via text/audio messaging.

Abstract: A method for producing a prototype of a graphical user interface (GUI) and a system thereof are provided. The method according to some embodiments of the present disclosure includes providing a prototype producing interface to a user, determining a target object from among one or more objects disposed on a target graphical user interface (GUI) screen produced through the prototype producing interface, determining a recommended motion for the target object using pre-produced GUI screen samples, wherein the GUI screen samples include motion objects, and providing the recommended motion to the user.

Abstract: Methods and systems disclosed herein describe generating virtual backgrounds for video communications. A virtual background generator may monitor a user's calendar and/or inbox for meetings. The virtual background generator may analyze the context of calendar invites and/or scheduled meetings to generate one or more virtual backgrounds for a video conference. A first background may be displayed for the video conference. Additionally, the virtual background generator may update the virtual background based on an analysis of one or more topics being discussed during the video conference. Based on the analysis of the one or more topics being discussed, the virtual background generator may generate a second virtual background to replace the first virtual background.

Abstract: Methods, computer readable media, and devices for exceeding the limits of visual-linguistic multi-task learning are disclosed. One method may include identifying a multi-modal multi-task classification dataset including a plurality of data examples, creating a transformer machine learning model to predict a plurality of categorical attributes of a product, and training the transformer machine learning model based on the multi-modal multi-task classification dataset using an alpha decay schedule and dynamically allocating task-specific parameters for at least one of the plurality of task-specific classification heads based on task complexity.

Abstract: Disclosed herein is a method of determining a user profile based on a set of user-selected images, a method of selecting images from an image database of digital images based on a user profile, a computer system and a computer program product.

Abstract: Securing information within a user interface can include mapping, using a processor, an electronic mail address to an avatar, wherein the mapped electronic mail address and the avatar are stored within a data storage device, and generating, using the processor, a user interface including a message correlated with the electronic mail address. The user interface displays the avatar of the electronic mail address in place of at least one of a name for the electronic mail address or the electronic mail address.

Abstract: A method of completing coloring of an image based on a query regarding a color-unknown region in the image and an answer to the query, includes: generating, by using an artificial neural network, a first intermediate image in which at least one uncolored region in a primary image is colored; generating, by using the artificial neural network, a first color query regarding the at least one color-unknown region in the primary image; and generating a secondary image based on at least one of the first color query, a first answer to the first color query, and the first intermediate image.

Abstract: A method includes: accessing a set of hardware parameters characterizing an embedded device; identifying a set of supported container functions based on the set of hardware parameters; accessing a selection of container functions; identifying a set of selected container functions based on the selection of container functions and the set of supported container functions; generating a hardware abstraction layer (HAL) including a set of libraries supporting the set of selected container functions; generating a container runtime environment (CRE) configured to execute, at the embedded device, a containerized application via the HAL, the containerized application including the set of selected container functions; installing the HAL and the CRE onto the embedded device; installing the containerized application onto the embedded device via the CRE; and at the embedded device, executing the containerized application via the CRE and the HAL.

Abstract: A non-transitory computer readable storage medium with instructions executed by a processor maintains different digital identities for different internet browsing personas associated with a real user. Persona selection rules are invoked to automatically designate a selected digital identity for a current internet browsing session. Browser state for the selected digital identity is loaded.

Abstract: A computer system displays a user interface that includes a flow pane, a tool pane, a profile pane, and a data pane. The flow pane displays a node/link flow diagram that identifies data sources, operations, and output datasets. The tool pane includes a data source selector that enables users to add data sources to the flow diagram, and includes an operation palette that enables users to insert nodes into the flow diagram for performing specific transformation operations. The profile pane displays schemas corresponding to selected nodes in the flow diagram, including information about data fields and statistical information about data values for the data fields and enables users to modify the flow diagram by interacting with individual data elements. The data pane displays rows of data corresponding to selected nodes in the flow diagram, and enables users to modify the flow diagram by interacting with individual data values.

Abstract: An example method facilitates modification and generation of User Interface (UI) display screens for webpages and web applications, such as process-based software applications. The example method includes receiving a first signal to access a webpage that includes a static UI display screen for a web application; serving the webpage in response to the signal; detecting the dynamic configuration functionality associated with the webpage, wherein the configuration functionality includes code and UI metadata provided in or with a dynamic layout file, the code and UI metadata including one or more rules and specifications for configuring schema used to generate rendering instructions for the dynamic part of the webpage.

Abstract: In an approach to improve generating an analytic application embodiments generate an analytic application from an image. Embodiments determine an orientation, font size, and color of a text, wherein the text is selected from one or more texts that are part of a visualization from the image. Embodiments classify the text using semantic analysis having predetermined criteria to create a result. Furthermore, embodiments bind one or more columns from a dataset to the visualization using the result of the semantic analysis, and apply a selection identified using predetermined criteria, comprising sorting, filtering, grouping, and aggregating, to data of the visualization. Additionally, embodiments create a new color palette having a dominant color in the analytic application, wherein the dominant color is identified as a most recurring color in the visualization of the image, and apply the new color palette to the analytic application.

Abstract: Arrangements for database schema creation and control are provided. In some aspects, a user may request creation or modification of a database schema. In response to receiving the request, one or more interactive user interfaces may be generated. The one or more interactive user interfaces may enable a user to select one or more selectable options for presenting data, establishing relationships between data, data sources, and the like. The schema, including a schema configuration including the presentational aspects and relationships, may be stored. A user may request to view data and the stored database schema may be retrieved. The schema may be transmitted to a configuration engine that may retrieve the requested data from one or more non-relational database sources. One or more user interfaces may be dynamically generated based on the schema configuration and may include the retrieved data.

Abstract: This disclosure provides a system and method for selecting an application dialog layout design based on a response pattern for a task-based application. A plurality of user interface layouts may be generated based on a first user interface layout, where the first user interface layout is associated with a task included in a process of a computer-implemented software application. One or more performance metrics associated with each user interface layout of the plurality of user interface layouts may be monitored, where the one or more performance metrics characterize a performance of the task by one or more task users. A second user interface layout may be selected based on an analysis of the one or more performance metrics. The second user interface layout may be provided to a plurality of users of a computer-implemented software application.

Abstract: Aspects of the present disclosure generally relates to a method including receiving user data and identifying at least a domain target for the at least a domain as a function of the domain-specific data. Also, the method may include generating a plurality of candidate schedules. Further, the method may include selecting an optimal user schedule from the plurality of candidate schedules. Moreover, the method may include presenting, at a remote device, the optimal user schedule to a user, and tracking, by the computing device, a user's progress with regard to the optimal user schedule.

Abstract: The disclosure is directed to techniques for generating forms on a webpage. Within source code of a webpage, a script file is included that creates a form object class that can be inserted into the source code of the webpage. A device creates a first configuration file that defines a first plurality of components of a first form, including at least one input component and at least one submission component. The device instantiates, within the source code of the webpage, the form object class to create a first instance that includes a reference to the first configuration file. The device executes the source code by executing the script file, executing the first instance using the script file and the first configuration file to generate a graphical user interface that includes at least a portion of the first plurality of components of the first form.

Abstract: An information processing device includes an acquiring unit configured to, when an electronic device is connected, acquire a menu screen configuration information which is stored in the electronic device and which includes predetermined setting items; a generating unit configured to change the acquired menu screen configuration information based on at least one setting item selected according to the connected electronic device from among multiple selectable setting items; and a storage controller configured to store the menu screen configuration information, which has been changed by the generating unit, in the electronic device, wherein when at least one advance setting item is selected in advance from among the multiple selectable setting items, the generating unit is further configured to change the acquired menu screen configuration information based on the at least one advance setting item.

Abstract: Techniques to facilitate visualization of an application associated with an industrial automation environment are disclosed herein. In at least one implementation, a plurality of data items associated with machine operations in the industrial automation environment is presented. A user selection of at least one data item of the plurality of data items is received. Additionally, display instructions comprising display properties of the at least one data item and position information that identifies where to display the at least one data item are also received. The display instructions are processed to render a graphical user interface to the application, wherein the at least one data item is displayed according to the display properties and positioned in the graphical user interface based on the position information.

Abstract: A method involves identifying state views of a stateful widget container in a design tool having a canvas design context and an all-states view design context, each state view of the stateful widget container being associated with a unique state of the stateful widget container. A first state view of the stateful widget container is displayed in the canvas design context, no other state view of the stateful widget container being displayed concurrently in the canvas design context. The state views of the stateful widget container are displayed concurrently in the all-states view design context, an internal widget layout of each state view corresponding to that displayed in the canvas design context. A first user input is received at a first interactive widget within the stateful widget container in the all-states view design context, the first interactive widget being associated with the first state view of the stateful widget container.

Abstract: In some examples, workflow-based dynamic data model and application generation may include ascertaining, for an application that is to be generated, a plurality of fields that are declared. Based on the plurality of declared fields, a data model may be generated. The data model may include a plurality of application programming interface (API) keys associated with the plurality of declared fields. Based on the data model, a mapping file may be generated to map a plurality of APIs that are to be invoked relative to the API keys. Based on the data model and the mapping file, the application may be generated.

Abstract: Methods and systems are disclosed for an independent internationalization (“i18n”) engine for loading language content into a Domestic Object Model (“DOM”). An application can receive a markup file. The markup file can include language markers and an object map. The object map can map the language markers to language content in a language library. The application can construct a DOM from the markup file. An i18n engine of the application can retrieve language content from the language library using the object map. The i18n engine can insert the language content into objects in the DOM according to their corresponding language markers. The application can display the markup file using the DOM with the included language content.

Abstract: The field of the invention relates to methods, systems and computer program products for navigating digital media content, in particular for navigating digital media content using an interface abstracted from that digital media content instead of, or as a supplement to, traditional user interface controls. There is provided a method for presenting a user interface to an end user to facilitate the searching, browsing and/or navigation of digital media content, the method comprising the steps of: (a) analysing the digital media content to create “hooks” related to the digital media content, or retrieving “hooks” in the digital media content, and (b) replacing or augmenting a graphical or textual representation of the digital media content with the “hooks.

Abstract: The present technology provides an interface and system for generating a previous version of a directory structure that can be useful in the restoration of a directory or file. The system, methods and non-transitory computer-readable storage media include receiving a request for a previous version of a directory structure at an indicated date, querying a content management system for placeholder content items associated with the previous version of the directory structure at the indicated date, receiving the placeholder content items, and generating a read-only copy of at least a portion of the previous version of the directory structure at the indicated date based on the placeholder content items, wherein the read-only copy of the directory structure is separate from the directory structure at a current date.

Abstract: A computing system that can operate to implement an interactive graphic design system that enables users to preview and resolve input actions that cause conflict with predefined constraints.

Abstract: A system and method for selecting a user profile for use with a platform based on an optimal persona of the user includes inferring a context of a user based on data received from a plurality of data sources, determining a persona of the user according to the context of the user from a plurality of user personas, and selecting a user profile associated with a platform that corresponds to the persona, in response to detecting that the user is accessing the platform.

Abstract: Data is received describing a local model of a first device generated by the first device based on sensor readings at the first device and a global model is updated that is hosted remote from the first device based on the local model and modeling devices in a plurality of different asset taxonomies. A particular operating state affecting one or more of a set of devices deployed in a particular machine-to-machine network is detected and the particular machine-to-machine network is automatically reconfigured based on the global model.

Abstract: A method for managing a display of at least one information item relating to a device disposed in a location, including: supplying, to the data processing unit, at least one first image of the device, generating, by the data processing unit, in a memory, a representation of the location including at least one template of the device, the template being composed of a parallelepiped or of a plurality of parallelepipeds, superimposing the first image on a face to form a representation, positioning, on the representation, a point of interest including an information item to be displayed relating to the device, generating an enriched image from the representation, and a step of display of displaying the enriched image on a screen.

Abstract: Among other things, a machine-based method is described. The method comprises recording object classes of an object model, producing an object representation for data of two or more data sources based on a mapping of data formats of the data sources to the object classes of the object model, and producing mapped data from the data sources. The mapped data is available in objects of the object classes and is comparable in the object representation. At least two of the data sources have different data formats.

Abstract: A printing method includes a customizing step of receiving a customization instruction of an administrator and customizing a printing screen, a printing step of performing printing in response to reception of a printing start instruction, a first displaying step of displaying the customized printing screen during the printing step, and a customized information processing step of enabling customized information corresponding to the customized printing screen to be confirmed after printing, when an execution instruction by a user is received during displaying the customized printing screen.

Abstract: A method, apparatus, device, and storage medium for determining a page theme are provided. The method may include: acquiring a current operating environment of a target page; determining a target theme that matches the current operating environment; searching for a target style resource link matching the target theme from a database in which style resource links corresponding to different themes are pre-stored; loading a CSS variable value in the target style resource link onto the target page, wherein the CSS variable value in the target style resource link is used to indicate, among styles of the target page, a style that is changed at the time of switching the themes.

Abstract: The present disclosure provides a weak-current unified system for rail transit. The weak-current unified system for rail transit is constructed in a cloud and end mode, and a weak-current unified cloud platform is communicatively connected to field devices of professional systems, so that the field devices of the professional systems are managed and controlled in a unified manner.

Abstract: Dynamic configuration of backups of production volumes based on desired recovery objectives is provided. A system may obtain a recovery point objective (“RPO”) for a particular production volume. The system may initially back up data, written to the production volume, to a storage volume with certain performance parameters. However, if the write operations to the production volume occur at a high enough rate and/or affect a large enough amount of data, there may be a lag in writing that data to the backup volume. The system may monitor the lag with respect to the specified RPO for backup of the production volume. If the lag approaches the RPO, then the system may dynamically change the configuration of the backup volume to better satisfy the RPO.

Abstract: A system stores resources such as text articles, videos, and so forth for an organization. During operation, the system receives a query and provides a response. During initial use of the system, there is little or no historical data available to help determine which resource is most relevant to a particular query. In this “cold-start” situation, the system determines attributes associated with a user account of the user making the query. The query is used to search a data store and retrieve a set of resources based on a term match with the query and to find the resources which correspond to the attributes of the user account. This allows the system to provide simplified output that is more likely to be relevant to that particular user in the “cold-start” situation.

Abstract: Machine learning systems and associated methods are provided. A processor comprising at least one neural network can process a captured input image to translate the captured input image into an interactive demonstration presentation for an envisioned software product. The processing can include: automatically recognizing features within the captured input image; extracting the recognized features from the captured input image at the machine learning processor; processing each of the extracted features to determine a corresponding element in a library trained via a machine learning algorithm; and automatically replacing the extracted features from the captured input image with the one or more corresponding files or components to transform the captured input image into the interactive demonstration presentation.

Abstract: A method and a system for dynamically tracking data lineage is provided. The method includes: assigning a first context key to a first data set; inputting the first data set into a first software module; receiving a second data set as an output of the first software module; and assigning a second context key to the second data set. The second context key includes information that identifies the inputted first data set and information that identifies the first software module. When the second data set is subsequently inputted into a second software module, a third context key that identifies the inputted second data set and the second software module is assigned to the resultant output data set.

Abstract: An example method facilitates modification and generation of User Interface (UI) display screens for webpages and web applications, such as process-based software applications. The example method includes receiving a first signal to access a webpage that includes a static UI display screen for a web application; serving the webpage in response to the signal; detecting the dynamic configuration functionality associated with the webpage, wherein the configuration functionality includes code and UI metadata provided in or with a dynamic layout file, the code and UI metadata including one or more rules and specifications for configuring schema used to generate rendering instructions for the dynamic part of the webpage.

Abstract: An image forming apparatus includes an extended app as an application for implementing a function other than the standard functions of the image forming apparatus, and an apparatus capability service generating information on the capability of the image forming apparatus, the information being used by the extended app when the extended app uses a function. The information on the capability indicates whether a function used by the extended app is effective.

Abstract: Systems and methods may include having an integrated unified filing engine. A system may include at least one processor configured to maintain at least one table containing a plurality of items and a plurality of asset designations, and to maintain at least one electronic whiteboard containing at least a subset of the plurality of asset designations. The processor may be further configured to maintain a data structure containing a plurality of links, wherein each link associates at least one of the subsets of asset designations with at least one location on the at least one electronic whiteboard, receive via a network access device, an activation of a particular link associated with a particular asset, alter a display of at least one electronic whiteboard containing an asset designation, and retrieving a presenting a corresponding asset in response to a received selection of a particular asset designation.

Abstract: A computer displays data sources associated with tables of data. The computer also displays a tree of data object icons, each representing a logical combination of tables. While displaying the data sources and the data object icons, the computer detects a portion of an input on a candidate data object icon. In response, the computer determines linking fields corresponding to a neighboring data object icon and linking fields corresponding to the candidate object icon. The computer displays options for a user to select linking fields. In response to detecting selection of linking fields, the computer validates the selection and/or updates the tree of data object icons based on the selected linking fields.

Abstract: Techniques are disclosed relating to determining locations of child elements in a user interface (UI), automatically updating the locations of the child elements in the UI, and generating an updated UI with the updated locations. A computer system may receive information specifying content of the UI and render an image of the UI based on the received information. Computer vision algorithms may be applied to the rendered of the UI to determine locations of elements in the UI. The locations of the elements may be updated to position the elements in selected locations relative to each other. The updated locations of the elements as determined by the computer vision algorithms may be implemented to generate updating information specifying content for the updated UI.

Abstract: Screen response validation of robot execution for robotic process automation (RPA) is disclosed. Whether text, screen changes, images, and/or other expected visual actions occur in an application executing on a computing system that an RPA robot is interacting with may be recognized. Where the robot has been typing may be determined and the physical position on the screen based on the current resolution of where one or more characters, images, windows, etc. appeared may be provided. The physical position of these elements, or the lack thereof, may allow determination of which field(s) the robot is typing in and what the associated application is for the purpose of validation that the application and computing system are responding as intended. When the expected screen changes do not occur, the robot can stop and throw an exception, go back and attempt the intended interaction again, restart the workflow, or take another suitable action.

Abstract: A wearable mixed reality system comprising a camera input system, and image projection system capable of being worn by a user, and a processor in communication with the camera input system and the image projection system. The processor may be capable of receiving a real-world image from the camera input system and simultaneously displaying at least a portion of the real-world image and an augmented image on the image projection system such that a user views the portion of the real-world image and the augmented image simultaneously.

Abstract: Techniques are disclosed for systems and methods for learning the behavior of and/or for performing automated testing of a system under test (SUT). The learning/testing is accomplished solely via the graphical user interface (GUI) of the SUT and requires no a priori metadata/knowledge about the GUI objects. The learning engine operates by performing actions on the GUI and by observing the results of these actions. If the actions result in a change in the screen/page of the GUI then a screenshot is taken for further processing. Objects are detected from the screenshot, new actions that need to be performed on the objects are guessed, those actions are performed, the results are observed and the process repeats. Text labels on the screens are also read and are used for generating contextualized inputs for the screens. The learning process continues until any predetermined learning/testing criteria are satisfied.

Abstract: A computer-implemented method, system and computer program product for improving the quality of subsequent searches. A request is received from a user to perform a search using the term(s) provided by the user. A search is then performed using the provided term(s). A representation of the search result is depicted as an area (e.g., bubble) with terms of interest displayed outside the area. The area represents a set of documents that were found in the performed search and the terms of interest represent terms that may be of interest to the user based on this set of documents. These terms of interest may be selected by the user to adjust the search result. In this manner, the user is presented with an intuitive view as to how different terms or different searches will have an impact on the search results thereby improving the quality of subsequent searches.

Abstract: A computer-implemented method, system and computer program product for improving the quality of subsequent searches. A request is received from a user to perform a search using the term(s) provided by the user. A search is then performed using the provided term(s). A representation of the search result is depicted as an area (e.g., bubble) with terms of interest displayed outside the area. The area represents a set of documents that were found in the performed search and the terms of interest represent terms that may be of interest to the user based on this set of documents. These terms of interest may be selected by the user to adjust the search result. In this manner, the user is presented with an intuitive view as to how different terms or different searches will have an impact on the search results thereby improving the quality of subsequent searches.

Abstract: A system and method for ensuring application content is displayed in a proper sized display is provided. An illustrative web-based application detects the display characteristics, e.g., size and/or aspect ratio, of its display window. If the display characteristics do not match a predefined requirement, the application ceases updating content and displays resizing notifications to alert the user to adjust the window. Once the window's display characteristics match the predefined criteria, the application resumes updating content in the window.

Abstract: Systems and methods for design element association and modification are provided. An example method for editing elements in multiple artboards includes receiving an isolation session-initiation user input that identifies a first design element arrangement on a first artboard in a workspace on a user interface. The method also includes, responsive to receiving the isolation session-initiation user input, identifying a second artboard in the workspace based on the second artboard including a second design element arrangement that is associated with the first design element arrangement, and updating the user interface to display the first artboard and the second artboard within an isolation session. As an example updating the user interface may include displaying the first design element arrangement and the second design element arrangement using a first style, and displaying other portions of the first artboard and the second artboard using a second style.

Abstract: A computer system displays a respective page of a home screen user interface, where the respective page includes a first plurality of application icons in a first predefined arrangement. The computer system detects a sequence of one or more inputs corresponding to a request to insert, into the respective page, a first user interface object containing a plurality of application icons that are automatically selected by the computer system. In response to detecting the sequence of one or more inputs, the computer system concurrently displays on the respective page: two or more of the first plurality of application icons in the first predefined arrangement, and a second plurality of application icons that are automatically placed on the respective page in locations that are aligned with the first predefined arrangement of the first plurality of application icons on the respective page of the home screen user interface.