Abstract: A server includes a first statistic processor configured to calculate, for each of different types of screens displayed on a display; a first statistic value of display time of a screen of each type display on the display, to generate first statistic values corresponding to the different types of screens; a first determiner configured to determine, for each type of the screens, whether a user is concentrating on a screen of each type, based on, from among the first statistic values, a first statistic value calculated for the screen of each type; and a generator configured to generate a list including screen identification information for identifying, from among the different types of screens, a type of screen for which a corresponding determination result from the first determiner is affirmative.

Abstract: Techniques are disclosed for dynamically generating a data set representative of search results in response to a query and using the data set to accurately rank search results in response to a domain specific search query. Upon receiving the search query, features of the query and features of each search result are extracted. A relevance ranking may be assigned to each search result based on a comparison of the features of the query and each search result. The relevance ranking of each search result may be adjusted based on metrics related to user interactions. A data set may be created which includes the query, search results, extracted features, and metrics. The data set may be used to train a machine learning model to accurately determine a ranking of search results in response to a subsequent search query.

Abstract: The disclosed systems, and methods are directed to assisting a user of a virtual environment, the method comprising: tracking and storing user interactions of the user with a user interface associated with the virtual environment, the user interactions being associated with the user attempting to perform a task in the virtual environment; performing a background analysis of the user interactions, the background analysis comprising: inputting one or more of the tracked and stored user interactions to a machine learning algorithm (MLA) having been previously trained to identify sequence pattern of user interactions; outputting, by the MLA, one or more sequence patterns of user interactions to be associated with the tracked and stored user interactions; determining, that the user requires assistance to complete the task; and operating an assistance module to guide the user in completing the task.

Abstract: A task optimization method and a task optimization device in a mobile robot are provided. The task optimization method includes: obtaining at least one task type in a mobile robot and usage information when all users use a task corresponding to each task type; separately performing machine learning on the usage information of all the users corresponding to each task type to obtain at least one piece of user's usage habit information corresponding to each task type and usage probability thereof, thereby performing machine learning on usage information when all users use the task corresponding to the task type; based on the at least one piece of usage habit information corresponding to each task type, the usage probability thereof and the real-time usage information, optimizing the task corresponding to the task type used by the user in real time.

Abstract: A cognitive assistant that allows a maintainer to speak to an application using natural language is disclosed. The maintainer can quickly interact with an application hands-free without the need to use complex user interfaces or memorized voice commands. The assistant provides instructions to the maintainer using augmented reality audio and visual cues. The assistant will walk the maintainer through maintenance tasks and verify proper execution using IoT sensors. If after completing a step, the IoT sensors are not as expected, the maintainer is notified on how to resolve the situation.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. A request for content is received from a user device. One or more candidate content items that are responsive to the request are identified from an inventory of content items. For each candidate content item, an expected performance measure associated with a respective candidate content item is determined. The expected performance measure for each respective candidate content item is compared to a predetermined threshold. When none of the candidate content items have an expected performance measure that exceeds the threshold, a notification is generated, including generating one or more queries, responsive to the request for inclusion in the notification. The notification is provided responsive to the request and for presentation to the user in lieu of a content item.

Abstract: In one example, a method performed by a processing system including at least one processor includes rendering an extended reality environment, receiving a request from a user endpoint device of a first user in the extended reality environment to place an avatar of the first user in the extended reality environment, placing the avatar of the first user within the extended reality environment, detecting that a second user is attempting to interact with the avatar of the first user, detecting conditions surrounding the avatar of the first user, identifying, based on the conditions, a set of candidate avatar personas for the first user, selecting a first avatar persona from among the set of candidate avatar personas, and rendering the avatar of the first user with the first avatar persona in the extended reality environment.

Abstract: Embodiments for providing intelligent recommendation of guidance instructions to a user by a processor. A user may be cognitively recognized performing a selected task on an item using one or more Internet of Things (“IoT”) computing devices. One or more guidance instructions may be provided/suggested for assisting with performing the selected task according to identified contextual factors. The user may be cognitively guided to perform the selected task using the one or more guidance instructions.

Abstract: Provided is a technique of preventing incorrect execution of a search function that is not intended by a user. A voice recognition apparatus includes an acquisition unit, an estimation unit, an execution frequency storage, and a controller. The acquisition unit acquires a voice. The estimation unit estimates a search function to be executed, by recognizing the voice acquired by the acquisition unit. The execution frequency storage stores the execution frequency of the search function. The controller refers to the execution frequency of an estimation search function, and then controls the execution of the estimation search function. The estimation search function is the search function estimated by the estimation unit.

Abstract: The present disclosure is directed to an on-demand intelligent assistant that obtains physical identifiers of a target individual using information received from sensors. The assistant determines an identity of the target individual using the physical identifiers. The assistant also caches the physical identifiers and the identity as baseline information of the target individual. The assistant further detects keywords used in communications of a user with the target individual. Moreover, the assistant determines that the user desires additional information of the target individual based on the keywords. Additionally, the assistant determines a query for the additional information using the baseline information and the keywords. Further, the assistant retrieves the additional information from a remote database using the query and provides the additional information to the user.

Abstract: A method may include accessing user activity data with respect to performances of a feature within an electronic application by a user; calculating a similarity score for the user with respect to a level of proficiency for the feature based on the accessed user activity data; and based on the similarity score meeting a threshold value: updating a level of proficiency value in a user profile for the feature of the electronic application; and enabling the user to enter into a collaborative editing mode with another user to complete a document using the feature of the application.

Abstract: Computerized systems are provided for automatically determining and providing enriched action items of an event, such as a meeting. Action items first may be determined and then enhanced or clarified in order to be more understandable by automatically modifying or supplementing the action item based on contextual information, such as related meeting discussion. Action items may be further enhanced through clarification by determining boundaries of their occurrence(s) so that extraneous content not related to the action items or not helpful for user understanding is deemphasized or excluded from presentation to the user. Some embodiments comprise an intelligent graphical user interface with functionality for receiving user feedback. The feedback can be employed to reconfigure the logic, such as machine learning models, utilized to determine the enriched action items to improve accuracy.

Abstract: The present disclosure involves systems, software, and computer implemented methods for presenting information and/or services to a user. One example method includes establishing a user session between a computing device operated by an entity and a first user device operated by a customer of the entity. The first user device provides a first interface through which the customer participates in the user session. The method also includes determining, based at least on a complexity of first information to be provided to the customer, to change the first interface to a new interface. Further, the method includes selecting, based on the complexity of the first information, a new interface, where the new interface is provided by at least a second user device. Furthermore, the method includes implementing the new interface to facilitate for the customer to participate in the user session.

Abstract: Proficiency level determining unit determines a user's proficiency level in operating his/her user device. Suggestion determining unit determines a suggestion to be disclosed, based on a trigger that has occurred. Suggestion type determining unit determines a type of the suggestion determined to be displayed by suggestion determining unit. Display method determining unit determines a display method of the suggestion based on the suggestion type determined by suggestion type determining unit, among display methods that differ in a method by which the user may operate the user device after a suggestion is displayed. Suggestion display control unit causes a display means of the user device to display the suggestion determined by suggestion determining unit using the display method determined by display method determining unit.

Abstract: A method, system, apparatus, and computer program product for efficiently outsourcing projects, such as software development projects, are presented. A business entity may precisely and succinctly define one or more requests for proposals (RFPs) using predefined service identifiers which specify discrete, short-term projects (e.g., 4 weeks or less) with fixed inputs and outputs and objective evaluation metrics which allow for each project to be evaluated using, for example, automated evaluation software tools. By posting RFPs on a web site, the business entity solicits bids from third party vendors to perform the project identified in the RFP. Since individual projects are identified with objective inputs, outputs, and evaluation metrics, vendors can bid on the project with minimal evaluation and speculation regarding the appropriate bidding price for the project.

Abstract: A management unit including: a demand plan generating unit that obtains control information items related to energy consuming appliances; an obtaining unit that obtains picture data items showing the appliances; a memory which stores the picture data items obtained by the obtaining unit; a selecting unit which selects a picture data item from selection candidates including the picture data items stored in the memory, based on a specified control mode; a processor that executes processing for superimposing the control information items corresponding to the appliances in the picture data item selected by the selecting unit; and an output unit which displays the picture data item with the superimposed control information item.

Abstract: Methods and apparatus related to determining additional features for a user task entry of a user based on a user habit of the user. For example, one or more aspects of a user task entry of a user may be compared to one or more aspects of a user habit of the user to determine a correlation measure between the task entry and the user habit. If the correlation measure satisfies a threshold, one or more additional features of the user task entry may be determined based on the user habit. For example, the user habit may include one or more trigger indicators that indicate an actual entry or anticipated entry of the user into the user habit, and one or more of the trigger indicators may be utilized to determine task trigger indicators for the user task entry.

Abstract: The innovation disclosed and claimed herein, in one aspect thereof, comprises systems and methods of user interface competence adaptation and fraud detection. The innovation includes a user device that provides a user interface to receive user interactions. A monitoring component monitors user interactions by the user on the user device. The user interactions can be controlling, navigating, or inputting to the user interface. A determination component determines a user proficiency based on the monitored user interactions. A configurator determines and implements a device configuration for the user device based on the determined user proficiency. A security component determines a different user is accessing the user device based on a change in user proficiency exceeding a threshold change. The security component implements security measures upon determine a different user has access.

Abstract: A workflow control device includes a workflow management processing portion, a clumsiness detection processing portion, and a display processing portion. The workflow management processing portion manages a workflow for combining processes corresponding to specific operations on an electronic apparatus, in a specific order and performing execution instructions for the processes. The clumsiness detection processing portion detects clumsiness in an operation which has been performed by a user on the electronic apparatus and delayed from a threshold. The display processing portion causes an order of processes based on a workflow through which execution instructions for processes corresponding to operations of the user can be performed in order, to be displayed on a screen based on detection of the clumsiness.

Abstract: Representative embodiments disclose mechanisms for dynamically adjusting the user interface and/or behavior of an application to accommodate continuous and unobtrusive learning. As a user gains proficiency in an application, the learning cues and other changes to the application can be reduced. As a user loses proficiency, the learning cues and other changes can be increased. User emotional state and openness to learning can also be used to increase and/or decrease learning cues and changes in real time. The system creates multiple learning models that account for user characteristics such as learning style, type of user, and so forth and uses collected data to find the best match. The selected learning model can be further customized to a single user. The model can also be tuned based on user interaction and other data. Collected data can also be used to adjust the base learning models.

Abstract: A method implemented on an electronic computing device includes displaying a document. An image of a person is received. The image of the person is overlaid onto at least a portion of the image of the document. One or more movements are received from the person. The image of the person is moved to indicate a specific area of the document. The movement of the image of the person to the specific area of the document is based on the one or more movements from the person.

Abstract: A communication assistive device and a communication assistive method for people with language disorder are provided. The communication assistive method comprises the steps of: receiving user touch screen input selecting one of images representing sentence components displayed on a screen, the sentence components such as words and postpositions constituting a sentence to be outputted; combining the received sentence components to generate a sentence; and outputting the generated sentence by voice, wherein input for at least one of the sentence components is performed by selection of an image coding a shape or meaning of a character, wherein a widget is created for the generated sentence.

Abstract: After starting output of an audio guidance at a first volume, a control portion judges whether or not an image of a user is contained in image data, and also judges whether or not a cover has been opened, such that if no image of the user is contained in the image data and the cover is in a closed state, the control portion maintains the volume of the audio guidance at a first volume, whereas even if no image of the user is contained in the image data, when the cover is opened, the control portion changes the volume of the audio guidance to a second volume.

Abstract: Techniques and technologies for smart support systems are described. In at least some embodiments, a method comprises: receiving an indication of a user invoking a support facility due to a problem experienced with a software application; obtaining user-related information including at least one of an age of the user or at least one indication of proficiency of the user with operation of the software application; obtaining problem-related information related to the problem experienced with the software application; and selecting a starting point of a support path based at least partially on the problem-related information and the user-related including at least one of an age of the user or at least one indication of proficiency of the user with operation of the software application, the support path defining one or more operations intended to address the problem experienced with the software application.

Abstract: A method and apparatus for providing assistance for an application. The application runs in a web browser displayed on a display system for a client device. The application monitors for user input to the web browser. When assistance is needed for a location in the web page, the location is identified based on the user input. A graphical element with a portion of the web page at the location is generated. A group of audio files on how to use the application at the location is identified. The graphical element with the portion of the web page at the location is displayed on the display system. The audio files are played on the client device while the graphical element with the portion of the web page at the location of the web page is displayed. The audio files and the graphical element provide the assistance.

Abstract: A computing platform having at least one processor, a memory, and a communication interface may establish a first connection, via the communication interface, with a remote client device and initiate a first client session. The computing platform may establish a second connection, via the communication interface, with an intelligent helper agent. While the second connection is established, the computing platform may receive new feature information relevant to the first client session as determined by comparing the new feature information to a first client persona. The computing platform may then transmit a first notification, via the communication interface, to the remote client device which, when executed by the remote client device, causes the first notification to be displayed on the remote client device.

Abstract: A system that incorporates teachings of the present disclosure may include, for example, an avatar engine having a controller to retrieve a user profile, cause a presentation device to present a user an avatar having characteristics that correlate to the user profile, detect one or more responses of the user, identify from the one or more responses a need to communicate with a merchant system, establish a communication session with the merchant system, receive a notification from the merchant system of a merchant avatar engine, establish communication with the merchant avatar engine, adapt the characteristics of the avatar at least in part according to instructions supplied by the merchant avatar engine, and cause the presentation device to present the user the adapted avatar. Other embodiments are disclosed.

Abstract: Various examples of the present disclosure include techniques and mechanisms for providing a customizable visual and functional experience for a user of an application or service. According to various examples, a system includes a first visual interface that is mapped to a first feature set to operate together as a first user interface that is presented throughout the application or service when selected. The system further includes a second visual interface that is mapped to a second feature set to operate together as a second user interface that is presented throughout the application or service when selected. The first feature set and second feature set differ from each other and both the first user interface and second user interface are customizable.

Abstract: Embodiments include method, systems and computer program products for a path-sensitive contextual help system. In some embodiments, user actions are obtained from a user session of a user. A concrete user action trace is captured using the obtained user actions, wherein the concrete user action trace is a subset of user actions from the user session. An abstract user action trace is generated using the concrete user action trace. A help action corresponding to the abstract user action trace is identified and, in some embodiments, is presented to the user.

Abstract: Techniques are disclosed for dynamically generating a data set representative of search results in response to a query and using the data set to accurately rank search results in response to a domain specific search query. Upon receiving the search query, features of the query and features of each search result are extracted. A relevance ranking may be assigned to each search result based on a comparison of the features of the query and each search result. The relevance ranking of each search result may be adjusted based on metrics related to user interactions. A data set may be created which includes the query, search results, extracted features, and metrics. The data set may be used to train a machine learning model to accurately determine a ranking of search results in response to a subsequent search query.

Abstract: A system for conducting a telephonic speech recognition application includes an automated telephone device for making telephonic contact with a respondent and a speech recognition device which, upon the telephonic contact being made, presents the respondent with at least one introductory prompt for the respondent to reply to; receives a spoken response from the respondent; and performs a speech recognition analysis on the spoken response to determine a capability of the respondent to complete the application. If the speech recognition device, based on the spoken response to the introductory prompt, determines that the respondent is capable of competing the application, the speech recognition device presents at least one application prompt to the respondent.

Abstract: A system and method for sending feature-instruction notifications to user computing devices. In one implementation, an online content management system detects a feature-instruction triggering event. If the user that caused the feature-instruction triggering event did not use a feature system of the online content management system, a feature-instruction notification may be sent to the user to educate the user on the feature system of the online content management system.

Abstract: Method, computer program product, and system to influence a person within an environment having a plurality of items for selection. The method includes determining, using a first visual sensor disposed within the environment, field of view (FOV) information for the person, and analyzing the FOV information to identify one or more first items within the FOV of the person. The method further includes determining, using a second visual sensor disposed within the environment, behavior information for the person and analyzing the behavior information to classify a behavior of the person into one of a number of predefined behavior types. The method further includes selecting, based on the identified one or more first items and the classified behavior, at least a second item for presentation to the person, and presenting information related to the second item to the person.

Abstract: Provided is a display apparatus, which includes a display, an inputter or input device configured to input user commands to execute a function of the display apparatus, a storage configured to store a user experience index matched with each of the user commands where the user experience index represents utilization of the display apparatus by a user, and a processor configured to determine the user experience index corresponding to the input user command based on a previously-stored user experience index, and control the display to display the determined user experience index.

Abstract: A method, system, apparatus, and computer program product for efficiently outsourcing projects, such as software development projects, are presented. A business entity may precisely and succinctly define one or more requests for proposals (RFPs) using predefined service identifiers which specify discrete, short-term projects (e.g., 4 weeks or less) with fixed inputs and outputs and objective evaluation metrics which allow for each project to be evaluated using, for example, automated evaluation software tools. By posting RFPs on a web site, the business entity solicits bids from third party vendors to perform the project identified in the RFP. Since individual projects are identified with objective inputs, outputs, and evaluation metrics, vendors can bid on the project with minimal evaluation and speculation regarding the appropriate bidding price for the project.

Abstract: A system and method for selecting an application dialog layout design based on a response pattern for a task-based application is described. A plurality of user interface layouts may be generated based on a first user interface layout, where the first user interface layout is associated with a task included in a process of a computer-implemented software application. One or more performance metrics associated with each user interface layout of the plurality of user interface layouts may be monitored, where the one or more performance metrics characterize a performance of the task by one or more task users. A second user interface layout may be selected based on an analysis of the one or more performance metrics. The second user interface layout may be provided to a plurality of users of a computer-implemented software application.

Abstract: A method and system for representing usage of an electronic learning system. The method and system involve receiving an input indicative of a selection of a property of the electronic learning system to be represented, the property including a course content provided by the electronic learning system and an activity available for that course content; receiving representation parameters that define a scope of the usage to be represented; determining an event count for the property during the period of interest; and generating a usage indicator for the property based at least on the event count. The usage indicator is generally reflective of at least a usage amount of the property during the period of interest.

Abstract: A system and method for increasing user engagement with an online service. The system includes a contextual instruction tool that teaches users about features of the online service. The system provides instruction according to different contexts of a user's interaction on their device. The instructions to the user may be in near-real time to the interaction or sometime after the interaction.

Abstract: A method includes, detecting a first touch input representing a selection of multiple rows of text displayed on a touch-sensitive display of the electronic device, determining whether a complete row of text has been selected from a start point or to an end point of the selected text, and, displaying a paragraph selection handle proximal to said row, the paragraph selection handle being responsive to a second touch input to place the electronic device in a paragraph selection mode for the selection of text.

Abstract: A method for controlling an application in a terminal includes receiving a request for executing the application from a user, executing the application, outputting one or more pieces of guide data in a first area of a screen for the executed application based on context data of the terminal and controlling the application according to the user selection.

Abstract: A method of producing a realistic virtual avatar by using a change in a pupil size according to heartbeats. The method tracks and records, in real time, a change in a pupil size of the actual user according to heartbeats of the actual user and applies the same to an eye model of a virtual avatar so as to synchronize the pupil size of the eye model with the pupil size of the actual user.

Abstract: Techniques described herein include a system and method for providing item descriptions customized to a skill level associated with a user. In some embodiments, statements related to an item may be stored and maintained by the service provider. Each statement may be associated with one or more skill levels. In some embodiments, statements associated with each skill level may be selected by members of a user community. Upon receiving a request for an item description, a service provider may determine a skill level associated with the requestor and may populate the item description with statements associated with the requestor's skill level.

Abstract: A management unit including: a demand plan generating unit that obtains control information items related to energy consuming appliances; an obtaining unit that obtains picture data items showing the appliances; a memory which stores the picture data items obtained by the obtaining unit; a selecting unit which selects a picture data item from selection candidates including the picture data items stored in the memory, based on a specified control mode; a processor that executes processing for superimposing the control information items corresponding to the appliances in the picture data item selected by the selecting unit; and an output unit which displays the picture data item with the superimposed control information item.

Abstract: A device, method and system for automatically inferring a mobile user's current context includes applying a user activity knowledge base to real-time inputs and stored user-specific information to determine a current situation. Automated reasoning is used to infer a user-specific context of the current situation. Automated candidate actions may be generated and performed in accordance with the current situation and user-specific context.

Abstract: A system, a method, and a computer program product for providing a generic user interface client. At least one common process in a plurality of processes performed by a plurality of software programs is determined. A user interface client for managing the common process is executed. The common process is managed using the user interface client.

Abstract: A process and associated system for code validation using content assist. A first list of items is presented to a code developer who is writing software code during operation of a content assist in an integrated development environment (IDE). Each item of the first list of items is enabled for validation. An item selected by the developer from the first list of items is received during the operation of the content assist. A result for the selected item is generated by (i) executing the selected item using at least one value received as input from the developer during the operation of the content assist and (ii) ascertaining whether executing the selected item requires prior initialization of a value of a variable. During the operation of the content assist, the result is displayed to the developer.

Abstract: It is an object to automatically provide information suitable for a user without increasing time or effort of the user. An information processing device acquires an operation history of a predetermined user about one or more races from storage device. The information processing device determines a skill level of the predetermined user about purchasing of betting tickets according to the operation status identified by the operation history. The information processing device controls display of the race information in response to a request from the predetermined user according to the skill level.

Abstract: A method, computer program product, and system for constructing a dynamic knowledge base of software usage patterns. A user action is monitored to identify one or more user action sequences. A common action sequence for the user action is identified, based on the one or more user action sequences. An instructional information resource is identified that corresponds to the common action resource, wherein the instructional information resource is accessed by the user. A database is constructed based on the common action sequence. The database organizes the common action sequences and instruction information resource. The instructional information resource is determined to be above a threshold based on the number of times the user consults the instructional information resource.

Abstract: A system that incorporates teachings of the present disclosure may include, for example, a media processor having a controller to solicit an appraisal for each of a plurality of media programs presented by the media processor for composing a proposal to update one or more operational features of the media processor according to one or more consumer preferences determined from one or more supplied appraisals. Other embodiments are disclosed.

Abstract: An unlocking application limits access to a computer application on a computing device. The unlocking application is configurable with at least one unlocking command comprising a sequence of inputs received by input devices of the computing device. The unlocking application limits access to at least one of the computer applications by requiring a user of the computing device to provide the at least one unlocking command using the input devices to access the at least one computer application.