Abstract: A smart mirror system includes a screen configured to generate a display for viewing by a user, a mirror positioned in front of the screen, a near-field-communication (NFC) card reader located behind the mirror, a network interface for communicating with a remote health data server, memory configured to store computer-executable instructions, and at least one processor configured to execute the computer-executable instructions. The computer-executable instructions include selectively detecting, by the NFC card reader, an NFC chip of a member card placed in proximity to the NFC card reader. The computer-executable instructions include, in response to detecting the NFC chip, obtaining member information from the detected NFC chip, and authenticating the user to the remote health data server, via the network interface, according, at least in part, to the obtained member information.

Abstract: Method starts with a processor receiving configuration settings including an identified task, a relationship data, and a criticality value. Processor initializes a communication session with an agent client device. The communication session is between a virtual caller associated with the system and the agent client device. Processor then processes an audio signal of the communication session to generate an agent utterance and generates a transcribed agent utterance based on the agent utterance using a speech-to-text processor. Processor generates a virtual caller utterance using a task-specific virtual caller neural network associated with the identified task. The virtual caller utterance can be generated based on the transcribed agent utterance. Processor then causes the virtual caller utterance to be played back in the communication session to the agent client device. Other embodiments are disclosed herein.

Abstract: A computer system for testing a user interface includes a memory circuit and a processor circuit configured to execute instructions including obtaining a state of the user interface. The instructions include setting a current position to a specified location within the user interface. The instructions include executing user interface tests to generate multiple paths. The instructions include determining a shortest path toward a goal location by identifying a path having a minimum distance that satisfies criteria. A distance for the path is based on two-dimensional distances between pairs of consecutive positions that include the current position as well as positions, along the particular path, of user interface elements requiring interaction to satisfy the criteria.

Abstract: A system for integrating a telephone system and a computing system is provided. The system includes an interactive voice response (IVR) platform configured to: obtain a computer-readable command based on user input; determine a goal in the web application associated with the computer-readable command; and obtain information indicating a shortest navigation path to the goal, relative to other navigational paths to the goal in the web application. The system includes a cobrowse client configured to receive a document object model (DOM) of a current state of the web application from a cobrowse session for a web server hosting the web application. The IVR platform is configured to, based on the DOM, determine a next navigation action along the shortest navigation path; generate a user prompt based on the next navigation action; and monitor user progress to reach the goal in the web application using one or more updated DOMs.

Abstract: A smart mirror system includes a screen configured to generate a display for viewing by a user, a mirror positioned in front of the screen, a near-field-communication (NFC) card reader located behind the mirror, a network interface for communicating with a remote health data server, memory configured to store computer-executable instructions, and at least one processor configured to execute the instructions. The instructions include selectively detecting, by the NFC card reader, an NFC chip of a member card placed in proximity to the NFC card reader. The instructions include, in response to detecting the NFC chip, obtaining member information from the detected NFC chip, and authenticating the user to the remote health data server, via the network interface, according, at least in part, to the obtained member information.

Abstract: Method starts with a processor receiving configuration settings including an identified task, a relationship data, and a criticality value. Processor initializes a communication session with an agent client device. The communication session is between a virtual caller associated with the system and the agent client device. Processor then processes an audio signal of the communication session to generate an agent utterance and generates a transcribed agent utterance based on the agent utterance using a speech-to-text processor. Processor generates a virtual caller utterance using a task-specific virtual caller neural network associated with the identified task. The virtual caller utterance can be generated based on the transcribed agent utterance. Processor then causes the virtual caller utterance to be played back in the communication session to the agent client device. Other embodiments are disclosed herein.

Abstract: A method for testing a user interface (UI) includes obtaining a first state of the UI and setting a current position to specified location coordinates. The method includes determining whether the first state satisfies criteria for a goal and, if so, updating a collection of completed tests with a test distance and test data. The method includes, in response to the first state not satisfying the criteria: determining a set of potential user actions to be performed in the first state based on interactive elements of the UI; selecting and executing an action; and updating the test distance based on the current position and location coordinates of the element associated with the action. The method includes determining a shortest path to the goal in the UI based on the collection of completed tests. The method includes, based on the determined shortest path, automatically visually transforming a state of the UI.

Abstract: A method includes capturing, by an image-capturing device, a one or more images of at least a portion of a pharmacy workstation. The method also includes identifying, by a processor in communication with the image capturing device, objects of interest in a first image of the one or more images and classifying, by the processor, the detected objects of interest using a convolutional neural network associated with the processor. The method also includes identifying, by the processor, a boundary defining an opening of a container in a second image of the one or more images. The method also includes updating, by the processor, an objects in container list based on a determination that at least one of the classified objects passed the boundary.

Abstract: A computer system for testing a user interface (UI) includes a test creation module, a test execution module, a path entry module, and an analysis module. The test creation module obtains testing parameters including a UI location and goal criteria. The test execution module obtains a state of the UI based on the location, sets a current position to a predetermined location, executes tests according to the obtained state and the current position, stores test distance or test data results from completed UI tests, and determines a shortest path toward the goal in the UI based on the completed UI tests. The path entry module receives preferred path information and accordingly generates a preferred path toward the goal. The analysis module compares the determined shortest path to the generated preferred path and outputs an analysis result according to the comparison of the determined shortest path to the generated preferred path.

Abstract: A method includes capturing, by an image-capturing device, a one or more images of at least a portion of a pharmacy workstation. The method also includes identifying, by a processor in communication with the image capturing device, objects of interest in a first image of the one or more images and classifying, by the processor, the detected objects of interest using a convolutional neural network associated with the processor. The method also includes identifying, by the processor, a boundary defining an opening of a container in a second image of the one or more images. The method also includes updating, by the processor, an objects in container list based on a determination that at least one of the classified objects passed the boundary.

Abstract: A computer system for testing a user interface (UI) includes a test execution module and an analysis module. The analysis module is configured to (i) analyze a state of the UI, (ii) in response to determining that the state satisfies criteria for a goal associated with the UI, output a success indicator, and (iii) in response to determining that the state does not satisfy the criteria, output a set of actions. The test execution module is configured to, in response to the output being the set of actions: execute an action from the set of actions; update a test distance, and supplement test data. The test execution module is further configured to (i) in response to the output being the success indicator, store the test distance and the test data in a collection of completed tests and (ii) determine a shortest path to the goal in the UI.

Abstract: Method for generating user interface that indicates medication changes in medication starts with a processor detecting a medication change event. Processor retrieves medication information based on the medication change event including images of two medications. Processor generates color difference output using a color neural network, image of first medication and second medication. Color difference output comprises information on a difference in hue, saturation or color distribution. Processor generates medication appearance difference output using medication appearance neural network, image of first medication and second medication. Medication appearance difference output comprises information on a difference in shape, segmentation or form. Processor generates a differential record using the color difference output and medication appearance difference output.

Abstract: A container vault system includes a plurality of container vaults in communication with a server via a communication network. The server is configured to store package data for each of a plurality of medication packages. Each of the container vaults comprises at least one container configured to hold a medication package, as well as a control system configured to (i) receive the package data for the medication package from the server, wherein the package data identifies at least one authorized user permitted to retrieve the medication package and (ii) control access to the container so that the authorized user identified in the package data is permitted to retrieve the medication package from the container.

Abstract: A system for monitoring access to a contained medication is disclosed. The system includes a server configured to store user information for each of a plurality of registered users. The system also includes a smart container configured to hold a medication. The smart container includes a processor configured to (a) detect a user device of a user in possession of the smart container, (b) determine if the user device is associated with one of the registered users, and (c) if the determination is affirmative, manage a user session with the user device and transmit one or more session messages to the server. The server is configured to store a transaction corresponding to each of the session messages to thereby create a transaction history for the smart container.

Abstract: Method starts with processing, by a processor, audio signal to generate audio caller utterance and transcribed caller utterance. Processor generates identified task based on transcribed caller utterance. Processor samples audio caller utterance to generate samples of audio caller utterance. Processor generates loudness result based on loudness values of samples using loudness neural network associated with identified task. Processor generates pitch result based on pitch values of samples using pitch neural network associated with identified task. Processor generates tone result for each word in transcribed caller utterance using tone neural network associated with identified task. Using task completion probability neural network associated with identified task, processor generates task completion probability result that is based on at least one of: loudness result, pitch result, or tone result. Other embodiments are disclosed herein.

Abstract: Methods and systems for an accessibility system are provided. The methods and systems include operations comprising: receiving a request for a markup language document; obtaining the markup language document; processing a first portion of the markup language document with a machine learning technique to generate a first dictation corresponding to the first portion of the markup language document, the machine learning technique being trained to establish a relationship between a plurality of training markup language documents and training dictations corresponding to the training markup language documents; and replacing the first portion of the markup language document with the first dictation.

Abstract: A computer system for improving a user interface (UI) is disclosed. The system includes a reinforcement module that obtains (i) a shortest path to a goal in the UI and (ii) user interaction experiments; a distance module that determines a reinforcement distance for each page of the UI based on the user interaction experiments; and a step analysis module that determines a count of times that user interaction experiments indicate a deviation from each step of the shortest path. The determination is based on the determined reinforcement distance for the page of the UI associated with the step. The reinforcement module is configured to, in response to determining that a step requires reinforcement, generate a reinforcement for the step. Generating the reinforcement includes at least one of generating a prompt for an action associated with the step and altering a UI element associated with the step.

Abstract: Method starts with a processor receiving configuration settings including an identified task, a relationship data, and a criticality value. Processor initializes a communication session with an agent client device. The communication session is between a virtual caller associated with the system and the agent client device. Processor then processes an audio signal of the communication session to generate an agent utterance and generates a transcribed agent utterance based on the agent utterance using a speech-to-text processor. Processor generates a virtual caller utterance using a task-specific virtual caller neural network associated with the identified task. The virtual caller utterance can be generated based on the transcribed agent utterance. Processor then causes the virtual caller utterance to be played back in the communication session to the agent client device. Other embodiments are disclosed herein.

Abstract: Method starts with processing, by a processor, audio signal to generate audio caller utterance. Processor generates an agent action ranking score associated with the audio caller utterance and determines whether the agent action ranking score is below a minimum threshold. In response to determining that the agent action ranking score is below the minimum threshold, processor generates a transcribed caller utterance using a speech-to-text processor and generates an identified task based on the transcribed caller utterance. Using the transcribed caller utterance and a task-specific agent coaching neural network associated with the identified task, processor generates an ideal response. Processor generates a feedback result and causes the feedback result to be displayed on a display device of the agent client device. Other embodiments are disclosed herein.

Abstract: A computer system for testing a user interface (UI) includes a test creation module, a test execution module, a path entry module, and an analysis module. The test creation module obtains testing parameters including a UI location and goal criteria. The test execution module obtains a state of the UI based on the location, sets a current position to a predetermined location, executes tests according to the obtained state and the current position, stores test distance or test data results from completed UI tests, and determines a shortest path toward the goal in the UI based on the completed UI tests. The path entry module receives preferred path information and accordingly generates a preferred path toward the goal. The analysis module compares the determined shortest path to the generated preferred path and outputs an analysis result according to the comparison of the determined shortest path to the generated preferred path.