Abstract: A device and method are provided for real-time classification of covert speech. The device comprises a plurality of sensors for capturing real-time bio-signal data for brain monitoring in response to mental tasks delivered to a user, and a brain computer interface with memory storing instructions to configure a processor to perform a method of real-time classification of covert speech. The method comprises capturing real-time bio-signal data for brain monitoring in response to mental tasks delivered to a user, pre-processing the raw bio-signal data, extracting a vector of features from the raw bio-signal data, selecting features from the vector of features, building classification model to generate classified covert speech data using the selected features, and controlling a display device with visual elements based on the classified covert speech data.

Abstract: An apparatus for vision and language-assisted smartphone task automation, includes a processor configured to execute instructions to identify whether an utterance of a user refers to one among at least one existing automation script, and based on the utterance being identified to not refer to the one among the at least one existing automation script, capture one or more screenshots and one or more coordinates of a display, the one or more screenshots and the one or more coordinates corresponding to one or more interactions of the user with the display while the user is demonstrating a new automation script, perform object detection and optical character recognition on the captured one or more screenshots and the captured one or more coordinates to obtain user interface (UI) elements corresponding to the one or more interactions, and obtain the new automation script, based on the obtained UI elements.

Abstract: An apparatus for vision and language-assisted smartphone task automation, includes a processor configured to execute instructions to identify whether an utterance of a user refers to one among at least one existing automation script, and based on the utterance being identified to not refer to the one among the at least one existing automation script, capture one or more screenshots and one or more coordinates of a display, the one or more screenshots and the one or more coordinates corresponding to one or more interactions of the user with the display while the user is demonstrating a new automation script, perform object detection and optical character recognition on the captured one or more screenshots and the captured one or more coordinates to obtain user interface (UI) elements corresponding to the one or more interactions, and obtain the new automation script, based on the obtained UI elements.

Abstract: A device and method are provided for real-time classification of covert speech. The device comprises a plurality of sensors for capturing real-time bio-signal data for brain monitoring in response to mental tasks delivered to a user, and a brain computer interface with memory storing instructions to configure a processor to perform a method of real-time classification of covert speech. The method comprises capturing real-time bio-signal data for brain monitoring in response to mental tasks delivered to a user, pre-processing the raw bio-signal data, extracting a vector of features from the raw bio-signal data, selecting features from the vector of features, building classification model to generate classified covert speech data using the selected features, and controlling a display device with visual elements based on the classified covert speech data.

Abstract: A differential non-contact sensor system for measuring biopotential signals is described. The sensor is a low-noise, non-contact capacitive sensor system to measure electrical voltage signals generated by the body comprising two capacitive electrodes and outputting a differential signal.