Abstract: A system and method for monitoring the state of an individual. The method includes providing a stimulus to the individual, measuring a response to the provided stimulus, comparing the measured response to an expected response, and diagnosing one or more aspects of disease in accordance with the result of the comparison between the measured response and the expected response. The stimulus may be a predetermined test sequence, such as a visually displayed predetermined sequence of images, or may include observation of the physical response of the individual while performing one or more predetermined activities. Stored images or video of the individual responding to one or more test sequences may be stored in a lossy or lossless state, and thus security and de-identification may be provided to stored data. This stored data may also be de-identified in a manner to allow for the answering of the greatest number of future questions.

Abstract: Methods, systems, and apparatus including computer programs encoded on a computer storage medium, for retrieving image search results using embedding neural network models. In one aspect, an image search query is received. A respective pair numeric embedding for each of a plurality of image-landing page pairs is determined. Each pair numeric embedding is a numeric representation in an embedding space. An image search query embedding neural network processes features of the image search query and generates a query numeric embedding. The query numeric embedding is a numeric representation of the image search query in the same embedding space. A subset of the image-landing page pairs having pair numeric embeddings that are closest to the query numeric embedding of the image search query in the embedding space are identified as first candidate image search results.

Abstract: A method includes: obtaining, by a computer, subject response data including audio data, video data, or audio-video data of a subject's response to one or more stimuli presented to the subject over a defined time period; extracting at least one subject descriptor from the subject response data as a function of time, the at least one subject descriptor including data characterizing involuntary or voluntary action of the subject in response to the one or more stimuli; deriving, from the at least one subject descriptor, a first biomarker characterizing a behavior of the subject in response to the one or more stimuli, in which a value of the first biomarker is indicative of a severity of a disease in the subject; and outputting a disease severity level for the disease as a function of the value of the first biomarker.

Abstract: Methods, systems, and apparatus including computer programs encoded on a computer storage medium, for retrieving image search results using embedding neural network models. In one aspect, an image search query is received. A respective pair numeric embedding for each of a plurality of image-landing page pairs is determined. Each pair numeric embedding is a numeric representation in an embedding space. An image search query embedding neural network processes features of the image search query and generates a query numeric embedding. The query numeric embedding is a numeric representation of the image search query in the same embedding space. A subset of the image-landing page pairs having pair numeric embeddings that are closest to the query numeric embedding of the image search query in the embedding space are identified as first candidate image search results.

Abstract: A method includes providing one or more instructions to perform a first action associated with administration of a medication; obtaining first data representing a capture of a patient performing the first action based on the one or more instructions as output by the output device; extracting information about movements of the patient from the first data; presenting an image configured to induce an emotional response in the patient; obtaining second data representing capture of the patient performing one or more microexpressions in response to presentation of the image; obtaining additional data including one or more of demographic information of the patient, information of a disease associated with the patient, or one or more characteristics of the medication; and based on the extracted information about the movements, the one or more microexpressions, and the additional data, determining a medical outcome including a progression of the disease in the patient.

Abstract: A method includes providing one or more instructions to perform a first action associated with administration of a medication; obtaining first data representing a capture of a patient performing the first action based on the one or more instructions; extracting information about movements of the patient from the first data; presenting an image configured to induce an emotional response in the patient; obtaining second data representing capture of the patient performing one or more microexpressions within 250 milliseconds of presentation of the image; obtaining additional data including one or more of demographic information of the patient, information of a disease associated with the patient, or one or more characteristics of the medication; and based on the extracted information about the movements, the one or more microexpressions, and the additional data, determining a medical outcome including a progression of the disease in the patient.

Abstract: A method for monitoring a mobile input device with a screen on which information can be displayed in a first pixel raster of image elements and which comprises a flat optical fingerprint reader and a second pixel raster of light-sensitive sensor elements. A fingerprint and fingerprint characteristics, comprising position of the finger on the screen are detected. The sensor elements detect the light intensity incident on them. The intensity levels are assembled into a static pattern of the fingerprint. The combination of the static pattern and the fingerprint characteristics are compared with a database. If the combination is in the database, a check is carried out whether an action is associated with this combination, which is then carried out, or whether no action is associated with this combination, whereupon a first standard action is carried out. If the combination is not stored, a second standard action is carried out.

Abstract: A system and method for recognizing an object. The system includes an imaging apparatus for capturing an image of an object and a processor for receiving the captured image of the object, and for, when it is determined that fewer than a predetermined number of objects have been previously imaged, for determining whether the image of the captured object includes one or more characteristics determined to be similar to a same characteristic in a group of previously imaged objects so that the captured image is grouped with the previously imaged objects, or whether the image of the captured object includes one or more characteristics determined to be dissimilar to a same characteristic in a group of previously imaged objects so that the captured image is not grouped with the previously imaged objects, and the image of the captured object starts another group of previously imaged objects.

Abstract: Methods, systems, and apparatus including computer programs encoded on a computer storage medium, for retrieving image search results using embedding neural network models. In one aspect, an image search query is received. A respective pair numeric embedding for each of a plurality of image-landing page pairs is determined. Each pair numeric embedding is a numeric representation in an embedding space. An image search query embedding neural network processes features of the image search query and generates a query numeric embedding. The query numeric embedding is a numeric representation of the image search query in the same embedding space. A subset of the image-landing page pairs having pair numeric embeddings that are closest to the query numeric embedding of the image search query in the embedding space are identified as first candidate image search results.

Abstract: A method for monitoring a mobile input device with a screen on which information can be displayed in a first pixel raster of image elements and which comprises a flat optical fingerprint reader and a second pixel raster of light-sensitive sensor elements. A fingerprint and fingerprint characteristics, comprising position of the finger on the screen are detected. The sensor elements detect the light intensity incident on them. The intensity levels are assembled into a static pattern of the fingerprint. The combination of the static pattern and the fingerprint characteristics are compared with a database. If the combination is in the database, a check is carried out whether an action is associated with this combination, which is then carried out, or whether no action is associated with this combination, whereupon a first standard action is carried out. If the combination is not stored, a second standard action is carried out.

Abstract: Methods and systems for recognizing suspicious activities of a user administering a medication are described. One of the methods include capturing one or more video sequences of a user administering a medication by a video capture device; analyzing the captured one or more video sequences to determine one or more indications of a suspicious activity of the user; and adaptively performing a follow-up operation in response to a determination of one or more indications of a suspicious activity of the user.

Abstract: Systems and methods for determining a heath status of a patient through an automated interview. One of the systems include one or more computers in one or more locations and one or more storage devices storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations including: providing, to a user interface of a user device, questions for a user to respond to in an interactive manner, in which each of the questions following the first questions is adaptive based on the user's response to one or more of the previous questions; capturing motion and appearance of the user in a video sequence while the user is responding to the questions; and analyzing the motion of the user in the video sequence to determine one or more indications of a disease or of a change in a disease progression.

Abstract: A system and method for monitoring the state of an individual. The method includes providing a stimulus to the individual, measuring a response to the provided stimulus, comparing the measured response to an expected response, and diagnosing one or more aspects of disease in accordance with the result of the comparison between the measured response and the expected response. The stimulus may be a predetermined test sequence, such as a visually displayed predetermined sequence of images, or may include observation of the physical response of the individual while performing one or more predetermined activities. Stored images or video of the individual responding to one or more test sequences may be stored in a lossy or lossless state, and thus security and de-identification may be provided to stored data. This stored data may also be de-identified in a manner to allow for the answering of the greatest number of future questions.

Abstract: Systems and methods for determining a heath status of a patient through an automated interview. One of the systems include one or more computers in one or more locations and one or more storage devices storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations including: providing, to a user interface of a user device, questions for a user to respond to in an interactive manner, in which each of the questions following the first questions is adaptive based on the user's response to one or more of the previous questions; capturing motion and appearance of the user in a video sequence while the user is responding to the questions; and analyzing the motion of the user in the video sequence to determine one or more indications of a disease or of a change in a disease progression.

Abstract: A system and method for monitoring the state of an individual. The method includes providing a stimulus to the individual, measuring a response to the provided stimulus, comparing the measured response to an expected response, and diagnosing one or more aspects of disease in accordance with the result of the comparison between the measured response and the expected response. The stimulus may be a predetermined test sequence, such as a visually displayed predetermined sequence of images, or may include observation of the physical response of the individual while performing one or more predetermined activities. Stored images or video of the individual responding to one or more test sequences may be stored in a lossy or lossless state, and thus security and de-identification may be provided to stored data. This stored data may also be de-identified in a manner to allow for the answering of the greatest number of future questions.

Abstract: A system and method for recognizing an object. The system includes an imaging apparatus for capturing an image of an object and a processor for receiving the captured image of the object, and for, when it is determined that fewer than a predetermined number of objects have been previously imaged, for determining whether the image of the captured object includes one or more characteristics determined to be similar to a same characteristic in a group of previously imaged objects so that the captured image is grouped with the previously imaged objects, or whether the image of the captured object includes one or more characteristics determined to be dissimilar to a same characteristic in a group of previously imaged objects so that the captured image is not grouped with the previously imaged objects, and the image of the captured object starts another group of previously imaged objects.

Abstract: A method includes: obtaining, by a computer, subject response data including audio data, video data, or audio-video data of a subject's response to one or more stimuli presented to the subject over a defined time period; extracting at least one subject descriptor from the subject response data as a function of time, the at least one subject descriptor including data characterizing involuntary or voluntary action of the subject in response to the one or more stimuli; deriving, from the at least one subject descriptor, a first biomarker characterizing a behavior of the subject in response to the one or more stimuli, in which a value of the first biomarker is indicative of a severity of a disease in the subject; and outputting a disease severity level for the disease as a function of the value of the first biomarker.

Abstract: A system and method for recognizing an object. The system includes an imaging apparatus for capturing an image of an object and a processor for receiving the captured image of the object, and for, when it is determined that fewer than a predetermined number of objects have been previously imaged, for determining whether the image of the captured object includes one or more characteristics determined to be similar to a same characteristic in a group of previously imaged objects so that the captured image is grouped with the previously imaged objects, or whether the image of the captured object includes one or more characteristics determined to be dissimilar to a same characteristic in a group of previously imaged objects so that the captured image is not grouped with the previously imaged objects, and the image of the captured object starts another group of previously imaged objects.

Abstract: A system for improving limited sensor estimates using rich sensor estimates is described.

Abstract: A system for user-initiated analysis of changes in symptoms of a patient is described. The system includes a storage device for storing data captured of a patient performing an action in response to a stimulus presented to the patient. The stimulus presented to the patient includes one or more instructions provided to the patient in accordance with monitoring of medication administration of the patient. The action performed in response to the stimulus presented to the patient includes the action of the patient performing a requested step indicative of proper medication administration and is indicative of a change in one or more symptoms associated with a disease and the overall progression of the disease, the storage device further storing one or more item selected from the group of: demographic information of the patient, disease progression information of the patient, and one or more medication characteristics of the medication subject to the medication administration monitoring process.