Abstract: A method and system for de-identifying a video sequence are provided. The method may include the steps of capturing a video sequence, comprising a number of individual frames, including one or more users performing one or more actions, and using activity recognition to recognize one of the one or more actions. One or more of the plurality of frames may be defined as comprising the recognized one or more actions, and a portion of the one or more of the plurality of frames may be identified to remain visible. The non-identified portions of the one or more of the plurality of frames and the non-defined frames may be de-identified. This method may be applied to the determination of whether a user has ingested a medication pill.

Abstract: A method, apparatus and computer program stored on a non-volatile computer readable storage medium for confirming a pill in the mouth of a user. The computer program causing a general purpose computer to perform the steps of capturing one or more images of a user by an image capture device, confirming the position of the face of the user within the captured image by measuring a size of the face, and setting a predetermined portion of the face of the user to be a region of interest. An open mouth of the user is confirmed within the region of interest, and the open mouth of the user is classified as one of a mouth with a pill therein and a mouth without a pill therein.

Abstract: A method and apparatus for determining an indication of interaction in a direction towards a webcam. The method includes the steps of determining an object in a region of interest, determining a first size of the object in the region of interest and tracking the object in the region of interest. A second size of the object in the region of interest is then determined, and a push interaction is confirmed as having taken place if the ratio of the second size to the first size is greater than a predetermined value.

Abstract: A medication management system is described that is operable to determine whether a user is actually following a protocol, provide additional assistance to a user, starting with instructions, video instructions, and the like, and moving up to contact from a medication administrator if it is determined that the user would need such assistance in any medical adherence situation, including clinical trial settings, home care settings, healthcare administration locations, such as nursing homes, clinics, hospitals and the like. Suspicious activity on the part of a patient or other user of the system is identified and can be noted to a healthcare provider or other service provider where appropriate.

Abstract: A method, system and computer program for confirming proper medication amount for a medication injection apparatus. The computer program causes a computer to perform the steps of providing one or more instructions on a display of a computing device instructing placement of an injectable medication apparatus including an indication of an amount of medication to be injected by the in medication apparatus, imaging by an image capture one or more images of the injectable medication apparatus including the indication of the amount of medication, and comparing by a processor of the computing device through recognition of the indication of the amount of medication, the indicated amount to a predetermined amount. One or more additional instructions may be provided om the display of the computing device to change the indication of the amount of medication if it is determined that the recognized indicated amount does not match the predetermined amount.

Abstract: A system and method for training a system for monitoring administration of medication. The method includes the steps of a method for training a medication administration monitoring apparatus, comprising the steps of defining one or more predetermined medications and then acquiring information from one or more data sources of a user administering medication. A first network is trained to recognize a first step of a medication administration sequence, and then a second network is trained to recognize a second step of a medication administration sequence based upon the training of the first network.

Abstract: In general, in some aspects, the subject matter of the present disclosure can be embodied in methods for confirming identity, in which the methods include: outputting a parameter by a reading device, the reading device adapted to read an image displayed on a display of a display device; receiving the parameter output by the reading device by the display device; generating a fractal image at least in accordance with the received parameter by the display device; displaying the generated fractal image on the display of the display device; imaging the displayed fractal image by the reading device; comparing the imaged fractal image to an expected fractal image generated by the reader at least in accordance with the parameter; and confirming that the imaged fractal image and the expected fractal image do not differ by more than a predetermined amount.

Abstract: A system and method for recognizing a medication are provided. The method includes the steps of presenting a medication to a medication identification apparatus, the medication identification apparatus adapted to visually image the presented medication and visually imaging the presented medication. A predetermined transformation may be applied to the visually imaged presented medication, the predetermined transformation adjusting one or more parameters of the visually imaged presented medication along one or more dimensions. Finally, the transformed visually imaged medication is compared to a medication library to determine a closest match therebetween.

Abstract: A method and apparatus for engaging consumers in the performance of predetermined action. The method comprises the steps determining performance of a predetermined action, providing feedback related to the determined performance of the predetermined action, and broadcasting confirmation of performance of the predetermined action along with at least a portion of the provided feedback. An incentive be provided based upon performance of the predetermined action, or upon broadcasting. The predetermined action may include eating a candy or other edible item. The feedback may include material related to an advertising campaign, or otherwise related to the candy or edible item.

Abstract: A method and apparatus for determining an indication of interaction in a direction towards a webcam. The method includes the steps of determining an object in a region of interest, determining a first size of the object in the region of interest and tracking the object in the region of interest. A second size of the object in the region of interest is then determined, and a push interaction is confirmed as having taken place if the ratio of the second size to the first size is greater than a predetermined value.

Abstract: A method and system for de-identifying a video sequence are provided. The method may include the steps of capturing a video sequence, comprising a number of individual frames, including one or more users performing one or more actions, and using activity recognition to recognize one of the one or more actions. One or more of the plurality of frames may be defined as comprising the recognized one or more actions, and a portion of the one or more of the plurality of frames may be identified to remain visible. The non-identified portions of the one or more of the plurality of frames and the non-defined frames may be de-identified. This method may be applied to the determine of whether a user has ingested a medication pill.

Abstract: A medication confirmation method and apparatus. The method of an embodiment of the invention includes the steps of capturing one or more video sequences of a user administering medication by a video capture device, storing the captured one or more video sequences to a non-transitory memory, and analyzing at least one of the stored video sequences to determine one or more indications of suspicious activity on behalf of the user.

Abstract: A medication management system is described that is operable to determine whether a user is actually following a protocol, provide additional assistance to a user, starting with instructions, video instructions, and the like, and moving up to contact from a medication administrator if it is determined that the user would need such assistance in any medical adherence situation, including clinical trial settings, home care settings, healthcare administration locations, such as nursing homes, clinics, hospitals and the like. Suspicious activity on the part of a patient or other user of the system is identified and can be noted to a healthcare provider or other service provider where appropriate.

Abstract: A method and apparatus for pattern tracking. The method includes the steps of performing a foreground detection process to determine a hand-pill-hand region, performing image segmentation to separate the determined hand portion of the hand-pill-hand region from the pill portion thereof, building three reference models, one for each hand region and one for the pill region, initializing a dynamic model for tracking the hand-pill-hand region, determining N possible next positions for the hand-pill-hand region, for each such determined position, determining various features, building a new model for that region in accordance with the determined position, for each position, comparing the new model and a reference model, determining a position whose new model generates a highest similarity score, determining whether that similarity score is greater than a predetermined threshold, and wherein if it is determined that the similarity score is greater than the predetermined threshold, the object is tracked.

Abstract: A medication confirmation method and apparatus for confirming administration of medication employing an inhalable medication administration apparatus. The method of an embodiment of the invention includes the steps of capturing one or more video sequences of a user administering medication employing the inhalable medication administration apparatus, storing the captured one or more video sequences, capturing one or more audio sequences of the user administering medication employing the inhalable medication administration apparatus and storing the captured one or more audio sequences. At least one of the stored video sequences and at least one of the stored audio sequences are then analyzed to confirm that the user has properly administered the medication.

Abstract: A medication confirmation method and apparatus. The method of an embodiment of the invention includes the steps of capturing one or more video sequences of a user administering medication via a medication administration apparatus, storing the captured one or more video sequences, and analyzing at least one of the stored video sequences to confirm that the user has properly administered the medication, and has properly positioned the medication administration apparatus.

Abstract: In general, in some aspects, the subject matter of the present disclosure can be embodied in methods for confirming identity, in which the methods include: outputting a parameter by a reading device, the reading device adapted to read an image displayed on a display of a display device; receiving the parameter output by the reading device by the display device; generating a fractal image at least in accordance with the received parameter by the display device; displaying the generated fractal image on the display of the display device; imaging the displayed fractal image by the reading device; comparing the imaged fractal image to an expected fractal image generated by the reader at least in accordance with the parameter; and confirming that the imaged fractal image and the expected fractal image do not differ by more than a predetermined amount.

Abstract: A system and method for recognizing a medication are provided. The method includes the steps of presenting a medication to a medication identification apparatus, the medication identification apparatus adapted to visually image the presented medication and visually imaging the presented medication. A predetermined transformation may be applied to the visually imaged presented medication, the predetermined transformation adjusting one or more parameters of the visually imaged presented medication along one or more dimensions. Finally, the transformed visually imaged medication is compared to a medication library to determine a closest match therebetween.

Abstract: A medication management system is described that is operable to determine whether a user is actually following a protocol, provide additional assistance to a user, starting with instructions, video instructions, and the like, and moving up to contact from a medication administrator if it is determined that the user would need such assistance in any medical adherence situation, including clinical trial settings, home care settings, healthcare administration locations, such as nursing homes, clinics, hospitals and the like. Suspicious activity on the part of a patient or other user of the system is identified and can be noted to a healthcare provider or other service provider where appropriate.

Abstract: A method and apparatus for pattern tracking. The method includes the steps of performing a foreground detection process to determine a hand-pill-hand region, performing image segmentation to separate the determined hand portion of the hand-pill-hand region from the pill portion thereof, building three reference models, one for each hand region and one for the pill region, initializing a dynamic model for tracking the hand-pill-hand region, determining N possible next positions for the hand-pill-hand region, for each such determined position, determining various features, building a new model for that region in accordance with the determined position, for each position, comparing the new model and a reference model, determining a position whose new model generates a highest similarity score, determining whether that similarity score is greater than a predetermined threshold, and wherein if it is determined that the similarity score is greater than the predetermined threshold, the object is tracked.