BEHAVIOUR CAPTURE DEVICE
A handheld or wearable behaviour capture device (100) comprises a physical input interface (101) configured to receive an input from a user (110) related to the user's behaviour. The input interface (101) is used to generate user input data. The device (110) further comprises a processor (102) configured to: receive the user input data; determine if the user input data corresponds to a plurality of predetermined identifiers; and generate feedback data. A feedback module (104) is provided and configured to receive the feedback data from the processor (102) and to provide feedback to the user (110).
This invention relates to a device and method for capturing the behaviour of a user and for managing behavioural health.
BACKGROUND TO THE INVENTION AND PRIOR ARTIndividuals of any age may choose to monitor their behaviours, emotions, attitudes, actions, habits, moods and feelings, etc. (hereinafter referred to collectively “behaviour(s)”) in order to help them achieve certain health, wellbeing, emotional or lifestyle goals. Mental and behavioural health challenges, including anxiety, depression, addictions, smoking, weight management, persistent pain and childhood emotional and behavioural issues such as Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD), learning disabilities, speech and language or other communication disorders, social and emotional learning challenges, can be addressed, in part, by well-established psychological approaches, including Cognitive Behaviour Therapy (CBT) and behaviour change techniques. These approaches aim to support individuals attain health, wellbeing or lifestyle goals by amongst other things observing, tracking, identifying, and analysing the individual's behaviours and other information related to the individual's behavioural health, emotional, psychological and/or physical states over a period of time. Gathering and analysing this information allows the individual and/or therapist to assess the behaviours in question, develop an understanding of behaviour triggers, set targets for behaviour change and offer relevant support and resources.
Hence, monitoring relevant behaviours is vital for implementing these psychological and behaviour change approaches to meet health, wellbeing and/or lifestyle goals. Traditional methods of behaviour monitoring involve the active maintenance by an individual of a written log or diary of his or her behaviours, psychological and/or physical state. A written diary or log may be impractical and laborious, challenging the users' engagement with the approach, or inappropriate in the case of young children or others with language or communication challenges.
Other monitoring methods include sensors on wearable devices that passively record physiological information, such as heart rate and galvanic skin response (GSR), to infer psychological and/or physical states. However, such methods do not capture behavioural and cognitive elements or encourage user engagement, and the information about psychological and/or physical states may be limited by the type of sensors and the nature and accuracy of the inference.
There is therefore a need for an improved, more inclusive and engaging behaviour tracking tool to aid individuals of all ages reach their health, wellbeing and lifestyle goals.
SUMMARY OF THE INVENTIONAccording to a first aspect of the invention there is provided a handheld or wearable behaviour capture device comprising:
-
- a physical input interface configured to receive input from a user related to the user's behaviour, and to generate user input data;
- a processor configured to:
- receive the user input data;
- determine if the user input data corresponds to at least one of plurality of predetermined identifiers; and
- generate feedback data; and
- a feedback module configured to receive the feedback data from the processor and to provide feedback to the user.
The physical act of a user in manipulating the behaviour capture device corresponds with either an action to intentionally indicate or communicate pre-assigned behaviours (e.g. moods, thoughts, feelings, emotions, actions, habits, personal or collective memories, behaviours or other information related to the users psychological, emotional, physiological or behavioural health) or more broadly a means to distract, self-soothe, and discharge emotions, energy, feelings, concerns, etc. otherwise known as fidgeting.
The device may further comprise memory, wherein the processor may be further configured to store a bookmark record in the memory in response to determining that the user input data corresponds to one of the predetermined identifiers.
The processor may be further configured to store a non-bookmark record, including fidgeting activity, in the memory in response to determining that the user input data does not correspond to one of the predetermined identifiers.
The record may include the predetermined identifier and one or more of a time, a duration, an amount of pressure and a location of the user input.
The predetermined identifier may be a pattern corresponding to a plurality of distinct user inputs of predetermined duration.
The feedback module may comprise one or more of a haptic feedback motor, a display and illumination means.
The physical input interface may be chosen from one or more of a force sensor, a pressure sensor, a push button and/or a switch configured to detect one or both of a force or a pressure applied to the physical input interface and/or an accelerometer, gyroscope, magnetometer or sensor to detect motion.
The device may further comprise sensing means configured to generate sensing data indicative of the orientation and acceleration forces applied to the behaviour capture device.
The device may further comprise a GNSS receiver.
The device may further comprise a transceiver.
According to a second aspect of the invention there is provided a handheld or wearable behaviour capture device comprising:
-
- a resiliently deformable input interface for generating user input data;
- a processor configured to:
- receive the user input data from the input interface;
- generate feedback data; and
- a feedback module configured to receive the feedback data from the processor and to provide feedback to the user.
The device may further comprise memory, wherein the processor may store a bookmark record in the memory in response to determining that the user input data corresponds to a predetermined identifier.
The processor may be further configured to store a non-bookmark record, including fidgeting activity, in the memory in response to determining that the user input data does not correspond to a predetermined identifier.
The record may include one or more of an amount of pressure, time, duration, intensity and location of the user input.
The predetermined identifier may correspond to a plurality of distinct user inputs of predetermined duration.
The feedback module may comprise one or more of a haptic feedback motor, a display and illumination means.
The physical input interface may be chosen from one or more of a force sensor, a pressure sensor, a push button and a switch configured to detect one or both of a force or a pressure applied to the input interface.
The device may further comprise sensing means configured to generate sensing data indicative of the orientation and acceleration forces applied to the behaviour capture device.
The device may further comprise a GNSS receiver.
The device may further comprise a transceiver.
According to a further aspect of the invention there is provided a behaviour capture system comprising: a behaviour capture device as described above and a computing device configured to communicate with the transceiver.
The computing device may be one or more of a mobile phone, tablet device, laptop, notebook or server.
According to a further aspect of the invention there is provided a method for behaviour capture comprising:
-
- providing a behaviour capture device as described above;
- receiving at the input interface an input from a user related to the user's behaviour and generating user input data;
- receiving the user input data at the processor;
- determining at the processor if the user input data corresponds to one of a plurality of predetermined identifiers;
- generating at the processor feedback data;
- providing the feedback data to the feedback module; and
- the feedback module providing feedback to the user.
Some embodiments of apparatus and/or methods in accordance with embodiments of the present invention are now described, by way of example only, and with reference to the accompanying drawings, in which:
The physical input interface 101 is arranged to receive a user input. As stated above, in this embodiment the physical input interface 101 is an electrical push button. In other embodiments the physical input interface 101 can be any type of sensor which receives a user input when the user squeezes, presses or otherwise physically manipulates an effective area of the physical input interface 101 on the behaviour capture device 100. The effective area of the physical input interface 101 may be limited to a specific region of the behaviour capture device 100 such that the user must physically manipulate that specific region in order to provide a user input to the physical input interface 100. Alternatively, the effective area of the physical input interface 101 may cover the entirety of the behaviour capture device 100 such that the user can manipulate any part of the behaviour capture device 100 to provide a user input to the physical input interface 101. For example, the physical input interface 101 may comprise one or more of a pressure pad, button, or other physical input means that is capable of detecting an applied force and preferably an applied pressure
A force sensing resistor (FSR) can be used to measure the squeezing force of the user's hand. The resistance of the FSR decreases when squeezed and such a sensor can be arranged to vary a voltage received by the processor, which can be recorded as an indication of the intensity of a bookmarking behaviour, as described below, the user wishes to express. The intensity of a bookmarking behaviour may additionally be expressed by the duration that the applied pressure is above a predetermined threshold. The threshold of applied pressure may be adjustable or customisable by the user. Alternatively the integral of pressure applied over the duration of a user's squeeze can be measured as an indication of intensity of a bookmarking behaviour. If the intensity of a bookmarking behaviour is expressed solely by the duration of the squeeze, then it is unnecessary to resolve the degree of pressure being applied. A simple switch arranged to operate when pressure is applied is sufficient.
Upon receiving a user input, the physical input interface 101 is arranged to generate input data. In its most basic embodiment, where the physical input interface 101 is a push button, the input data corresponds to the closing of the electrical switch of the push button. The input data generated by the physical input interface 101 may comprise data corresponding to the force or pressure applied to the physical input interface 101 by the user. The physical input interface 101 is arranged to be in data communication with a processor 102 such that the physical input interface 101 transmits any generated input data to the processor 102. Preferably, the physical input interface 101 is arranged such that a user must apply an intentional amount of pressure to the physical input interface 101, for example that is higher than that applied during simple and regular handling of the behaviour capture device 101, in order for the physical input interface 101 to generate input data. Alternatively, the physical input interface 101 generates input data in response to all detectable pressure applied to the physical input interface 101, and the processor 102 instead provides a thresholding function to ignore input data that does not correspond to an intentional user input.
The processor 102 is configured to detect patterns of user input by analysing the input data received from the physical input interface 101. Preferably, the processor 102 is configured to detect at least two or more different patterns of user input by analysing the input data. These patterns of user input are described more generally below as “predetermined identifiers”. For example, the processor 102 may be configured to detect: a first pattern of user input by analysing the input data, wherein the first pattern of user input corresponds to one short squeeze followed by one long squeeze of the behaviour capture device 100 by a user; and a second pattern of user input by analysing the input data, wherein the second pattern of user input corresponds to two short squeezes followed by one long squeeze of the behaviour capture device 100 by a user. It should be noted that different recognisable patterns of user input detectable by the processor 102 are also within the scope of the present invention.
Additionally, the processor 102 is configured to analyse input data received from the physical input interface 101 and determine secondary data from the input data. For example, the processor 102 may determine secondary data from input data wherein the secondary data corresponds to at least one of: the length of time of each user input; the amount of pressure applied during user input; and the frequency of user input. The processor 102 is also configured to determine the current time and date using a clock (not shown).
The memory module 103 is arranged to receive, store and transmit data to and from the processor 102. The data received by the memory module 103 includes input data transmitted from the physical input interface 101, via the processor 102. The memory module 103 comprises a database for storing data records of data received from the processor 102. The memory module 104 is also arranged to transmit the data stored in the database to the processor 102.
The feedback module 104 is arranged to provide user feedback in response to usage of the behaviour capture device 100, based on instructions received from the processor 102. Preferably, the feedback module 104 comprises a haptic feedback motor. The instructions received from the processor 102 include instructions to activate and deactivate the feedback module 104. Preferably, the feedback module 104 is able to exhibit different patterns of feedback depending on the instructions received from the processor 102. For example, the haptic feedback motor in the feedback module 104 is preferably arranged to pulse or remain on for different duty cycles and periods of times based on the instructions received from the processor 102. Preferably, the feedback module 104 provides feedback in response to each user input. For example, for each short squeeze of the behaviour capture device 100, the haptic feedback motor in the feedback module 104 activates correspondingly with a short activation. The feedback module 104 is also arranged to provide notifications to the user through, for example, the activation of the haptic feedback motor.
In an alternative embodiment, the feedback module 104 also includes display or illumination means, such as an LED array. Preferably, the LED array is arranged to exhibit different patterns of feedback based on instructions received from the processor 102. For example, the LEDs in the LED array may turn on or off individually or in groups depending on the instructions received from the processor 102. Additionally, in this embodiment, the LED array is arranged to display system information concerning the behaviour capture device 100. This may include using at least one of the LEDs in the LED array to indicate: a battery level of the behaviour capture device's 100 battery module; and/or the state of each operating mode of the behaviour capture device 100. The operating modes of the behaviour capture device 100 may be one or more of: airplane mode, sleep mode, on/off mode and battery mode.
Turning back to the first embodiment in
Although not shown in
The behaviour capture device 100 can be used by a user to actively record moods, thoughts, feelings, emotions, actions, habits, behaviours or other information related to the user's psychological and/or physical state or behavioural health. In the description that is to follow, these are simply referred to as “behaviours”, although they are not limited as such. Using, for example, the companion mobile application to the behaviour capture device 100, the user can pre-assign behaviours to be tracked that are relevant to their goals and objectives. A user can then use the behaviour capture device 100 to record each time the user experiences such pre-assigned behaviours. The recordal of these pre-assigned behaviours is herein referred to as creating a ‘bookmark’. The pre-assigned behaviours identified by a user for bookmarking may be changed by the user at their discretion. The number of pre-assigned behaviours, referred to as ‘bookmark types’, available for recordal corresponds to the number of patterns of user input or predetermined identifiers the processor 102 of the behaviour capture device 100 is capable of detecting. For example, if the processor 102 is configured to detect two predetermined identifiers corresponding to two respective user input patterns, then the user has two bookmark types at their disposal for recordal, i.e., type 1 and type 2. If the two detectable input identifiers are one short squeeze followed by one long squeeze of the behaviour capture device 100; and two short squeezes followed by one long squeeze of the behaviour capture device 100, then these two user input identifiers/patterns correspond to bookmarks type 1 and type 2, respectively. In general each bookmark type corresponds to a predetermined identifier or pattern of user inputs. In particular, each bookmark type corresponds to a plurality of distinct user inputs of predetermined duration.
Prior to using the behaviour capture device 100, the user will have associated a behaviour with each bookmark type, which forms the predetermined set of behaviours. For example, a user may pre-assign a behaviour with each bookmark type in the course of initially configuring the behaviour capture device 100 using an external program or other device. Hence, in order to record a specific behaviour from the predetermined set of behaviours, the user will record the corresponding bookmark type by inputting the corresponding user input pattern, herein referred to as performing a ‘bookmarking action’.
At step S202, in response to each user input, the processor 101 instructs the feedback module 104 to activate and provide feedback. Preferably, the instructions from the processor 102 are dependent on the user input data received by the processor 101 from the physical input interface 101, and therefore the feedback module 104 exhibits different feedback patterns dependent on the user input data received by the processor 102. For example, a haptic feedback motor in the feedback module 104 may activate in short bursts during short squeezes of the behaviour capture device 100, and provide a pulsing sensation during longer squeezes of the behaviour capture device 100. Similarly, an LED array in the feedback module 104 may activate in short bursts during short presses of the behaviour capture device 100, and provide a pulsing glow during longer squeezes of the behaviour capture device 100. Additionally, the haptic feedback motor may provide more powerful feedback corresponding to the amount of pressure exerted on the behaviour capture device 100 by the user, or the LED array may light up brighter corresponding to the amount of pressure exerted on the behaviour capture device 100 by the user. Additionally, the number of activated LEDs in the LED array may correspond to the amount of pressure exerted on the behaviour capture device 100 by the user such that a higher pressure or tighter squeeze corresponds to more activated LEDs. It should be noted that different patterns of feedback in response to user input are within the scope of the invention.
At step S203, the processor 102 determines whether the user has provided a recognisable pattern of user input, i.e., performed a bookmarking action, by analysing the input data received from the physical input interface 101. If a bookmarking action is detected, at step S204, the feedback module 104 provides a pattern of feedback that confirms to the user that a bookmark action has been detected. The pattern of feedback provided by the feedback module 104 when confirming the detection of a bookmark action to the user may be any predetermined pattern of haptic and/or light feedback. At step S205, the processor 102 instructs the memory module 103 to create a new bookmark record in the database that corresponds to the bookmark type.
At step S206, the processor 102 associates a time stamp with the new bookmark and stores it in the database in the memory module 103 in association with the new bookmark entry or record. The time stamp is indicative of the time and date on which the new bookmark was created.
At step S207, the processor 102 determines and associates an intensity with the new bookmark and stores it in the database in the memory module 103 in association with the new bookmark record. The intensity is indicative of the user's evaluation of the strength of the corresponding behaviour. The processor 102 analyses the input data received from the physical input interface 101 to determine the intensity. Preferably, the processor 102 determines the intensity based on the length of the long squeeze stage of the user input patterns described above, wherein a longer squeeze indicates a higher intensity. Alternatively, the processor 102 may determine the intensity based on other factors such as: the total amount of pressure applied during the bookmaking action; or the total length of time of the bookmarking action. In other embodiments this step may be skipped and no intensity data may be determined or recorded.
At step S208, the processor 102 updates a record in the database in the memory module 104 indicating the number of times that that bookmark type has been recorded.
Thus, at the end of the bookmarking process shown in
At step S211, the processor 102 stores the fidget to the memory module 103. Storing the fidget to the memory module 103 may include storing any captured pressure data as a function of time.
At step S212, the processor 102 updates a record in the database in the memory module 104 indicating the number of times that a fidget has been recorded as a non-bookmark record.
Thus, at the end of the fidget process shown in
Storing data indicative of the movement of the behaviour capture device 300 using the sensor module 306 allows for monitoring of the user's passive engagement with the behaviour capture device 300. An advantage of this is that such data can be used in combination with bookmark and fidget data to infer useful information about the user's usage of the behaviour capture device 300. For example, if there are long periods of time where the user has not actively recorded any bookmarks or fidgets, the sensor data may be used to determine whether the user has been moving or handling the device 300 in other ways. If so, it can be inferred that the user is using the device 300 but has not felt the need to record bookmarks and fidgets, as opposed to simply neglecting the device 300.
In an alternative embodiment, the sensor module 306 further comprises physiological sensors, which may include Galvanic Skin Response (GSR) sensors and pulse or heart rate sensors. Preferably, the physiological sensors also continuously provide sensor data to the processor 302. Preferably, the processor 302 stores the sensor data in the memory module 303 when the processor 302 detects that the physiological sensors are in use. When the processor 302 detects that the physiological sensors are in use, the processor 302 stores a GSR, pulse or heart rate reading in the memory module 303 with an associated time stamp.
The collection of physiological data of the user in the above alternative embodiment provides additional data to complement bookmark, fidget and movement sensor data. Particularly, physiological data can be used in combination with the bookmark and fidget data to infer useful information and verify trends. For example, patterns of stress indicated by GSR readings and pulse or heartbeat readings can be compared at the times a user records a bookmark associated with stress. Hence, such comparisons may allow the verification of certain behaviour capture and data patterns.
The purpose of the GNSS receiver 407 is to record additional location data when a user records a bookmark or a fidget. An example of this is shown in the flow chart in
Similarly, at step S514, the processor 402 sends a request to the GNSS receiver 407 to be provided with the location of the behaviour capture device 400. Once the GNSS receiver 407 has received the location data, the GNSS receiver 407 transmits the location data to the processor 402. The processor 402 then stores the location data in the database in the memory module 403 in association with the new fidget entry or record.
The GNSS receiver 407 and its functionality provides contextual information to complement bookmark and fidget data. The location data may be used to infer further insights in association with the recorded bookmarks and fidgets. For example, one may use the location data to associate links between a user's location and their behaviour recordal activities. Additionally, in a case that the user later inspects their recorded bookmarks and fidgets, having associated location data may be advantageous so that the user can more easily remember contextual information surrounding the behaviour recordal, such as the environment, who they were with, what they were doing, and why they felt that behaviour.
In an alternative embodiment, the processor 402 is arranged to continuously receive location data from the GNSS receiver 407 whilst the behaviour capture device 400 is powered on. Furthermore, the processor 402 is arranged to store all received location data to the memory module 403. Alternatively, the processor 402 only stores location data to the memory module 404 when the location changes by a significant amount, by a distance exceeding a predetermined threshold. This functionality of the present embodiment allows for the continuous tracking of the behaviour capture device 400 whilst it is powered on. Storing a continuous stream of location data would allow one to analyse a user's general engagement with the behaviour capture device 400. The continuous location data may also allow one to verify a user's usage of the behaviour capture device 400, during periods of fewer bookmark and fidget recordals. For example, it is expected that the user will interact less frequently with the behaviour capture device 400 whilst they are driving.
The mobile device 602 is arranged to allow data communication between the behaviour capture device 601 and the mobile device 602 after the completion of a pairing procedure. The mobile device 602 is configured to input, transmit, receive, process and display information. Furthermore, the mobile device 602 is host to a mobile application that allows the user to interact with the behaviour capture device 401 and behaviour capture data. The mobile device 602 also stores the behaviours that are associated with the available bookmark types.
A user can use the mobile device 602 to retrieve and store the behaviour capture data that has been collected using the behaviour capture device 601, the process for which is shown in
Once paired, in step 702, the behaviour capture device 601 transmits all new behaviour capture data to the mobile device 602. This includes the transmission of bookmark and fidget records in the database of the memory module 103, 303, 403 and their respective types, time-stamps and intensities. The transmitted data may also include the sensor data stored in the memory module 303, 403 collected using the sensor module 306, 406. Additionally, the transmitted data may also include location data in accordance with the third embodiment of the invention.
At step 703, the mobile device 602 receives the transmitted behaviour capture data. Upon receiving the transmitted behaviour capture data, the mobile device 602 associates a corresponding behaviour with each received bookmark based on predetermined bookmarks types (e.g., bookmark types 1 and 2). Furthermore, upon successfully receiving the information, the mobile device 602 sends a confirmation message to the behaviour capture device 601.
At step 704, the behaviour capture device 601 receives the confirmation message. Upon receiving the confirmation message, the processor 102 of the behaviour capture device 601 instructs the feedback module 104, 304, 404 to provide user feedback. Preferably, the feedback pattern exhibited by the feedback module 104, 304, 404 is a pattern that notifies the user. For example, a haptic feedback motor in the feedback module 104, 304, 404 may activate and exhibit a pattern of feedback that notifies the user of the confirmation. Alternatively, one or more LEDs in an LED array in the feedback module 104, 304, 404 may blink or light up to notify the user of the confirmation. It should be noted that feedback from the LEDs and haptic feedback motor may be exhibited at the same time. Furthermore, preferably, the behaviour capture device 601 automatically deletes all transmitted data from its own memory module 103, 303, 403 upon receiving the confirmation message from the mobile device 602, in order to make memory space available for subsequent behaviour, location and sensor data capture. Alternatively, the behaviour capture device 601 does not automatically delete the transmitted data in response to the confirmation message, and only deletes the data when instructed to by the mobile device 602 in a separate instruction. For example, the mobile application on the mobile device 602 may have a specific function to send an instruction to delete old data from the behaviour capture device 601. Alternatively, the behaviour capture device 601 may comprise a button or switch to delete old behaviour capture data.
At step 705, once the mobile device has stored the received behaviour capture data, the mobile device 602 associates the current location (where available) of the mobile device 602 with the received data using the mobile device's GNSS capabilities. However, the skilled person will appreciate that this step can be omitted if the behaviour capture device 601 is in accordance with the third embodiment of the invention shown in
After the operation in
Alternatively, the user may disconnect the behaviour capture device 601 from the mobile device 602. In this case, the user may continue to record bookmarks, fidgets and other data on the behaviour capture device 601, and transfer the data at a later time to the mobile device 602 as described in
Storing behaviour data on the mobile device 602 has the advantage of making the data more accessible through the mobile device's extended network capabilities and more accessible user interface. Furthermore, storing the behaviour data on the mobile device 602 provides the user with a backup of the data as a security measure, where the data can be further replicated and backed up by transferring it from the mobile device 602 to a server or other computer storage media. Additionally, the mobile device 602 may have more processing power than the behaviour capture device 601 and therefore allow for more intensive processing of the behaviour capture data.
A user can also use the mobile device 602 to view, annotate and analyse the behaviour capture data using a mobile application that is hosted on the mobile device 602, providing that such data has been transferred to the mobile device 602 through the process in
View 802 shows how a bookmark can be annotated with contextual information. The view 802 displays the behaviour related to the bookmark, the address and map location associated with the bookmark, and an option to edit the intensity of the bookmark. Although the intensity of a bookmark is determined at the time of recordal using the behaviour capture device 601, the option to edit the intensity is provided for the user to edit it in retrospect. The user is able to annotate the bookmark with text. Annotations provided by the user preferably include contextual information concerning: where the user was, what the user was doing and who the user was with at the time of recording the bookmark; as well as why the user believes he felt the need to record the bookmark. Annotations may also include any other information that the user feels is relevant to the context of the bookmark. Alternatively, annotations may also be provided by the user in the form of images and ‘stickers’, or a selection of images, phrases and number ratings from a limited range of options. Annotations may also include audio clips uploaded to the behaviour capture device or the mobile device. By annotating bookmarks with contextual information, the user is able to reflect upon and determine the reasons or causes surrounding their behaviour. Hence, the user can use this as feedback to work towards their behaviour change targets. The mobile application may also include avatars to assist in the behavioural understanding and learning process for children, which in turn may be linked to the sending of messages or haptic feedback.
View 803 shows a page where a user can change the behaviour that is associated with a bookmark type. For example, the user can change the behaviour that is associated with bookmark type 1 if s/he decides to track a different behaviour using the behaviour capture device 601. After assigning a new behaviour to bookmark type 1 using the mobile device 602, every new bookmark of type 1 that is received by the mobile device 602 and was recorded on the behaviour capture device 601 after the new behaviour assignment will be stored in association with the new behaviour. All previous bookmarks of type 1 that were recorded before the new behaviour assignment will remain in association with the behaviour that was previously associated with bookmark type 1.
The ability to customise the behaviour associated with bookmark types provides the user with flexibility as to how they use the behaviour capture system 600 for their own personal targets. For example, a behaviour that a user chooses to associate with a bookmark type may be a particular behaviour, thought, feeling, action, or other information related to the user's psychological and physical state. In one example, a user may use the behaviour capture system 600 to track and manage stress. This could be achieved by associating feelings of stress with bookmark type 1. The user may track feelings of stress using bookmark type 1 alone, or use bookmark type 2 in combination with bookmark type 1 depending on the user's stress management targets. For example, the user may associate events of stress externalisation with bookmark type 2 to track when the user acts upon his feelings of stress. Alternatively, the user may associate instances of positive stress management with bookmark type 2, to track when the user successfully manages and overcomes feelings of stress in a positive way. In either case, the user is able to track feelings of stress, the context surrounding these feelings through annotations, and other information such as location and sensor data to work towards his/her behaviour change target.
In another example, a user may use the behaviour capture system 600 to track and manage a treatment plan for pain management, including physiotherapy and cognitive therapy. A user may associate feelings of pain with bookmark type 1, and the action of doing cognitive therapy homework with bookmark type 2. Alternatively the user may associate instances of positive pain management with bookmark type 2, such as breathing exercises or other predetermined activities. Such tracking can help the user to analyse the effectiveness of their treatment plan for pain management or other actions. Such data can also be used by professionals to assist in pain management to achieve maximum effectiveness and efficiency by considering patterns in the tracking data.
In another example, a child may use the behaviour capture system 600 for social and emotional learning to help them better understand how their behaviours are connected to their emotions. A child user may associate feelings of anger with bookmark 1, and the action of doing cognitive homework to counter the anger with bookmark 2. Such tracking can help the child user to learn about their feelings of anger and associated behaviours and how to manage those feelings and change their challenging behaviour.
In another example, a child may use the behaviour capture system 600 to help them manage ADHD or help adults in detecting behavioural challenges. A child user may associate bookmark type 1 with feeling distracted, needing to move around or take a break from concentrating. A child user may associate a bookmark type 2 with actions of doing homework to manage their attention to stay on task. Such tracking can help the child user and supervising adults to analyse the situations and patterns that precipitate the inattentive behaviour or other ADHD symptoms and plan a strategy for managing these. Such data can also be used by the adults to determine the effectiveness of any behaviour strategies which have been implemented.
In another example, a user may use the behaviour capture system 600 to track and manage smoking cessation. A user may first associate the feeling of cravings with bookmark type 1 to assess patterns in the user's cravings, and associate bookmark type 2 with stress management techniques, such as exercise. Alternatively the user may associated bookmark type 2 with cigarette smoking. The user may use this data to alter their daily routine and/or adjust nicotine substitutes to achieve maximum benefit and efficiency for tackling smoking addiction. It should be appreciated that such use of the behaviour capture system 600 may be extended to any other form of addiction and withdrawal symptoms. In any case, the behaviour capture system 600 allows the user to work towards their behaviour change target.
Furthermore, if there are at least two bookmark types available, i.e., types 1 and 2, the user may associate behaviours in an opposite way. For example, the user may associate feelings of anxiety with type 1 and confidence with type 2 in order to track these opposite psychological states. In this case, the user may spot patterns in these states by considering their times, locations, and contextual annotations surrounding it. Alternatively, the user may associate behaviours in an additive way. For example, the user may associate feelings of anxiety with type 1, and feelings of deeper anxiety with type 2. In this case, the user is able to more easily separate different causes of the behaviours and their effect at a more separate or granular scale.
The mobile application on the mobile device 602 is able to process all behaviour capture data and annotations to perform analytics and machine learning. This may include, for example, scanning bookmark annotations for keyword analysis; and analysing bookmark, fidget, location and sensor data to recognise patterns and trends in behaviour and usage of the behaviour capture device 601. Hence, based on the performed analytics and machine learning, the mobile application is able to provide the user with notifications, warnings, customised goals, wellbeing messages or any other personalised user content.
Furthermore, the mobile application is able to display bookmark, fidget, location, sensor and usage data in various graphical forms. It is also able to perform other functions such as sending messages and uploading files. Additionally, whilst the mobile device 602 is paired or bonded to the mobile device 601, the mobile application is able to: display the battery level of the behaviour capture device 601; and view and change the operating modes of the behaviour capture device 601. This includes, for example, the enabling and disabling of airplane mode, sleep mode, on/off mode and battery mode.
The behaviour capture system 900 includes a server 903. The server 903 is arranged to be in data communication with the mobile device 902 of each subsystem. Preferably, the server 903 and mobile devices 902 communicate over a wireless network, such as Wi-Fi (®), cellular network, or any other suitable means of wireless communication. The server 903 is arranged to store and process data received from the mobile devices 902. Data received by the server 903 includes all bookmark data, fidget data, sensor data, location data, and all associated data such as annotations, locations, time-stamps and intensities. The server 903 is also arranged to receive and store a complete backup of personal user information, behaviour change targets, behaviour assignments to bookmark types, personalised content and other data from the mobile application on each mobile device 902. Preferably, the server 903 receives data from the mobile devices 902 instantaneously, provided that there is a working connection between the server 903 and mobile devices 902.
In an alternative embodiment, the server 903 is configured to perform machine learning and analytics on the data received from the mobile devices 902, rather than the mobile devices 902 as previously described. This includes: scanning bookmark annotations for keyword analysis; and analysing bookmark, fidget, location and sensor data to recognise patterns and trends in behaviour and usage of the behaviour capture devices 902. Hence, based on the performed analytics and machine learning, the server 903 is able to transmit notifications, warnings, customised goals, wellbeing messages or any other personalised content to the user via the mobile device 902. Performing machine learning and analytics on the server 903 may be advantageous if the server 903 has a larger capacity for processing, at least relative to the mobile devices 902. Hence, performing machine learning and analytics on the server 903 may be a more efficient delegation of processing load, and consequently may help reduce processing load on the mobile devices 902. This may result in longer battery life and general longevity of the mobile devices 902 and their components.
In another alternative embodiment, the server 903 is arranged to be in data communication with external service providers. Preferably, the server 903 receives information from an external service provider over a wireless network. Preferably, the external service providers are service providers that the user receives services from, wherein the services relate to the gathering of physical or psychological data with respect to the user. The server 903 can therefore use information from a user's external service provider account in combination with a user's behaviour capture data when providing insights and personalised content through analytics and machine learning as described above.
The behaviour capture system 900 comprises at least one user terminal 904. The user terminal 904 is arranged to be in data communication with the server 903. Preferably, the user terminal 904 is in communication with the server 903 over a wireless network. Alternatively, the user terminal 904 may be in communication with the server 903 over a wired network. A user can use the user terminal 904 to access their personal behaviour capture data from the server 903. Preferably, the user accesses their personal behaviour capture data by logging into a web application or a software application. The user may log in to the user terminal 904 and access all of their behaviour capture data in graphical form or otherwise. Additionally, the user may access other personalised user content such as notifications, behaviour change targets and warnings. The user may use the user terminal 904 to perform some functions performed also by the mobile device 902, such as providing annotations to bookmarks, editing bookmarks and changing personal settings. The user terminal 904 therefore provides an alternative way for a user to access and interact with their behaviour capture data. This may be advantageous in certain circumstances, for example if the user's mobile device 902 is misplaced, malfunctioning, has run out of battery or if the user does not have a mobile device 902. Otherwise, the user terminal 904 also allows a user to access their behaviour capture data on a device that has more processing power for visual graphics and rendering, a more convenient keyboard, and more storage capacity for creating a local backup of their behaviour capture data.
The behaviour capture system 900 may also comprise at least one advocate terminal 905. In this context the advocate may be a therapist, counsellor, carer, family member etc. The advocate terminal 905 is arranged to be in data communication with the server 903 over a wired or wireless network. The advocate terminal 905 may be used by a behaviour change professional, or therapist, to access, upon authorisation, an individual's personal behaviour capture data. Preferably, the advocate's access to users' personal behaviour capture data is overseen by a system administrator, such that the advocate only has access to the data of their specific authorizing users. The advocate may use the advocate terminal 905 to visualise all of a user's behaviour capture data, such as bookmark, fidget, sensor and location data as well as all associated time-stamps, intensities and locations in graphical or raw data format. Alternatively, the advocate's access may be limited by an administrator of the behaviour capture system 900 to only access certain parts of a user's personal behaviour capture information. For example, the advocate may not be able to see a certain user's location data if not authorised to be an administrator. The advocate may use the advocate terminal 905 to provide professional comments and feedback to users of the behaviour capture system 900. Hence, the advocate may oversee and aid in a user's progression through their behaviour change programs, and develop further insights to better help a user meet their behaviour change targets.
The behaviour capture system 900 also comprises at least one administrator terminal 906. The administrator terminal 906 is arranged to be in data communication with the server 903 over a wired or wireless network. A system administrator may use the administrator terminal 906 to perform administrative tasks within the behaviour capture system 900. For example, an administrator may use the administrator terminal 906 to: manage user licences and subscriptions to the system; deploy system-wide updates; manage security of the system; grant or limit access to certain features or data to users and advocates, such as ensuring a user of a user terminal 904 may only access their own personal data and ensuring an advocate may only access their authorising users' data; send specific user or system wide messages; and generally provide system oversight and management.
The server 1003 is arranged to be in data communication with the behaviour capture devices 1001 over a wireless network as described above. The server 1003 is arranged to store and process data received from the behaviour capture devices 1001. Data received by the server 1003 from the behaviour capture devices 1001 includes all behaviour capture data and system data as previously described. The server 1003 is also arranged to receive and store a complete backup of all behaviour capture data received from the behaviour capture devices 1001.
In this arrangement of the behaviour capture system 1000, since the behaviour capture device 1001 is no longer in direct communication with a mobile device 1002, the user is unable to transmit behaviour capture data directly from a behaviour capture device 1000 to the mobile device 1002 as described in
At step 1102, the behaviour capture device 1001 transmits all new behaviour capture data to the server 1003. This includes the transmission of bookmark and fidget records in the database of the memory module 403, and their respective types, time-stamps, intensities and locations. The transmitted data also includes sensor data stored in the memory module 403. Additionally, the transmitted data also includes location data collected by the behaviour capture device 1001 over time.
At step 1103, the server 1003 receives the transmitted behaviour capture data. Furthermore, upon successfully receiving the behaviour capture data, the server 1003 sends a confirmation message to the behaviour capture device 1001.
At step 1104, the behaviour capture device 1001 receives the confirmation message. Upon receiving the confirmation message, the processor 402 of the behaviour capture device 1001 instructs the feedback module 404 to provide user feedback. Preferably, the feedback pattern exhibited by the feedback module 404 is a pattern that notifies the confirmation to the user. For example, a haptic feedback motor in the feedback module 404 may activate and exhibit a pattern of feedback that notifies the user of confirmation or provides other type of feedback. Alternatively, one or more LEDs in an LED array in the feedback module 404 may blink or light up to notify the user of the feedback or confirmation. It should be noted that the LEDs and haptic feedback motor may exhibit feedback at the same time. Furthermore, preferably, the behaviour capture device 1001 automatically deletes all transmitted data from its memory module 403 upon receiving the confirmation message from the server 1003, in order to make memory space available for subsequent new data entries or records. Alternatively, the behaviour capture device 1001 does not automatically delete the transmitted data in response to the confirmation message, and only deletes the data when instructed to by the server 1003 in a separate instruction.
The user may use the behaviour capture device 1001 for behaviour capture whilst maintaining its connection with the server 1003. In this case, all new behaviour data captured using the behaviour capture device 1001 will be instantly transmitted to the server 1003. Alternatively, the user may disconnect the behaviour capture device 1001 from the server 1003 and continue to use the behaviour capture device 1001 “offline”. In this case, all new behaviour capture data will be maintained on the behaviour capture device 1001 and may be transmitted to the server 1003 at a later time through the process described in
The server 1003 is also arranged to be in data communication with the mobile devices 1002, similarly to the previous arrangement of the behaviour capture system in
The mobile devices 1002 otherwise have similar features and associated advantages to the mobile devices described in previous system arrangements. This includes: annotating bookmarks; viewing, analysing and editing the behaviour capture data; changing the behaviours associated with bookmark types; sending all mobile application data to the server to store as a complete backup (e.g., changes to the behaviour capture data, annotations, behaviour assignments to bookmark types and personal information); displaying system information about the behaviour capture device such as battery level and operating mode; issuing notifications, warnings and messages; changing the operating mode of the behaviour capture device; and performing analytics and machine learning for the generation of insights and personalised content. In an alternative embodiment, the server 1003 may perform machine learning and analytics as previously described. Additionally, in the arrangement in
The behaviour capture system 1000 comprises a user terminal 1004, therapist terminal 1005 and an administrator terminal 1006, the features of which are the same as the features of the corresponding terminals in
The arrangement of the behaviour capture system in
In an alternative embodiment, the behaviour capture device 1001 and mobile device 1002 are also arranged to be in direct communication as described in previous arrangements of the behaviour capture system. Hence, in this alternative embodiment, the user of the behaviour capture device 1001 has the option to communicate and transmit data directly to the server 1003, or to the mobile device 1002.
The following variations of the above embodiments and arrangements will be envisioned within the scope of the invention.
In one variation, the behaviour capture device comprises additional buttons, sensors and switches. Preferably, the additional buttons, sensors and switches are functional to change the operating modes of the device. In a further embodiment, the additional buttons, sensors and switches may additionally or alternatively be functional to record additional types of bookmarks. For example, different types of bookmarks may be recordable using the behaviour capture device by considering the input received from the pressure pad, in combination with different buttons, sensors and switches or with the behaviour capture device.
In another variation, the processor of the behaviour capture device is configured to detect patterns in the sensing data received from the sensor module, such that certain movement patterns of the behaviour capture device are detectable. Preferably, the processor performs functions in response to detecting different movement patterns, such as changing the operating modes of the device. Furthermore, the processor may also use the detectable movement patterns to initiate different types of bookmarks, hence increasing the number of bookmarks detectable by the behaviour capture device.
In another variation, the behaviour capture device further comprises a microphone. Preferably, the microphone is arranged to capture voice. Hence, in this variation, the user may control aspects of the behaviour capture device's functionality using their voice. This may include, for example, recording bookmarks, changing operating modes and initiating data transfers.
In another variation, the user may use peripheral devices in combination with the behaviour capture device. Preferably, the peripheral devices communicate with the behaviour capture device. Alternatively, the peripheral devices may connect to and communicate directly with the mobile device. The peripheral devices are arranged to collect additional data for the purpose of behaviour capture, but external to the behaviour capture device. This may include, for example: a peripheral microphone for capturing voice commands; a ring, wristband, pendant or bracelet for capturing pulse, heartbeat and GSR data; or a pedometer for capturing the number of steps taken by a user. It should be appreciated that in the case that peripheral devices are used to capture physiological data such as pulse, heartbeat and GSR data, the sensor module in the behaviour capture device may not comprise these sensors and instead receive sensing data from these sensors.
In another variation, the mobile application on the mobile device is configured to perform voice recognition. Preferably, the voice recognition is used to navigate the application or provide user annotations to bookmarks.
Claims
1. A handheld or wearable behaviour capture device comprising:
- a physical input interface configured to receive input from a user related to the user's behaviour, and to generate user input data;
- a processor configured to: receive the user input data; determine if the user input data corresponds to a plurality of predetermined identifiers; and generate feedback data; and
- a feedback module configured to receive the feedback data from the processor and to provide feedback to the user.
2. A device as claimed in claim 1 and further comprising memory, wherein the processor is further configured to store a bookmark record in the memory in response to determining that the user input data corresponds to one of the predetermined identifiers.
3. A device as claimed in claim 1, wherein the processor is further configured to store a non-bookmark record in the memory in response to determining that the user input data does not correspond to one of the predetermined identifiers.
4. A device as claimed in claim 2, wherein the record includes the predetermined identifier and one or more of a time, a duration, an amount of pressure and a location of the user input.
5. A device as claimed in claim 1, wherein the predetermined identifier is a pattern corresponding to a plurality of distinct user inputs of predetermined duration.
6. A device as claimed in claim 1, wherein the feedback module comprises one or more of a haptic feedback motor, a display and illumination means.
7. A device as claimed in claim 1, wherein the physical input interface is chosen from one or more of a force sensor, a pressure sensor, a push button and a switch configured to detect one or both of a force or a pressure applied to the physical input interface.
8. A device as claimed in claim 1, further comprising sensing means configured to generate sensing data indicative of the orientation and acceleration forces applied to the behaviour capture device.
9. A device as claimed in claim 1, further comprising a GNSS receiver.
10. A device as claimed in claim 1, further comprising a transceiver.
11. A handheld or wearable behaviour capture device comprising:
- a resiliently deformable input interface for generating user input data;
- a processor configured to: receive the user input data from the input interface; generate feedback data; and
- a feedback module configured to receive the feedback data from the processor and to provide feedback to the user.
12. A device as claimed in claim 11 and further comprising memory, wherein the processor stores a bookmark record in the memory in response to determining that the user input data corresponds to a predetermined identifier.
13. A device as claimed in claim 11, wherein the processor is further configured to store a non-bookmark record in the memory in response to determining that the user input data does not correspond to a predetermined identifier.
14. A device as claimed in claim 12, wherein the record includes one or more of an amount of pressure, time, duration, intensity and location of the user input.
15. A device as claimed in claim 11, wherein the predetermined identifier corresponds to a plurality of distinct user inputs of predetermined duration.
16. A device as claimed in claim 11, wherein the feedback module comprises one or more of a haptic feedback motor, a display and illumination means.
17. A device as claimed in claims 11, wherein the input interface is chosen from one or more of a force sensor, a pressure sensor, a push button and a switch configured to detect one or both of a force or a pressure applied to the input interface.
18. (canceled)
19. (canceled)
20. (canceled)
21. (canceled)
22. (canceled)
23. A method for behaviour capture comprising:
- providing a behaviour capture device that comprises a physical input interface configured to receive input from a user related to the user's behaviour, and to generate user input data; a processor configured to: receive the user input data; determine if the user input data corresponds to a plurality of predetermined indentifers; and generate feedback data; an a feedback module configured to receive the feedback data from the processor and to provide feedback to the user;
- receiving at the input interface an input from a user related to the user's behaviour and generating user input data;
- receiving the user input data at the processor;
- determining at the processor if the user input data corresponds to one of a plurality of predetermined identifiers;
- generating at the processor feedback data;
- providing the feedback data to the feedback module; and
- the feedback module providing feedback to the user.
Type: Application
Filed: Oct 31, 2018
Publication Date: Sep 10, 2020
Applicant: OLITOOL LTD (London)
Inventors: Elizabeth Ann ERICKSON (London), Deborah WERBNER (London), Lawrence ARCHARD (Lidlington), Kyoko MURAKAMI (Copenhagen)
Application Number: 16/761,274