USER FEEDBACK SYSTEM AND METHOD
A user feedback system for a user of a delivery device within a delivery ecosystem includes an obtaining processor adapted to obtain two or more user factors indicative of a state of the user, wherein a first obtained user factor is based upon at least a first aspect of the user’s operation of the delivery device and wherein a second obtained user factor is based upon at least a second aspect of the user’s situation separate to their operation of the delivery device, which occurs during one or more selected from the list consisting of a predetermined period preceding the user’s operation of the delivery device, and a predetermined period following the user’s operation of the delivery device; and an estimation processor adapted to identify a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second user factors.
The present application is a National Phase entry of PCT Application No. PCT/GB2021/051579, filed Jun. 22, 2021, which claims priority from Great Britain Application No. 2009486.8, filed Jun. 22, 2020, each of which is hereby fully incorporated herein by reference.
TECHNICAL FIELDThe present disclosure relates to a user feedback system and method for a user of a delivery device.
BACKGROUNDThe “background” description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this background section, as well as aspects of the description which may not otherwise qualify as prior art at the time of filing, are neither expressly or impliedly admitted as prior art against the present disclosure.
Aerosol provision systems are popular with users as they enable the delivery of active ingredients (such as nicotine) to the user in a convenient manner and on demand.
As an example of an aerosol provision system, electronic cigarettes (e-cigarettes) generally contain a reservoir of a source liquid containing a formulation, typically including nicotine, from which an aerosol is generated, e.g. through heat vaporisation. An aerosol source for an aerosol provision system may thus comprise a heater having a heating element arranged to receive source liquid from the reservoir, for example through wicking / capillary action. Other source materials may be similarly heated to create an aerosol, such as botanical matter, or a gel comprising an active ingredient and/or flavouring. Hence more generally, the e-cigarette may be thought of as comprising or receiving a payload for heat vaporisation.
While a user inhales on the device, electrical power is supplied to the heating element to vaporise the aerosol source (a portion of the payload) in the vicinity of the heating element, to generate an aerosol for inhalation by the user. Such devices are usually provided with one or more air inlet holes located away from a mouthpiece end of the system. When a user sucks on a mouthpiece connected to the mouthpiece end of the system, air is drawn in through the inlet holes and past the aerosol source. There is a flow path connecting between the aerosol source and an opening in the mouthpiece so that air drawn past the aerosol source continues along the flow path to the mouthpiece opening, carrying some of the aerosol from the aerosol source with it. The aerosol-carrying air exits the aerosol provision system through the mouthpiece opening for inhalation by the user.
Usually an electric current is supplied to the heater when a user is drawing/ puffing on the device. Typically, the electric current is supplied to the heater, e.g. resistance heating element, in response to either the activation of an airflow sensor along the flow path as the user inhales/draw/puffs or in response to the activation of a button by the user. The heat generated by the heating element is used to vaporise a formulation. The released vapour mixes with air drawn through the device by the puffing consumer and forms an aerosol. Alternatively or in addition, the heating element is used to heat but typically not burn a botanical such as tobacco, to release active ingredients thereof as a vapour / aerosol.
How the user interacts with the e-cigarette (for example the amount of vaporised / aerosolised payload consumed by the user, and/or their pattern of use), and their actual or perceived utility from the interaction, may be influenced by the user’s state, which at least in part may be expressed colloquially as their mood(s) and/or subjective need(s).
Consequently it would be useful to provide a delivery mechanism that was more responsive to the user’s state.
BRIEF SUMMARYIn a first aspect, A user feedback system for a user of a delivery device within a delivery ecosystem, comprising: an obtaining processor adapted to obtain two or more user factors indicative of a state of the user, wherein a first obtained user factor of the two or more user factors is based upon an aspect of the user’s operation of the delivery device; and wherein a second obtained user factor of the two or more user factors is based upon an aspect of the user’s situation separate from the user’s operation of the delivery device, the aspect of the user’s situation occurring during one or more selected from the list consisting of: i. a predetermined period preceding the user’s operation of the delivery device, ii. a predetermined period following the user’s operation of the delivery device, and iii. a period during the user’s operation of the delivery device; and an estimation processor adapted to identify a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second obtained user factors.
In another aspect, a user feedback method for a user of a delivery device within a delivery ecosystem comprising comprises: obtaining two or more user factors indicative of a state of the user, wherein a first obtained user factor of the two or more user factors is based upon an aspect of the user’s operation of the delivery device; and wherein a second obtained user factor of the two or more user factors is based upon an aspect of the user’s situation separate from the user’s operation of the delivery device, the aspect of the user’s situation occurring during one or more selected from the list consisting of: i. a predetermined period preceding the user’s operation of the delivery device, ii. a predetermined period following the user’s operation of the delivery device, and iii. a period during the user’s operation of the delivery device; and of identifying a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second obtained user factors.
Further respective aspects and features of the invention are defined in the appended claims.
It is to be understood that both the foregoing general summary of the disclosure and the following detailed description are indicative, but are not restrictive, of the disclosure.
A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
-
-
-
-
-
-
-
A user feedback system and method is disclosed. In the following description, a number of specific details are presented in order to provide a thorough understanding of the embodiments of the present disclosure. It will be apparent, however, to a person skilled in the art that these specific details need not be employed to practice embodiments of the present disclosure. Conversely, specific details known to the person skilled in the art are omitted for the purposes of clarity where appropriate.
As described above, the present disclosure relates to a user feedback system. This user feedback system is for improving the responsiveness of a delivery device for a user.
The term ‘delivery device’ may encompass systems that deliver a least one substance to a user, and include non-combustible aerosol provision systems that release compounds from an aerosol-generating material without combusting the aerosol-generating material, such as electronic cigarettes, tobacco heating products, and hybrid systems to generate aerosol using a combination of aerosol-generating materials; and aerosol-free delivery systems that deliver the at least one substance to a user orally, nasally, transdermally or in another way without forming an aerosol, including but not limited to, lozenges, gums, patches, articles comprising inhalable powders, and oral products such as oral tobacco which includes snus or moist snuff, wherein the at least one substance may or may not comprise nicotine.
The substance to be delivered may be an aerosol-generating material or a material that is not intended to be aerosolised. As appropriate, either material may comprise one or more active constituents, one or more flavours, one or more aerosol-former materials, and/or one or more other functional materials.
Currently, the most common example of such a delivery device is an aerosol provision system (e.g. a non-combustible aerosol provision system) or electronic vapour provision system (EVPS), such as an e-cigarette. Throughout the following description the term “e-cigarette” is sometimes used but this term may be used interchangeably with delivery device except where stated otherwise or where context indicates otherwise. Similarly the terms ‘vapour’ and ‘aerosol’ are referred to equivalently herein.
Generally, the electronic vapour / aerosol provision system may be an electronic cigarette, also known as a vaping device or electronic nicotine delivery device (END), although it is noted that the presence of nicotine in the aerosol-generating (e.g. aerosolisable) material is not a requirement. In some embodiments, a non-combustible aerosol provision system is a tobacco heating system, also known as a heat-not-burn system. An example of such a system is a tobacco heating system. In some embodiments, the non-combustible aerosol provision system is a hybrid system to generate aerosol using a combination of aerosol-generating materials, one or a plurality of which may be heated. Each of the aerosol-generating materials may be, for example, in the form of a solid, liquid or gel and may or may not contain nicotine. In some embodiments, the hybrid system comprises a liquid or gel aerosol-generating material and a solid aerosol-generating material. The solid aerosol-generating material may comprise, for example, tobacco or a non-tobacco product. Meanwhile in some embodiments, the non-combustible aerosol provision system generates a vapour / aerosol from one or more such aerosol-generating materials.
Typically, the non-combustible aerosol provision system may comprise a non-combustible aerosol provision device and an article (otherwise referred to as a consumable) for use with the non-combustible aerosol provision system. However, it is envisaged that articles which themselves comprise a means for powering an aerosol generating component (e.g. an aerosol generator such as a heater, vibrating mesh or the like) may themselves form the non-combustible aerosol provision system. In one embodiment, the non-combustible aerosol provision device may comprise a power source and a controller. The power source may be an electric power source or an exothermic power source. In one embodiment, the exothermic power source comprises a carbon substrate which may be energised so as to distribute power in the form of heat to an aerosolisable material or heat transfer material in proximity to the exothermic power source. In one embodiment, the power source, such as an exothermic power source, is provided in the article so as to form the non-combustible aerosol provision. In one embodiment, the article for use with the non-combustible aerosol provision device may comprise an aerosolisable material.
In some embodiments, the aerosol generating component is a heater capable of interacting with the aerosolisable material so as to release one or more volatiles from the aerosolisable material to form an aerosol. In one embodiment, the aerosol generating component is capable of generating an aerosol from the aerosolisable material without heating. For example, the aerosol generating component may be capable of generating an aerosol from the aerosolisable material without applying heat thereto, for example via one or more of vibrational, mechanical, pressurisation or electrostatic means.
In some embodiments, the aerosolisable material may comprise an active material, an aerosol forming material and optionally one or more functional materials. The active material may comprise nicotine (optionally contained in tobacco or a tobacco derivative) or one or more other non-olfactory physiologically active materials. A non-olfactory physiologically active material is a material which is included in the aerosolisable material in order to achieve a physiological response other than olfactory perception. The aerosol forming material may comprise one or more of glycerine, glycerol, propylene glycol, diethylene glycol, triethylene glycol, tetraethylene glycol, 1,3-butylene glycol, erythritol, meso-Erythritol, ethyl vanillate, ethyl laurate, a diethyl suberate, triethyl citrate, triacetin, a diacetin mixture, benzyl benzoate, benzyl phenyl acetate, tributyrin, lauryl acetate, lauric acid, myristic acid, and propylene carbonate. The one or more functional materials may comprise one or more of flavours, carriers, pH regulators, stabilizers, and/or antioxidants.
In some embodiments, the article for use with the non-combustible aerosol provision device may comprise aerosolisable material or an area for receiving aerosolisable material. In one embodiment, the article for use with the non-combustible aerosol provision device may comprise a mouthpiece. The area for receiving aerosolisable material may be a storage area for storing aerosolisable material. For example, the storage area may be a reservoir. In one embodiment, the area for receiving aerosolisable material may be separate from, or combined with, an aerosol generating area.
Alternatively or in addition to aerosol provision systems, a delivery device may include any device that causes/enables the introduction of an active ingredient into the body of the user in a manner that allows the active ingredient to take effect.
Example delivery devices may thus for example include a device that disperses an aerosol into a receptacle, after which a user may take the receptacle from the device and inhale or sip the aerosol. Hence the delivery device does not necessarily have to be directly engaged with by the user at the point of consumption.
In this regard, a delivery device may alternatively or in addition provide a reminder or usage regime for a user, for example reminding a user when to use a snus pouch, or other active deliverable such as a pill. The delivery device may optionally store and dispense such consumables according to the reminder or usage regime.
Similarly, an example delivery device may be a home refill station, which mixes e-liquid components for the user and uses the mix to fill a reservoir of their e-cigarette, thereby determining the type, blend, and/or concentration of active ingredients that the user will consume, all else being equal. Such a home refill station may be referred to as a ‘dock’, as may a power recharging station, or a device that combines both functions.
In this regard, a delivery device operating as a vending machine may similarly provide consumable refills or disposable devices based on mixes and/or selections of e-liquid components, either mixed on demand or equivalently selected from a range of pre-prepared mixes. Similarly, in other implementations, the vending machine may dispense oral products (such as for example snus, snuff, gums, gels, sprays, and other delivery systems such as patches) or other consumable products containing active ingredients and/or flavourants, for example.
In each case, the delivery device is operable to influence one or more of the amount, timing, type, blend, and/or concentration of active ingredient consumed by the user.
Hence more generally a delivery device is operable to influence a property of an active ingredient consumed by a user.
It will be appreciated that several delivery devices may operate in tandem to provide this influence. For example a home refill station, or a vending machine, may operate in conjunction with an e-cigarette to actually deliver a modification of active ingredient, or other feedback, to a user. Similarly a mobile phone may operate in parallel with an e-cigarette to provide information or analysis relevant to the modification or other feedback.
In this sense a delivery device may actually be a delivery system comprising multiple devices operating sequentially and/or in parallel to affect the desired influence / feedback. Hence references to a delivery device or delivery system herein may be considered interchangeable except where stated otherwise.
Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views,
The e-cigarette has a generally cylindrical shape, extending along a longitudinal axis indicated by dashed line LA, and comprises two main components, namely a body 20 and a cartomiser 30. The cartomiser includes an internal chamber containing a reservoir of a payload such as for example a liquid comprising nicotine, a vaporiser (such as a heater), and a mouthpiece 35. References to ‘nicotine’ hereafter will be understood to be merely an example and may be substituted with any suitable active ingredient. References to ‘liquid’ as a payload hereafter will be understood to be merely an example and may be substituted with any suitable payload such as botanical matter (for example tobacco that is to be heated rather than burned), or a gel comprising an active ingredient and/or flavouring. The reservoir may be a foam matrix or any other structure for retaining the liquid until such time that it is required to be delivered to the vaporiser. In the case of a liquid / flowing payload, the vaporiser is for vaporising the liquid, and the cartomiser 30 may further include a wick or similar facility to transport a small amount of liquid from the reservoir to a vaporising location on or adjacent the vaporiser. In the following, a heater is used as a specific example of a vaporiser. However, it will be appreciated that other forms of vaporiser (for example, those which utilise ultrasonic waves) could also be used and it will also be appreciated that the type of vaporiser used may also depend on the type of payload to be vaporised.
The body 20 includes a re-chargeable cell or battery to provide power to the e-cigarette 10 and a circuit board for generally controlling the e-cigarette. When the heater receives power from the battery, as controlled by the circuit board, the heater vaporises the liquid and this vapour is then inhaled by a user through the mouthpiece 35. In some specific embodiments the body is further provided with a manual activation device 265, e.g. a button, switch, or touch sensor located on the outside of the body.
The body 20 and cartomiser 30 may be detachable from one another by separating in a direction parallel to the longitudinal axis LA, as shown in
The e-cigarette 10 is provided with one or more holes (not shown in
It will be appreciated that the e-cigarette 10 shown in
The body 20 includes a battery or cell 210 for powering the e-cigarette 10 in response to a user activation of the device. Additionally, the body 20 includes a control unit (not shown in
The body 20 further includes a cap 225 to seal and protect the far (distal) end of the e-cigarette 10. In many embodiments there is an air inlet hole provided in or adjacent to the cap 225 to allow air to enter the body 20 when a user inhales on the mouthpiece 35. The control unit or ASIC may be positioned alongside or at one end of the battery 210. In some embodiments, the ASIC is attached to a sensor unit 215 to detect an inhalation on mouthpiece 35 (or alternatively the sensor unit 215 may be provided on the ASIC itself). An air path is provided from the air inlet through the e-cigarette, past the airflow sensor 215 and the heater (in the vaporiser or cartomiser 30), to the mouthpiece 35. Thus when a user inhales on the mouthpiece of the e-cigarette, the CPU detects such inhalation based on information from the airflow sensor 215.
At the opposite end of the body 20 from the cap 225 is the connector 25B for joining the body 20 to the cartomiser 30. The connector 25B provides mechanical and electrical connectivity between the body 20 and the cartomiser 30. The connector 25B includes a body connector 240, which is metallic (silver-plated in some embodiments) to serve as one terminal for electrical connection (positive or negative) to the cartomiser 30. The connector 25B further includes an electrical contact 250 to provide a second terminal for electrical connection to the cartomiser 30 of opposite polarity to the first terminal, namely body connector 240. The electrical contact 250 is mounted on a coil spring 255. When the body 20 is attached to the cartomiser 30, the connector 25A on the cartomiser 30 pushes against the electrical contact 250 in such a manner as to compress the coil spring in an axial direction, i.e. in a direction parallel to (co-aligned with) the longitudinal axis LA. In view of the resilient nature of the spring 255, this compression biases the spring 255 to expand, which has the effect of pushing the electrical contact 250 firmly against connector 25A of the cartomiser 30, thereby helping to ensure good electrical connectivity between the body 20 and the cartomiser 30. The body connector 240 and the electrical contact 250 are separated by a trestle 260, which is made of a non-conductor (such as plastic) to provide good insulation between the two electrical terminals. The trestle 260 is shaped to assist with the mutual mechanical engagement of connectors 25A and 25B.
As mentioned above, a button 265, which represents a form of manual activation device 265, may be located on the outer housing of the body 20. The button 265 may be implemented using any appropriate mechanism which is operable to be manually activated by the user - for example, as a mechanical button or switch, a capacitive or resistive touch sensor, and so on. It will also be appreciated that the manual activation device 265 may be located on the outer housing of the cartomiser 30, rather than the outer housing of the body 20, in which case, the manual activation device 265 may be attached to the ASIC via the connections 25A, 25B. The button 265 might also be located at the end of the body 20, in place of (or in addition to) cap 225.
The cartomiser 30 includes an air passage 355 extending along the central (longitudinal) axis of the cartomiser 30 from the mouthpiece 35 to the connector 25A for joining the cartomiser 30 to the body 20. A reservoir of liquid 360 is provided around the air passage 335. This reservoir 360 may be implemented, for example, by providing cotton or foam soaked in liquid. The cartomiser 30 also includes a heater 365 for heating liquid from reservoir 360 to generate vapour to flow through air passage 355 and out through mouthpiece 35 in response to a user inhaling on the e-cigarette 10. The heater 365 is powered through lines 366 and 367, which are in turn connected to opposing polarities (positive and negative, or vice versa) of the battery 210 of the main body 20 via connector 25A (the details of the wiring between the power lines 366 and 367 and connector 25A are omitted from
The connector 25A includes an inner electrode 375, which may be silver-plated or made of some other suitable metal or conducting material. When the cartomiser 30 is connected to the body 20, the inner electrode 375 contacts the electrical contact 250 of the body 20 to provide a first electrical path between the cartomiser 30 and the body 20. In particular, as the connectors 25A and 25B are engaged, the inner electrode 375 pushes against the electrical contact 250 so as to compress the coil spring 255, thereby helping to ensure good electrical contact between the inner electrode 375 and the electrical contact 250.
The inner electrode 375 is surrounded by an insulating ring 372, which may be made of plastic, rubber, silicone, or any other suitable material. The insulating ring is surrounded by the cartomiser connector 370, which may be silver-plated or made of some other suitable metal or conducting material. When the cartomiser 30 is connected to the body 20, the cartomiser connector 370 contacts the body connector 240 of the body 20 to provide a second electrical path between the cartomiser 30 and the body 20. In other words, the inner electrode 375 and the cartomiser connector 370 serve as positive and negative terminals (or vice versa) for supplying power from the battery 210 in the body 20 to the heater 365 in the cartomiser 30 via supply lines 366 and 367 as appropriate.
The cartomiser connector 370 is provided with two lugs or tabs 380A, 380B, which extend in opposite directions away from the longitudinal axis of the e-cigarette 10. These tabs are used to provide a bayonet fitting in conjunction with the body connector 240 for connecting the cartomiser 30 to the body 20. This bayonet fitting provides a secure and robust connection between the cartomiser 30 and the body 20, so that the cartomiser and body are held in a fixed position relative to one another, with minimal wobble or flexing, and the likelihood of any accidental disconnection is very small. At the same time, the bayonet fitting provides simple and rapid connection and disconnection by an insertion followed by a rotation for connection, and a rotation (in the reverse direction) followed by withdrawal for disconnection. It will be appreciated that other embodiments may use a different form of connection between the body 20 and the cartomiser 30, such as a snap fit or a screw connection.
The body connector 240 extends from this external housing 201 of the body 20. The body connector 240 as shown in
As mentioned above, the cap 225 is provided with an air inlet hole to allow air to flow when a user inhales on the mouthpiece 35. However, in some embodiments the majority of air that enters the device when a user inhales flows through collar 290 and body connector 240 as indicated by the two arrows in
Referring now to
In
Alternatively or in addition the delivery device, such as for example the e-cigarette 10, may communicate indirectly with one or more of these classes of device via a network such as the internet 500, for example using Wifi ®, near field communication, a wired link or an integral mobile data scheme. Again, as noted above, in this manner these devices may cooperate in any suitable configuration to form a delivery system.
Alternatively or in addition the delivery device, such as for example the e-cigarette 10, may communicate indirectly with a server 1000 via a network such as the internet 500, either itself for example by using Wifi, or via another device in the delivery ecosystem, for example using Bluetooth ® or Wifi Direct ® to communicate with a smartphone 100, a dock 200, a vending machine 300, or a wearable 400 that then communicates with the server to either relay the e-cigarette’s communications, or report upon its communications with the e-cigarette 10. The smartphone, dock, or other device within the delivery ecosystem, such as a point of sale system / vending machine, may hence optionally act as a hub for one or more delivery devices that only have short range transmission capabilities. Such a hub may thus extend the battery life of a delivery device that does not need to maintain an ongoing WiFi® or mobile data link. It will also be appreciated that different types of data may be transmitted with different levels of priority; for example data relating to the user feedback system (such as user factor data or feedback action data, as discussed herein) may be transmitted with a higher priority than more general usage statistics, or similarly some user factor data relating to more short-term variables (such as current physiological data) may be transmitted with a higher priority than user factor data relating to longer-term variables (such as current weather, or day of the week). A non-limiting example transmission scheme allowing higher and lower priority transmission is LoRaWAN.
Meanwhile, the other classes of device in the ecosystem such as the smartphone, dock, vending machine (or any other point of sale system) and/or wearable may also communicate indirectly with the server 1000 via a network such as the internet 500, either to fulfil an aspect of their own functionality, or on behalf of the delivery system (for example as a relay or co-processing unit). These devices may also communicate with each other, either directly or indirectly.
In an embodiment of the description, to form a user feedback system as will be described later herein, the server 1000, the delivery device, such as for example the e-cigarette 10, and/or any other device within the delivery ecosystem, may utilise one or more sources of information within the delivery ecosystem or accessible by one or more devices within it in order to be more accurately responsive to the user’s state. These may include a wearable or mobile phone (or any other source, such as the dock or vending machine), or sources such as a storage system 1012 of the server. The delivery device may also provide information (such as data relating to interaction with an e-cigarette) to one or more data receivers within the ecosystem, which again may comprise one or more of a wearable, mobile phone, dock, or vending machine, or the server.
To form a user feedback system as will be described later herein, a device within the delivery ecosystem, such as the delivery device 10, may utilise one or more processors to analyse or otherwise process this information, in order to estimate the user’s state and/or estimate a form of feedback action determined to alter the estimated state of a user (whether a typical / default user, or a user of a similar demographic to the current user, or specifically the current user), for example by causing modification of one or more operations of the delivery device or another device in the delivery ecosystem.
It will be appreciated that the delivery ecosystem may comprise multiple delivery devices (10), for example because the user owns multiple devices (for example so as to easily switch between different active ingredients or flavourings), or because multiple users share the same delivery ecosystem, at least in part (for example cohabiting users may share a charging dock, but have their own phones or wearables). Optionally such devices may similarly communicate directly or indirectly with each other, and/or with devices within the shared delivery ecosystem and/or the server. In such cases, a PIN, ID or account may be associated with each delivery device, so that devices may be associated with the correct user, particularly where multiple users share the same delivery ecosystem.
It will be appreciated that references to ‘the user’s state’ encompass one of many states of the user, or equivalently one aspect of the overall state of the user. Hence for example the user’s level of stress, which as a non-limiting example may be a combination of social circumstance and cortisol levels, is an example of ‘the state of the user’, but does not completely define the user. In other words, the state of the user is a state relevant to the potential intervention of one or more feedback actions as described elsewhere herein.
User Feedback SystemReferring now to
In this embodiment, the obtaining processor 1010, estimation processor 1020, and feedback processor 1030 are located within the server 1000. However, it will be appreciated that any one or more of these processors may be located elsewhere within the ecosystem 1, or its role may be shared between two or more processors in server and/or the ecosystem. For example the obtaining processor may be located in an e-cigarette or mobile phone, or the feedback processor may be located in a vending machine or e-cigarette, or the functionality of these processes may be shared between the server and such devices. In other examples, these processors may be local to the delivery device (e.g. an e-cigarette), or to a delivery system comprising the delivery device and a mobile phone.
Obtaining ProcessorThe obtaining processor 1010 obtains or receives one or more user factors from one or more sources, with the user factors being in one or more classes of data.
Such user factors may have a causal and/or correlating relationship with the user’s state, or some other predictable relationship with it. Whilst such a state may be associated with what is colloquially referred to as the user’s ‘mood’, the user’s subjective mood per se is not a primary consideration of the feedback system; rather, the feedback system relates to the correspondence between obtained user factor(s) and user states, and user states and a form of feedback action that may alter such a state of the user, typically in a predetermined manner that is beneficial to the user.
Further it will be appreciated that where there is a correspondence between user factor(s) and states, and states and feedback, there is also in principle a correspondence between the user factor(s) and the feedback, without the intervening state necessarily needing to be explicitly estimated.
The classes of data obtained by or for the obtaining processor include but are not limited to: indirect or historical data; neurological or physiological data; contextual data; environmental or deterministic data; and use-based data.
Indirect or Historical DataIndirect or historical data provides background information about the user that is not necessarily related to their immediate circumstances (e.g. not their immediate environment or context), but which may nevertheless have an influence on the user’s state.
Examples of indirect or historical data include but are not limited to the user’s purchase history, previously input user preference data, or behavioural patterns in general. Hence more generally, user choices or actions, typically relating to the delivery device but typically not directly derived from use of the delivery device itself.
Optionally, such information (or indeed any persistent information, such as preferred user settings, or model data for user state and/or feedback action as described elsewhere herein, account details, or other stored user factor data), may be transferred between devices where a given user purchases or uses different delivery devices, so that such information does not need to be reacquired for new or respective devices. Such information may be transferred or shared for example by direct data transfer via Bluetooth® link between old and new devices. However, since a potential reason for buying a new device is because a previous one has been lost, alternatively or in addition the information may be transferred or shared by (also) holding the information remotely in association with an account/user ID to which different delivery devices / systems of the user are then also associated. Hence a system with learnt / obtained indirect or historical data on an old device may be transferred or shared to a new device either directly between devices or via a centralised user account.
As an example of historical information, purchase history may be indicative of a user’s state, being indicative of a general state of the user long term (for example in terms of significant or recurrent purchases), and/or a recent state of the user (for example in terms of recent purchases, or purchases that are likely to still influence the user).
Hence purchase history that may be indicative of the user’s state includes type(s) of products bought, frequency of purchase, and the like (not necessarily limited to products directly related to the delivery device or its consumables), how they are bought (e.g., online vs shop), and volume of purchases in a time period or a single purchasing event. The correspondence between how purchases (and the purchased product or service) affect a user’s state may be initially determined on a population basis (e.g.to enable a statistically significant amount of data to be collated, for example via a questionnaire), or on a subset of such a population having similar demographics to the user, and/or on the basis of the individual user. Purchases may assist with this process for example, by being marked as associated with certain states, whether using human readable (and subsequently entered e.g. on their phone by the user) or machine readable markings (such as QR codes e.g. scanned by the user with their phone); if a consumable or other purchase comprises a machine readable mark, this may be registered as an indicator of mood.
Similarly, a consumable may comprise a means for it to be recognised as indicative of mood when inserted or otherwise loaded into the delivery device; for example a microchip with a code, or another uniquely identifiable means of electronically detecting a payload type (such as a binary pattern of conductive dots on the consumable’s surface that may be detected by corresponding contacts on the delivery device), may be used. Such identifiable types may vary by composition (e.g. flavours, active ingredients or concentrations of either) or default administration (e.g. two types could be identical except for indicating to the device a different heating profile that results in a different inhalation effect).
The obtaining processor may obtain indirect or historical data from a number of sources, including user profile data held in storage 1012 at the server, for example comprising previously input user preference data, and/or similarly logs of interactions and/or usage patterns; web or Internet based data 110 such as purchasing records received from vendors or other partners; information gathered with consent by a mobile phone 100 of the user, variously relating to input user preference data, on-line purchases, interaction/usage data (for example where the phone operates in tandem with an e-cigarette or other delivery device as a delivery system local to the user), user questionnaires, and the like. Similarly alternatively or in addition the obtaining processor may obtain such data from the delivery device itself.
Neurological and/or Physiological DataNeurological and/or physiological data is descriptive of the physical state of the user, in terms of mind and/or body. The data may be descriptive of the user’s state on various timescales, including immediate status or changes in state (such as for example heart rate), longer term status or changes in state (such as hormonal cycles), or chronic status, such as fitness levels.
Non-limiting examples of long-term data, for example in the order of multiple months to years, include indicators of the user’s metabolism, body shape (e.g. ectomorph, mesomorph, endomorph) or body mass index; chronic disease; any other long term condition such as pregnancy; and activity/fitness level.
Such data may be obtained by or for the obtaining processor from one or more user questionnaires (for example either a questionnaire completed specifically to assist the user feedback system, and/or a questionnaire completed for any third-party partner, for example for a fitness wearable device or social media provider); medical or insurance records by consent; or at least in part from other devices such as a fitness wearable 400 and/or other devices in a wider ecosystem 1 such as smart scales. The optional timing of such questionnaires is described elsewhere herein
Non-limiting examples of medium-to-long-term data, for example in the order of multiple weeks to months, include a user’s hormonal levels or hormonal cycles for hormones such as oestrogen, testosterone, dopamine and cortisol; any acute condition or illness; and activity/fitness level.
Non-limiting examples of medium term data, for example in the order multiple days to weeks, include a user’s sleep cycle; any acute condition or illness; and a user’s hormonal levels or hormonal cycles for hormones such as oestrogen, testosterone, dopamine and cortisol.
Non-limiting examples of medium to short-term data, for example in the order of multiple hours to days, include the user’s degree of wakefulness; their degree of activity; appetite or fullness; blood pressure; temperature; and again any acute condition or illness, and/or hormones.
Again such medium term data (whether longer or shorter) may be obtained by or for the obtaining processor from questionnaires, medical or other records, or fitness or other smart devices. Hence for example hormonal levels may be obtained or inferred from questionnaires, medical or other records, diary or calendar entries with consent, and/or fitness or other smart devices, including for example pinprick blood tests. Similarly blood pressure, temperature, degree of activity and the like may be obtained from smart devices (in many embodiments wearables) or user input.
Non-limiting examples of short term data, for example in the order of multiple minutes to hours, include the user’s sweat response; galvanic skin response (phasic and/or tonic); their degree of activity; appetite or fullness; blood pressure; breathing rate; temperature; muscle tension; heart rate and/or heart rate variability; and again any acute condition or illness, and/or hormones.
In addition, neurological and/or physiological information specific to the delivery device may also be obtained by the obtaining processor, such as the cumulative amount of vapour generated within the short term (for example within a preceding period corresponding to one, two or more times the pharmacological half-life of the active ingredient in the user’s body).
Non-limiting examples of immediate data, for example in the order of seconds to minutes, include the user’s body position; blink rate; breathing rate; heart rate; heart rate variability; brain wave pattern; galvanic skin response (e.g. phasic); muscle tension; skin temperature; voice (e.g. qualities such as volume, pitch, breathiness); and their degree of activity.
Again short-term and immediate data may be obtained by or for the obtaining processor typically from biometric sensing, for example using smart devices, or using any suitable approach described herein. For example galvanic skin response could be measured by electrodes on the delivery device; heart rate may be obtained by optical scanning of a blood vessel on the wrist by a wearable device, or by use of an electrocardiogram (ECG) or other dedicated strap-on device. Similarly brainwave patterns may be detected by an electroencephalogram (EEG), and muscle tension may be detected by electromyogram (EMG). Meanwhile body position, blinking and the like may be captured for example by a camera on a phone or in a vending machine.
It may be that short term and immediate physiological data are difficult to obtain; for example a smartwatch may only check the user’s heart rate every 10 minutes, meaning that for a given puff the available data is too old to have direct relevance. Similarly a user may wear gloves, making galvanic skin response unavailable. Other data may require the user’s chose to wear an appropriate sensor, which they may not do consistently. Similarly, some short term and immediate data may indicate values that have multiple causes, and hence may indicate multiple states of the user. For example an elevated heart rate may suggest that the user is stressed, or may indicate that the user is enjoying exercise. Consequently it may be that optionally such short term and immediate physiological data is only used in conjunction with other contextual data that serves to disambiguate the readings. For example, an elevated heart rate during office hours, where the user is located at work and is not travelling a significant distance is much more likely to be a sign of stress than the same hear rate on a Saturday morning when the user is detected as travelling at a running pace near their home.
Hence short term and immediate physiological data (and as appropriate any neurological or physiological data that may require contextual disambiguation) may be discounted, or have a reduced weighting, in the obtaining and packaging of data and/or the evaluation of the user’s state, or optionally may be used or more fully weighted when disambiguating contextual data is also obtained that indicates the type of state that the data is likely to relate to.
To the extent that the same examples span different time frames in the above description, it will be appreciated for example that different hormones, hormonal cycles, fitness levels and the like can have shorter and longer term characteristics. It will also be appreciated that where an example of data is included in one list but not another, this does not preclude the data being gathered / used over a different time frame; for example blood pressure may be listed as an example of short term data, but clearly may also be part of longer term data, for example due to ongoing high blood pressure.
As with indirect or historical data, data of a plurality of these types and/or from multiple sources may be used in any suitable combination.
In addition to directly measured neurological or physiological data, any suitable analysis or data fusion may be implemented to obtain data of particular relevance to the delivery device regarding the user’s state.
For example, the feedback system may be operable to estimate a current nicotine concentration (as a non-limiting example of an active ingredient), or a concentration of active or inactive compounds that break down from the consumed ingredient, within a user (and subsequently deliver nicotine / the active ingredient accordingly).
Hence in principle the feedback system (for example in a pre-processor or subsystem of the obtaining processor) may estimate the concentration of nicotine in the user based on monitoring the nicotine consumed, the time at which it is consumed, and having stored the value for the half-life of nicotine in the body (around 2 hours, although this value may be refined based on information regarding the individual, such as height, weight etc.). Such monitoring may be performed based on usage data from the delivery device. Hence for example based on the original active ingredient concentration, and a predetermined relationship between heating/aerosol generator power and aerosol mass output, an mass of active ingredient per unit volume inhaled may be estimated; from that, using predetermined absorption relationships (optionally based on analysis of depth/duration of inhalation, using airflow data), the amount of active absorbed may be determined; finally the body mass of the user, and potentially other factors such as a age, gender and the like may be used to determine the concentration of active ingredient and/or breakdown products in the user over time. Again, here nicotine is a non-limiting example of an active ingredient.
It has been found that users typically try to have a nicotine level which is between an upper and lower threshold (which may be different between users), which collectively may be regarded as defining a ‘baseline’ level. The feedback system can establish such a baseline (e.g., by monitoring use over time), and, as will be described in more detail later herein, the feedback system can select and optionally cause modification of one or more operations of the delivery device to deliver nicotine to match the baseline. The baseline may be a steady value or may vary, e.g. with time of day or day of week. It may be initially estimated based on a profile of the user obtained for example from a questionnaire, and/or built up or refined by information (measured and/or self-reported) from the user.
Such a modification may be expected to alter the estimated state of a user, in a positive manner, as it has been previously determined that the chance that a user will be in a positive mood increases when their nicotine levels are close to their personal baseline or thresholded range.
Where a user consumes several different active ingredients, each may have its own baseline thresholds. Optionally, the feedback system can monitor whether consumption of one active ingredient overlaps another to the extent that one active ingredient may affect the baseline of another, and if so modify these accordingly, for example based on stored pharmokinetic data relating to such overlaps.
As noted previously, in these circumstances it is likely that the user interacts with multiple delivery devices to consume the different active ingredients, and the usage from each device may be combined for the associated user. Alternatively, where a single device can switch between payloads (for example hating different gels), or has a mixed payload of actives, the currently heated payload or payload mix may be communicated to the feedback system for the purposes of tracking consumption.
Contextual DataContextual data relates to situational factors other than environmental factors (see elsewhere herein) that may affect the user’s state. In many embodiments such situational factors affect the user’s psychological state or disposition towards stress, calm, happiness, sadness, or certain patterns of behaviour, and hence may also influence and/or have a correlation with neurological and physiological user factors such as dopamine or cortisone levels, blood pressure, heart rate and the like as described elsewhere herein.
Examples of contextual data include the user’s culture, including at a broad scale where they live, their religion if they have one, and at a narrower scale their job and/or employment status, educational attainment and the like, and social economic factors that may interact with these such as gender and relationship status.
Such information may be obtained by or for the obtaining processor from user questionnaires, social media data, and the like. The optional timing of such questionnaires is described elsewhere herein.
Other contexts include the season (e.g. winter, spring, summer, autumn) or month, and any particular events or periods within that season or month, such as Lent, Easter, Ramadan, Christmas and the like. For example, users are more likely to see consumption at or below their personal baseline as a positive thing during Lent, or the first few weeks of January.
Such information may be obtained by or for the obtaining processor from a calendar and database of events, suitably filtered if appropriate according to other contexts such as country, religion, employment, gender and the like as described previously.
Other contexts include the user’s agenda or calendar, which can indicate sources of stress or relaxation, and how busy or otherwise the user is at a given time. Hence for example a social event may be associated with a positive influence on user state, for example raising dopamine levels, whereas a medical appointment or driving test may be associated with stressors such as an increase in cortisol and heart rate. Similarly events, appointments, and/or reminders in rapid succession may indicate a negative effect on the user’s state. The nature of events in the user’s agenda or calendar may be determined by keyword analysis as described elsewhere herein, and the frequency or other metrics associated with the calendar, such as the number of clashes, or the individuals likely to attend a meeting, may be determined from the data provided by the calendar itself.
The user’s agenda or calendar can also provide an indication of the user’s likely location, which may affect either their state, or their ability to use the delivery device in a manner that may modify that state. For example, the user may have different typical states, and different abilities to use their delivery device, depending on whether they are at home, at work, in outdoor or indoor public spaces, in an urban or countryside environment, or commuting.
The relationship between user state and location may at least initially be based on data from a corpus of users. Alternatively or in addition this relationship may be built up or refined based on data from the user (e.g. measured or self-reported), so that the user feedback system learns what the user is likely state will be at a given location, whether or not this is explicitly commented upon by the user.
It will be appreciated that the user’s location may be determined from a GPS signal obtained by the delivery device or an associated device such as a smartphone, or the registered location of a vending machine or point of sale unit. Optionally, a device such as the user’s mobile phone may comprise an off-line map or location database, for example recording location of the user’s home and work, and optionally the location of devices that may temporarily be incorporated into the users delivery ecosystem such as vending machines, public charging units and the like. This enables the device to compare the user’s current location with locations that may not be public knowledge (in the case of the user’s personal details) or otherwise known to the user (in the case of additional delivery ecosystem infrastructure). If on the other hand the user’s location is fed back to a back end server for any reason (for example as part of obtaining, combining or packaging data, user state estimation, or feedback processing), then optionally the user’s actual location could be partially obscured (i.e. made partly anonymous) by classifying the location, e.g. as ‘Work’, ‘Home’, ‘Gym’, ‘Commuting’, or other classes of location, or ‘Other’ for unknowns. These could be done on the user’s phone, for example with a predetermined tolerance around a classified GPS position being associated with the classification.
Alternatively or in addition the wireless environment may be associated with the location; for example an in-car Bluetooth, or on-train wifi may be associated with ‘commuting’, whilst home, office or gym wifis may be associated with those locations.
Whilst the user may be asked to identify / classify these locations / wireless environments on their phone, optionally the GPS or wireless data may be sent to a secure server for automatic classification by comparison to a database of locations and/or wireless access points, for example managed by a third party.
In any event subsequently the classification of the location, rather than the location itself, may thus be provided by or for the obtaining processor.
With regards to commuting or other modes of travel, the type of travel may influence the user’s state. For example, walking may have a more positive effect on the user’s state than driving, for example in terms of heart rate, blood pressure and the like. More generally, activity levels may influence the user’s state, with increased activity generally having a positive impact on the user, typically during the activity but potentially also for the rest of that day and possibly the day after. It will be appreciated that this context illustrates the potential for the combination of contexts to be significant, as walking in the sun versus walking in the rain may have different effects on the user’s state. The type of travel may for example be inferred from GPS data from the user’s phone, or the pairing of the phone or delivery device with a vehicle, or the purchase of public transport tickets, or a questionnaire indicating travel habits/times.
Such information may be obtained by or for the obtaining processor from work or personal digital calendars, for example on the user’s phone. It will also be appreciated that the user’s phone, or other smart wearable, may directly provide an indication of the user’s location, and/or historical patterns of location, for example corresponding to a user’s home and work locations and average commuting times.
Other contexts include the weather in the user’s location or the upcoming weather in the user’s location or upcoming location. Depending on the user, sunny weather is likely to improve the user’s mood and sociability, whilst poor weather is likely to lower the user’s mood and potentially reduce their sociability or affect their ability to socialise. For example, some users are likely to behave so as to consume active ingredients to an extent that reflects their expectations of mood as suggested by the weather, optionally in conjunction with other contextual factors and further user factors as described herein.
Such information may be obtained by or for the obtaining processor from a weather app, which may be located on a smart phone 100 of the user, or accessed directly for example by the server 1000. More generally weather data may be obtained in response to GPS data (for example by the smartphone) or locations indicated in the users calendar/appointments, and/or using a local weather measuring sensor such as a barometer.
Other contexts include the user’s proximity to other people, either generally in terms of crowds or social setting, or specifically in terms of other individuals with which there is in principle a measurable correlation with user behaviour. For example, a user may have a different state depending on whether they are in proximity to their boss, their work colleagues, the friends, their partner, their children, or their parents. Hence for example the user may have a different state in a crowded or sociable environment versus when alone or with a partner or family members. Or may behave differently when in the presence of children than in the presence of only adults.
Such proximity may be inferred from the user’s agenda or calendar, their mobile phone, their delivery device, or their location. The user may self-report their social status either specifically for the purpose of the user feedback system herein, or generally for example on social media; meanwhile a phone and/or delivery device for example may detect signals from other phones and/or delivery devices for more than a predetermined period of time, indicating they are remaining in each other’s presence. Optionally a phone’s camera may be used to detect others, but this may not be available if the phone is in a pocket or bag. The feedback system can also determine the proximity of users of the delivery device with other users of such a delivery device - e.g. any suitable delivery device whose location may be determined by the feedback system (for example directly or via an associated mobile phone), whether or not that other delivery device is part of a feedback system itself. Similarly the feedback system can determine the proximity of specific people whom the user has, with permission, identified to the feedback system; for example by providing their phone number to the feedback system, or the system associating a detected Bluetooth ® or other ID with that user.
A user may also indicate (for example via a questionnaire) their typical state in response to different social situations, groups or individuals, whether at a broad level such as ‘introverted’ or ‘extroverted’, or more specifically.
Other contextual information relating to the user’s social situation may be measured directly using sensors such as microphones or cameras.
For example a microphone in the delivery device, the user’s mobile phone, or any other device in the delivery ecosystem or connectable thereto to may be used to detect the user’s voice (for example when speaking specifically to the device, or to other people nearby, on a phone call, or optionally as an ongoing background activity in a manner similar to a voice activated personal digital assistant). Properties of the user’s voice such as volume, word speed, timbre, tonality, pitch, and/or non-harmonic content may be analysed to determine whether the user is vocalising in a calm or a stressed manner, optionally after calibration for example to the user’s neutral voice. Similarly optionally such a device in the delivery ecosystem may monitor for keywords indicative of different states of the user, whether positive and/or negative.
Such a microphone can also be used to detect background noise/music; a high degree of random or non-music noise may be indicative of a stressful situation such as commuting, whilst a quiet background may be indicative of a calm situation such as being at home or in the garden. Similarly the type of music being listened to, whether specifically identified using known techniques, or analysed to determine the presence of a beat and any tempo may be indicative of the user’s state, with specific tracks related to positive or negative emotions being indicative of corresponding emotional state of the user, whilst for example upbeat dance music may be indicative of high dopamine levels, but slow music or music in a minor key may be indicative of a low mood or depression.
Like any other since a function described herein, where the appropriate sensor (in this case a microphone) is already present to provide other analyses, this additional facility could be provided by updating the software of the relevant device or devices.
Similarly a device in the delivery ecosystem or connectable thereto may comprise a camera. Data from images from such cameras may be obtained pertaining to the user’s state, including for example the user’s overall facial expression, which typically has a strong correlation with the user’s subjective mood, but also as described previously herein to detect when the user is alone or in a crowd, or with specific individuals who may have a strong correlation with the user’s state.
It will be appreciated that alternatively or in addition such a camera may be used for other types of data, such as physiological data as described previously herein. For example, muscle tension may be detectable in the face, which tends to correlate with stress, strain, or pain. Meanwhile eye movements can indicate a user’s degree of focus and/or the nature of some activities the user is undertaking (for example patterns of eye movement and/or blinking will be different when driving, reading, or socialising, and tend to differ when a person is alert or drowsy). Similarly, if capable of being resolved by the camera, micro-movements in the face or neck may be indicative of heart rate.
It will be appreciated that other contexts exist that may influence the user’s state, such as recently consumed information; social media content, websites, internet searches, on-line adverts, news articles, streamed video, e-books, e-magazines, photos, music and other similar content that may be obtained by or for the obtaining processor. Some content may be assumed to have a universally consistent effect on the state of users, such as for example news of a natural disaster, whilst other content may affect individuals differently, such as the results for a user’s preferred sports team, and be assessed individually, for example based upon results of a user questionnaire.
The content of the consumed information may be assessed, for example for keywords, to generate a rating for positive or negative influence on the user’s state. Optionally only the rating may be obtained by or for the obtaining processor, or any suitable digest, such as a keyword selection. More generally the obtaining processor may only receive a digest of user factors as appropriate, particularly where the source material does not itself enumerate some user factor property.
The obtaining processor, or a processor administering content such as that described above, may perform such assessments. In the latter case, the processor may then provide its results either directly to the obtaining processor, or to the device within the delivery ecosystem through which the content is consumed, from which may subsequently be relayed to the obtaining processor, optionally after further processing for example to incorporate one or more other metrics measured within the delivery ecosystem.
By way of a concrete example, when a user consumes social media for example via their mobile phone, then the social media platform, the mobile phone or other consuming device, and/or the obtaining processor (whether operating separate to the mobile phone, or at least partially implemented on the mobile phone or other consuming device) may optionally analyse the text of posts read by the user, and in particular optionally analyse the texts of posts written by the user, for keywords. Some keywords may only be indirectly indicative of a user state; for example, a user’s choice of adjective or verb in a sentence may indicate whether the user is feeling positive or negative, or calm or stressed. Similarly the presence of swearing can indicate stress. Meanwhile keywords may explicitly indicate user state such as for example ‘feel[ing]... nervous [about the trip to the] dentist’. In this case, the word ‘feel’ indicates the user is talking about themselves, and the keywords ‘nervous’ and ‘dentist’ may be part of a predetermined set of keywords having a typically negative connotation or a determinable correlation or correspondence with levels of stress. The analysis of a user’s consumed or produced social communications may optionally analyse one or more of a user’s choice of words, swearing, or explicit indications, as described above.
It will also be appreciated that alternatively or in addition to social media use, optionally the above approach may be applied to user’s texts, and/or calendar entries, and in conjunction with speech recognition, their phone conversations or real-world conversations with others.
A similar approach may be applied to news articles, e-books, e-magazines and the like, and meta data associated with streamed video, photos and/or music.
Hence for example, whilst as noted previously herein a microphone may be used to assess the background noise or music around the user, where by contrast the user is choosing the music, or specifically listening to music, meta data related to the music may be obtained including one or more of artist, title, genre, and lyrics. Any of these may be assessed for an indication of corresponding user state, for example based upon a database maintained by the server, or similar heuristics to those described above in relation to use of a microphone, but based upon supplied metadata.
In a similar manner to assessing music, other content may be evaluated in a similar way, such as websites; some websites are provided to entertain, while others are intended to inform and hence may be categorised according to genres or more generally classifications having a correlation or correspondence with different user states. As noted elsewhere herein, the content of the websites may similarly be parsed for keywords.
Likewise, usage of devices other than the delivery device may influence the user’s state. In particular a choice of apps on the user’s phone, and the interaction, type of interaction, and/or duration of interaction with them may have correlations with the user’s state; for example social media or playing a gaming app may raise dopamine and/or cortisol levels, heart rate, and the like; whilst listening to a music app may alter heart rate and/or cortisol levels. The duration of interaction may have a linear or non-linear relationship with these changes of state, or may with time indicate a different state; for example playing a game for a long time may indicate boredom.
It will be appreciated that for many user factors, not merely contextual but of other types as well, a situational response (e.g. an expected state) may at least be initially based upon data from a cohort of users (for example a prior test population of users), but alternatively or in addition may be built up or refined from information obtained from the user (whether measured, received or self-reported).
Environmental and Deterministic DataEnvironmental and deterministic data effectively relate to long-term context data outside of the user’s choice or influence. There is some overlap with longer term contextual influences such as culture; hence for example the user’s upbringing, their genetics, gender, biome internally (for example they gut biome) and/or externally (for example whether they live in an arid or verdant environment), and age.
As with other data described herein, such environmental and deterministic data may be obtained by or for the obtaining processor from one or more user questionnaires (for example either a questionnaire completed specifically to assist the user feedback system, and/or a questionnaire completed for any third-party partner, for example for a fitness wearable device or social media provider). Amongst other things, such a questionnaire may ask for details such as sex/gender, height, weight, ethnicity, age, etc. Such a questionnaire may also comprise psychometric test questions to estimate a user’s mental predisposition and/or history (e.g. one or more of extrovert / introvert, active/passive, optimist/pessimist, calm/anxious, independent/dependent, content/depressed, and the like). Such a questionnaire may also ask questions related to the user’s culture and beliefs (e.g. one or more of: a country of own or parent’s origin; religion, if any; political persuasion, if any; newspapers or news websites read, if any; other media consumption, if any; and the like). Again as with other data described herein, some such environmental and deterministic data may be obtained by or for the obtaining processor from medical or insurance records by consent; and/or may be inferred from the user’s location, as appropriate. The optional timing of such questionnaires is described elsewhere herein.
Not all environmental and deterministic data need be long-term; hence for example the time of day, day of the week and month of the year may be considered environmental and deterministic data. Hence for example the user state may vary over the course of a day or week, for example being different during weekdays and weekends, and/or during work hours of the weekday versus evenings, and also potentially at specific times of day. Similarly there may also be overlap for example with other contextual data, such as the weather. Again there may also be synergy between different user factors; for example the time of year may affect the amount of daylight (in terms of both the length and potentially also weather patterns). The level and/or duration of daylight, either as measured (e.g. using a light sensor / camera on a device within the delivery ecosystem) or as inferred from the date, may also have a detectable relationship with the user’s state. The quality of light (e.g. colour temperature, indoor / flickering or outdoor) may also be treated as such a user factor, for example captured by a camera within the delivery ecosystem.
It will be appreciated that the time of day, day of week and month of year may also be considered contextual data, particularly when defined functionally as work hours or a work routine, commuting time, personal time, quality time etc., or where patterns of behaviour over the course of days, weeks, or months is established. These relates to changes in user factor data as a function of day, week, or month, or the relationships between such user factor data and user state or identified feedback actions. Hence as described elsewhere herein, one or two step models relating user factor data to feedback actions may use time as an input or use different models and different times.
Use-Based DataUse-based data relates to direct interactions of the user with the delivery device and/or optionally any other device within the delivery ecosystem or which can report on interactions with it to the feedback system (e.g. to the obtaining processor). These interactions may relate to vaping/consumption and/or manipulation/handling and/or setting the device.
Vaping/consumption based interactions may relate to the number, frequency, and/or distribution/pattern of puffs/acts of consumption within one or more chosen periods. Such periods may include daily, hourly, as a function of location, as a function of pharmokinesis (for example the active ingredient half-life within the body for one or more delivered active ingredients), or any other period that may be relevant to the user’s state, and/or chosen to increase the apparent correlation between number, frequency and/or distribution/pattern of puff/consumption and a user’s state. Hence as a non-limiting example the total number of puffs in the device lifetime, since a payload /consumable refill, in a month/week/day/hour, and/or in a particular session, and one or more corresponding cumulative usage times, may be included as metadata with any puff data used in analysis either by the delivery device, a companion device such as a smartphone, and/or a remote server. Such puff data or puff metadata may also be associated with a time stamp, for example so that such a collation of puff data may be performed subsequently, e.g. at the phone or remote server, and/or with a time stamp and/or associative link with another piece of (non-puff) data as described elsewhere herein.
Vaping based interactions may also relate to individual vaping actions or statistical descriptions of a cohort thereof (for example but not limited to a cohort within one of the above-described chosen periods), such as duration, volume, average airflow, airflow profile, active ingredient ratio, heater temperature, and the like.
Data relating to vapes and vaping behaviour (or more generally consumption) as described above may be obtained by or for the obtaining processor from a delivery device itself, for example via a Wi-Fi ® connection to the server 1000, or via communication with a companion mobile phone 100 or other local computing device, paired to the delivery device 10 for example via a Bluetooth ® connection to form a delivery system.
The delivery device may comprise one or more airflow sensors as described previously herein to determine when the user vapes and/or how the user vapes, for example as characterised above, and raw data relating to vaping/consumption events may be stored in the memory of the delivery device or transmitted to the companion mobile phone. The data may then be used to determine features such as the number, frequency, and/or distribution/pattern of puffs/acts of consumption within one or more chosen periods, and/or the duration, volume, average airflow, airflow profile, average ingredient ratio, heater temperature values for one or more vaping/consumption events, using a processor of the delivery device and/or the mobile phone.
Optionally at least one sensor may be adapted to sense at least two of puff profile, puff frequency, puff duration, number of puffs, session length, peak puff pressure and determine the mood of the user from the sensed information.
A user’s puffing behaviour provides a useful indicator of stress vs non-stressed states. In particular, the intensity and frequency of a user’s puff has been found to change from a normal level during instances of stress (e.g. to stronger and shorter puffs, and more frequent puffs). Therefore optionally the delivery device or another device within the delivery ecosystem (such as the user’s mobile phone) or a back end server may establish baseline profiles, frequencies, patterns, puff numbers, peak pressures and the like as described elsewhere herein, and subsequently detect deviations from this baseline (e.g. above a predetermined threshold) indicative of stress. Further optionally different baselines may be set for different situations and contexts, such as time of day, day of week, and location; for example a user might be more stressed at work than at home, but this partial elevation of stress may be considered a baseline for a work context, and only further stress might be considered to be a deviation that indicates a change of user stress that may prompt a response.
Puff profile, for example, characterises the variation of inhalation strength over the duration of an inhalation. Hence for example the airflow rate of a puff may be used to characterise the puff profile, with higher airflow rates associated with short sharp inhalations being likely indicative of high stress than lower airflow rates. Puff frequency may similarly have a correlation with stress such that in stressed conditions the puff frequency may be higher than when the user is calm. Puff duration may be considered a subset of puff profile; to a first approximation, the duration is also indicative of the type of inhalation being taken, typically with a correlation between shorter puffs in stressful situations and longer puffs with the user is calm. Peak puff pressure may also be considered a subset of puff profile, and is indicative of how sharply user inhales.
The number of puffs within a session can also be indicative of the user’s state. A session may be understood to either be a fixed period of time, or defined functionally as a period comprising inhalations that are separated by less than a predetermined period of time that is taken to indicate that the session is over. for any given session, all else being equal the number of puffs taken by a user is likely to be greater when the user is in the stressed state than when the user is calm. Similarly, where a session is defined functionally, sessions are likely to be shorter when the user is in a stressed state than when the user is calm.
In any event as noted above, such information may then be packaged and sent to the obtaining processor as one or more user factors.
Manipulation/handling based interactions may relate to how the user interacts with the delivery device when not actively vaping on it; for example to characterise whether the delivery device is kept in a bag until immediately prior to use, or whether the user plays or fidgets with the delivery device in between uses.
In particular, micro-movements or tremors in the range 3 to 9 Hertz are considered indicative of elevated stress or arousal, and so detection of such motion may be used as an input indicative of stress. Conversely, optionally manipulations that are e.g. lower frequency may be considered indicative of lower stress. Similarly movements that are not ‘micro’ movements (i.e. deliberately swinging the device, as opposed to holding it in a trembling hand) may either be ignored for the above purposes, or analysed for other significance (e.g. a motion characteristic of imminent use, or associated with a wider context for which a user state has a clear correlation).
For example, separate to micro-motions, a given user tends to hold their delivery device more often and/or for longer in times of stress than when relaxed or in a calm scenario. This may be because the user has made a conscious or unconscious link between the device and a reduction in stress caused by vaping with it. Such holding may be detected using one or more accelerometers and/or touch sensors as mentioned elsewhere herein.
Optionally the delivery device or another device within the delivery ecosystem (such as the user’s mobile phone) or a back end server may establish baseline levels of holding and/or physical interaction with the delivery device for the purpose of detecting when increased holding and/or physical interaction occur (e.g. above a predetermined threshold), and similarly optionally may correlate such normal or elevated levels with other indicators or correlates of the user’s state and/or with the user’s state directly so that holding and/or physical interaction can provide a (futher) indication of user state and/or act as a proxy for another source of such indications if this is normally used/preferred but currently unavailable. As with puffing behaviour, Further optionally different baselines may be set for different situations and contexts, such as time of day, day of week, and location; for example a user might be more stressed at work than at home, but this partial elevation of stress may be considered a baseline for a work context, and only further stress might be considered to be a deviation that indicates a change of user stress that may prompt a response.
The delivery device may comprise one or more touch by sensors or motion sensors (e.g accelerometers) to determine such interactions. Similarly, the device may comprise buttons and other settings for which user interactions may be logged. Interactions with buttons and other settings relating to the delivery device on a companion mobile phone may also be logged. Such interaction data may then be packaged and sent to the obtaining processor is one or more user factors.
Hence for example using telemetry from one or more such motion sensors within the delivery device, the user feedback system can detect incidental or subconscious manipulation of the device based on characteristic changes in orientation, such as spins, flips, rocking and the like, which are not related to gross movement of the device or the user. Such toying may be indicative of a state of the user; for example it may be indicative of at least a subconscious wish to use the device, or to use the device more than is currently the case, and hence correlate with heightened stress, a lack of focus, and/or a user’s deviation from a preferred baseline amount of active ingredient within their body.
Similarly for example, in a delivery device where activation uses a button press or other UI interface, the delivery device may measure the time between such activation and inhalation occurring. This period of time is likely to have a correlation or correspondence with one or more of user stress, user fatigue, user focus, and a user’s deviation from a preferred baseline amount of active ingredient within their body. Hence for example the period of time is likely to be shorter if the user is stressed than if the user is calm.
The delivery device or other devices within the delivery ecosystem may comprise other sensors operable to obtain measurements relating to usage of behaviour, including a microphone or a camera. These may record inhalation and/or exhalation, relative timings and characters behaviours related to inhalation actions or other behaviours and usages, which may be determined from audio and/or image analysis as inputs to the obtaining processor.
It will be appreciated that where a user has multiple delivery devices 10, usage may be aggregated across these devices, either by obtaining user factor date from each device, or already aggregated via an intermediary such as a phone app or one of the delivery devices acting as a hub for this purpose. Where different devices deliver different active ingredients (whether type or concentration), this may also be accounted for in modelling use, as a non-limiting example in relation to pharmokinesis.
Multiple Data SourcesAs noted above, and as shown in
As noted above, these user factors may variously be classified as indirect or historical data; neurological or physiological data; contextual data; environmental or deterministic data; and/or use-based data.
In the case of use-based data, it will be appreciated that multiple sensors, and/or a sensor with multiple sensing capabilities may be used in a sensor platform to obtain some or all of such use-based data.
Whilst the above description recites the sensor platform in relation to serving the feedback system, it will be appreciated that a delivery device such as an aerosol provision device may comprise a such sensor platform anyway, independently of any feedback system, for example to provide information to the user or some other device. Hence any suitable aerosol provision device may have a sensor platform comprising one or more selected from the list consisting of a galvanic skin response detector, a heart rate detector, a touch detector, and any other suitable detector described herein (for example, a cortisol detector); and the or each detector may be located on one or more selected from the list consisting of a grip portion of the delivery device, a mouthpiece of the delivery device and an activation button of the delivery device, as appropriate. A further location for a sensor platform for one or more sensors is on an optional collar attachment arranged for example to fit between the cartomiser and the main body of the delivery device, or between the main body of the device and a mouthpiece, or between any two user-separable components of the delivery device, as appropriate. The collar may be user-attachable, may be user-detachable, or may be integral to the device. The collar may for example thus encircle and form part of the airflow path within the delivery device, and comprise the (or a further) airflow sensor, for example to detect puff strength or profile, or comprise one or more accelerometers or gyroscopes to detect one or more of device orientation, acceleration, velocity, or position, or any other suitable sensors (e.g. a touch sensor). The collar can draw power from the delivery device for example whilst passing power on to the cartomiser. The collar may also include a Bluetooth® link and antenna (for example an annular antenna). The collar may thus enable retrofitting of capabilities relevant to the techniques herein to a delivery device that may otherwise be unsuitable, or only provide more limited information.
It will be appreciated that different data sources relate to data that spans different time periods; for example a single puff may take 1-3 seconds, whereas the context of being at work may be true for hours on either side of this event. Hence the obtaining processor may use data sources that by their nature precede, coincide with, and/or follow the occurrence of other data sources, and correlations with a user’s state at a particular point in time (for example as indicated by a more transitory even such as a puff) can take these wider perspectives into account through any notable correlations.
However, as well as sources that are innately of long duration, it will be appreciated that the techniques herein can use one or more sensors to obtain data that complements reading from other sensors by recording data, before, during, and/or after the readings by the other sensors. For example, a heart rate monitor may measure heart rate before, during, and/or after a puff or series of puffs. Hence data regarding the user’s state may be usefully gained from the periods immediately preceding and following the actual inhalation (or other measurable interaction) on the device, as well as during the inhalation.
It will be appreciated that any measurable parameter of interest could be recorded to provide time-localised context for measurements of any other, although measuring such parameters on one or both sides of a puff action in particular may be of benefit.
Whilst data from one or more such sensors may be continuously analysed, this could require high processing resources and power consumption which would adversely affect the battery life of the delivery device. Consequently optionally the delivery device comprises a circular memory buffer that is updated with values from the or each sensor used in this scheme, thus using minimal processing. The buffer may comprise storage for e.g. 5, 10, 15, 30, or 60 seconds of sensor readings, and is overwritten during use in a circular manner.
When a puff is detected, the data in the buffer is collected for processing either on the delivery device, or via data transmission as described elsewhere herein to a companion device such as a mobile phone, or to a remote server, either directly via data transmission or via the companion device.
When the puff is detected, optionally the data in the buffer is collected for a further period of time roughly equal to half the circular memory duration of buffer so that the puff event corresponds with the middle portion of the resulting buffer record, with data preceding and following the puff event also recorded. It will be appreciated that the amount of buffer data recorded during and after the detection of the puff event may be used to control the balance of preceding and following data recorded in the buffer; this may be of use depending on whether the sensor data being recorded is of particular relevance preceding the puff or following the puff, or balance of the two.
The recording following data may be relative to the detected start of the puff, or the detected end of the puff. Hence for example for a two second puff and a five second buffer, sensor data for one or more sensors other than the airflow sensor may be sent for analysis for the five preceding seconds; or four preceding seconds and one second of puff; or three preceding seconds and two seconds of puff; or two preceding seconds, two seconds of puff, and one following second; or one preceding second, two seconds of puff, and two following seconds; or two seconds of puff and three following seconds; or one latter second of puff and four following seconds; or five following seconds. It will be appreciated that division by fractional seconds is also possible depending upon the sensor sample rate used in the buffer, as is division by greater than one second intervals.
Hence more generally the delivery device may comprise a circular buffer that periodically records sensor data for one or more sensors other than the airflow/puff sensor, so that when a puff is detected to occur sensor data preceding, during and/or following the puff event can also be provided for analysis, thereby providing time localised contextual data (e.g. sensor data or other relevant data) in a power-efficient manner.
It will also be appreciated that more generally still any device within the delivery ecosystem may comprise a circular buffer that periodically records data (e.g. sensor data for one or more sensors other than the airflow/puff sensor, or other relevant data), so that when a puff is detected to occur data preceding, during and/or following the puff event can also be provided for analysis, labelling, or classification. In this case the puff event may be signalled to the or each other device for example via Bluetooth either directly or indirectly via a companion device such as a phone. In this case optionally the companion device may collate the sensor data from one or more devices, potentially including itself, either for analysis by the delivery device, the phone itself, another device within the delivery ecosystem, or a remote server.
In any event, this data preceding and/or following, and optionally also during a puff, may be used to provide contextual data or metadata in association with the puff (for example being included in puff data packets). In some cases this data may be used as part of the subsequent analysis as a further user factor. Alternatively or in addition, the presence of data indicative of a user factor may be used as a label or classification for the puff data, effectively such as ‘puff at work’, or ‘puff following elevated heart rate’ or the like.
Obtaining Processor OperationTurning again to
The obtaining processor 1010 may comprise one or more physical and/or virtual processors, and may be located within the remote server, and/or its functionality may be distributed or further distributed over multiple devices, including but not limited to the user’s mobile phone 100, a docking unit 200, a vending machine 300, and the delivery device 10 itself. The obtaining processor may comprise one or more communication inputs, for example via network connections, and/or via local connections to local storage. The obtaining processor may also comprise one or more communication outputs, for example via network connections, and/or via local connections, for example to the estimation processor 1020.
The obtaining processor may comprise pre-processors or sub-processors (not shown) adapted to parse and/or convert obtained information into user factors where this information is not immediately usable as such; examples may include keyword or sentiment analysis of consumed media, for example to determine as a user factor a net positive or negative influence on an aspect of user state, or similarly keyword analysis of the user’s calendar to determine locations and events, for example again to determine as a user factor a net positive or negative influence on an aspect of user state. Other inputs, such as ambient temperature or probability of rain, may similarly be converted to a scale appropriate to user factors, for example being normalised or classified according to influences on user state.
The obtaining processor may thus be operable to generate and/or relay user factors for input to the estimation processor at varying degrees of abstraction from the original source material.
Hence optionally original source data may be enumerated, codified, classified, formatted, or otherwise processed, or simply passed through and provided as input to the estimation processor, so that there are potentially as many or more inputs as there are original sources of data. As will be appreciated from the description above, this may result in a large number of inputs.
Hence optionally one, some or all of the original source data may be any rated, codified, classified, formatted, or otherwise processed, or simply passed through as appropriate to an optional intermediate user factor generation stage of the obtaining processor; this may determine positive or negative influences from the submitted inputs on a specific subset of user factors that may be relevant to the user state but not directly or easily measurable, such as effects on dopamine and/or cortisol, heart rate, satiety, and the like.
Similarly such an intermediate user factor generation stage of the obtaining processor may combine inputs from similar classes to generate a class-level user factor for one or more of the classes of data described herein.
Hence as non-limiting examples, indirect or historical data could be summarised as how actively the user modifies or updates their device, or how receptive they are to such modifications, on a given scale. Neurological or physiological data could be summarised as how stressed the user appears to be, on a given scale, and/or their trajectory on that scale. Contextual data could be summarised as how sociably desirable use of the delivery device is currently, on a given scale. Environmental or deterministic data could be summarised by how likely the user is to want to use the delivery device in a given timeframe; and use-based data could be summarised as how frequently or deeply the user is or has recently used the delivery device.
It will be appreciated that in practice only source data from some or one of the classes may be available, and even where data from one class is available, a class-level user factor such as in the examples above may not be generated, or different kinds of class level user factor may be generated depending on the type of data received within that class (e.g. different subsets of individual user factors); similarly, class-level user factors may be generated for input to the estimation processor in parallel with individual user factors.
The contributing values and/or influences from different individual, subset and/or or class level user factors may then be presented as inputs to the estimation processor, with the selection of class, subset and/or individual user factors being chosen to give a good discrimination between different user states.
For example, galvanic skin response may provide a good indicator of a user’s state, and is also responsive to nicotine as an active ingredient by reducing the response; as such it may optionally be a candidate for an individual source of data to be used as an input to the estimation processor. Other physiological measures to provide good discrimination include muscle tension (EMG), heart rate, skin temperature, brainwaves (EEG), and breathing rate. Any of these, where available, may be considered for inclusion as an individual source of data, optionally after being any rated, codified, classified, formatted or otherwise processed, alternatively or in addition combined in any combination with these or other user factors described elsewhere herein.
Similarly location, social setting, time-of-day, and hormonal levels are all good indicators of the user’s state and may be candidates for use as individual sources of data as input to the estimation processor.
Hence more generally user factors may be obtained by or for the obtaining processor and provided to the estimation processor after any suitable parsing or processing, either individually and/or as combined subset or class values with one or more others (for example based on weighted contributions, statistical functions, trained machine learning outputs, look-up tables of precomputed correspondences between values of the obtained data and values of a target user factor, and the like), as for example individual, subset and/or or class level user factors.
Estimation ProcessorThe estimation processor 1020 is operable to calculate an estimation of user state, based upon one or more of the inputs received from the obtaining processor comprising or based upon obtained user factors. The calculation of an estimation of user state may be either explicit to generate an output reflective of a user’s state prior to generating a proposed feedback action (which may be thought of as a two-step process), or implicit to generate a proposed feedback action expected to alter a user’s state (which may be thought of as a single step process).
Like the obtaining processor, the estimation processor may comprise one or more physical and/or virtual processors and may be located within the remote server, and/or its functionality may be distributed or further distributed over multiple devices, including but not limited to the user’s mobile phone 100, a docking unit 200, a vending machine 300, and the delivery device 10 itself. The estimation processor may comprise one or more communication inputs, for example to receive data from the obtaining processor 1010. The estimation processor may also comprise one or more communication outputs, for example to provide a proposed feedback action to the feedback processor 1030.
Explicit State EstimationIn an embodiment of the description, in a two-step process the estimation processor initially explicitly estimates a state of the user in a first step before then generating a proposed feedback action in response to the estimated state in a second step. This estimated state may itself take the form of a single value or category, or may be a multivariate description of the user’s state.
As non-limiting examples of a single value state, the estimated state may describe:
- i. a stress level of the user;
- ii. a degree of benefit the user is expected to subjectively experience in response to a unit consumption of a proposed active ingredient; and
- iii. a social flexibility score, indicative of how easily the user can currently use the delivery device and hence alter their state through modification of delivery;
As non-limiting examples of a state category, the estimated state may be:
i. one of a plurality of state classifications, all, some, or none of which may correspond to what are colloquially referred to as moods; hence for example happy, sad, low cortisol, medium cortisol, high cortisol, calm, stressed, receptive to change (for example willing to use their delivery device to alter their state), or unreceptive to change.
ii. one of a plurality of state classifications chosen to have a subsequent clear correlation with either inputs from the obtaining processor and/or an available feedback action, the classifications not necessarily fitting a notional category such as ‘happy’ or ‘high cortisol’, but having classification boundaries driven at least in part by their correspondence to either the available inputs from the obtaining processor or outputs for the feedback processor.
As non-limiting examples of a multivariate description of the user’s state, the estimated state may comprise:
- i. the user’s stress level according to physiological indicators, and separately according to contextual indicators, together with an indication of their current social flexibility based on time-of-day, location, and/or proximity to specific individuals;
- ii. an indicator of the user’s physiological state based upon galvanic skin response and heart rate, together with current position in a hormonal cycle, and indicators of mental state derived from questionnaire and/or social media analysis.
These examples may be used to provide non-limiting illustrations of the operation of the estimation processor, as follows.
The estimation processor may use predetermined rules, algorithms and/or heuristics to convert input data from the obtaining processor into estimated states.
- For example, a single value state such as a stress level of the user may be derived by applying a predetermined combination to a plurality of user factors, such as a weighted sum, with the result normalised according to the number of currently available inputs contributing to the sum.
- Similarly a single value state such as the degree of benefit expected for the user may be derived by estimating the user’s positive or negative emotional state based upon summing indicator values for positive or negative keywords or sentiments in on-line media recently consumed or produced, and positive or negative values associated with a classification of the user’s location.
- Likewise an estimated state category may be selected by template matching user factor values to predetermined values indicative of a given category, or similarly identifying a least-mean-squares error between user factors and a template of user factor values for each candidate category, optionally with different categories and greater error having different linear or non-linear weightings, reflecting their relative salience in identifying the category.
- Finally as an example, a multivariate state may comprise deriving individual indications of state according to any of the above examples; hence a single value stress level may be generated as discussed above for each of physiological and contextual indicators, and a social flexibility value may be determined based upon scores previously associated with different times of day, location and class of specific individual (e.g., partner versus child); or a social flexibility classification may be based matching templates to such scores and/or values for the underlying input data.
Alternatively or in addition, the estimation processor may use look up tables to convert input data from the obtaining processor into estimated states.
In one instance, these look up tables may simply provide a precomputed implementation of the above predetermined rules, algorithms and/or heuristics, to avoid repetition of these calculations either at the server, or on a device within the delivery ecosystem that has limited processing capability but is acting as the estimation processor or sharing its role, such as the delivery device 10, or a dock 200, vending machine 300, wearable device 400, or associated phone 100.
In another instance, such look up tables may provide associations between input values from the obtaining processor and output values of user states, state classifications and/or multivariate states previously derived according to any suitable mechanism, such as for example feedback from extensive user testing, or as described later herein, the output of a machine learning system; again in this latter case, a look up table may potentially provide a computationally simpler facsimile of such a machine learning system by recording pairs of inputs and outputs for common values that may be easier to implement on devices within the delivery ecosystem having a comparatively low computational power.
Alternatively or in addition, the estimation processor may model correlations between input data and estimated states of the user. Such correlations may be due to causal links between a user factor and a user state, or a tendency for the user factor to accompany a cause of the user state, hence acting as a proxy, typically with particular degree of probability. Similarly such correlations may be due to the user factor and the user state both responding to a separate cause or circumstance in a manner that is sufficiently repeatable to form a correlation. Likewise such correlations may be due to the user state giving rise to the user factor. Hence more generally correlations relate to measurably predictable correspondences between one or more user factors (whether individual, subsets or class level user factors as output by the obtaining processor) and a user state (whether a single value, a classification or multivariate), typically either due to a causal link (in either direction between user factor and state), a common cause resulting in responses in user factor and user state with a repeatable relationship at least at a statistical level, and/or a measurable correspondence regardless of whether a direct or indirect causal link is known.
Where the estimation processor models correlations, it may be trained using a data set comprising as inputs data corresponding to the above described outputs of the obtaining processor, and as target outputs descriptors of a state of the user, whether single value, a classification, or multivariate, for example based upon a direct measurement of a user’s state and/or user self-reporting regarding their state.
The specific means by which such correlations may be derived include any suitable technique for estimating such correlations, including a correlation map between inputs and outputs, where presentation of an input and output at the same time (or within a predetermined time window, if a temporal factor is included) results in a reinforcement of the link between the specific inputs and outputs (for example by increment of a connective weight). Once trained on the dataset, a new input will result, by virtue of the connective weights, in the activation to a greater or lesser extent of one or more candidate states correlating with that input; the candidate state with the strongest activation may then be chosen as the user state, or such states may be ranked by activation strength. It will be appreciated that in such a system, multiple input values may be provided simultaneously, corresponding to individual, subset of class level user factors as described elsewhere herein, and the generated outputs may correspond to a single value state, a classification, or a multivariate state with a number of values representing different aspects of the user state as described elsewhere herein being output.
A specific example of a correlation map is a neural network, and any suitable form may be considered.
More generally, any suitable machine learning system capable of determining a correlation or other predictable correspondence between one or more inputs and one or more outputs may be considered.
Given the above described dataset, such machine learning systems are typically supervised and may for example be a supervised classification learning algorithm, for example if the user state is a classification; or a supervised regression learning algorithm, for example if the user state is a single value or multivariate. Other forms of machine learning are also suitable, such as reinforcement learning or adversarial learning, or semi-supervised learning. Furthermore multiple independent machine learning systems separately trained on different or partially overlapping individual, subset or class level outputs of the obtaining processor may be ensembled to improve modelling results, for example to accommodate different configurations of source data due to different patterns of ownership of devices in the delivery ecosystem of different users, and different permissions and habits affecting the availability of online sources of information. It will also be appreciated that a mixture of different machine learning systems may be used in parallel, for example to generate a multivariate state of the user, with for example one or more different elements of the multivariate description been generated by different respective machine learning systems. These respective machine learning systems may be on separate hardware (e.g. based on dedicated neural processors) but more typically may be on the same hardware (e.g. software based machine learning systems that are loaded and run as required).
Meanwhile unsupervised learning algorithms may also be considered; hence for example associative learning may determine the probability that if one input or pattern of input is present then the user will be in a given state.
Examples of the above machine learning systems, in the forms of algorithms and/or neural networks, will be known to the skilled person.
Meanwhile machine learning may optionally also be used to prepare (e.g. pre-process) data, either at the estimation processor and/or in the obtaining processor; hence for example clustering (for example k-means clustering) may be used to classify a diverse set of inputs into a class level user factor of the type described previously herein. Such an approach may be used or also used for example to derive classifications for user states, as per the second example of a state category classification described previously herein, in response to inputs from the obtaining processor or available feedback actions of the feedback processor.
Similarly as a preparatory step at the estimation processor and/or obtaining processor, dimension reduction, such as principal component analysis, may be employed to reduce the number of inputs whilst retaining information having a significant correspondence with the user state.
Hence in summary the estimation processor, if generating explicit estimates of user state, uses a repository for the correspondence between available inputs from the obtaining processor and the estimated states, where that repository for the correspondence may be embodied in algorithms, rules or heuristics, and/or in one or more look up tables, and/or in one or more trained machine learning systems.
In each case, the result is an estimation of the user state, which may take the form of a single value, a category, or a multivariate description/representation of the user state as described previously herein.
Meanwhile the operation of the estimation processor if generating implicit estimates of user state, is described later herein.
Feedback Proposals from an Estimated StateAs noted previously herein, the estimation processor may operate in a two-step process; in the first step estimating a user state from inputs comprising one or more user factor or data derived from such user factors by the obtaining processor, as described previously herein, and in the second step generating a proposed feedback action expected to alter a user’s state, as will be described below.
In principle, the second step may be implemented by the feedback processor rather than the estimation processor, or may be shared between the feedback processor and the estimation processor. Alternatively the feedback processor may simply receive the proposed feedback action. In any case, the feedback processor may then select the feedback action (either by default if only one is proposed, or selecting one or more if a plurality are proposed), or optionally act to cause one or more feedback actions proposed by the estimation processor to occur in an appropriate manner within the delivery ecosystem.
For the purposes of explanation, the second step is described herein as occurring within the estimation processor.
The two-step process may be chosen for practical reasons; for example, training sets for use in modelling the correspondence/correlation between user factors or their derivations by the obtaining processor and user state may be easier to generate or acquire than training sets for use when directly modelling the correspondence/correlation between user factor based inputs and proposed feedback actions, because the user’s state may be either directly measurable, or straightforward for a user to report.
Similarly it may be easier to generate a training set determining the correspondence/correlation between a measurable and/or self-reported user state and a proposed feedback action, based for example upon user questionnaires ranking feedback actions for given states, and/or upon the subsequent effectiveness of an implemented feedback action in altering the state of the user toward a more desirable state, as measured and/or reported by the user. The optional timing of such a questionnaire is described elsewhere herein. In many embodiments a more desirable state is one which improves the user’s subjective sense of well-being and/or moves physiological or neurological indicators of the user’s state toward a preferred norm (for example reducing elevated heart rate, galvanic skin response, elevated skin temperature, and/or breathing rate, and the like).
The input for the second step will in many embodiments be an estimation of the user state, represented by a single value, a category, or a multivariate description as described previously herein, or a plurality of these if multiple states are estimated (for example with varying degrees of activation/strength of correlation in response to the inputs of the first step). Optionally, inputs to the second step may also comprise one or more user factors and/or inputs as provided by the obtaining processor; for example, as described elsewhere herein certain physiological measurements may be useful indicators/proxies for the user state, such as galvanic skin response, heart rate, breathing rate, skin temperature and the like. Hence optionally one or more of these or any other inputs to the first stage, may also be provided for the second stage in conjunction with the or each estimated state.
In any event, as with the estimation of the user state, the generation of a proposed feedback action may use any suitable mechanism that embodies a correspondence/correlation between the estimated user state and the proposed feedback action.
As noted previously, this may include predetermined rules, algorithms and or heuristics to convert estimated states into proposed feedback action.
- For example, a single value state (such as degree of stress) may drive a corresponding proposed feedback action, such as increasing the proportion of active ingredient within an inhaled unit volume of generated aerosol, which in turn may be achieved by modifying heater, air flow, reservoir and/or other payload storage settings, and the like, which as described later herein may be managed by the feedback processor. The relationship between the degree of stress and the change in active ingredient may be linear or non-linear, or may change qualitatively at different values, for example not changing at all for low levels of stress, have a linear relationship for medium levels of stress, and have an asymptotic relationship for high degrees of stress up to a maximum proportion of active ingredient, and for example at or near this maximum also modifying a behaviour of the user interface of the delivery device or other device within the ecosystem, such as issuing a warning or calming message on the user’s phone.
- Meanwhile for example a single category state may have a corresponding proposed feedback action.
- Finally for example a multivariate state may result in a corresponding proposed feedback action being based on weighted or unweighted contributions from the different elements of the state description, and/or different feedback actions may be proposed based on overlapping or non-overlapping subsets of the elements of the state description. Hence for example if the state description suggests that the user is stressed and are in a work environment, then the feedback action may assume that they are implicitly stressed because they are in the work environment, but are currently unable to increase their intake of active ingredient, and therefore issue a message on a UI of the delivery device or other devices in the ecosystem, such as the user’s phone, to suggest the user that they take a break. Meanwhile if the user is stressed but not in their work environment, then the feedback action may be similar to the degree of stress example above, resulting in an increase in the proportion of active ingredient delivered to the user.
- As noted above, any one of these may also be accompanied by one or more inputs to the first step.
Again like the estimation of user state, the estimation processor may alternatively or in addition use look up tables to convert state estimation data into proposed feedback actions.
Alternatively or in addition, again like the estimation of user state, the estimation processor may model correlations between estimated user states and proposed feedback actions, and the use similar techniques to do so.
Where the estimation processor models correspondences/correlations, it may be trained using a data set comprising as inputs data corresponding to the estimated user state (for example in the form of single values, classifications, or multivariate descriptions, or a combination of these) and optionally also inputs from the obtaining processor as described previously herein, and as target outputs proposed feedback actions.
The proposed feedback actions are discussed in more detail later herein, but may in many embodiments comprise at least one type of action and optionally one or more variables characterising the performance of that action. Hence for example a change in vaporisation temperature is a type of action, and an increase or decrease, or amount of increase or decrease, would represent a variable characterising the performance of that action. Similarly modifying active ingredient concentration in the aerosol is a type of action, and an increase or decrease in concentration, or an amount of increase or decrease, would represent a variable characterising the performance of that action.
Hence as a non-limiting example in the context of a machine learning system, different output nodes may represent different types of action, and the values of those nodes may represent either a flag indicating selection of that feedback action, or a value relating to a variable of that feedback action, depending on how the system is trained. It will also be appreciated that multiple output nodes may be associated with one or more types of action in a machine learning system, depending on the training regime.
It will be appreciated that potentially a plurality of feedback actions may be indicated in response to an estimated user state. In such circumstances, the feedback processor may subsequently determine whether to select just one feedback action, for example based upon the degree of change caused by the action as implied by its associated variable or variables, or implement multiple feedback actions in parallel or sequentially, in the latter case optionally a sequence determined by a predetermined order, or again responsive to the strength of activation of a flag output node for each feedback action, and/or the degree of change implied by each action’s associated variable or variables.
It will also be appreciated that to train such a machine learning system, measured and/or reported user states could be provided as inputs, and respective proposed feedback actions could be provided as targets, with actions and values selected according to their reported efficacy during user trials for users having the corresponding user state; again in this case efficacy or effectiveness typically relates to the user’s perceived improvement in state, and/or a change in neurological and/or physiological state toward a predetermined norm or preferred state.
Optionally as first training phase, simulated states and corresponding feedback actions could be used to provide initial training (for example based on questionnaire results as described previously), with a proportionally smaller cohort of real-world training data then being used to refine the model.
Optionally, feedback from the user themselves as to the efficacy and/or suitability, desirability, practicality etc., of any feedback actions could be further used to refine the model and effectively personalise it to the user. Again this feedback may be reported by the user for example via a user interface on a device within the delivery ecosystem such as the delivery device or their phone, and/or based on measurements of neurological and/or physiological response. Where plural feedback actions are implemented or indicated, optionally the user may rank them in order of preference.
In summary, the two-step process, comprising an explicit estimation of user state as a first or interim step, may be of use where these steps better fit the available underlying empirical data sets used to model the correspondences/correlations, whether this is done by rule-based techniques or machine learning.
Objectively, the operation of the estimation processor in this mode is thus to take inputs from the obtaining processor, typically in the form of different individual, subset and/or or class level user factors, and output one or more proposed feedback actions either simply identifying the action in a manner similar to a flag, and/or identifying the degree of relevance of that action to the estimated state based on the activation level and output corresponding to the proposed feedback action, and/or indicating a change or amount of change of one or more variables that at least in part characterise the proposed feedback action.
The explicit estimation of the user state is thus typically an internal, interim step. However it will be appreciated that this estimate could be relayed to the user for their information, and optionally the user could modify the estimate, particularly where the estimate or a component of the estimate in a multivariate description relates to a subjective measure or to a proxy of a subjective measure such as the user’s sense of stress. Hence for example the estimate could be displayed on a user interface of the user’s mobile phone, and the user could use this information to self-assess, and make changes to the estimate as a result. The modified estimate of the user’s state could then be used together with or instead of the originally generated estimate in the second step to generate a proposed feedback action that may be more accurate than the proposal based on the original estimate of the user’s state.
Furthermore, any changes made to the estimate of the user’s state could be used to update and refine the model of the first step, and indeed for certain machine learning techniques, a lack of correction by the user may similarly be taken as a positive reinforcement of the estimate for the purposes of training.
As mentioned previously herein, if further training is not desired, then optionally the relationships between input and output values derived by the machine learning process may be captured in one or more look up tables, which may be computationally simpler to use (though may occupy more memory).
Implicit State EstimationIn an embodiment of the description, rather than using the two-step process described above, the estimation processor performs a single step process that implicitly estimates a state of the user as part of the relationship between individual, subset and/or or class level user factors provided as input by the obtaining processor, and proposed feedback actions generated as an output and typically expected to alter a user’s state.
Hence an estimation processor (1020) adapted to calculate an estimation of user state based upon one or more of the obtained user factors may equally be an estimation processor (1020) adapted to generate a proposed feedback action state based upon one or more of the obtained user factors; in this case the user state is implicit in the relationship between the user factors and the proposed feedback action, which is expected to alter the implicitly estimated state of a user.
In a similar manner to the two-step process described previously herein, the estimation processor may use predetermined rules, algorithms and/or heuristics to convert input data from the obtaining processor into estimated states. These may for example combine the processes for the two separate steps of the explicit state estimation embodiments, and/or refine some or all of the rules, diagrams and/or heuristics in response to the single step nature of the implicit state estimation approach, or may be derived from scratch for the singe step process.
Again like the two-step process, the estimation processor may alternatively or in addition use look up tables to convert input data into proposed feedback actions. Again these may be concatenations of look up tables from the two-step approach, and/or may be further processed to provide single step look-up tables, or may be derived from scratch for the singe step process.
Again like the two-step process, the estimation processor may alternatively or in addition use machine learning. In this case for example, inputs used in the first step of explicit state estimation, and targets used in the second step of generating proposed feedback actions from the estimated steps, may be used to train a machine learning system that identifies measurable correspondences between them.
It will be appreciated that to present corresponding inputs and targets for training purposes, the training set should have captured this correspondence; as noted previously herein, it may be that datasets exist for the inputs and a user state, and user states and effective feedback actions; consequently inputs and feedback actions may be married for training purposes based upon the common user state value, class or multivariate descriptors as appropriate; clearly also where the training datasets were collected by users for whom user factors were measured and/or self-reported, user states were measured and/or self-reported, and subsequent efficacy and/or suitability, desirability, practicality etc., of feedback actions were measured and/or self-reported, then these self-consistent sets of input user factors (as provided by the obtaining processor) and target feedback actions may be used for training.
Alternatively or in addition, a two-step system with explicit state estimation, which has been trained on separate datasets, and/or uses respective rules, algorithms and/or heuristics from the two steps, and/or uses look up tables from the two steps, may be used as a data source.
For example, a single step look-up table may be created by running through the first and second steps of look-up tables or rules, algorithms and/or heuristics, and/or machine learning systems for a two-step estimation to provide look up links between inputs as provided by the obtaining processor, and proposed feedback actions generated by running through the two-step process using those inputs.
Alternatively or in addition, a single step machine learning system may be trained by running through the first and second step of look up tables or rules, algorithms and/or heuristics, and/or machine learning systems for a two-stage estimation to provide inputs as provided by the obtaining processor, and provide as targets for training proposed feedback actions generated by running through the two step process using those inputs.
Optionally, a single step machine learning system trained in this manner may then have its training refined using additional data, such as a combined training set as described above and/or, in a similar manner to that described previously herein for the step scheme, data received from one or more users during use of the user feedback system.
It will also be appreciated for example that a training set may be based directly on capturing the desired input and target values rather than using an amalgam of datasets or processes.
It will be appreciated that for either the two-step approach or the single step approach, training data may be gathered using one or more devices in the delivery ecosystem, for example to build a training set relating user factors to user states. Such a training set may be generated using a version of the user feedback system that does not generate a proposed feedback action, but simply gathers the user factors and user state information. Similarly a training set relating user states to proposed feedback actions may initially be based upon asking users, for whom their state is known (e.g. measured/reported) to rate proposals for feedback actions, for example via a user interface on their phone as part of a user testing scheme. Hence in this case the feedback system may propose feedback actions and select one or more of the proposed actions, but in different versions or modes may either present the selected proposed feedback action(s) to the user for evaluation (for example via a user interface) for example during a training-data gathering phase or a calibration phase (for example to characterise the user within a subgroup to which responses may be better tailored, as disclosed elsewhere herein), and/or may cause the selected proposed feedback action(s) to be implemented, either modifying of one or more operations of at least a first device within the delivery ecosystem, or prompting the user to do so, responsive to the estimation of user state (whether explicitly or implicitly modelled), in a manner expected to alter the estimated state of a user. Training data relating user factors to proposed feedback actions may be obtained in a similar manner.
Hence such datasets may be obtained using a version or mode of the user feedback system that as noted above does not actually cause a modification to one or more operations of a device in the ecosystem (optionally except for eliciting a response from the user, e.g. for training data purposes).
This preceding generation of the user feedback system, or training/refinement mode of the user feedback system, could thus comprise an obtaining processor (1010) operable to obtain one or more user factors indicative of user state, and operable to obtain user state data (for example based on measurements similar to those of user factors, and/or self-reporting by the users), and or feedback action preference/efficacy data; the estimation processor would then comprise a training or development phase in which the correspondences/relationships/correlations between inputs based on the user factors as described previously and targets based on the user states (in the two-step scheme) or the proposed feedback actions (in the single-step scheme) are modelled as described previously, for example once a sufficient corpus of data had been amassed.
Alternatively or in addition, in such a preceding generation and/or in a training mode of a feedback system, the delivery device and/or other participating devices in the delivery ecosystem may consequently only upload data to the obtaining processor, but not download feedback actions (or optionally any other data) from the feedback system.
Similarly, in either such a preceding generation and/or in a training mode of a feedback system, and/or in providing improved or supplementary input for the feedback system in normal use, then as mentioned elsewhere herein user factors such as from neurological / physiological data (e.g. from biometric sensing), motion and/or location user factors (e.g. from touch, accelerometer or GPS sensors), contextual user factors, and/or any of the other user factors disclosed herein may be accompanied by direct input on the user’s state as reported by the user. This may be used for the generation of a training set, as described previously, but alternatively or in addition the user’s reported state may be treated as a user factor by the obtaining processor, or directly by the estimation processor.
The user’s reported state may be obtained based upon results of a questionnaire presented to the user, for example via a user interface on a device within the delivery ecosystem such as for example the user’s mobile phone or delivery device. Such a questionnaire may simply ask the user to select a state that best approximates their subjective understanding of their own state, for example from a menu or drop-down box, and/or may ask questions to which the choice of answer by the user may be indicative of the user’s state. Such a questionnaire may be provided periodically, or in response to some event, for example relating to a detected user factor or a value associated with the user factor reaching a certain threshold. Hence for example a questionnaire may be provided in response to certain calendar events, or in response to a user visiting a certain location, or a user’s heart rate exceeding a predetermined threshold. Optionally the frequency with which a questionnaire is provided to the user may be limited, so that the user does not become annoyed by the questionnaire process. Similarly optionally the extent of the questionnaire may be varied so that direct self-assessment is more frequent than assessment based on responses to questions as described above, where this is provided.
More generally, and also in relation to other questionnaires described herein, the presentation of, offer to present, or request to fill in, a questionnaire to the user may optionally depend on a number of factors. For example, questionnaires about the user’s cultural background may only need to be done once e.g. as part of an initial set up process, and optionally confirmed e.g. annually. Meanwhile other questionnaires may be periodic, e.g. monthly or weekly, or passively await update from the user, such as the user’s current weight. Further questionnaires may be event based, for example in response to a detected deviation in puff frequency or behaviour, or in response to a feedback intervention. In these cases, optionally there is also a time-out in which the same or other questionnaires are not asked within a predetermined period (e.g. 1-N hours or a day), so as to avoid overwhelming the user. Optionally if the user has agreed to more intensive questioning (e.g. as part of a system training programme) then questionnaires may be asked more regularly, e.g. ever couple of hours, when the user is awake.
In principle the user’s reported state may optionally be used in lieu of an explicit state estimation by the estimation processor, but it is possible that at least in some cases the user’s reported state will be approximate compared to what may be derivable, or estimated from some measurements (if these are available), or the user may not be informed by all the facts available to the feedback system. Furthermore, some users may normalise their state and self-report in a biased manner, particularly for pathological states such as depression. Hence optionally the user’s direct input on their state may be used in conjunction with one or more other user factors from the obtaining processor as described above as input to the estimation processor, in the first (or only) step as described above. Optionally, alternatively or in addition the user’s direct input on their state may be used in conjunction with an estimation of their state as input to the second step of the estimation processor, if the two-step technique is used.
Other variations in training and input may also be considered. For example it will be appreciated that as noted previously herein, different user factors operate or vary over different time scales. Consequently for either the two-step approach or the single step approach for the estimation processor as described herein, user factors that are not expected to have changed within an interval between successive operations of the estimation processor may be stored and re-used (for example in storage 1012), rather than being re-obtained.
Furthermore, some parts of the estimation model relating to these longer term factors may not need to be re-run if the outcomes for those factors are expected to remain the same. This may be straightforward for rule, algorithm and/or heuristic methods, and/or look-up tables, but for a machine learning system it may require a modified architecture; for example a two-stage ML or multi-layer system may be trained on all inputs, but subsequently run with inputs or outputs relating to long-term user factors clamped, and the previously computed intermediate results of that part of the ML system fed into the remaining part of the ML system in conjunction with newly generated intermediate results from user factors with shorter time frames.
It will also be appreciated that as noted previously herein, different users may have different combinations of devices within their delivery ecosystem, and/or different combinations of these devices may be active at any one time; similarly, different users may have greater or lesser presence on social media, or use their digital calendar to a greater or lesser extent, and the like. Consequently the user factors available to the obtaining processor and hence also the inputs available to the estimation processor may differ from user to user, and/or from time to time. Accordingly, the estimation processor may use different models (explicit or implicit, as discussed above) to propose feedback actions, depending upon the inputs available. Alternatively or in addition, where an input to a model is missing, a neutral input value may be provided so as to reduce or remove the influence of that missing input on the feedback action proposed. The number of different models provided by/for the estimation processor may therefore depend upon the number of data sources assumed for a model (with more sources or more diverse sources making the model potentially more fragile), and the robustness of the model to the replacement of inputs with placebo/neutral values where an input is currently unavailable; in this latter case it will be appreciated that some inputs may be more critical than others, so at least some individual inputs may be required for a model to run. Hence depending upon the complexity and robustness of the model, it may be that only one model is needed, or a suite of models anticipating different scenarios. Optionally, a subset of all available models is selected for a user depending upon the devices known to exist in their delivery ecosystem; meanwhile new models may be added when new devices join the delivery ecosystem, whether permanently for example in the case of the user buying a new dock 200, or temporarily for example in the case of the user interacting with a vending machine or point-of-sale device.
Estimation Processor OutputWhether a single step or two step process is used, and whether the estimation for any step is based on rules, algorithms, and/or heuristics, look up tables, and/or machine learning, the output of the estimation processor is a proposed feedback action.
Possible feedback actions differ qualitatively and/or quantitatively.
Hence for example they may vary qualitatively based on whether they relate to modifying the generation of aerosol for the user (whether in response to current circumstances or pre-emptively); modifying the user’s interaction with the delivery device or system, either during inhalation or between inhalations; modifying the user interface of the delivery device or system; reminding the user to use or change their use of a delivery device or system; recommending an operation or selection of a delivery device or delivery device consumable; and/or recommending/activating/modifying the operation of a device that is not directly related to the delivery of active ingredient, but may nevertheless change the user’s state, either directly (for example through biofeedback) or indirectly (for example by activating noise cancellation in a user’s headphones).
Hence more generally feedback actions may fall into categories that are behavioural, focusing on altering actions and/or habits of the user to change their state; pharmaceutical, focusing on how one or more active ingredients delivered to the user may change their state; and non-consumption interventions, focusing on alternative first or third party options (i.e. relating to the delivery device or other devices in the delivery ecosystem or elsewhere) to change a user’s state.
Meanwhile proposed feedback actions may vary qualitatively depending on the extent to which the effect of the feedback action is desired to make a positive change in the user’s state; hence for example in the delivery device a change to heater temperature, payload aerosolisation, payload composition, or the like may comprise a quantitative value indicating the degree of change, or class of change, as appropriate. Similarly modifications to a user interface in the delivery device or another device of the delivery ecosystem may comprise incremental steps relating to the number of user interactions required or prompted with the delivery system, and the nature of those user interactions; for example running through five categories, with the first category having no notifications to minimise interruption of the user, a second category only having critical notifications such as for low battery or low payload, a third category corresponding to a default in which critical and non-critical notifications are provided, a fourth category further including recommendations and/or prompts to engage the user with other features of the user interface, and a fifth category additionally including an audible tone. These five categories may be selected according to the user state on a scale of how stressed they are (for example with minimal notifications for high stress), and/or how bored they are (for example with high notification for high boredom).
As noted previously, the type of feedback action, and/or the amount or class of change, if appropriate, may be identified according to rules, algorithms, and/or heuristics, look up tables, and/or machine learning as appropriate.
Similarly as noted previously, where more than one type of feedback action, and/or more than one amount or class of change is calculated/estimated to be an appropriate response to the user factors/user state, optionally multiple feedback actions may be proposed accordingly, or the top N feedback actions may be selected based for example upon strength of activation, where N may be one or more.
Feedback ProcessorThe feedback processor 1030 is operable to implement one or more proposed feedback actions, thereby causing modification of one or more operations of a device within the delivery ecosystem, responsive to the estimation of user state.
Hence the feedback processor may act to cause the feedback action or actions proposed by the estimation processor to occur in an appropriate manner within the delivery ecosystem.
The feedback action or actions are in many embodiments implemented in a manner expected to alter the estimated state of a user. This user may be considered a generic, average, notional user; it will be appreciated that the model or models upon which the generation of the proposed feedback action(s) is/are based are in many embodiments developed or trained using data from a corpus of users, and hence relate to changing the state of a generic, average, or notional user.
However, in many embodiments this will nevertheless similarly alter the state of the particular user of a respective delivery device, on the basis that most users are likely to respond in a similar manner to these changes.
However as described elsewhere herein, if the feedback system can receive further feedback from the individual user (for example by measurement or self-reporting) as to the efficacy of proposed feedback actions, then optionally the system can become increasingly tailored towards the particular user, for example through supplementary training and/or refinement of parameters, and hence implement feedback actions responsive to the estimation of user state in a manner expected to alter the estimated state of the particular user. Similarly, separate rules, algorithms, and/or heuristics, look up tables, or machine learning systems may be generated for different user groups, for example based on demographics and/or patterns of response to feedback actions, so that the proposed feedback actions are better tailored to a particular user falling within one of these groups, even if measured or reported assessments of feedback efficacy are not available from the particular user, or are too sparse to effectively refine the training of a machine learning system or alter the parameters of an algorithm etc., to personalise its response to them.
Like the obtaining processor and the estimation processor, the feedback processor 1030 may co3mprise one or more physical and/or virtual processors and may be located within the remote server 1000, and/or its functionality may be distributed or further distributed over multiple devices within the delivery ecosystem, including but not limited to the user’s mobile phone 100, a docking unit 200, a vending machine 300, and the delivery device 10 itself. The feedback processor may comprise one or more communication inputs, for example to receive data from the estimation processor 1010, and one or more communication outputs, for example to communicate with the delivery device 10, and/or another device within the delivery ecosystem 1 such as those listed above, or any other device that may participate in a feedback action.
In particular, the feedback processor may optionally comprise a selection and notification sub-processor (not shown) which may be located at the server and/or at a device within the delivery ecosystem with suitable computational power, such as a vending machine or mobile phone, to optionally select one or more feedback actions and select one or more respective devices within the ecosystem for implementing one or more feedback actions; and optionally an action implementation sub-processor (not shown) at one or more respective devices within the ecosystem for managing the implementation of a feedback action. Optionally, the action implementation sub-processor may be considered a separate processor to the feedback processor.
Herein, references to the selection and notification sub-processor and the feedback processor, or the action implementation sub-processor and the feedback processor, may each be considered interchangeable; it will be appreciated that whilst these sub-processors may be complementary hardware to the feedback processor, and/or effectively share a role of the feedback processor, they may equally be functions of the feedback processor operating under suitable software instruction. Meanwhile as noted above, optionally at least the action implementation sub-processor may be a separate processor to the feedback processor, for example communicating with the feedback processor via the Internet.
Selection and NotificationOptionally, the selection notification sub-processor may select one or more feedback actions generated by the estimation processor in a manner as described previously herein, if the estimation processor indicates more than one feedback action may be appropriate. Clearly, if only one feedback action is proposed, then as a default this would be selected.
For a selected feedback action, the selection notification sub-processor may then select which device or devices within the delivery ecosystem should implement the feedback action, and formulates a command/notification/instruction for the or each device characterising the type and/or amount of the feedback action. It will be appreciated that where a device is only capable of one feedback action, then the type may be implicit in the act of notification, and similarly where a device is only capable of one amount feedback action, then the amount may be implicit in the act of notification. Any device within the delivery ecosystem could potentially comprise a feedback means. It will be appreciated therefore that potentially the device or devices that provide user factor data to or for the obtaining processor within the delivery ecosystem are different to the device or devices implementing the or each feedback action.
Optionally, the selection notification sub-processor may poll devices within the delivery ecosystem to determine their availability for the purposes of providing a feedback action. For devices that may be accessible by the processor, for example by the Internet, then devices registered in association with the user or the user’s delivery device (such as for example the delivery device 10, mobile phone 100, wearable device 400, docking device 200) may be polled directly.
For devices that may only be accessed via an intermediary device, for example via Bluetooth ® connection to an accessible device, the accessible device may be asked to poll such indirect devices. Hence for example the selection notification sub-processor may cause/request the user’s mobile phone 100 to poll a delivery device 10, wearable device 400 or docking device 200, if these are only accessible via a local wired or wireless connection.
For devices that are not formally associated with the user or only intermittently associated with the user, such as a vending machine 300 or other point of sale system, the selection notification sub-processor may receive location data from a device within the delivery ecosystem associated with the user, such as their mobile phone 100 or delivery device 10, and compare this with a registered or reported location of the vending machine 300; if the locations are within a threshold distance of each other, then the vending machine may be considered part of the delivery ecosystem whilst that condition holds true. Alternatively or in addition, the selection notification sub-processor may instruct an accessible device to either poll for any compatible vending machines, or broadcast a Bluetooth beacon identifying the accessible device, for example using a single-use ID so that the accessible device is identifiable without revealing details of the user or their associated devices; such an ID may comprise a component identifying the purpose of the ID to enable detection by the vending machine, followed by the single use component unique to the user or their associated device; a compatible vending machine in accordance with embodiments of the present invention may then optionally recognise the single use ID and relay it back to the selection notification sub-processor, thereby informing it that the user has accessible devices within local wireless range of the vending machine. It will be appreciated that whilst the above makes reference to a vending machine, this is an example for the purposes of explanation, and these techniques may apply to any device not formally associated with a user or only intermittently associated with them, such as a car or train, a WiFi® or Bluetooth ® hotspot in a shop, a smart TV, or the like.
Optionally, devices outside the user’s own deliver ecosystem may be selected. For example, a delivery device and/or a phone or other device of a friend or family member associated with the user (for example following registration of these people by the user) may be used to inform that friend or family member of the user’s status, so that the friend or family member can intervene. Optionally the user can set the conditions under which this occurs, and/or which friends or family members are notified. Similarly, devices within a predetermined proximity of the user may be selected. For example, if the user is in a good mood, compatible devices within a predetermined radius of the user may all synchronise a feature such as a colour of a light, to signal to these users that there is scope for an enjoyable social encounter.
Using one or more of these techniques, the selection notification sub-processor may thus determine what devices are currently available to deliver a feedback action.
In many embodiments, a feedback action will be specific to a particular device within the delivery ecosystem or a pair of devices cooperating to fulfil a function; consequently, for a proposed feedback action or selected feedback action, optionally the selection notification sub-processor may only poll the device or devices within the delivery ecosystem that are relevant to that feedback action.
Similarly, it will be appreciated that certain devices within the delivery ecosystem may provide input data to the feedback system that is used to generate the proposed feedback action; consequently such input activity from devices may be logged as indicating their accessibility, and/or it may be implicit from the proposed feedback action that certain devices are currently accessible to the feedback system; in either case, a poll of the devices may not be necessary, or the receipt of input data may be treated as an effective poll result if a polling scheme is in place.
In the event that the device or devices relevant to that feedback action are not available (e.g. do not respond to the poll), then optionally the feedback processor/selection notification sub-processor may choose the next proposed feedback action in the top N feedback actions, if multiple feedback actions were proposed by the estimation processor. If no relevant device is available for a feedback action, then the feedback processor may not implement any feedback action, and/or send a notification to the user to that effect, for example via a user interface of the user’s phone, or if the user’s phone, as the accessible device for linking to other devices within the ecosystem, is not available, then notifying the user via a text or similar other mechanism that will reach the user once they are contactable again.
In the event that the device or devices relevant to a feedback action are available (i.e. do respond to the poll, or have responded to a poll within a predetermined preceding period of time during which it may be assumed the device is still accessible, or have contributed input data within a predetermined preceding period of time), then the feedback processor will transmit one or more commands to the device or devices for implementing the feedback action as proposed by the estimation processor.
As noted above, the nature of the commands may depend upon the proposed action and the target device or devices. In some cases, the simple existence of the command will be sufficient to specify the proposed action, for example to turn a device on when it is off. In other cases, the command will need to specify the type of feedback action, for example in relation to changing heater function, payload type, user interface behaviour or the like within the delivery system. In either of these cases, the command may need to specify the amount of feedback action, for example to specify the change in temperature, the concentration of active ingredient or flavouring within the payload, or selected parameters for the user interface.
As noted above, the command may be directly to an accessible device, or may be to request that an accessible device relays a command to another device within the ecosystem, or itself issues a command to such a device; for example the feedback processor may instruct the user’s mobile phone 100 to issue commands to the delivery device 10. Further degrees of indirection may be envisaged, such as the user’s mobile phone issuing commands to a dock 200, which in turn may modify settings of the delivery device when it is docked (for example to charge power or payload). It will similarly be appreciated that the feedback processor may issue commands of different kinds to different devices; hence for example a command may be issued directly to the mobile phone to change aspects of its user interface, and to a dock 200 (either directly if it is capable, or via the phone), causing it to change a composition of a payload to be provided to the delivery device, and also change one or more settings on the delivery device when it is docked. It will be appreciated that other permutations of commands such as these, whether direct, indirect, or a mix of the two, may be envisaged within the delivery ecosystem.
As described elsewhere herein, will be appreciated that different feedback actions may relate to behavioural, pharmaceutical and/or non-consumption aspects of the delivery ecosystem.
Behavioural feedback actions are typically focused on altering actions and habits of the user relating to operations of, and/or interactions with, a device within the delivery ecosystem other than operations relating to an amount or nature of an active ingredient delivered by the delivery device itself, although this can occur in parallel. Examples may relate to the use of changes in flavour or flavour concentration, changing vapour mass delivery to modify inhalation behaviour; modification to scheduling schemes or reminders relating to delivery device usage or correlated with delivery device usage; changes to user interfaces, whether on the delivery device on another device in the delivery ecosystem, in terms of information provided, mode of feedback (e.g. haptic and/or visible such as coloured lights, graphical themes, and/or messages); for example providing a traffic light UI display on the delivery device, such as an LED, to alert the user to how they are using the device), and the like.
Pharmaceutical feedback actions focus on pharmaceutical interventions to change the state of the user, and typically relate to interventions based on active ingredients, such as the amount or type, and when these are changed (for example reactively or pre-emptively, for example based upon correlations between current user factors and future user states or feedback actions), and the like. Such acts can also relate to selecting alternative modes of consumption, for example switching from vaping to snus or vice versa.
Non-consumption feedback actions typically relate to activating/controlling or simply recommending the use of devices not specifically related to the consumption of the active ingredient, such as aromatherapy systems/steamers, biofeedback devices, headphones (for example activating noise cancellation, or modifying volume or music selection), vehicle use (for example stress warnings, or route selection / reselection to longer but less congested or slower routes), and the like.
The selection notification sub-processor may be comprised of one or more real or virtual processors, and its functionality may be located or distributed within the server and/or one or more devices within the delivery ecosystem as appropriate.
Action ImplementationThe action implementation sub-processor may be optional; for example some devices may accept commands directly with no further interpretation or processing required. In this case the action implementation sub-processor may be either thought of as not required, or having its role implemented by the feedback processor / selection and notification sub-processor.
Meanwhile, in some cases the role of the action implementation sub-processor may in fact pre-exist within the device, which for example is capable of interpreting user interface commands to implement changes to the operation of the device; in this case, the commands from the feedback processor may optionally simply replicate such user interface commands.
In other cases, the action implementation sub-processor may be separately provided, for example by adapting a conventional processor according to suitable software instruction. Such an example may be an app on a user’s mobile phone, operable to receive commands and modify one or more of aspects of the mobile phone and/or the app on the mobile phone, the delivery device, and/or one or more other devices in the delivery ecosystem. Similarly, a dock 200 for the delivery device may comprise such an action implementation sub-processor, as may some varieties of delivery device.
The action implementation sub-processor operates to implement the feedback action on the or each relevant device. Hence for example if a command relating to a feedback action describes changing heater temperature of the delivery device, then the action implementation sub-processor may change the power supply to the heater, and/or a duty cycle of the heater, to implement the specified change.
Similarly for example if a command relating to a feedback action describes reducing ambient noise levels for the user, then the action implementation sub-processor for a pair of noise cancelling headphones may activate the noise cancelling function; the action implementation sub-processor for the user’s mobile phone may reduce the volume level of music being played into those headphones, and display a message to the user suggesting that they seek to avoid sources of noise in their environment.
The specific actions implemented by respective sub-processors may thus depend on the nature of the proposed feedback action and the nature of the device within the delivery ecosystem, but will typically represent a direct translation of the proposed feedback action into the mechanism by which it may be enacted within device.
As noted previously herein, feedback actions may be accompanied or followed up by requests or opportunities for the user to report on their efficacy. Alternatively or in addition, feedback actions may be accompanied or followed up by positive reinforcement of the expected state change, for example through a message on a UI, or a change of interface colour, haptic response or the like, or for example a positive goal being met in an app for a wearable. The reinforcement may be a simple message indicating that the feedback has occurred, or may be based upon measurements, for example to report that the user’s heart rate has lowered, or to confirm that an action has worked well (by changing the user’s state, typically as evidenced by a change to one or more user factors, or as self-reported by the user). The perception and/or expectation of a change in state engendered by such positive reinforcement can increase the effectiveness of at least some feedback actions.
The action implementation sub-processor may be comprised of one or more real or virtual processors, and its functionality may be located or distributed within the server and/or one or more devices within the delivery ecosystem as appropriate.
ProcessorsAs noted previously, the obtaining processor, estimation processor, and feedback processor (and any sub processors) may comprise one or more real or virtual processors located within one or more servers and/or within the delivery ecosystem. Furthermore it will be appreciated that the demarcation of roles described herein is not fixed; for example the obtaining processor may receive information directly indicative of user state (for example by user self-reporting), and so the first step of a two step process by the estimation processor could be bypassed or supplemented by the obtaining processor; similarly in this case, the feedback processor may, for example, look up a corresponding proposed feedback action. Hence in this example, the role of the estimation processor is carried out by the obtaining processor and the feedback processor. Hence more generally these processors are representative of tasks that may be implemented by any processor under suitable software instruction, and can equivalently be considered to comprise a data gathering task, a feedback proposal task (whether or not based on an explicit estimation of the state of the user), and either a feedback training task or a feedback delivery task.
In an embodiment of the description, as noted elsewhere herein data may be collected from sensors on the delivery device and transmitted to a companion device within the delivery ecosystem such as a user’s phone. The data may optionally undergo at least some pre-processing by the delivery device prior to transmission. As noted elsewhere herein, such sensor data from the delivery device may then be associated with data from other sources (e.g. information relevant to the user’s state before, during and/or after the recording of the sensor data, such as the previously mentioned environmental, deterministic, contextual, neurological, physiological, indirect, and historical data) to generate multiple source associated data. This data may be sent to a backend server (e.g. at least part of the obtaining server function occurs at such a server). Alternatively the data may be processed with the smartphone operating as the obtaining processor, and the function of the estimation processor may be implemented on one of the phone, the back end server, or a mix of the two. In this case the function of the feedback server may similarly be implemented on one of the phone, the back end server, or a mix of the two (for example depending on the nature of the feedback or follow-on activities; actions such as sending notifications or product requests may be conducted by the back end server in one embodiment, or the phone in another). The combination where all three processors are implemented by the smartphone has the advantage of privacy for the user because no data is sent to a back end server. Alternatively for example, the function of the estimation processor may be performed by the server as this is likely to be computationally complex; meanwhile the inputs to the estimation processor may be machine readable only and optionally associated with an anonymised request (e.g. a single use request number), so that the data may be processed without the user of the back end server being able to determine the inputs or estimated state of a particular user.
Summary EmbodimentsIn a summary embodiment of the present description, a user feedback system for a user of a delivery device within a delivery ecosystem (1), comprises the following.
Firstly, an obtaining processor (1010) adapted to obtain two or more user factors indicative of a user state, wherein a first obtained user factor is based upon at least a first aspect of the user’s operation of the delivery device; and wherein a second user factor is based upon at least a second aspect of the user’s situation separate to their operation of the delivery device, which occurs during one or more selected from the list consisting of a predetermined period preceding the user’s operation of the delivery device, and a predetermined period following the user’s operation of the delivery device, as described elsewhere herein. It will be appreciated that consequently the user factors may relate to situations at least partially characterised by one or more of indirect/historical data, contextual data and environmental or deterministic data as described elsewhere herein.
Secondly, an estimation processor (1020) adapted to identify a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second user factor, as described elsewhere herein.
In an instance of the summary embodiment, the user feedback system comprises a circular data, and the circular data buffer is configured to record data descriptive of the second user factor, as described elsewhere herein.
In this case, optionally when the user operates the delivery device, for a second user factor which occurs during a predetermined period preceding the user’s operation of the delivery device, the circular data buffer is configured to output, for association with data of the first obtained user factor, recorded data descriptive of the second user factor for the predetermined period, as described elsewhere herein.
Similarly in this case, optionally when the user operates the delivery device, for a second user factor which occurs during a predetermined period following the user’s operation of the delivery device, the circular data buffer is configured to record data that is descriptive of the second user factor following the user’s operation of the delivery device for the predetermined period, and is configured to subsequently output the recorded data for association with data of the first obtained user factor, as described elsewhere herein.
Similarly in this case, optionally when the user operates the delivery device, for a second user factor which occurs during the user’s operation of the delivery device, the circular data buffer is configured to record data that is descriptive of the second user factor during the user’s operation of the delivery device, and is configured to subsequently output the recorded data for association with data of the first obtained user factor, as described elsewhere herein.
Similarly in this case, optionally the circular buffer is configured to record one selected from the list consisting of 5 seconds’ worth of data, 10 seconds’ worth of data, 15 seconds’ worth of data, 30 seconds’ worth of data, 45 seconds’ worth of data, and 60 seconds’ worth of data, as described elsewhere herein, or equivalently a predetermined number of data points (e.g. where the data of the second aspect is collected at wider intervals, and/or is event triggered rather than periodic).
In an instance of the summary embodiment, the data of the second obtained user factor is used to provide contextual data (or metadata or the like) for the data of the first obtained user factor, as described elsewhere herein.
In an instance of the summary embodiment, the operation of the delivery device comprises one selected from the list consisting of activation of a user interface to trigger generation of an aerosol by the delivery device, and an inhalation action on the delivery device to trigger generation of an aerosol by the delivery device, as described elsewhere herein.
In an instance of the summary embodiment, the user feedback system comprises a feedback processor (1030) adapted to select at least a first feedback action identified by the estimation processor for at least a first device within the delivery ecosystem, as described elsewhere herein.
In this instance, optionally the feedback processor may be adapted to cause a modification of one or more operations of at least a first device within the delivery ecosystem according to the or each selected feedback action, as described elsewhere herein. Subsequently in this case, optionally the device within the delivery ecosystem for which one or more operations is modified is the delivery device (10), as described elsewhere herein.
In an instance of the summary embodiment, data relating to at least a first aspect of the user’s situation upon which at least a first of the user factors is based is obtained from a physical sensor.
In this instance, optionally such a physical sensor is a microphone, and the obtained data relates to one or more selected from the list consisting of background noise levels, background media playback (e.g. from music or video), and the user’s speech (whether vocal tone or spoken content), as described elsewhere herein.
Similarly in this instance, optionally such a physical sensor is a camera, and the obtained data relates to one or more selected from the list consisting of whether the user is alone or not, whether the user is with one or more known individuals, and the user’s facial expression, as described elsewhere herein.
In an instance of the summary embodiment, data relating to the second user factor is obtained from a textual analysis of content that the user has interacted with, as described elsewhere herein.
In this instance, optionally the content comprises one or more selected from the list consisting of social media posts the user is reading or sending, news articles the user is reading, websites the user is visiting, searches the user is making online, test messages the user is reading or sending, content of calls the user is participating in, and the content of conversations the user is having, as described elsewhere herein.
Similarly in this instance, optionally the content comprises calendar information for the user, as described elsewhere herein. In this case, optionally the calendar information indicates one or more selected from the list consisting of a person the user is currently or about to meet, an event the user is currently or about to attend, a location the user is currently or about to visit, and a task the user is currently or about to perform, as described elsewhere herein.
Again similarly in this instance, optionally content comprises one or more user responses to a questionnaire relating to the state of the user, as described elsewhere herein.
In an instance of the summary embodiment, data relating to the second user factor is obtained from the user’s interaction with devices within the delivery ecosystem other than the delivery device (10), as described elsewhere herein.
In this instance, optionally the user’s interaction comprises one or more selected from the list consisting of a choice of app used by the user, a choice of device by the user to interact with, a duration of interaction by the user with a chosen app or device, a type of interaction by the user with a chosen app or device, and a type of media consumed with a chosen app or device, as described elsewhere herein.
In an instance of the summary embodiment, data relating to the second user factor is obtained from data indicative of the user’s environment, as described elsewhere herein.
In this instance, optionally the data indicative of the user’s environment is based upon one or more selected from the list consisting of the user’s current or next location, whether the user is in an open or enclosed space, whether the user is in daylight or artificial light, the user’s current mode of transport, and the weather at the user’s location, as described elsewhere herein.
In an instance of the summary embodiment, data relating to the second user factor is obtained from data indicative of the user’s social situation, as described elsewhere herein.
In this instance, optionally the data indicative of the user’s social situation is based upon one or more selected from the list consisting of whether the user is alone or with one or more others, whether the user is with one or more work colleagues, whether the user is with one or more friends, whether the user is with one or more family members, and whether the user is with one or more children, as described elsewhere herein.
In an instance of the summary embodiment, data relating to the second user factor is obtained from data indicative of a past history of the user, as described elsewhere herein.
In this instance, optionally the data indicative of the past history of the user is based on one or more selected from the list consisting of the user’s place of birth, a cultural background of the user, a religion of the user, a purchase history of the user, and settings preferences of the user for one or more devices of the delivery ecosystem, as described elsewhere herein.
In an instance of the summary embodiment, the estimation processor is operable to use a plurality of user factors as input when identifying a corresponding feedback action, as described elsewhere herein.
In this instance, optionally at least a further user factor (i.e. one of the plurality other than the at least first) is selected from the list consisting of a user factor based upon a self-reported indication of a user’s state from the user, a user factor based upon a physiological sensor data from the user, and a user factor based upon motion and/or location analysis, as described elsewhere herein.
Similarly in this instance, optionally at least a further user factor is based upon sensor data from the delivery device (10), as described elsewhere herein.
In an instance of the summary embodiment, the estimation processor does not generate an explicit estimation of user state as an interim step in the identification of the one or more proposed feedback actions, as described elsewhere herein.
In an instance of the summary embodiment, the estimation processor uses different respective machine learning systems responsive to the composition of the one or more user factors provided as input to the estimation processor, as described elsewhere herein.
In an instance of the summary embodiment, the estimation processor is operable to generate one or more proposed feedback actions relating to one or more selected from the list consisting of a behavioural feedback action for affecting at least a first behaviour of the user, pharmaceutical feedback action for affecting the consumption of an active ingredient by the user, and a non-consumption feedback action for affecting one or more non-consumption operations of the delivery ecosystem, as described elsewhere herein.
In an instance of the summary embodiment, the delivery ecosystem comprises one or more selected from the list consisting of one or more delivery devices (10), one or more mobile terminals (100), one or more wearable devices (400), and one or more docking units (200) for the or each delivery device, as described elsewhere herein.
Meanwhile, in an instance of the summary embodiment, the functionality of one or more of the obtaining processor, estimation processor, and feedback processor is provided at least in part by one or more processors located within one or more devices (10, 100, 200, 300, 400) of the delivery ecosystem (1), or the remote server (1000).
Referring now to
In a first step s710, obtaining two or more user factors indicative of a state of the user. As described previously herein, this may be a function of the obtaining processor (1010), or may be performed by one or more devices/processors/data sources operating collectively or in parallel as the obtaining processor or for the obtaining processor, or which may share such functionality with the obtaining processor.
Notably, a first obtained user factor is based upon at least a first aspect of the user’s operation of the delivery device whilst a second obtained user factor is based upon at least a second aspect of the user’s situation separate to their operation of the delivery device. As noted elsewhere herein, such a second aspect of the user’s situation may relate to one or more of indirect or historical aspects, circumstantial aspects, or environmental or deterministic aspects. Such aspects may have a degree of overlap with each other, or with usage or physiological aspects (e.g. chronic health may be both a physiological aspect and also historic, circumstantial or deterministic, depending on the health matter and how it influences the user’s situation).
Moreover, the second aspect occurs during one or more selected from the list consisting of a predetermined period preceding the user’s operation of the delivery device, and a predetermined period following the user’s operation of the delivery device (though this does not preclude the second aspect also occurring during the user’s operation of the delivery device).
In a second step s720, identifying a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second user factors. As described previously herein, this may be a function of the estimation processor (1020). More generally, it may be a function of a processor of the feedback system, in many embodiments located within a server remote to the delivery ecosystem, but optionally located in one or more devices of the delivery ecosystem operating collectively or in parallel as the estimation processor or for the estimation processor, or which may share such functionality with the estimation processor.
It will be apparent to a person skilled in the art that variations in the above method corresponding to operation of the various embodiments of the apparatus/system as described and claimed herein are considered within the scope of the present disclosure, including but not limited to:
- in an instance of the summary embodiment, recording data descriptive of the second user factor in a circular buffer, as described previously herein;
- in this instance, optionally when the user operates the delivery device, for a second user factor which occurs during a predetermined period preceding the user’s operation of the delivery device, the method comprises the step of outputting, for association with data of the first obtained user factor, recorded data descriptive of the second user factor for the predetermined period, as described previously herein;
- similarly in this instance, optionally when the user operates the delivery device, for a second user factor which occurs during a predetermined period following the user’s operation of the delivery device, the method comprises the steps of recording in the circular data buffer data that is descriptive of the second user factor following the user’s operation of the delivery device for the predetermined period, and subsequently outputting the recorded data for association with data of the first obtained user factor, as described previously herein;
- similarly in this instance, optionally when the user operates the delivery device, for a second user factor which occurs during the user’s operation of the delivery device, the method comprises the steps of recording in the circular data buffer data that is descriptive of the second user factor during the user’s operation of the delivery device, and subsequently outputting the recorded data for association with data of the first obtained user factor, as described previously herein;
- in an instance of the summary embodiment, the data of the second obtained user factor is used to provide contextual data (or metadata, labelling, classification data or the like) for the data of the first obtained user factor, as described previously herein;
- in an instance of the summary embodiment, the operation of the delivery device comprises one selected from the list consisting of activation of a user interface to trigger generation of an aerosol by the delivery device, and an inhalation action on the delivery device to trigger generation of an aerosol by the delivery device, as described previously herein;
- in an instance of the summary embodiment, selecting at least a first feedback action for at least a first device within the delivery ecosystem, as identified in the estimation step, that is expected to alter the estimated state of a user. As described previously herein, this may be a function of the feedback processor (1030), which in turn may comprise one or more of the selection and notification sub-processor and the action implementation sub-processor. More generally, it may be a function of a processor of the feedback system, in many embodiments located within a server remote to the delivery ecosystem, but optionally located in one or more devices of the delivery ecosystem operating collectively or in parallel as the feedback processor or a sub-processor thereof or for such a processor, or which may share such functionality with the feedback processor or a sub-processor thereof, as described elsewhere herein;
- hence in an instance of the summary embodiment, selecting at least a first feedback action identified by the estimation step for at least a first device within the delivery ecosystem, as described elsewhere herein;
- in this instance, optionally causing a modification of one or more operations of at least a first device within the delivery ecosystem according to the selected feedback action, as described elsewhere herein;
- in this instance, optionally the device within the delivery ecosystem for which one or more operations is modified is the delivery device, as described elsewhere herein;
- in an instance of the summary embodiment, data relating to the second user factor is obtained from at least a first physical sensor, as described elsewhere herein;
- in an instance of the summary embodiment, data relating to the second user factor is obtained from a textual analysis of content that the user has interacted with, as described elsewhere herein;
- in this instance, optionally the content comprises calendar information for the user, as described elsewhere herein;
- in this instance, optionally the content comprises one or more user responses to a questionnaire relating to the state of the user, as described elsewhere herein;
- in an instance of the summary embodiment, data relating to the second user factor is obtained from the user’s interaction with devices within the delivery ecosystem other than the delivery device (10), as described elsewhere herein;
- in an instance of the summary embodiment, data relating to the second user factor is obtained from data indicative of the user’s environment, as described elsewhere herein;
- in an instance of the summary embodiment, which data relating to the second user factor is obtained from data indicative of the user’s social situation, as described elsewhere herein;
- in an instance of the summary embodiment, data relating to the second user factor is obtained from data indicative of a past history of the user, as described elsewhere herein;
- the estimation step comprises using a plurality of user factors as input when identifying a corresponding feedback action, as described elsewhere herein;
- in this instance, optionally at least a further user factor is selected from the list consisting of a user factor based upon a self-reported indication of a user’s state from the user, a user factor based upon a physiological sensor data from the user, and a user factor based upon motion and/or location analysis, as described elsewhere herein;
- in this instance, optionally at least a further user factor is based upon sensor data from the delivery device (10), as described elsewhere herein; and
- in an instance of the summary embodiment, the estimation step comprises generating one or more proposed feedback actions relating to one or more selected from the list consisting of a behavioural feedback action for affecting at least a first behaviour of the user, a pharmaceutical feedback action for affecting the consumption of an active ingredient by the user, and a non-consumption feedback action for affecting one or more non-consumption operations of the delivery ecosystem, as described elsewhere herein.
It will be appreciated that the above methods may be carried out on conventional hardware suitably adapted as applicable by software instruction or by the inclusion or substitution of dedicated hardware. Examples of such hardware have been described previously herein, for example in relation to server 1000 and the devices of the delivery ecosystem 1.
Thus the required adaptation to existing parts of a conventional equivalent device may be implemented in the form of a computer program product comprising processor implementable (computer executable) instructions stored on a non-transitory machine-readable medium such as a floppy disk, optical disk, hard disk, solid state disk, PROM, RAM, flash memory or any combination of these or other storage media, or realised in hardware as an ASIC (application specific integrated circuit) or an FPGA (field programmable gate array) or other configurable circuit suitable to use in adapting the conventional equivalent device. Separately, such a computer program may be transmitted via data signals on a network such as an Ethernet, a wireless network, the Internet, or any combination of these or other networks.
Claims
1. A user feedback system for a user of a delivery device within a delivery ecosystem, comprising:
- an obtaining processor adapted to obtain two or more user factors indicative of a state of the user,
- wherein a first obtained user factor of the two or more user factors is based upon an aspect of the user’s operation of the delivery device; and
- wherein a second obtained user factor of the two or more user factors is based upon an at aspect of the user’s situation separate from the user’s operation of the delivery device, the aspect of the user’s situation occurring during one or more selected from the list consisting of: i. a predetermined period preceding the user’s operation of the delivery device, ii. a predetermined period following the user’s operation of the delivery device, and iii. a period during the user’s operation of the delivery device; and
- an estimation processor adapted to identify a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second obtained user factors.
2. The user feedback system according to claim 1, comprising:
- a circular data buffer; and in which: the circular data buffer is configured to record data descriptive of the second obtained user factor.
3. The user feedback system according to claim 2, in which:
- when the user operates the delivery device, for the second obtained user factor which occurs during the predetermined period preceding the user’s operation of the delivery device,
- the circular data buffer is configured to output, for association with data of the first obtained user factor, recorded data descriptive of the second obtained user factor for the predetermined period preceding the user’s operation of the delivery device.
4. The user feedback system according to claim 2, in which:
- when the user operates the delivery device, for the second obtained user factor which occurs during the predetermined period following the user’s operation of the delivery device,
- the circular data buffer is configured to record data that is descriptive of the second obtained user factor following the user’s operation of the delivery device for the predetermined period following the user’s operation of the delivery device, and is configured to subsequently output the recorded data for association with data of the first obtained user factor.
5. The user feedback system according to claim 2, in which:
- when the user operates the delivery device, for the second obtained user factor which occurs during the period during the user’s operation of the delivery device,
- the circular data buffer is configured to record data that is descriptive of the second obtained user factor during the user’s operation of the delivery device, and is configured to subsequently output the recorded data for association with data of the first obtained user factor.
6. The user feedback system according to claim 2, in which:
- the circular buffer is configured to record one selected from the list consisting of: i. 5 seconds’ worth of the data; ii. 10 seconds’ worth of the data; iii. 15 seconds’ worth of the data; iv. 30 seconds’ worth of the data; v. 45 seconds’ worth of the data; and vi. 60 seconds’ worth of the data.
7. The user feedback system according to claim 1, in which
- data of the second obtained user factor is used to provide contextual data for data of the first obtained user factor.
8. The user feedback system according to claim 1, in which the operation of the delivery device comprises one selected from the list consisting of:
- i. activation of a user interface to trigger generation of an aerosol by the delivery device; and
- ii. an inhalation action on the delivery device to trigger generation of an aerosol by the delivery device.
9. The user feedback system according to claim 1, comprising:
- a feedback processor adapted to select the corresponding feedback action identified by the estimation processor for the delivery device within the delivery ecosystem.
10. The user feedback system according to claim 9, in which
- the feedback processor is adapted to cause a modification of one or more operations of at the delivery device within the delivery ecosystem according to the selected corresponding feedback action.
11. (canceled)
12. The user feedback system according to claim 1, in which data relating to the second obtained user factor is obtained from a textual analysis of content that the user has interacted with.
13. The user feedback system according to claim 12, in which the content comprises one or more selected from the list consisting of:
- i. one or more social media posts that the user is reading or sending;
- ii. one or more news articles that the user is reading;
- iii. one or more websites that the user is visiting;
- iv. one or more searches that the user is making online;
- v. one or more text messages that the user is reading or sending;
- vi. content of one or more calls that the user is participating in; and
- vii. content of one or more conversations that the user is having.
14. The user feedback system according to claim 12, in which the content comprises calendar information for the user.
15. The user feedback system according to claim 14, in which the calendar information indicates one or more selected from the list consisting of:
- i. a person that the user is currently meeting or about to meet;
- ii. an event that the user is currently attending or about to attend;
- iii. a location that the user is currently visiting or about to visit; and
- iv. a task that the user is currently performing or about to perform.
16. The user feedback system according to claim 12, in which the content comprises one or more user responses to a questionnaire relating to the state of the user.
17. The user feedback system according to claim 1, in which data relating to the second obtained user factor is obtained from the user’s interaction with devices within the delivery ecosystem other than the delivery device.
18. The user feedback system according to claim 17, in which the user’s interaction comprises one or more selected from the list consisting of:
- i. a choice of app used by the user;
- ii. a choice of device within the delivery ecosystem by the user to interact with;
- iii. a duration of interaction by the user with a chosen app or a chosen device within the delivery ecosystem;
- iv. a type of interaction by the user with a chosen app or a chosen device within the delivery ecosystem; and
- v. a type of media consumed with a chosen app or a chosen device within the delivery ecosystem.
19. The user feedback system according to claim 1, in which data relating the second obtained user factor is based is obtained from data indicative of the user’s environment.
20. The user feedback system according to claim 19, in which the data indicative of the user’s environment is based upon one or more selected from the list consisting of:
- i. the user’s current or next location;
- ii. whether the user is in an open or enclosed space;
- iii. whether the user is in daylight or artificial light;
- iv. the user’s current mode of transport; and
- iv. weather at the user’s location.
21. The user feedback system according to claim 1, in which data relating to the second user factor is obtained from data indicative of the user’s social situation.
22. The user feedback system according to claim 21, in which the data indicative of the user’s social situation is based upon one or more selected from the list consisting of:
- i. whether the user is alone or with one or more others;
- ii. whether the user is with one or more work colleagues;
- iii. whether the user is with one or more friends;
- iv. whether the user is with one or more family members; and
- v. whether the user is with one or more children.
23. The user feedback system according to claim 1, in which data relating to the second user factor is obtained from data indicative of a past history of the user.
24. The user feedback system according to claim 23, in which the data indicative of the past history of the user is based on one or more selected from the list consisting of:
- i. the user’s place of birth;
- ii. a cultural background of the user;
- iii. a religion of the user;
- iv. a purchase history of the user; and
- v. settings preferences of the user for the delivery device or one or more other devices of the delivery ecosystem.
25. The user feedback system according to claim 1, in which
- the estimation processor is operable to use a plurality of the two or more user factors as input when identifying the corresponding feedback action.
26. The user feedback system according to claim 1, in which the estimation processor does not generate an explicit estimation of user state as an interim procedure in the identification of the corresponding feedback action.
27. The user feedback system according to claim 1, in which the estimation processor uses different respective machine learning systems responsive to a composition of the two or more user factors provided as input to the estimation processor.
28. The user feedback system according to claim 1, in which the estimation processor is operable to generate the corresponding feedback action relating to one or more selected from the list consisting of:
- i. a behavioral feedback action for affecting at least a first behavior of the user;
- ii. a pharmaceutical feedback action for affecting consumption of an active ingredient by the user; and i. a non-consumption feedback action for affecting one or more non-consumption operations of the delivery ecosystem.
29. The user feedback system according to claim 1, in which the delivery ecosystem comprises one or more selected from the list consisting of:
- i one or more mobile terminals;
- ii one or more wearable devices; and
- iii one or more docking units for the delivery device.
30. The user feedback system according to claim 9, in which functionality of one or more of the obtaining processor, estimation processor, and feedback processor is provided at least in part by one or more processors located within the delivery device or one or more other devices of the delivery ecosystem, or a remote server.
31. A user feedback method for a user of a delivery device within a delivery ecosystem comprising:
- obtaining two or more user factors indicative of a state of the user,
- wherein a first obtained user factor of the two or more user factors is based upon an aspect of the user’s operation of the delivery device; and
- wherein a second obtained user factor of the two or more user factors is based upon an at aspect of the user’s situation separate from the user’s operation of the delivery device, the aspect of the user’s situation occurring during one or more selected from the list consisting of: i. a predetermined period preceding the user’s operation of the delivery device, ii. a predetermined period following the user’s operation of the delivery device, and iii. a period during the user’s operation of the delivery device; and
- identifying a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second obtained user factors.
32. The user feedback method of claim 31 comprising:
- recording data descriptive of the second obtained user factor in a circular buffer.
33. The user feedback method of claim 32 in which:
- when the user operates the delivery device, for the second obtained user factor which occurs during the predetermined period preceding the user’s operation of the delivery device, the method comprises:
- outputting, for association with data of the first obtained user factor, recorded data descriptive of the second obtained user factor for the predetermined period preceding the user’s operation of the delivery device.
34. The user feedback method of claim 32, in which:
- when the user operates the delivery device, for the second obtained user factor which occurs during the predetermined period following the user’s operation of the delivery device, the method comprises: recording in the circular data buffer data that is descriptive of the second obtained user factor following the user’s operation of the delivery device for the predetermined period following the user’s operation of the delivery device; and subsequently outputting the recorded data for association with data of the first obtained user factor.
35. The user feedback method of claim 32, in which:
- when the user operates the delivery device, for the second obtained user factor which occurs during the period during the user’s operation of the delivery device, the method comprises: recording in the circular data buffer data that is descriptive of the second obtained user factor during the user’s operation of the delivery device; and subsequently outputting the recorded data for association with data of the first obtained user factor.
36. The user feedback method of claim 31, in which
- data of the second obtained user factor is used to provide contextual data for data of the first obtained user factor.
37. The user feedback method of claim 31, in which
- the operation of the delivery device comprises one selected from the list consisting of: i. activation of a user interface to trigger generation of an aerosol by the delivery device; and ii. an inhalation action on the delivery device to trigger generation of an aerosol by the delivery device.
38. The user feedback method according to claim 31, comprising a step of:
- selecting the corresponding feedback action identified by the estimation step for the delivery device within the delivery ecosystem.
39. The user feedback method according to claim 38, comprising:
- causing a modification of one or more operations of the delivery device within the delivery ecosystem according to the selected corresponding feedback action.
40. (canceled)
41. The user feedback method according to claim 31, in which data relating to the second obtained user factor is obtained from at least a first physical sensor.
42. The user feedback method according to claim 31, in which data relating to the second obtained user factor is obtained from a textual analysis of content that the user has interacted with.
43. The user feedback method according to claim 31, in which data relating to the second obtained user factor is obtained from the user’s interaction with devices within the delivery ecosystem other than the delivery device.
44. The user feedback method according to claim 31, in which data relating to the second obtained user factor is obtained from data indicative of the user’s environment.
45. The user feedback method according to claim 31, in which data relating to the second obtained user factor is obtained from data indicative of the user’s social situation.
46. The user feedback method according to claim 31, in which data relating to the second obtained user factor is obtained from data indicative of a past history of the user.
47. (canceled)
48. The user feedback method according to claim 31, in which identifying comprises generating the corresponding feedback action relating to one or more selected from the list consisting of:
- i. a behavioral feedback action for affecting at least a first behavior of the user;
- ii. a pharmaceutical feedback action for affecting consumption of an active ingredient by the user; and
- iii. a non-consumption feedback action for affecting one or more non-consumption operations of the delivery ecosystem.
49. A computer program stored on a non-transitory machine-readable medium comprising computer executable instructions adapted to cause a computer system to perform; identifying a corresponding feedback action expected to alter a state of the user as indicated at least in part by the first and second obtained user factors.
- obtaining two or more user factors indicative of a state of the user,
- wherein a first obtained user factor of the two or more user factors is based upon an aspect of the user’s operation of the delivery device; and
- wherein a second obtained user factor of the two or more user factors is based upon an aspect of the user’s situation separate from the user’s operation of the delivery device, the aspect of the user’s situation occurring during one or more selected from the list consisting of: i. a predetermined period preceding the user’s operation of the delivery device, ii. a predetermined period following the user’s operation of the delivery device, and iii. a period during the user’s operation of the delivery device, and
50. (canceled)
Type: Application
Filed: Jun 22, 2021
Publication Date: Sep 21, 2023
Inventors: Patrick MOLONEY (London), Juan Esteban Paz JAUREGUI (London), Flavio MACCI (London), Justin Han Yang CHAN (London), Catalin Mihai BALAN (London), Johanna KUENZEL (London), Matthew HODGSON (London), Howard ROUGHLEY (London)
Application Number: 18/002,955
