CONTEXT BASED NOTIFICATIONS USING MULTIPLE PROCESSING LEVELS IN CONJUNCTION WITH QUEUING DETERMINED INTERIM RESULTS IN A NETWORKED ENVIRONMENT
In some implementations, a notification for presentation to a user is identified. An action for the user to perform in response to receiving the notification is identified, where the action is associated with the notification. Context data generated using sensor data from one or more devices associated with the user is received. The context data indicates a current context of the user, where the context data indicates at least one of an activity of the user or a physiological state of the user. The context data is used to evaluate an ability of the user to perform the action associated with the notification in the current context. A manner of providing of the notification by the one or more devices associated with the user is customized based on the evaluation of the ability of the user to perform the action.
The application is a continuation of U.S. application Ser. No. 15/804,201, filed Nov. 6, 2017, now allowed, which is incorporated by reference in its entirety.
FIELD OF THE INVENTIONThe systems and methods described herein relate to the processing of input digital data in a networked environment of computer processing devices, amongst a networked community of users, in conjunction with generating one or more related electronic communications.
BACKGROUNDIn the present technological environment, various services, user device applications and other platforms provide information and notifications to users based on observed events and/or in some predetermined scheduled manner, for example.
Current notifications systems are designed to send notifications to users uncertain if the user will see or act upon the notification. Therefore, notifications are often sent more than once. Such systems may have fallback notification options if the first notification attempt was unsuccessful. However, this leads to even more notifications being transmitted, inefficient use of the devices, inefficiency of the communication channels, and inefficiency of the network. The current inefficient systems not only clog networks with multiple and redundant notifications, they also clog the user's device with redundant notifications, consume excessive power of the user's device and the network, and consume bandwidth. These inefficiencies cost the consumer and provider.
Therefore, technical improvements and solutions are needed to overcome this technical problem while accommodating the evolving needs of users. The systems and methods of the present invention provide such improvements.
SUMMARYThe systems and methods of the invention provide a notification system that analyzes the state of the user to deliver notifications when the user is anticipated to be both cognitively receptive AND able to act upon external stimuli. In accord with at least one aspect, the system assesses the physiological context (of a user) both inward and outward by interpreting the user and surroundings in order to reach a general state of the user. In a technically efficient manner—utilizing different levels of processing in conjunction with leveraging previously performed processing through queuing results of such processing—the system provides the ability to reduce scenarios in which missed or inappropriate notifications (due to cancellation by user, inability to react, and avoidance due over stimuli, for example) occur. In accord with aspects of the invention, systems and methods of the invention perform processing, in a technically efficient manner, to assess data input from sensors (in the real-world environment in which a user exists) and responsively generate appropriate notifications or other communications that are output to a user or a person associated with the user.
In accord with at least one aspect, from a high-level, the system in the background evaluates one or more signals, i.e. inputs for example, driving a suggested notification before responding to such input. The signal is evaluated by reviewing its criteria for notifications along with the physiology of the user. The system makes the determination both whether the signal triggering the request is meaningful, and if the user, at that moment in time, should or could react to a notification. The system can otherwise, delay, dismiss or transfer the notification between users of the system and/or persons associated with users of the system, in accordance with at least one aspect of the invention.
Because evaluating the anticipated reaction and reception of the user is subjective, the system must know more about the individual and her surroundings in order to provide a meaningful action on behalf of the user. This requires the assessment of physiological data as a genetic makeup for the internal processing—including the processing required to determine whether the message is appropriate and deliverable.
In the systems and methods of the invention, assessment is carried out by collecting information either directly by the server or servers or through a backend server counterpart that can synchronize with the application. Information that is collected may occur through several interfaces that enable communication to environmental sensors, health sensors, activities and tasks, and economy inputs, for example. Each of these interfaces, devices and sensors help convey, to the system, data regarding what the user is currently doing, what she might be feeling, where she might be, and whether it is a good time to ask the particular user to perform a particular task, for example.
Once these many data points are interpreted such data points are matched to a given scenario for the user that can change how the notification message appears, what sound it plays, and what device or system it is delivered to for best responsiveness.
The present invention provides a system of networked apparatuses that provide cognitive-like processing based on an aggregation of input data, the processing performed over a network to provide a communication interface amongst the networked apparatuses, each of the apparatuses in the form of a tangibly embodied computer processor, each computer processor including instructions on a non-transitory computer medium disposed in a corresponding database, the system comprising: the network over which the networked apparatuses communicate; a plurality of the networked apparatuses respectively being a data providing (DP) processor, each DP processor provided to input user data regarding a user; a CAND (Context Aware Notification Delivery) server, the CAND server including: a communication portion that interfaces with each of the DP computer processors; a database; and a CAND computer processor, the CAND computer processor performing processing for first window criteria including: interfacing with a first DP processor over the network to input first input data; interfacing with a second DP processor over the network to input second input data; performing first processing to generate a first data aggregation based on at least the first input data and the second input data; performing a determination of whether the first data aggregation satisfies first window criteria; determining that the first data aggregation does not satisfy the first window criteria, but that the first data aggregation does satisfy criteria for a suggested event, and the CAND server, based on the determination of satisfaction of criteria for the suggested event, generating queue data based on said first data aggregation; the CAND computer processor performing processing for second window criteria including: interfacing with a third DP processor over the network to input third input data; interfacing with a fourth DP processor over the network to input fourth input data; performing second processing to generate a second data aggregation based on at least the third input data and the fourth input data; performing a determination of whether the second data aggregation satisfies second window criteria; determining that the second data aggregation does not satisfy the second window criteria; the CAND computer processor performing further processing for the first window criteria including: interfacing with a fifth DP processor over the network to input fifth input data; performing third processing to generate a third data aggregation based on the queue data in conjunction with the fifth input data; performing a determination of whether the third data aggregation satisfies the first window criteria; determining that the third data aggregation does satisfy the first window criteria; the CAND computer processor performing further processing for the second window criteria including: interfacing with a DP processor over the network to input further input data; performing fourth processing to generate a fourth data aggregation based on at least the further data; performing a determination of whether the fourth data aggregation satisfies the second window criteria; determining that the fourth data aggregation does satisfy the second window criteria; the CAND computer processor performing further processing including: performing a determination of whether the first window criteria and the second window criteria are both satisfied; determining that the first window criteria and the second window criteria are both satisfied; and sending, based on the determination that first window criteria and second window criteria are both satisfied, a notification communication associated with the user.
The network may include further data including at least one of the third input data and the fourth input data, such that the fourth processing to generate the fourth data aggregation is performed based on (a) the further data and (b) at least one of the third input data and the fourth input data. The further data including both the third input data and the fourth input data, such that the fourth processing to generate the fourth data aggregation is performed based on (a) the further data and (b) both the third input data and the fourth input data.
One of the plurality of the DP processors may be the CAND server. The first window criteria may be the cognitive window constituted by some first criteria set, and the first criteria set is based in cognitive related attributes. The first criteria set might include at least one of a requisite threshold and a requisite summation of values. The CAND computer processor may assign a weight to at least one of the first input data, the second input data and the fifth input data. The second window criteria might be an accessibility window constituted by some second criteria set, and the second criteria set might be based in accessibility related attributes. The second criteria set might include a requisite threshold and a requisite summation of values. The CAND computer processor might assign a weight to at least one of the third input data, the fourth input data and the sixth input data. One of the DP processors might input data from a sensor associated with the user. The sensor associated with the user might be a heart rate sensor and/or a proximity sensor. The CAND computer processor might determine a communication path, to a target recipient, based on the data input from the DP sensors. The second window criteria might relate to communication data that is associated with the communication path. The target recipient could be the user, or a caregiver associated with the user. The fourth processing, regarding the second window criteria, could be performed as a result of the third processing in which the first window is determined to have been satisfied.
The present invention also provides a notification network providing improved efficiency of sending notifications to a user. The network including a plurality of devices associated with the user; an efficiency analysis processor including instructions on a non-transitory computer medium, the non-transitory computer medium constituted by one of more data storage mediums; a database of known data about the user and the plurality of devices, the database resident on the non-transitory computer medium; and a notification system that sends notification communications to the user through one or more of the plurality of devices. The plurality of devices, efficiency analysis processor, database, and notification system are in communication to form the notification network. Further, the efficiency analysis processor determines physical accessibility of the user by comparing current data from the plurality of devices in the network against known data in the database relating to the user's physical accessibility. The efficiency analysis processor also determining cognitive accessibility of the user by comparing current data from the plurality of devices in the network against known data relating to the user's cognitive abilities. Accordingly, the efficiency analysis processor generates and sends instructions, constituted by generating instruction data and sending the instruction data in a signal, to the notification system to send a notification communication to the user when the following conditions are met: (1) the efficiency analysis processor has determined the notification should be transmitted to the user; (2) the efficiency analysis processor has determined the user is physically accessible; and (3) the efficiency analysis processor has determined the user is cognitively accessible.
The plurality of devices in the network might include computing devices and sensors. The efficiency analysis processor determining physical accessibility of the user based on data associated with the user's use of one of the plurality of devices. Such device may be the user's mobile phone. The devices could include includes a first sensor in the user's home, a second sensor in the user's office, and the user's mobile phone. The plurality of devices could also include a companion computing device associated with a family member of the user or a caregiver. The sensor could be a proximity sensor. The efficiency analysis processor could determine which of the plurality of devices to transmit the notification based on power data of a device, the device being one of the plurality of devices associated with the user. The power data could be the power level of the device or the power consumption profile of the device. The efficiency analysis processor could also determine which of the plurality of devices to transmit the notification based on network efficiency data. The network efficiency data could be the cost of bandwidth along the communication path to a device associated with the user, or the communication path reliability to a device associated with the user, the device being one of the plurality of devices associated with the user. The efficiency analysis processor determining which of the plurality of devices to transmit the notification based on the reliability of the communication path and the cost of bandwidth to a device associated with the user, the device being one of the plurality of devices associated with the user. The instruction data to the notification system could include identification information on which of the plurality of devices should receive the notification. The instruction data to the notification system could include information on the identification of which communication path should be used for sending the notification. The communication path could include one or more paths or links.
The present invention could also provide a notification system, method or software for providing improved efficiency of transmitting a notification to a user. The system could be comprised of: an efficiency analysis processor including instructions on a non-transitory computer medium, the non-transitory computer medium constituted by one of more data storage mediums; a database of known data about the user and about a plurality of devices associated with the user, the database resident on the non-transitory computer medium; and a notification system that transmits notification communications to the user through one or more of the devices. The efficiency analysis processor would be in communication with the plurality of devices associated with the user, the plurality of devices. The devices could be computing devices or sensors, or a combination of many. The efficiency analysis processor could determine the physical accessibility of the user by comparing current data from the devices against known data in the database relating to the user's physical accessibility. The efficiency analysis processor could also determine the cognitive accessibility of the user by comparing current data from the devices against known data relating to the user's cognitive accessibility. Further, the system or the efficiency analysis processor can generate and send instructions, constituted by generating instruction data and sending the instruction data in a signal, to the notification system to send the notification to the user when the following conditions are met: (1) the efficiency analysis processor has determined the notification should be transmitted to the user; (2) the efficiency analysis processor has determined the user is physically accessible; and (3) the efficiency analysis processor has determined the user is cognitively accessible.
Various other features of the systems and methods of the invention are described below.
The present invention will be better understood on reading the following detailed description of non-limiting embodiments thereof, and on examining the accompanying drawings, in which:
Hereinafter, aspects of the systems and methods of the invention will be described in accordance with various embodiments. As used herein, any term in the singular may be interpreted to be in the plural, and alternatively, any term in the plural may be interpreted to be in the singular.
It is appreciated that a feature of one embodiment of the invention as described herein may be used in conjunction with one or more other embodiments as may be desired.
The Self-Monitoring & Notification environment 110 includes health sensors 112, proximity sensors 114, environmental sensors 116, and one or more user devices 118. The Health sensors 112 can be used to measure various aspects of the user's health including heart rate, pulse, blood pressure, weight, and other factors. The proximity sensors 114 are used to identify various aspects about the user including location, and devices in the self-monitoring & notification environment 110. The environmental sensors 116 help to measure various aspects about the environment including temperature, humidity, time of day, weather and other elements. The user devices 118 includes mobile devices, tablets, smart watches and other devices close to the user, for example.
The Local Monitoring & Notification environment 120 includes a local hub 122, local sensors 124, family and neighbor devices and networks 126, and local devices 128. The local hub 122 is resident in the local environment of the user (i.e. the home) and typically connected through a router or other device to a local network. Local sensors 124 are used to identify various aspects about the local network 120 including local devices 128, the status of such devices, available family and neighbor devices and networks 126 and other sensors. The local devices 128 includes mobile devices, tablets, PCs, smart TVs, and other smart devices.
The Remote Monitoring & Notification network 130 monitors the user while at the office or other common but remote location. The Remote network 130 includes a remote hub 132, remote sensors 134, coworkers 136, and remote network devices 138. Similar to the Local network, the remote hub 132, sensors 134, and remote devices 138 interact to create a network for monitoring and connecting a user and their devices to obtain data, transmit to the CAND 200, and receive notifications if appropriate (as determined by the system).
The Transition Monitoring & Notification network 140 connects the user to the system 100 during transition periods like travelling to or from work. The Transition network 140 includes a transition hub 142, transition sensors 144, passengers 146, and transition devices 148. The transition hub 140 could be a car or automotive hub and acts with the transition sensors 144 and devices 148 to connect the user during transitions.
In addition, the network 100 may include Service Provider Monitoring & Notification 150 which includes direct care providers 152, public safety 154, or public health 156 officials. The network 100 can also integrate third-party data or resources 190 including real time data 192 (i.e. weather, news) and medical data 194. The sub-networks connect to the CAND system 200 to create the network 100 of the present system.
The computer processing portion (CPP) 210 includes various processing portions. As shown in
As shown in
As shown in
Additionally, the CPP 210 includes input monitoring portion 215. The input monitoring portion 215 inputs a wide variety of data regarding patterns and/or occurrences. The particular nature of such data may vary widely as may be desired and/or needed for a particular user group, for example.
As reflected in
As shown in
With further reference to
The CPP 210 further includes a delivery manager. In accordance with at least one embodiment of the invention, the delivery manager 217, for example, handles delivery of a notification to a user—upon a suggested system event being deemed “perfected” by the notification manager 216. In some embodiments of the invention, the delivery manager 217 may simply output the notification on a communication channel that is already been determined by the notification manager. In accord with other embodiments, the delivery manager 217 may perform decisioning so as to determine a particular communication channel (perhaps selected from a group of available transmission channels) to use in forwarding the notification to the user. The latter situation reflects a scenario in which the particular communication channel utilized (or to be utilized) was not part of the decisioning of the notification manager, i.e. was not part of the decisioning as to whether or not to send the communication/notification to the user.
The CPP 210 includes further processing portions as shown in
The system 200 further includes database 230 as described above. The database may be in the form of a suitable computer readable medium or collection of computer readable media that serve to store the various wide variety of data used by and/or generated by the CPP 210 (including the various processing portions of the CPP 210 as described above). It is appreciated that the particular architecture of the CPP 210 and the particular architecture of the database 230 may be varied as desired and as is described otherwise herein. The database portion 230, in at least one embodiment of the invention, includes detection function database 231, comparator function database 232, filter function database 233, execute function database 234, user database 235, general operating system (OS) database 236, sensor attribute/communication database 237, and forwarding logic database 238. Such databases hold a wide variety of data, as such data is described below.
The ongoing processing performed by the CAND system includes step 301. In step 301, the system performs user account processing. Such user account processing may relate to on-boarding a new user to the system. On the other hand, such user account processing may include engagement with an existing user, such as to change the profile of an existing user. Further details of such processing are described below with reference to
The ongoing processing of
The ongoing processing of
As shown, the processing of
As referenced above,
As reflected at 312′ of
Accordingly, after the processing of step 312
In general, the processing of
The processing of
As shown in step 324 of
The event suggestion processing of
In further explanation of the processing of step 330, as shown at 330′, system events may be “suggested” in this monitoring process. In other words, the data that is input, from one or more sources, may serve to satisfy a portion of attributes that are requisite for a particular action by the system, i.e. that are requisite for a particular system event by the CAND system. Illustratively, a particular system event may require the system to observe three particular types of input data. If indeed the system observes 2 out of those 3 particular types of input data, such may be interpreted by the system as constituting a suggestion of a system event. In embodiments of the invention, the CAND system then saves that “suggestion” of a system event in a suitable manner, such as in a queue. The system then does not need to re-process the determination—that the original input data (previously input) generated the suggestion of the system event. Rather, the CAND system just looks, in accordance with one embodiment, for that third requisite data input to be observed by the system. Upon such third data input being observed by the system, the CAND system then moves on to performing the particular system event. Accordingly, the systems and methods of the invention solves a technical problem of conserving computer processing bandwidth. Such computer processing bandwidth translates into both time saved as well as energy saved, which would otherwise have been required to perform additional processing. Such saved energy may be critical in particular applications, such as with portable user devices.
The processing of
The input of data in step 340 may include the input of front-end data, such as sensor data. On the other hand, the input of data in step 340 may include the input of backend data. For example, such backend data may include weather system data, news related data, data regarding local events, and/or data regarding nearby system users. Accordingly, the data input of step 340 includes data related to the environment of the user. In further illustration, the data input in step 340 might include data from temperature sensors in the environment of the user or in some other way related to the user. Accordingly, as reflected at 340′ of
The processing of
As reflected in box 350′ of
The processing of
As shown in box 370′ of
As shown in box 370″ of
On the other hand, if yes in step 331′, then the processing passes to step 332. In step 332, the system determines whether the live (i.e. current) input data and/or stored input data satisfies criteria such as trends, thresholds, patterns, for example, so as to be further processed by the system. In other words, in step 332, the system attempts to understand whether there is any meaning to the data as the data is being observed, be that data input previously or currently. If the input data does not satisfy any trends thresholds, patterns, for example, then the decisioning results in a “no” and the process passes to step 332′. In step 332′, the input data is tagged by the system. Accordingly, even though no trends, thresholds, patterns were identified—any newly input data is still tagged in accordance with one embodiment of the invention—so as to be more effectively used in subsequent processing. Additionally, as reflected in step 332″, such data as tagged may contribute to trending updates and/or other aggregated data processing. After the processing of step 332″, the processing then passes back to step 331. Step 332 may be characterized as a STEP 2-2 (Comparator function—see
On the other hand, it may be determined in step 332 that the live input data and/or stored input data does indeed satisfy trends, thresholds, patterns, for example. Accordingly, the process results in a “yes” in step 332—and the processing passes to step 333. In step 333, the system determines whether the input data suggests a system event (SE). Further details are described with reference to
As reflected by box 334′ of
As reflected in box 334″ of
To explain further, essentially, the comparative processing of the invention is looking to see if a system event should be queued based on some earlier criteria for selection. For example, a too high, too low, spike, large difference, etc. style of scenario is detected by the system. As otherwise described herein, such processing addresses a technical problem of reducing battery consumption and/or bandwidth consumption. In particular, the consumption of battery may be critical in the processing in whole or in part that is performed on a user device such as a phone. Further, the consumption of bandwidth may be critical in certain network environments. In general, the processing performed by the invention allows the CAND system to operate in a highly efficient manner conserving both processing consumption, battery consumption, and network bandwidth consumption, for example.
As reflected in box 333(1)′ of
After the processing of step 333(2), the process passes to step 333(3). In step 333(3), the processing retrieves any triggered system events (i.e. suggested system events) that are associated with the data record, which was mapped to. In other words, in accordance with one aspect of the invention, the processing maps the input data to a particular record—and that data record contains data regarding a particular system event that is dictated by the particular sensor data. It is appreciated that such processing may well involve thresholds and/or other criteria to determine whether data of certain value does or does not result in a system event. Step 333(3) may be characterized as a STEP 3-3 (Filter function). Accordingly, in step 333(4), the system determines if a system event is indeed suggested by the input data. Step 333(4) may be characterized as a STEP 3-4 (Execute function). Then, the process passes to step 333(5). In step 333(5), the processing returns to
As is reflected in
As is also reflected in box 333(3)′, not all qualifiers are determined in conjunction with the processing of
In step 360′, input from a sensor, for example, is mapped to a suggested system event. In other words, a suggested system event (resulting from prior input data) has been previously placed into queue. The newly input data, input in step 360′, is associated with such queued suggested system event so as to result in further processing of such queued system event. After the mapping of step 360′, the process passes to step 360. In step 361, the system determines if a “cognitive window” is open so as to evolve the suggested system event to be an actionable suggested system event. The processing then stores the result. Step 361 may also be characterized as a STEP 5-1—Comparator function A (Stage 1).
In other words, the processing of step 361 determines if a suggested system event has evolved into an actionable suggested system event. To explain further, the concept of a suggested system event being evolved means, in accord with one embodiment, that inputs have been received so as to transform a suggested system event to an actionable system event that may be performed by the system. For example, as reflected in box 1501, a cognitive window might be fulfilled by multiple sensors that are being managed through an AND gated Boolean operation. In this example, if only one sensor input matches, then the system will delay until the other requisite sensor is fulfilled. In other words, if a particular system event requires specific data type from two respective sensors, and only one sensor requirement is fulfilled—then such situation may constitute a “suggested system event”. This suggested system event will then be placed into queue. At a later point in time, the other sensor requirement may be fulfilled. This newly input data is then compared to the suggested system event in queue—so as to evolve the suggested system event into an actionable system event. The actionable system event is actionable in that the system will put into motion the processing to perform the perfected system event, but only assuming that the suggested system event is also an accessible system event. Relatedly, as reflected in box 1502 of
If a suggested system event is deemed to have evolved into an actionable system event AND a suggested system event is deemed to have evolved into an accessible system event—then the system deems that the system event has evolved into a perfected system event. In accordance with some embodiments, the evolution of such a suggested system event may or may not include particulars of the delivery mechanism, such as the particular communication channel utilized for the delivery. In other words, if the evolution of the suggested system event “factors in” the particular communication utilized in the delivery of the notification—then there may be no more decisioning performed by the CAND system—for such notification to be sent (absent available system resources, for example). On the other hand, the processing of the CAND system may utilize an approach in which they suggested system event is indeed deemed to be “perfected” but with the actual performance of the system event being contingent on such things as communication logistics, such as does the CAND system have electronic resources so as to actually send the notification to the user or someone associated with the user, for example.
With further reference to
That is, in step 363 of
If the determination is “no” in step 363, then the processing passes to step 364. In step 364, the system deems that the suggested system event is not actionable. As a result, processing of the suggested system event is re-queued until other input, such as other sensor input or backend record input, triggers the particular queued suggested system event.
On the other hand, the determination may be “yes” in step 363. As a result, the processing passes from step 363 to step 365, as shown in
As also reflected in
As described at 1521 of
Furthermore, the processing of step 361 and the processing of step 363 of
With further reference to
After the processing of step 361(2), the process passes to step 361(3). In step 361(3), the system sums (determines a summation), for example, the various weighted contextual factor values to yield a summed weighted factor value. The invention is of course not limited to such particular mathematical processing. Rather, the processing of step 361(3) reflects that in one way or another, the CAND system collectively considers the various cognitive contextual factors that might influence the sending or not sending of a particular notification, for example. After the processing of step 361(3), the process passes to step 361(4). In step 361(4), the system further (determines whether the system event under consideration is an actionable system event. In other words, is the cognitive window open so as to deem the system event (under consideration) to be an actionable system event. In this example, such determination is performed based on comparing the sum weighted contextual factor value vis-à-vis a corresponding threshold value. The invention is also not limited to such particular processing and/or the use of such particular interrelationship as a threshold. Rather, the processing of step 361(4) reflects that various input information aggregated together (in a collective manner) is then compared to some known quantity so as to determine whether the suggested system event under consideration should be deemed an actionable system event. The systems and methods of the invention may make such determination in various ways. For example, the system processing may include aggregating some weighted values together so as to determine if such first aggregation satisfies a particular threshold value, as well as aggregating other weighted values together so as to determine if such second aggregation satisfies a second particular threshold value. Accordingly, different input values might be separately aggregated together—and then compared to some known quantity, so as to determine if a suggested system event should evolve into an actionable system event. As described above, if such actionable system event is also deemed to be an accessible system event, then such system event is deemed to be perfected—thus resulting in a notification being sent to the user.
As reflected at 1601, the processing of step 361(2), step 361(3), and step 361(4) shows processing in which cognitive related parameters are aggregated and/or mapped so as to allow the system to understand such cognitive related parameters. The processing of step 361(2), step 361(3), and step 361(4) may be characterized collectively as Step 2—comparator functions. Further details are described below with reference to
After the processing of step 361(4), the process passes to step 361(5). In step 361(5), the system stores the determination of whether the cognitive window is open or whether the cognitive window is not open. Step 361(5) may also be characterized as Step 3—filtering. Then, the processing passes to step 361(6). In step 361(6), the processing returns to
As shown at 1602, after the processing of
As described above, the processing in
In the example of
Trigger the notification if the following conditions are met.
-
- Heart Rate=Moderate (not sleeping)
- AND
- Busy=Moderate to Low (not too busy)
- AND
- Not currently performing a task (i.e. Running)
- AND
- There isn't a major storm (i.e. Hurricane)
- AND
- EEG shows individual is not depressed currently (mild improvement would be ok based on trending and situations)
- =User should accept notification presented
- Otherwise, forward notification to someone else in the system such as a caregiver if too much time elapses or if the priority is high enough due to number of high priority queued triggers.
Accordingly, as shown at 1702, in the illustrative processing, the system maps the “cognitive parameters” to determine if the cognitive parameters reflect a scenario in which the user or caregiver can accept a notification. The cognitive parameters might be input data that relates to the cognitive situation of the user. Such mapping may include determining if the observed inputs, observed by the CAND system, correspond to particular criteria such as one or more of a pattern, satisfaction of a Boolean requirement, satisfaction of a particular weighting or sum of weights amongst particular inputs, and/or satisfaction of a particular threshold value or values amongst particular inputs, for example.
As shown, processing of
Then, in step 363(4), the system determines whether the suggested system event is an actionable AND ACCESSIBLE suggested system event based on comparing the summed weighted factor value vis-à-vis a corresponding threshold value, for example. After the processing of step 363(4), the process passes to step 363(5).
In step 363(5), the system stores the determination of the processing, i.e. the system stores the determination of whether the accessibility window is open or whether the accessibility window is not open. Step 363(5) may be characterized as a Step 3 filtering function. Then, the processing passes to step 363(6). In step 363(6), process returns to
As reflected at 1903, accordingly, the cognitive situation of the user is separately checked through a first stage of the two-stage comparator operation, which may be performed by a notification management processing portion, for example.
As reflected at 1902, the processing performed by steps 363(2), 363(3), 363(4) effectively “maps” accessibility parameters to known criteria. Details are described below with reference to
As shown, the processing maps “accessibility parameters” (i.e. input data that relates to the “accessibility” situation of user) to determine if the accessibility parameters reflect a scenario in which the user/caregiver can accept a notification. The accessibility parameters may be data input from sensors or other type of data. Such mapping may include, for example, determining if the observed inputs correspond to predetermined criteria: satisfaction of a particular pattern, satisfaction of a Boolean requirement, satisfaction of a particular weighting, satisfaction of a sum of weights amongst all inputs, satisfaction of a sum of weights amongst particular inputs, and/or satisfaction of particular threshold value or values, for example.
Various further features of the CAND system are described below.
Such data, as illustrated in the example of
That is, as shown at 2014, the system inputs further input data and processes such further data, along with the first input data and/or the second input data (or alternatively a representation of the first input data and/or the second input data as represented in the queued “suggested event”). The system determines that the further input data now indeed fulfills the criteria for a “perfected” system event for the first window. The perfection of the system event might have resulted from (1) a combination of the further input data along with the first input data; (2) a combination of the further input data along with the second input data; or (3) a combination of the first input data, the second input data, AND the further data.
As reflected at 2001, it is appreciated that the illustrated processing may be performed using distributed processing including distinct processing routines on a same physical processor device, different instances running on a same processor, and/or different physical processors networked together, for example. Such distributed system is reflected by the processor 1, processor 2, processor 3, and processor 4 of
Additionally, as reflected at 2002, the linearity illustrated in
Accordingly, at 2017, the system sends a notification to the particular user. For example, the recipient might be the user herself, or a caregiver of the user, for example.
A significant technical problem with notifications today is that they are highly inefficient. Notifications are sent to users indeterminately. Systems are structured to send notifications to users uncertain if the user will see or act upon the notification. Therefore, notifications are often sent more than once. Further, systems may have alternative notification options if the first option was unsuccessful leading to even more notifications being transmitted. These inefficient systems clog networks with multiple notifications, consume power of the network and devices, and consume bandwidth.
A technical advantage of the present invention is the ability to assess and improve the efficiency of the network by making improved notification decisions. Through the systems' ability to limit or minimize notifications to preferred or optimized times, devices, and notification channels the system improves the overall efficiency. Such improvements include limiting usage of power consumption of devices in the network and limiting bandwidth of the notification channels (telecom, Wi-Fi, Internet, etc.).
The system is not only capable of identifying the devices in the network but can also identify or determine the available power and the power usage profiles of the devices. Such usage profile can be based on known profiles or by reading or monitoring the power consumption of the devices over time (short or extended). For example, the system can ping devices in the network and obtain power level data on the devices before and after a notification to determine power consumption. Further, the system can ping a device prior to a notification to determine the power level of the device to determine if it has enough power to receive the notification; or if the device is currently being charged. Through use of the data on the available power and the power consumption profile of the device, the system can identify devices in the network that are both available (or likely to be available when a notification is ready to be sent) and which are likely to use less power when receiving a notification(s). Therefore, the system can make analytical decisions on which devices are most efficient for receiving a notification. Such analysis or efficiency could be based on which devices consume less power, which devices are most likely to be seen (and the notification acted upon) by the user; and which devices are likely to be marginally impacted (i.e. device is charging, and battery power consumption would be offset).
The system can also identify and analyze available communication paths or notification channels for the various devices. The system can review the communication paths to each device which may include multiple paths or links which may be dependent or independent. For example, the paths might include telecommunication networks, Internet, wide area networks, local area networks, Wi-Fi, and Bluetooth. The system can also factor into the analysis the reliability of each communication path and bandwidth, cost, and time of sending the alternative notification types (i.e. SMS text, mobile app notification, mobile device call, local hub notification through Internet/WIFI). Such cost data could include analysis on a user's mobile phone plan (i.e. unlimited vs. limited, cost of bandwidth, allowable SMS messages), home network plan (Internet service, free Wi-Fi), and other related network plans and costs. Further, the system can determine reliability of both the message being delivered (network reliability) and the message being acted upon (SMS vs. in-app notification).
Ultimately, the system through (one or more efficiency analysis processors) can identify the optimized time, type, and channel (or channels) for a notification based on the user being accessible, cognitively available and the power data analysis and network communication data analysis. The system therefore provides a technical solution of smart notifications based on improved delivery protocols as well as improved efficiencies on power consumption, network activity, and communication reliability and cost.
As depicted in
The User Physiological Model 2103 includes information from sensing elements such as: the Measured Environmental Impact 2105, the Measured Health and Physiological Impact 2107, the Measured Activity Impact 2109, and the Measured Economic Impact 2111.
The Measured Environmental Impact 2105 may include many sensing elements such as: weather sensors, sound sensors, particle sensors, gas sensors, light spectrum-heat detecting sensors, network analyzer sensors, radio communication analyzer sensors, magnetometer sensors, optical communication sensors, proximity detection sensors, position-movement sensors, and usage sensors. The weather sensors may use or sense light detection, temperature, atmospheric pressure (barometric), and capturing position of the sun and moon; sunrise and sun set; and local current weather measurement which can be augmented with regional, national, and global data. The sound sensors can be used to detect noise level, frequency identification, and transcriptive services to name a few. Particle sensors may be used to detect or measure dust particles and pollen level using particulate matter and low pulse occupancy (LPO), and smoke and mold spores by means of negative ion generator, or photoelectric light detection. Gas sensors may be used to detect gas or fumes which might have a detrimental (or positive) effect including: formaldehyde (Molecular Formula: H2CO or CH2O); alcohol vapor (Molecular Formula: hydroxyl group-OH, e.g. Isopropyl-C3E18O or C3H7OH as well as Ethanol-C2H6O or C2H5OH); benzene (C6H6); Hexane (C6H14); Liquefied Petroleum Gas (LPG) which could include a mixture of butane (Molecular Formula: CH3CH2CH2CH3 or C4H10) and isobutene (Molecular Formula: (CH3)2CH CH3 or C4H10 or (CH C4H10)2CHCH3); propane (Molecular Formula: CH3CH2CH3 or C3H8); natural coal or town gas which could consist of methane or natural gas (Molecular Formula: CH4); carbon dioxide (Molecular Formula: CO2); hydrogen (Molecular Formula: H2); carbon monoxide or possibly smoke (Molecular Formula: CO); and oxygen (Molecular formula: O2). Light spectrum-heat detecting sensors can be used to detect various environment aspects including: visual-light levels; movement; heat maps; light spectrum identification; infrared detection; UV radiation; and image recognition. Network analyzer sensors can be used to detect various network aspects including: available wireless networks; proximity; signal strength-RSSI; manufacturer information; serialization, addressing; standards-Wi-Fi, Bluetooth, Cellular; topology-MESH, Star, ring, point-to-point, bus, tree, hybrid; and network types (PAN, SAN, CAN, LAN, MAN, WAN, GAN). Radio communication analyzer sensors may be used to sense or detect: radio communication frequency; signal strength; active broadcasters; band (AM, FM, longwave, shortwave). Magnetometer sensors may be used to sense or detect: magnetic field-inductive sensing of polarity, multi-axis field strength detection, near-field communication (NFC). Optical communication sensors may be used to sense or detect: 3-dimensional positioning of sensing emitter, signal strength of emitter or emitters, and communication. Proximity detection sensors may be used to sense or detect radio signal strength feedbacks, light feedback, step responses, reactivity to nearby electro-magnetic objects and thermal heat placement to determine proximity of the user or devices. Position movement sensors may be used to detect or sense movement including: local position; altimeter-elevation; gravitational force; movement relative to a 3-axis accelerometer; degree of change; speed of change; and global positioning systems (“GPS” for determining global longitude, global latitude, global degree of change, global speed of change). The system may also employ usage sensors to detect usage such as electricity for individual appliances or outlets, and total electricity used, active outlets versus inactive outlets, garage door usage, open or closed doors, water leak detection, water usage, open or closed windows, car distance traveled, car operating or car off, garbage empty or garbage full, natural gas, LPG, petroleum gas, water return/waste, phone and Internet usage.
The Measured Health and Physiological Impact (Vitals) 2107 may include many sensing elements such as: temperature sensors, heart rate sensors, pulse rate sensors, respiratory sensors, blood pressure sensors, metabolic sensors, circulatory sensors, neuro sensors, cardiac sensors, nerve sensors, pain response sensors, awake/sleep sensors, and health context sensors. Temperature sensors may be used to collect internal, surface level, and external temperature. Heart rate sensors may detect, or sense heart rate and heart signal characteristics based on the heartbeat and/or derived from an electrical impulse within the QRS signal. Pulse rate sensors may be used to detect, measure, or sense: the blood flowing through the circulatory system using a circulatory based sensor like Blood Pressure or a Pulse Oximeter; or collecting blood flow transit time rate in conjunction with a QRS signal or additional circulatory sensors (per location on the body). Respiratory sensors may be used to collect respiratory-breathing rate, positive airway pressure to the lungs, physiological signal of forced expiratory volume, and forced vital capacity. Blood pressure sensors may be used to measure and collect degree of stress, degree of arteries constricted (vasoconstriction), white coat syndrome, medication influenced, exercise influence, and resting state. Metabolic sensors may be used, including blood glucose sensors, to collect blood sugar levels, metabolism before/after meals, detoxification influences, and sleeping influences. Circulatory sensors may be used to detect or sense pulse oximetry as an indirect measure of oxygen saturation (SpO2), a direct collection of arterial blood gases (SaO2), partial pressure (PaO2), tissue oxygen saturation (StO2) and other O2 data collection sites within the body, signal strength, and photoplethysmography (PPG). Neuro sensors may be used, including using EEG-brain sensors, to collect stress indicators, sleep indicators, and disorders. Cardiac sensors may be used, including using ECG, to collect heart activity, electrical impulses, QRS, and R-R interval. Nerve sensors may be used, including sensing the vagus nerve, and collecting resting state of the body's organs measured using vagal tone, and respiratory sinus arrhythmia (RSA). Pain response sensors may be used, including collecting salival level of cortisol, to determine pain and stress (measured for example using pain level combined with vagal tone, RSA, blood pressure and heart rate). Awake and sleep sensors may be used to collect, and measure awake and sleep data including the environmental impact (e.g. movement, audible indicators-snoring, teeth grinding, sleep talking) combined with vitals (e.g. EEG—providing cortex activity, NREM, REM, sleep depth; ECG-providing Heart rate changes; Respiration-changes, CPAP detection) and sweating (e.g. body temperature, perspiring and rate of perspiration). Health context sensors may be used to determine various health conditions including weight sensors, height through lift sensors and light detection, skin pigmentation and hair color through camera and light frequency detection, dry skin rating via electrical conductivity, dry tongue via electrical conductivity, eye dryness via camera data collection, hearing tests, and coughing via audio recording.
The Measured Activity Impact (Tasks) 2109 may include many sensing elements such as: food sensors, bathroom sensors, personal product sensors, shock sensors, daily task sensors, exercise sensors, travel sensors, appliance sensors, relaxation sensors, and hardware usage sensors. Food Sensors may include caloric sensors, gluten detection sensors, meal detection sensors to define, sense, or measure eating-nutrition, calories, meal status. Bathroom sensors may include using environmental usage sensor(s) of electricity, water and waste suggesting using the bathroom, toilet, or shower. Personal product sensors may sense or collect data on using a toothbrush sensor for brushing teeth, movement sensors connected to makeup or hairbrush for detecting combing hair, and feedback products like electrical stimulation for managing habitual needs (shock sensors). Daily task sensors may be used for sensing or collecting data on using a calendar, email activity, call activities suggesting working-busy day, light work day, planning to leave early/late, planning to arrive early/late, needing to focus-do not disturb; meetings-presenter, decision maker, note taker, passive listener; conversations-deeply engaged, or mildly listening; chores-mowing, auto services, home services, and personal services (purchases, healthcare checkups, dental checkups, physical and mental health-chiropractic, massages, acupuncture, therapist, community groups). Exercise sensors may be used to sense or collect data including equipment reporting-workout time, intensity, calories burned, energy level, and category including weights, cardio, and yoga. Travel sensors may sense or collect data from emails, travel applications, environment sensors detecting indirect traveling (i.e. someone else is doing the work), and direct traveling (i.e. driving, cycling, rowing, running). Appliance sensors may be used to detect or sense using fridges and ovens to describe level of cooking-status as engaged, lightly engaged, not engaged; or using the clothes washer, clothes dryer, dishwasher for chores detection along with increased water usage and electricity changes. Relaxation, meditation and sleep sensors may be used including EEG-based sensors, audio detection, motion detection, to determine various duration, status, depth, and suggestions. Hardware usage sensors may be used to passively collect data on usage of devices from sensors from mobile phones, portable audio devices, hands-free voice recognized playback and Internet-driven cognitive computing devices, televisions, tablets, e-readers, hubs and providing a collection of information on charging, battery level, screen usage, interactions-touch, buttons, frequency, patterns, number of apps, app classification, app usage, call log, email usage, SMS usage; and self-reported hobbies.
The Measured Economic Impact (Media) 2111 may include many sensing elements such as: news related sensors, work-life balance sensors, finance related sensors, and hospital or care related sensors. News related sensors may include web crawling and news media feeds for cognitive computing of news with reporting based on current location, surroundings or home, and friends' locations to define user recognizable personalized global tragic events, global heightened security, global impact level and national tragic events, national heightened security, and national impact level; local tragic events, local heightened security, and local impact level. Work-life balance sensors or data may be collected through calendar, globally available calendars, and suggested activities planned in relation to work-life balance, by measuring holiday-working and related stress; weekend-working and related stress; travel impact-cancellations, planned departure, delays, arrival times traffic-heavy traffic on route, crashes, police; and closures of an office or school. Finance related sensors or data may be collected through personal finance companies that the user provides access for assessing financial-gains, losses, stocks, investments, upcoming bills to pay, risks in due dates and running tight of funds for the month. The measured economic impact 2111 may also include hospital or care related sensors and data collected through media, calendars, emails from hospitals or care providers including data on hospitalization, births, deaths-importance, and impact level.
The sensing elements utilized by the system to determine or measure the Measured Environmental Impact 2105, the Measured Health and Physiological Impact 2107, the Measured Activity Impact 2109, and the Measured Economic Impact 2111 may be direct, indirect (including 3rd party sensors), passive, or active sensing elements. In addition, many of the sensing elements can integrate with a feedback loop such as a manually derived feedback survey loop. Such feedback loop systems are well suited for use with activity tasks, heath related sensors and measurements, environmental sensors and measurements, and economic sensing elements and measurements.
The system 2100 also includes a Software Application 2104 that can read the User Physiological Model 2103. An interface for reading the User Physiological Model exists within the Software Application 2104. The Software Application includes a Smart Notifications 2106 module or component based on the User Physiological Model. The Smart Notification 2106 includes a Presentation and Interaction Logic 2108 component; a Physiological and Context Based Logic 2110 component; and a Delivery Management System 2112 component.
The Presentation and Interaction Logic (how information is presented to the user) considers both situational analysis and available systems and proximity. Situationally it considers: loud situation-defined as priority or intense; normal situation-operates as designed; soft situation-defined as discrete or quiet; suspended situation-snooze and revisit later; automatically dismiss situation-cancel situation; and transfer situation-move situation to another user or system. As for available systems and proximity (how the system reaches the user) the system considers various paths and channels including: mobile phone; home health hub; portable health hub; car radio/navigation system; PC; home phone; connected caregiver systems (EHR—Electronic Health Records); and connected friends and family systems (including co-workers).
The Physiological and Context Based Logic 2110 determines situations that invoke presentations and interaction logic. The Physiological and Context Based Logic 2110 component includes a situation algorithm that determines presentation and interaction logic and situation based on user physiological model and the signal from the delivery management system. The Physiological and Context Based Logic 2110 component also considers the signal relationship to the User Physiological Model 2103. This includes the relationship model showing what information is relevant based on data retrieved from sensors either directly or indirectly related to the user's physiology and impact of vitals, surrounding environmental elements, tasks, and media.
The Software Application 2104 also includes a Delivery Management System 2112. The Delivery Management System 2212 provides base rules for all alerts, notifications, and user signaling of message delivery mechanisms. The Delivery Management System 2112 provides signal name and signal rules for triggering a notification.
The signal rules may be periodic or episodic. The periodic rules are regular triggered events occurring on a timed interval and may include: an initial time of trigger such as time of day, time (e.g. number of seconds) from now, counter time from base time (where base time is referenced within the system as a counter with a reference to absolute 0 defined as start time), and time from start time; a reoccurrence time trigger such as every, every other, custom repeating pattern of enabled versus disabled (e.g. first 3 are on and next 3 are off), multi-combination (e.g. pattern 1=custom, where first 3 on, fourth is off, then pattern 2=every; an interval rate trigger such as time between occurrence with units and reference, where units can be a unit of time or a count value, and reference defines the unit; and exceptions such as occurrences that have been excluded, specified as count values, time and date, or number of occurrences to silence until next occurrence. The episodic rules are triggered events occurring on a rule-based pattern. The rule based pattern may be based on rule monitoring such as defined with WHEN, IF, AND/OR, THEN, AND THEN. Where WHEN determines initial rule trigger, IF determines the next trigger or triggers, AND/OR defines logic within the trigger and THEN describes the action. This may be based on information from the user physiological model and is directly or indirectly related to the user's physiology and impact of vitals, surrounding environmental elements, tasks, and media. The rule based pattern may also be action based such as starting the notification on a periodic basis with or based on settings as described within the periodic rule and when to stop periodic notification.
Personalized Notification Behavior UX/UI:The system 2100 collects various data elements from numerous devices in the network including the following data: user requests; user behaviors and patterns; and sensor data. User requests include how the user interacts with the system by enabling sources of data and accepting or rejecting notifications delivered to the user. User behaviors and patterns includes behaviors and patterns which may be defined by the user during first time or early use including identification of their preferences. The system 2100 may ask them to define their approximate sleep times, work times, enable calendar objects to be shared, sensor data, delivery preferences and friends and family. Additionally, this information may be supplemented by machine learning where actions are recorded and, based on advanced configurations available to the user, can automatically be applied to learn over their preferences or availability time (e.g. if the user regularly dismisses a notification, they could be asked to see less of the dismissed notifications, and then give a reason as to why). The reason can then be applied across similar notifications in the future as it learns the user's preferences real-time. Further, the system 2100 collections sensor data which can be captured passively and directly from sensors on the hardware(s) or devices that are running the application(s) for the system 2100. The collection of sensor data may be active, continuous, or periodic and directly (or indirectly) from sensors both inside and outside of the hardware(s) or devices that are available to the user and/or which have been permitted by the user.
During daily use, the user may receive tailored notifications and alerts, soft tasks, and status notifications. The tailored notifications and alerts are the notifications that are delivered in a manner corresponding to how the user would like to be notified in the given situation. Soft tasks are notifications that are planned and are silently updated giving the user the knowledge of what may occur next and what is required for it to occur. Status information are a list of what notifications and alerts have been delivered, which systems they were delivered to, which users they were delivered to, and if they were not delivered the reason they were not delivered (or acted upon).
The system 2100 also determines which channel and device to deliver the notification. The channel selected for notification could be one of the following: (1) local wearable system, where delivery occurs through a wearable system for instance: a watch, a patch, a strap or band, a clothing item or accessory embedded with technology capable of communicating, and delivery notifications; (2) local portable system, where delivery occurs through a computer that the user can carry with them, for instance: a mobile phone, a tablet, a laptop or some combination of these. (This would also support a hub which may or may not have a user interface for interacting but would not be solely relying on a stationary power source); (3) local stationary system, where delivery occurs through a location stationary device that requires stationary power source (the system could either have a user interface or not require a user interface); and (4) remote system, where delivery occurs through the existing user or another user's equipment that may include a wearable system, portable system, or stationary system. The interfaces for the location stationary system could include a television, a set top box using a digital or analog connection to a television, a gaming console, a home audio system, a phone system, appliances, a navigation system in a car, or a clock.
The system 2100 can also determine or has rules, which identify, based on certain situations, when a user is not notified. These instances might include where the user is unable to perform the requested action, where the user is disrupted and unable to perform the requested action, or where the situation is not appropriate. For example, the user may not be at the location to take action (e.g. a weight scale sensor is at home and the user is at work), or the equipment is not with the user (e.g. a medication monitor was forgotten in the car). This may cause the system 2100 to postponed notification, and may generate a different notification. Instead of “time to take your medication”, the system reports earlier to the user “please make sure you have your medication as you will need in 8 hours” when the user leaves the medication behind and it assumes they are going to work based on user preferences or user learned behavior. In such an instance, the user can also indicate to the system if they would like to see more notifications or alerts like these, and if not, they can give a reason such as “only notify me if the reminder is due in 4 hours”, which may be because the user usually goes to lunch and has their medication outside of the office. Further, an example of a non-delivery notification may occur when the disruption of the notification is not appropriate such as when the system identifies the user may be driving (e.g. speed of the user in relation to their surroundings suggests they are in a car and cannot take their blood pressure reading, and to avoid).
In some instances, the system may determine that notification delivery may distribute to one or more of the following: directly to the devices or hardware(s) that the application(s) are running on in the system; and directly to the devices or hardware(s) that the application has been permitted to communicate with from the user.
The system also processes one or more rules and/or alerts in step 2220. The rules and alerts are based on a reference time 2221 and the predefined and user defined lookup tables 2223. Further, the rules and alerts also help to refine the lookup tables 2223. The rules and alerts are also processed against one or more analytical processes or algorithms 2230 which may use one or more relationship tables 2231. The system, using the various data, rules and alerts, and analysis then analyzes the notifications configurations 2240. The notification configuration 2240 considers situations or situational data 2241 and available systems and proximity 2243. Available systems include analysis of the various devices in the system network. Available systems or devices include the devices in the home, office, and those of family, friends, and coworkers. If the system determines it is not the right time to send a notification, the notification is rescheduled in step 2242. The rescheduled notification would be processed again by the rules processing 2220, algorithms 2230 and notification configuration 2240 analysis.
Once the system determines all elements are present to presenting the notification, the system then presents a personalized notification to the user 2247. If the system determines the user needs a notification but the user is not available, the system can transfer the notification (step 2245) to a network device which may be the device of a family member, friend, or co-worker, or emergency personnel.
As previously discussed in conjunction with
The self-environment includes scenarios that cover the individual, including the impact of daytime and nighttime, weather, environmental, eating and activity (caloric balance, calories in versus calories out), stress (brain activity), bathroom usage and hydration, physical state (such as weight, BMI) and well-being (such as Breathing Rate, Breathing Capacity, Oxygen transference to the Blood (SpO2), Heart Rate and QRS complex (Electrocardiogram), Arterial pulsatile wave shape (plethysmograph), and arterial pressure (blood pressure).
The local environment includes scenarios which cover the user in any local environment such as being at Home. The expectation of such environment might be that it is more calming due to proximity of friends and family, hobbies and improvement activities for home, others leading to the care of oneself. This includes activities like sleeping, exercising, chores, and overall quality of the environment.
The transition or exchange environment includes scenarios which cover the user while moving in between local and remote environments. The expectation of such environment is that it is a transitional state for the user where awareness is raised to nearby individuals and privacy walls are more conscience than while in a local environment. The transition environment includes transportation options like walking (running), flying, boating (cruises), bicycling (motorbike), and driving (public bus, taxi or private car). Each of these has different pickup locations, drop-off, and considerations with nearby passengers either within or externally present.
The remote environment includes scenarios which cover the user while in any remote environment such as an office. The expectation of such environment is that it may be of high stress due to the proximity of tasks and complexities bestowed on the user. A user that is shopping, or at a restaurant, or in an office will behave differently and respond to informational queues differently than when at home in a local environment.
However, the system may perform a remote check, for example, if the time has been exceeded (step 2413). The system is also capable of by passing step 2409 and 2410 and going from step 2408 directly to step 2413 if it determines conditions exists which warrant expedited notification (i.e. due to sensor data indicating a heightened status). If a remote check 2413 is needed, the system then seeks to retrieve a new user's (second person) current location. If the system cannot identify the location or the location is not known, step 2416, the system may attempt to approximate location based on various sensor and network data. If the new or second user is determined (step 2417) to be near the first user, then a notification is sent to the new or second user (step 2420). If the user does not respond to the notification, the system in step 2418 may attempt to identify alternative users and/or the reasons such second user has not responded or ignored the notification.
The system is also capable of adjusting or providing moderated notification levels including: loud, softer, or vibrate. The system can adjust the level based on the status of the user. For example, the system might send a loud notification is the user is sleeping. The system might send a soft notification if the system believes the user is not sleeping; and might send a vibration notification is the user is potentially occupied (i.e. at work).
High-Level Architecture InterfacesIn an exemplary embodiment, the core processing classes of the system are broken up into 4 categories: (I) is the high-level interactions with the user which include the definition of the requests, the consumption of sensory information, and the presentation of the messaging; (II) is the management of the signaling for the periodic and episodic request generation; (III) is the management of the user's physiology including activities, environment, health and economy; and (IV) is the delivery management of the notification, and the situation modeling of the relationship to the user's physiology.
In one exemplary embodiment, there are several user roles that information is collected on or distributed to: (1) the administrator; (2) the user role; and (3) the friends, family, coworker role. The administrator role interacts by interacting with requests and the request class of the system. This forms the basis for the signaling that will drive the notifications ultimately. The default is determined to be set by the user acting as an administrator, with downstream changes occurring from administrators of systems outside of this interface. The requests then get triggered by the signal management describe in (II). The request provides information whether the request was triggered (an event generated by the signal manager) and whether it is meaningful (which is based on the rules defined within the signal itself to establish a temporary relationship with the physiology of the user.
The user role interacts with the request class, user class and message class by contributing information about themselves, their delivery systems, or the environment around them based on physiological sensors. The system will detect from user if they are able to respond based on activities and availability, and whether they are in a coherent cognitive state receptive to stimuli. Once determining if the request was triggered, if the request is meaningful, if the user is ready, if the user can respond and are coherent, then based on the situation the appropriate message and delivery needs are met, it is sent in a customized configuration to the end user in a means that is most receptive.
The friends and family role interacts with the message class to receive information based on the situation when a transfer of information is requested on behalf of the user. The system will notify an adjacent user of the system, classified as friends and family of the current user, the desired messaging that is most appropriate of the situation.
Signaling management happens when new signals are programmed into the system and are triggered based on periodic and episodic conditions. There may be more than one signal occurring at a time, or only a single signal. If there are more than one that the system may have additional prioritization that can be linked into this database for additional selection properties. The signals can be cleared if they are reset, or deleted if they are dismissed. Signals can also be updated to managed exceptions of occurrences within the system as to when the previous signal was cleared to better prioritize this for future occurrences. E.g. User dismisses event and an hour later if the same pattern exists, through machine learning the next event could be automatically dismissed. If a threshold or exception occurs, then there is the ability to force without exception.
Signals have patterns and sequences that describe their structure and duty cycle between active signals. Patterns may include multiple active signals then a timeout period, alternating sequences and regular timed occurrences.
The rules define the behavior relationship to the physiology of the user. For example, if the user is awake, and not stressed out, and is not driving, but in proximity of the weigh scale; then remind them to take a measurement. This may transition to the notification (IV) where a specific scenario is also selected for customized delivery to the user. (III) The physiology management happens whenever new sensory data, through passive or active requests occurs throughout the system. This could happen on a backend server where the data is collected from other servers and then populated in the database which is synchronized with the local database that the user is managing through active use of the delivery system.
The data is then collecting in separate buckets, including an activities database bucket, an environment database bucket, a health database bucket, and an economy database bucket. Each of these have utilities which allow the varying managers within the system to easily assess the current status of the user including, tasks, sun relationship, weather, air quality, pollution, positioning of the body in reference to the local and global systems and directional in an up or down or flat or standing position; stress, pain, satiety, relaxation, sleeping state, and overall impact of external events on the user's coherence.
For Activity, this includes varying tasks that make up a user's day, the time spent or planned time to spend, any roles that suggest the level of cognitive drain from the user and any effects that may contribute to other physiological areas.
For Environment, this includes varying sensors capable of measuring data within a stationary environment such as a home or office, or while the user is moving between stationary environments. Sensors may be collected from local systems, portable systems, or remote systems capable of collecting relevant location based data like weather systems.
For Health, this includes varying wearable sensors either on the body of the user, or that the user can directly interact with. These may be portable sensors that the individual can carry with them, or stationary sensors like weight scales which may be positioned in a bathroom.
For Economy, this includes external stimuli that may further impact the behavior and acceptance of new stimuli. This collected from calendars and news sources for the latest in global, national, and local occurrences.
Each of these physiological data points is captured in a way that allows for separation of concerns from a regulatory, security and user privacy perspective. The delivery management occurs through a series of interactions between delivery system utilities and situation utilities. A given delivery system must be identified based on the appropriate delivery mechanism. This is defined by the situation and the relationship to the physiology of the user.
Delivery types can include a mobile phone as well as other registered systems such as Hubs that can be used to passively monitor home environment or other stationary environments like an office, or a car system, or desktop, laptop, home phone, alternate phone, a caregiver system or a friends and family registered user system.
Situation Utilities define a Go/No-Go where the correct situation is identified, and lookup has been matched based on rules of the originating signal (I) and physiology (II) and mapped to the relationship model and database of the system.
It is appreciated that features of one embodiment as describe herein may be used in conjunction with one or more other embodiments.
The systems and methods of the invention in described embodiments may be implemented as a system, method, apparatus or article of manufacture using programming and/or engineering techniques related to software, firmware, hardware, or any combination thereof. The described operations may be implemented as code maintained in a “computer readable medium”, where a processor may read and execute the code from the computer readable medium. A computer readable medium may comprise media such as magnetic storage medium (e.g., hard disk drives, floppy disks, tape, etc.), optical storage (CD-ROMs, DVDs, optical disks, etc.), volatile and non-volatile memory devices (e.g., EEPROMs, ROMs, PROMs, RAMs, DRAMs, SRAMs, Flash Memory, firmware, programmable logic, etc.), etc. The code implementing the described operations may be further implemented in hardware logic (e.g., an integrated circuit chip, Programmable Gate Array (PGA), Application Specific Integrated Circuit (ASIC), etc.). Still further, the code implementing the described operations may be implemented in “transmission signals”, where transmission signals may propagate through space or through a transmission media, such as an optical fiber, copper wire, etc. The transmission signals in which the code or logic is encoded may further comprise a wireless signal, satellite transmission, radio waves, infrared signals, Bluetooth, etc. The transmission signals in which the code or logic is encoded is capable of being transmitted by a transmitting station and received by a receiving station, where the code or logic encoded in the transmission signal may be decoded and stored in hardware or a computer readable medium at the receiving and transmitting stations or devices. An “article of manufacture” comprises computer readable medium, hardware logic, and/or transmission signals in which code may be implemented. A device in which the code implementing the described embodiments of operations is encoded may comprise a computer readable medium or hardware logic. Of course, those skilled in the art will recognize that many modifications may be made to this configuration without departing from the scope of the present invention, and that the article of manufacture may comprise suitable information bearing medium known in the art.
In an embodiment of the invention, the systems and methods use networks, wherein, the term, ‘networks’ means a system allowing interaction between two or more electronic devices, and includes any form of inter/intra enterprise environment such as the world wide web, Local Area Network (LAN), Wide Area Network (WAN), Storage Area Network (SAN) or any form of Intranet.
In an embodiment of the invention, the systems and methods can be practiced using any electronic device. An electronic device for the purpose of this invention is selected from any device capable of processing or representing data to a user and providing access to a network or any system similar to the Internet, wherein the electronic device may be selected from but not limited to, personal computers, mobile phones, laptops, palmtops, tablets, portable media players and personal digital assistants.
As noted above, the processing machine used to implement the invention may be a suitable computer or other processing machine. The processing machine may also utilize (or be in the form of) any of a wide variety of other technologies including a special purpose computer, a computer system including a microcomputer, mini-computer or mainframe for example, a programmed microprocessor, a micro-controller, a peripheral integrated circuit element, a CSIC (Consumer Specific Integrated Circuit) or ASIC (Application Specific Integrated Circuit) or other integrated circuit, a logic circuit, a digital signal processor, a programmable logic device such as a FPGA, PLD, PLA or PAL, or any other device or arrangement of devices that is capable of implementing the steps of the processes of the invention.
The processing machine used to implement the invention may utilize a suitable operating system (OS). Thus, embodiments of the invention may include a processing machine running the Unix operating system, the Apple iOS operating system, the Linux operating system, the Xenix operating system, the IBM AIX™ operating system, the Hewlett-Packard UX™ operating system, the Novell Netware™ operating system, the Sun Microsystems Solaris™ operating system, the OS/2™ operating system, the BeOS™ operating system, the Macintosh operating system (such as macOS™), the Apache operating system, an OpenStep™ operating system, the Android™ operating system (and variations distributed by Samsung, HTC, Huawei, LG, Motorola, Google, Blackberry, among others), the Windows 10™ operating system, the Windows Phone operating system, the Windows 8™ operating system, Microsoft Windows' Vista™ operating system, the Microsoft Windows' XP™ operating system, the Microsoft Windows' NT™ operating system, the Windows' 2000 operating system, or another operating system or platform.
The systems and methods of the invention may utilize non-operating systems (aka serverless architecture) as well for distributed processing. In the processing of the invention, services on cloud computing networks leveraging systems like AWS (as offered by Amazon Web Services, Inc.), BlueMix (as offered by IBM), and Microsoft Azure, can perform data collection services using varying technologies that are spun up on demand using tools like Chef to create container based deployments like Docker, or non-container compute services (e.g. AWS Lambda).
The invention provides real-time analytics processing that requires scale on demand to the users in the system, in accordance with at least one embodiment of the invention. Such offerings as AWS Lambda and Kinesis (as offered by Amazon Web Services, Inc.) are among those that may be used in implementation of the invention. For example, AWS Lambda may be utilized to execute code (to perform processes of the invention) in response to various triggers including data changes, shifts in system state, or particular action taken by users. Similarly, in an embodiment, the OS (operating system) of the invention might be encapsulated in an EC2 instance (as offered by Amazon Web Services, Inc.) or multiple instances for deployment.
It is appreciated that in order to practice the method of the invention as described above, it is not necessary that the processors and/or the memories of the processing machine be physically located in the same geographical place. That is, each of the processors and the memories used by the processing machine may be located in geographically distinct locations and connected so as to communicate in any suitable manner, such as over a network of over multiple networks. Additionally, it is appreciated that each of the processor and/or the memory may be composed of different physical pieces of equipment. Accordingly, it is not necessary that the processor be one single piece of equipment in one location and that the memory be another single piece of equipment in another location. That is, it is contemplated that the processor may be two pieces of equipment in two different physical locations. The two distinct pieces of equipment may be connected in any suitable manner. Additionally, the memory may include two or more portions of memory in two or more physical locations.
To explain further, processing as described above is performed by various components and various memories. However, it is appreciated that the processing performed by two distinct components as described above may, in accordance with a further embodiment of the invention, be performed by a single component. Further, the processing performed by one distinct component as described above may be performed by two distinct components. In a similar manner, the memory storage performed by two distinct memory portions as described above may, in accordance with a further embodiment of the invention, be performed by a single memory portion. Further, the memory storage performed by one distinct memory portion as described above may be performed by two memory portions.
Further, as also described above, various technologies may be used to provide communication between the various processors and/or memories, as well as to allow the processors and/or the memories of the invention to communicate with any other entity; i.e., so as to obtain further instructions or to access and use remote memory stores, for example. Such technologies used to provide such communication might include a network, the Internet, Intranet, Extranet, LAN, an Ethernet, or any client server system that provides communication, for example. Such communications technologies may use any suitable protocol such as TCP/IP, UDP, or OSI, for example.
Further, multiple applications may be utilized to perform the various processing of the invention. Such multiple applications may be on the same network or adjacent networks, and split between non-cloud hardware, including local (on-premises) computing systems, and cloud computing resources, for example. Further, the systems and methods of the invention may use IPC (inter-process communication) style communication for module level communication. Various known IPC mechanisms may be utilized in the processing of the invention including, for example, shared memory (in which processes are provided access to the same memory block in conjunction with creating a buffer, which is shared, for the processes to communicate with each other), data records accessible by multiple processes at one time, and message passing (that allows applications to communicate using message queues).
As described above, a set of instructions is used in the processing of the invention. The set of instructions may be in the form of a program or software. The software may be in the form of system software or application software, for example. The software might also be in the form of a collection of separate programs, a program module within a larger program, or a portion of a program module, for example. The software used might also include modular programming in the form of object oriented programming. The software tells the processing machine what to do with the data being processed.
Further, it is appreciated that the instructions or set of instructions used in the implementation and operation of the invention may be in a suitable form such that the processing machine may read the instructions. For example, the instructions that form a program may be in the form of a suitable programming language, which is converted to machine language or object code to allow the processor or processors to read the instructions. That is, written lines of programming code or source code, in a particular programming language, are converted to machine language using a compiler, assembler or interpreter. The machine language is binary coded machine instructions that are specific to a particular type of processing machine, i.e., to a particular type of computer, for example. The computer understands the machine language.
Any suitable programming language may be used in accordance with the various embodiments of the invention. Illustratively, the programming language used may include assembly language, Ada, APL, Basic, C, C++, C#, Objective C, COBOL, dBase, Forth, Fortran, Java, Modula-2, Node.JS, Pascal, Prolog, Python, REXX, Visual Basic, and/or JavaScript, for example. Further, it is not necessary that a single type of instructions or single programming language be utilized in conjunction with the operation of the system and method of the invention. Rather, any number of different programming languages may be utilized as is necessary or desirable.
Also, the instructions and/or data used in the practice of the invention may utilize any compression or encryption technique or algorithm, as may be desired. An encryption module might be used to encrypt data. Further, files or other data may be decrypted using a suitable decryption module, for example.
As described above, the invention may illustratively be embodied in the form of a processing machine, including a computer or computer system, for example, that includes at least one memory. It is to be appreciated that the set of instructions, i.e., the software for example, that enables the computer operating system to perform the operations described above may be contained on any of a wide variety of media or medium, as desired. Further, the data that is processed by the set of instructions might also be contained on any of a wide variety of media or medium. That is, the particular medium, i.e., the memory in the processing machine, utilized to hold the set of instructions and/or the data used in the invention may take on any of a variety of physical forms or transmissions, for example. Illustratively, as also described above, the medium may be in the form of paper, paper transparencies, a compact disk, a DVD, an integrated circuit, a hard disk, a floppy disk, an optical disk, a magnetic tape, a RAM, a ROM, a PROM, a EPROM, a wire, a cable, a fiber, communications channel, a satellite transmissions or other remote transmission, as well as any other medium or source of data that may be read by the processors of the invention.
Further, the memory or memories used in the processing machine that implements the invention may be in any of a wide variety of forms to allow the memory to hold instructions, data, or other information, as is desired. Thus, the memory might be in the form of a database to hold data. The database might use any desired arrangement of files such as a flat file arrangement or a relational database arrangement, for example.
In the system and method of the invention, a variety of “user interfaces” may be utilized to allow a user to interface with the processing machine or machines that are used to implement the invention. As used herein, a user interface includes any hardware, software, or combination of hardware and software used by the processing machine that allows a user to interact with the processing machine. A user interface may be in the form of a dialogue screen for example. A user interface may also include any of a mouse, touch screen, keyboard, voice reader, voice recognizer, dialogue screen, menu box, list, checkbox, toggle switch, a pushbutton or any other device that allows a user to receive information regarding the operation of the processing machine as it processes a set of instructions and/or provide the processing machine with information. Accordingly, the user interface is any device that provides communication between a user and a processing machine. The information provided by the user to the processing machine through the user interface may be in the form of a command, a selection of data, or some other input, for example.
As discussed above, a user interface is utilized by the processing machine that performs a set of instructions such that the processing machine processes data for a user. The user interface is typically used by the processing machine for interacting with a user either to convey information or receive information from the user. However, it should be appreciated that in accordance with some embodiments of the system and method of the invention, it is not necessary that a human user interact with a user interface used by the processing machine of the invention. Rather, it is also contemplated that the user interface of the invention might interact, i.e., convey and receive information, with another processing machine, rather than a human user. Accordingly, the other processing machine might be characterized as a user. Further, it is contemplated that a user interface utilized in the system and method of the invention may interact partially with another processing machine or processing machines, while also interacting partially with a human user.
Claims
1. A method performed by one or more electronic devices, the method comprising:
- identifying, by the one or more electronic devices, a notification for presentation to a user;
- identifying, by the one or more electronic devices, an action for the user to perform in response to receiving the notification, the action being associated with the notification;
- receiving, by the one or more electronic devices, context data generated using sensor data from one or more devices associated with the user, the context data indicating a current context of the user, wherein the context data indicates at least one of an activity of the user or a physiological state of the user;
- using, by the one or more electronic devices, the context data to evaluate an ability of the user to perform the action associated with the notification in the current context; and
- based on the evaluation of the ability of the user to perform the action, customizing, by the one or more electronic devices, a manner of providing of the notification by the one or more devices associated with the user.
2. The method of claim 1, wherein the notification requests that the user perform the action associated with the notification.
3. The method of claim 1, wherein the action associated with the notification is for the user to provide a response to the notification.
4. The method of claim 1, wherein the action associated with the notification comprises performing a measurement using a measuring device.
5. The method of claim 1, wherein the context data further indicates a location of the user, and wherein evaluating the ability to perform the action is further based on the location of the user.
6. The method of claim 1, wherein the context data includes calendar data indicating appointments for the user, and wherein evaluating the ability to perform the action is further based on the calendar data.
7. The method of claim 1, wherein the context data includes communication data indicating calls or messages involving the user, and wherein evaluating the ability to perform the action is further based on the communication data.
8. The method of claim 1, wherein the context data indicates the activity of the user, including a current task being performed by the user.
9. The method of claim 1, wherein the context data indicates the physiological state of the user, including at least one of the user's breathing rate, heart rate, pulse rate, blood pressure, temperature, blood oxygen saturation, or weight.
10. The method of claim 1, wherein customizing a manner of providing the notification comprises customizing at least one of:
- content of the notification;
- a time of delivery of the notification;
- a device to provide the notification; or
- a communication channel for delivering the notification.
11. The method of claim 1, wherein the one or more electronic devices comprise a server system; and
- wherein the method comprises providing, by the server system, the notification to a client device for presentation of the notification.
12. The method of claim 1, wherein evaluating the ability of the user to perform the action associated with the notification comprises determining whether the user is near a device used to perform the action.
13. The method of claim 1, wherein customizing the manner of providing the notification comprises:
- in response to determining that the user is not able to perform the action in the current context, postponing the notification or generating a notification with a different message.
14. The method of claim 1, wherein customizing the manner of providing the notification comprises selecting, based on the context data, a device to present the notification to the user, the device being selected from among multiple devices associated with the user.
15. The method of claim 1, wherein customizing a manner of providing the notification comprises selecting, based on the context data, a communication channel through which to present the notification to the user, the communication channel being selected from among multiple communication channels.
16. The method of claim 1, further comprising using, by the one or more electronic devices, the context data to evaluate mental readiness of the user to receive the notification in the current context; and
- wherein customizing the manner of providing the notification is further based on the evaluation of the mental readiness of the user to receive the notification in the current context.
17. The method of claim 16, wherein evaluating the mental readiness of the user to receive the notification comprises evaluating a mood of the user or a stress level of the user.
18. The method of claim 16, wherein evaluating the mental readiness of the user to receive the notification comprises determining a current capacity for receiving information and a level of capacity being used in activities of the user.
19. The method of claim 16, wherein evaluating the mental readiness of the user to receive the notification comprises determining whether the context data indicates a combination of factors that represent cognitive accessibility of a user to receive a notification.
20. A system comprising:
- one or more electronic devices; and
- one or more machine-readable media storing instructions that, when executed by the one or more electronic devices, cause the one or more electronic devices to perform operations comprising: identifying, by the one or more electronic devices, a notification for presentation to a user; identifying, by the one or more electronic devices, an action for the user to perform in response to receiving the notification, the action being associated with the notification; receiving, by the one or more electronic devices, context data generated using sensor data from one or more devices associated with the user, the context data indicating a current context of the user, wherein the context data indicates at least one of an activity of the user or a physiological state of the user; using, by the one or more electronic devices, the context data to evaluate an ability of the user to perform the action associated with the notification in the current context; and based on the evaluation of the ability of the user to perform the action, customizing, by the one or more electronic devices, a manner of providing of the notification by the one or more devices associated with the user.
21. One or more machine-readable media storing instructions that, when executed by one or more electronic devices, cause the one or more electronic devices to perform operations comprising:
- identifying, by the one or more electronic devices, a notification for presentation to a user;
- identifying, by the one or more electronic devices, an action for the user to perform in response to receiving the notification, the action being associated with the notification;
- receiving, by the one or more electronic devices, context data generated using sensor data from one or more devices associated with the user, the context data indicating a current context of the user, wherein the context data indicates at least one of an activity of the user or a physiological state of the user;
- using, by the one or more electronic devices, the context data to evaluate an ability of the user to perform the action associated with the notification in the current context; and
- based on the evaluation of the ability of the user to perform the action, customizing, by the one or more electronic devices, a manner of providing of the notification by the one or more devices associated with the user.
Type: Application
Filed: Jun 1, 2020
Publication Date: Sep 17, 2020
Inventors: Praduman Jain (Fairfax, VA), Josh Schilling (Salem, OR)
Application Number: 16/889,550
