Optimizing preemptive operating system with motion sensing
A method and apparatus to provide a scheduler comprising receiving motion information from a mobile device, determining a current use characteristic for the mobile device based on the motion information, and scheduling a task based on the current use characteristic.
Latest DP Technologies, Inc. Patents:
The present invention relates to preemptive operating systems, and more particularly to scheduling in preemptive operating systems.
BACKGROUNDMobile devices are gaining increasing functionality and importance in our daily lives. Accelerometers may be incorporated in these devices for measuring the motion that the device experiences. More and more of these mobile devices have multi-tasking preemptive operating systems that allow the device to run several programs or applications at once. These preemptive operating systems have schedulers to prioritize tasks. In prior implementations, these schedulers based their decision on the priority of each application or function, and occasionally on the time of day.
SUMMARY OF THE INVENTIONA method and apparatus to provide a scheduler comprising receiving motion information from a mobile device, determining a current use characteristic for the mobile device based on the motion information, and scheduling a task based on the current use characteristic.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
The method and apparatus described is for providing a preemptive operating system which schedules tasks in a mobile device. Prior art schedulers have had no awareness as to the motion that the device is experiencing and in particular what the user's motion implies about the state of the device and the likelihood of the user to perform certain actions with the device. In prior art, these schedulers know only of the current state of various programs and whether the device has the screen turned on or off but have no awareness of the motion that a device is experiencing.
The scheduler of the present invention in one embodiment optimizes these preemptive operating environments using motion information. The scheduler optimizes tasks, programs, and data communications based upon the device's use characteristic, determined based on the motion information. Data communications may include pulling data from and pushing data to the network.
While the scheduler improves the performance of all programs on a mobile device, some programs require especially low latency in their execution in order to operate accurately. In particular, programs that receive and process the input from integrated or wirelessly tethered sensors degrade rapidly in performance and accuracy as latency increases. Many of these sensor programs analyze data in real time, sampling a sensor from 1 to 300+Hz. In a preemptive operating system where the host processor interfaces directly with a given sensor, a higher priority task such as a phone call or data transfer will preempt the lower priority task of real time data analysis. If system bandwidth is limited, the lower priority task may be halted entirely, significantly degrading the program's performance.
The mobile device 110 may also obtain data from other another mobile device 150 either through a direct connection or through network. The scheduler 160 in mobile device 110 determines when the various tasks and communications occur. This may include obtaining data from, and sending data to, servers 130, sensors 120, and other mobile devices 150, as well as internal processes such as programs and tasks.
Scheduler 160 includes a resource identification list 210, which includes a listing of one or more potential tasks and the resource(s) that the task uses. For example, a download task utilizes network bandwidth, storage bandwidth (memory bus), and storage. By contrast, a telephone call task only uses network bandwidth.
Prioritizer 220 includes a list of tasks and their relative priorities. For example, a task which is observed by the user is a higher priority than a task which is generally not observed by the user. A task which provides semi-real-time feedback or other data processing is higher priority than a task which provides background download, synchronization, or similar features. In one embodiment, user may use a user interface 225 to prioritize tasks. In one embodiment, the system comes with a default set of priorities, which may be edited or adjusted by the user.
Motion information logic 230 receives motion data. In one embodiment, motion data is received from an accelerometer or other inertial sensor. In one embodiment, motion data is received from a 3-dimensional accelerometer that is part of the device. Motion logic 230 determines a current motion, and based on an identified activity of the user, determines expected future motion as well. For example, if the user is walking at a rapid cadence, it is likely that he or she will continue to walk. If the user is playing a game, he or she is likely to continue moving the device and playing the game.
In one embodiment, the system further includes an active application detector 240. In one embodiment, active application detector detects when an application is active (i.e. being used), even if there is no associated motion. For example, the user may open an application such as a web download application while keeping the mobile device stationary.
Current task scheduler 250 prioritizes current tasks based on prioritizer 220 data and resource ID 210 data. The current tasks are determined by current task scheduler 250 based on active app. detector 240 and motion logic 230.
If the current task scheduler 250 determines that two applications conflict, it can in one embodiment, send a stop message to application stop logic 270. In one embodiment, current task scheduler 250 also then sends the stopped task to future task scheduler 260. In one embodiment, current task scheduler 250 may also utilize resource restrictor 280 to reduce available resources for lower priority tasks. In one embodiment, current task scheduler 250 uses prioritizer data to determine which application(s) to throttle.
Resource restrictor 280 may be used to reduce the available resources to one or more of the currently active applications. This may include reducing available bandwidth.
Future task scheduler 260 receives future tasks for scheduling. In one embodiment, these future tasks may be received from current task scheduler 250. In one embodiment, future tasks may be received from the user. The user may, in one embodiment, add tasks to a list of “future tasks” which should be performed when there are resources available. For example, for a larger download or upload project, the user may indicate that the project is a “future task” instead of directly initializing the task.
Future task scheduler 260 passes a task to current task scheduler 250 when the motion info logic 230 and active application detector 240 indicate that the time is good for performing that task. For example, when the device is not in motion, and there are no applications using network bandwidth, a upload or download future task may be scheduled. In one embodiment, future task scheduler 260 passes tasks for data calls to the server for uploads, downloads, and synchronization to the current task scheduler 250 when the device is idle. In one embodiment, the device is idle when no motion is detected. In one embodiment, the device is idle when no motion is detected and the user is not interacting with any application.
In one embodiment, the system may have tasks that are interruptible (such as downloads) and tasks that are not interruptible (such as installation of applications). In one embodiment, future task scheduler 260 may also have as an input a clock. In one embodiment, the future task scheduler may take into account the likelihood of a user initiating a conflicting task, prior to passing a non-interruptible task to the current task scheduler 250.
At block 310, motion data is logged. Motion data is logged, in one embodiment in a buffer or similar temporary memory. At block 315, current motion is identified, and future expected motions are identified. At block 320, the active applications are identified.
At block 320, the process determines whether there is a conflict between the motions/sensors and any current tasks. If there is no conflict, the process continues to block 330. At block 330, the process determines whether there are any future tasks. Future tasks are tasks either scheduled by the user to be executed in the future, or halted previously. If there are no future tasks, the process returns to block 310 to continue logging motion data.
If there are future tasks, the process, at block 335, determines whether there are resources available currently to execute the future task. In one embodiment, this is determined based on the motion data. In one embodiment, this is determined based on the motion data and the active application data. In one embodiment, this is determined based on the motion data and time-of-day data.
If the resources are available, at block 340 the future task is initiated. The process then returns to block 330, to query whether there are any more future tasks to be scheduled. In one embodiment, the future tasks are scheduled in order of priority. That is the first query is for the highest priority future task, then for the next highest priority, and so on. In one embodiment, each future task is evaluated by this process. If there are no remaining future tasks, the process returns to block 310 to continue logging motion data.
If, at block 325, the process found that there was a conflict between the current applications, the process continues to block 350.
At block 350, the conflicting resource is identified. This may include network bandwidth, memory bandwidth, display, etc.
At block 355, the lowest priority application which uses that resource is identified. In one embodiment, the lowest priority resource may be one that is restartable, not viewed or actively utilized by the user. For example, a backup application may be the lowest priority application.
At block 360, the process determines whether throttling should be used. In one embodiment, throttling is always used when available. In one embodiment, throttling is only used if the application is a non-interruptible application. In one embodiment, the user may set a preference for throttling.
If throttling should be used, the process, at block 365 throttles the conflicting application's use of the conflicting resource. The process then returns to block 325, to determine whether there is still a conflict.
If throttling should not be used, at block 370 the lowest priority application is stopped. It is then, at block 375, added to the future tasks list. In this way, the system ensures that the task will be performed at some future time. The process then returns to block 325, to determine whether there is still a conflict.
In this way, the system provides a method to ensure that low priority applications are throttled based on motion data, and potentially other data. Note that while this and other processes are shown in flowchart form, the actual implementation need not be sequential as described. Thus, for example, future tasks may also be monitoring the resource availability for tasks on the list. In one embodiment, conflicts may be tested for every time there is a change in state in the device, i.e. a new application is started, a new motion type is detected, etc.
At block 410, the applications on the mobile device are identified. In one embodiment, this process is triggered each time a new application is added to the mobile device. In one embodiment, only new applications are evaluated and prioritized in that instance.
At block 415, the process identifies any applications needing real-time feedback. Such applications may include sensors which require real-time control commands, applications such as telephone applications where even short delays can impact the user experience.
At block 420, the process determines whether there are any such applications. If so, at block 422, these applications receive the highest priority. The process then continues to block 425. If there are no such applications, the process continues directly to block 425.
At block 425, the process identifies any applications having direct user interactions. Such applications may include games, productivity applications, and other applications where delays can impact the user experience.
At block 423, the process determines whether there are any such applications. If so, at block 432, these applications receive the next highest priority. The process then continues to block 435. If there are no such applications, the process continues directly to block 435.
At block 435, the process identifies any non-interruptible applications. Such applications may include software installation, games requiring periodic memory access, and other applications that cannot be terminated without causing problems.
At block 440, the process determines whether there are any such applications. If so, at block 442, these applications receive the next highest priority. The process then continues to block 445. If there are no such applications, the process continues directly to block 445.
At block 445, the process identifies any applications including periodic reporting. This includes sensors that have periodic updates, applications which report out to the user, applications such as email which use periodic data pulls, etc.
At block 450, the process determines whether there are any such applications. If so, at block 452, these applications receive the next highest priority. The process then continues to block 455. If there are no such applications, the process continues directly to block 455.
At block 455, the remaining applications receive the lowest priority.
At block 460, the process determines whether there is likely conflicts between equally prioritized applications. For example, it is unlikely that a user will be playing two games simultaneously, but the user may walk and make a telephone call at the same time. If there are equally prioritized applications which may conflict, the process continues to block 462.
At block 462, the conflicting applications are reprioritized based on usage statistics or other measurements. In one embodiment, the prioritization occurs within the same category. That is, the lowest priority application within a category is still a higher priority than the highest prioritization in the next lower category. In one embodiment, more frequently used applications receive higher priority. In one embodiment, delay-sensitivity is used for prioritizing within the category. In one embodiment, this step is skipped entirely, and the user is prompted to make prioritization decisions. In one embodiment, if two such applications are found in conflict during use, the one which was activated later is considered the higher priority application.
At block 465, in one embodiment the priorities are provided to the user, and the user is permitted to make changes. In one embodiment, this only occurs if the user specifically requests it. Otherwise, the entire scheduling process is completely transparent to the user, and the user need not be aware of it at all. In one embodiment, if the user lowers the priority of an application which requires real-time feedback or has user interaction, the user is warned of the risk of such a reprioritization.
At block 470, the priorities are saved. The process then ends at block 475. In one embodiment, this process may be invoked by the user at any time, may be automatically triggered periodically, may be triggered whenever a new application is added to the mobile device, or may be started by another trigger.
In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims
1. A method comprising:
- receiving motion information from a mobile device;
- receiving active application data from the mobile device, the active application data identifying a currently active application, and resources used by the currently active application, the resources including network bandwidth, storage bandwidth, memory, and sensor data;
- determining a current use characteristic for the mobile device based on the motion information and the active application data;
- calculating expected future motions based on the motion information; and
- determining resources used by a task, the resources including one or more of:
- network bandwidth, storage bandwidth, memory, and sensors;
- scheduling the task based on the current use characteristic, the expected future motions, and the resources used by the task.
2. The method of claim 1, further comprising:
- scheduling the task to be immediately executed.
3. The method of claim 1, further comprising:
- wherein receiving the active application data from the mobile device, comprises receiving an indication that there is no active application.
4. The method of claim 1, further comprising:
- determining a conflict between an existing operation and the task; and
- when the task is a higher priority than the existing operation, altering a use profile of the existing operation.
5. The method of claim 4, wherein altering the use profile comprises throttling one or more of the resources used by the active application.
6. The method of claim 4, wherein altering the use profile comprises terminating the active application.
7. The method of claim 6, wherein when the currently application is terminated, the current application is placed on a future task list to be executed when the resource becomes available again.
8. The method of claim 1, further comprising:
- prioritizing tasks based on resource use and application profile.
9. The method of claim 1, wherein the task is a data call, and wherein the data call task is scheduled when the motion information indicates that the device is idle.
10. The method of claim 9, wherein the data call is for one or more of: uploading, downloading, and synchronizing data with a server.
11. The method of claim 9, wherein the device is idle when the device is motionless, and no user interaction with the device is occurring.
12. The method of claim 9, wherein the device is idle when the device is motionless and no voice call is being made.
13. A mobile device comprising:
- a motion information logic implemented in a processor to receive motion information from a sensor in a mobile device, and to determine a current use characteristic and an expected future motion based on the motion information;
- an active application detector to identify an active application, and one or more resources associated with the active application, the one or more resources including: network bandwidth, storage bandwidth, memory and sensor data; and
- a scheduler to schedule a task based on the current use characteristic, the expected future motion, and a resource requirement associated with the task.
14. The mobile device of claim 13, further comprising:
- the scheduler scheduling the task to be immediately executed.
15. The mobile device of claim 13, further comprising:
- a prioritizer determining a conflict between an existing operation and the task; and
- a resource restrictor throttling one or more of the resources available to the existing operation.
16. The mobile device of claim 13, further comprising:
- the scheduler scheduling a task when the mobile device is idle, wherein the mobile device is idle when the mobile device is motionless and no voice call is being made.
17. A mobile device comprising:
- a motion information logic implemented in a processor to receive motion data, and calculate current and expected future user activities;
- an active application detector to detect a current use of the mobile device, including one or more resources used by the current use of the mobile device, the one or more resources including: network bandwidth, storage bandwidth, memory, and sensor data; and
- a scheduler to schedule tasks based on the current use, and the current and expected future user activities, and resource requirements of the tasks.
18. The mobile device of claim 17, further comprising:
- a resource restrictor to restrict resources to an active application, based on the current and the expected future user activities.
19. The mobile device of claim 17, further comprising:
- the scheduler to determine a category of the current use and the task, and to order the current use and the tasks based on the category.
20. The mobile device of claim 19, further comprising:
- the scheduler prioritizing tasks within each category, to order the current use and the tasks within each category.
21. The mobile device of claim 17, further comprising: the scheduler prioritizing a frequently used application above a less frequently used application.
22. The mobile device of claim 17, further comprising: a user interface to enable a user to alter a prioritization of tasks, the altered prioritization used by the scheduler.
| 4285041 | August 18, 1981 | Smith |
| 4571680 | February 18, 1986 | Wu |
| 4578769 | March 25, 1986 | Frederick |
| 4700369 | October 13, 1987 | Siegal et al. |
| 4776323 | October 11, 1988 | Spector |
| 5313060 | May 17, 1994 | Gast et al. |
| 5386210 | January 31, 1995 | Lee |
| 5430480 | July 4, 1995 | Allen et al. |
| 5446725 | August 29, 1995 | Ishiwatari |
| 5446775 | August 29, 1995 | Wright et al. |
| 5454114 | September 26, 1995 | Yach et al. |
| 5485402 | January 16, 1996 | Smith et al. |
| 5506987 | April 9, 1996 | Abramson et al. |
| 5583776 | December 10, 1996 | Levi et al. |
| 5593431 | January 14, 1997 | Sheldon |
| 5654619 | August 5, 1997 | Iwashita |
| 5703786 | December 30, 1997 | Conkright |
| 5737439 | April 7, 1998 | Lapsley et al. |
| 5771001 | June 23, 1998 | Cobb |
| 5778882 | July 14, 1998 | Raymond et al. |
| 5911065 | June 8, 1999 | Williams et al. |
| 5955667 | September 21, 1999 | Fyfe |
| 5955871 | September 21, 1999 | Nguyen |
| 5960085 | September 28, 1999 | de la Huerga |
| 5976083 | November 2, 1999 | Richardson et al. |
| 6013007 | January 11, 2000 | Root et al. |
| 6061456 | May 9, 2000 | Andrea et al. |
| 6122595 | September 19, 2000 | Varley et al. |
| 6135951 | October 24, 2000 | Richardson et al. |
| 6145389 | November 14, 2000 | Ebeling et al. |
| 6246321 | June 12, 2001 | Rechsteiner et al. |
| 6282496 | August 28, 2001 | Chowdhary |
| 6353449 | March 5, 2002 | Gregg et al. |
| 6369794 | April 9, 2002 | Sakurai et al. |
| 6396883 | May 28, 2002 | Yang et al. |
| 6408330 | June 18, 2002 | de la Huerga |
| 6428490 | August 6, 2002 | Kramer et al. |
| 6470147 | October 22, 2002 | Imada |
| 6478736 | November 12, 2002 | Mault |
| 6493652 | December 10, 2002 | Ohlenbusch et al. |
| 6496695 | December 17, 2002 | Kouji et al. |
| 6513381 | February 4, 2003 | Fyfe et al. |
| 6522266 | February 18, 2003 | Soehren et al. |
| 6529144 | March 4, 2003 | Nilsen et al. |
| 6532419 | March 11, 2003 | Begin et al. |
| 6539336 | March 25, 2003 | Vock et al. |
| 6595929 | July 22, 2003 | Stivoric et al. |
| 6607493 | August 19, 2003 | Song |
| 6611789 | August 26, 2003 | Darley |
| 6628898 | September 30, 2003 | Endo |
| 6634992 | October 21, 2003 | Ogawa |
| 6665802 | December 16, 2003 | Ober |
| 6672991 | January 6, 2004 | O'Malley |
| 6685480 | February 3, 2004 | Nishimoto et al. |
| 6700499 | March 2, 2004 | Kubo et al. |
| 6731958 | May 4, 2004 | Shirai |
| 6766176 | July 20, 2004 | Gupta et al. |
| 6771250 | August 3, 2004 | Oh |
| 6786877 | September 7, 2004 | Foxlin |
| 6788980 | September 7, 2004 | Johnson |
| 6790178 | September 14, 2004 | Mault et al. |
| 6813582 | November 2, 2004 | Levi et al. |
| 6823036 | November 23, 2004 | Chen |
| 6826477 | November 30, 2004 | Ladetto et al. |
| 6836744 | December 28, 2004 | Asphahani et al. |
| 6881191 | April 19, 2005 | Oakley et al. |
| 6885971 | April 26, 2005 | Vock et al. |
| 6895425 | May 17, 2005 | Kadyk et al. |
| 6898550 | May 24, 2005 | Blackadar et al. |
| 6928382 | August 9, 2005 | Hong et al. |
| 6941239 | September 6, 2005 | Unuma et al. |
| 6959259 | October 25, 2005 | Vock et al. |
| 6975959 | December 13, 2005 | Dietrich et al. |
| 7010332 | March 7, 2006 | Irvin et al. |
| 7020487 | March 28, 2006 | Kimata |
| 7027087 | April 11, 2006 | Nozaki et al. |
| 7028547 | April 18, 2006 | Shiratori et al. |
| 7042509 | May 9, 2006 | Onuki |
| 7054784 | May 30, 2006 | Flentov et al. |
| 7057551 | June 6, 2006 | Vogt |
| 7072789 | July 4, 2006 | Vock et al. |
| 7092846 | August 15, 2006 | Vock et al. |
| 7096619 | August 29, 2006 | Jackson et al. |
| 7148797 | December 12, 2006 | Albert |
| 7149964 | December 12, 2006 | Cottrille et al. |
| 7155507 | December 26, 2006 | Hirano et al. |
| 7158912 | January 2, 2007 | Vock et al. |
| 7169084 | January 30, 2007 | Tsuji |
| 7171222 | January 30, 2007 | Fostick |
| 7171331 | January 30, 2007 | Vock et al. |
| 7173604 | February 6, 2007 | Marvit et al. |
| 7176886 | February 13, 2007 | Marvit et al. |
| 7176887 | February 13, 2007 | Marvit et al. |
| 7176888 | February 13, 2007 | Marvit et al. |
| 7177684 | February 13, 2007 | Kroll et al. |
| 7180500 | February 20, 2007 | Marvit et al. |
| 7180501 | February 20, 2007 | Marvit et al. |
| 7180502 | February 20, 2007 | Marvit et al. |
| 7200517 | April 3, 2007 | Darley et al. |
| 7212230 | May 1, 2007 | Stavely |
| 7212943 | May 1, 2007 | Aoshima et |
| 7220220 | May 22, 2007 | Stubbs et al. |
| 7254516 | August 7, 2007 | Case et al. |
| 7280096 | October 9, 2007 | Marvit et al. |
| 7280849 | October 9, 2007 | Bailey |
| 7297088 | November 20, 2007 | Tsuji |
| 7301526 | November 27, 2007 | Marvit et al. |
| 7301527 | November 27, 2007 | Marvit et al. |
| 7301528 | November 27, 2007 | Marvit et al. |
| 7301529 | November 27, 2007 | Marvit et al. |
| 7305323 | December 4, 2007 | Skvortsov et al. |
| 7328611 | February 12, 2008 | Klees et al. |
| 7334472 | February 26, 2008 | Seo et al. |
| 7353112 | April 1, 2008 | Choi et al. |
| 7365735 | April 29, 2008 | Reinhardt et al. |
| 7365736 | April 29, 2008 | Marvit et al. |
| 7365737 | April 29, 2008 | Marvit et al. |
| 7379999 | May 27, 2008 | Zhou et al. |
| 7387611 | June 17, 2008 | Inoue et al. |
| 7397357 | July 8, 2008 | Krumm et al. |
| 7451056 | November 11, 2008 | Flentov et al. |
| 7457719 | November 25, 2008 | Kahn et al. |
| 7457872 | November 25, 2008 | Aton et al. |
| 7463997 | December 9, 2008 | Pasolini et al. |
| 7467060 | December 16, 2008 | Kulach et al. |
| 7512515 | March 31, 2009 | Vock et al. |
| 7526402 | April 28, 2009 | Tanenhaus et al. |
| 7608050 | October 27, 2009 | Shugg |
| 7640804 | January 5, 2010 | Daumer et al. |
| 7647196 | January 12, 2010 | Kahn et al. |
| 7653508 | January 26, 2010 | Kahn et al. |
| 7664657 | February 16, 2010 | Letzt et al. |
| 7689107 | March 30, 2010 | Enomoto |
| 7705884 | April 27, 2010 | Pinto et al. |
| 7752011 | July 6, 2010 | Niva et al. |
| 7753861 | July 13, 2010 | Kahn et al. |
| 7765553 | July 27, 2010 | Douceur et al. |
| 7774156 | August 10, 2010 | Niva et al. |
| 7788059 | August 31, 2010 | Kahn et al. |
| 7857772 | December 28, 2010 | Bouvier et al. |
| 7881902 | February 1, 2011 | Kahn et al. |
| 7892080 | February 22, 2011 | Dahl |
| 7987070 | July 26, 2011 | Kahn et al. |
| 8187182 | May 29, 2012 | Kahn et al. |
| 20010047488 | November 29, 2001 | Verplaetse et al. |
| 20020006284 | January 17, 2002 | Kim |
| 20020023654 | February 28, 2002 | Webb |
| 20020027164 | March 7, 2002 | Mault et al. |
| 20020042830 | April 11, 2002 | Bose et al. |
| 20020044634 | April 18, 2002 | Rooke et al. |
| 20020054214 | May 9, 2002 | Yoshikawa |
| 20020089425 | July 11, 2002 | Kubo et al. |
| 20020109600 | August 15, 2002 | Mault et al. |
| 20020118121 | August 29, 2002 | Lehrman et al. |
| 20020122543 | September 5, 2002 | Rowen |
| 20020138017 | September 26, 2002 | Bui et al. |
| 20020142887 | October 3, 2002 | O'Malley |
| 20020150302 | October 17, 2002 | McCarthy et al. |
| 20020151810 | October 17, 2002 | Wong et al. |
| 20020173295 | November 21, 2002 | Nykanen et al. |
| 20020190947 | December 19, 2002 | Feinstein |
| 20030018430 | January 23, 2003 | Ladetto et al. |
| 20030033411 | February 13, 2003 | Kavoori et al. |
| 20030048218 | March 13, 2003 | Milnes et al. |
| 20030083596 | May 1, 2003 | Kramer et al. |
| 20030093187 | May 15, 2003 | Walker et al. |
| 20030101260 | May 29, 2003 | Dacier et al. |
| 20030109258 | June 12, 2003 | Mantyjarvi et al. |
| 20030139692 | July 24, 2003 | Barrey et al. |
| 20030139908 | July 24, 2003 | Wegerich et al. |
| 20030149526 | August 7, 2003 | Zhou et al. |
| 20030151672 | August 14, 2003 | Robins et al. |
| 20030187683 | October 2, 2003 | Kirchhoff et al. |
| 20030208110 | November 6, 2003 | Mault et al. |
| 20030208113 | November 6, 2003 | Mault et al. |
| 20030227487 | December 11, 2003 | Hugh |
| 20030236625 | December 25, 2003 | Brown et al. |
| 20040017300 | January 29, 2004 | Kotzin et al. |
| 20040024846 | February 5, 2004 | Randall et al. |
| 20040043760 | March 4, 2004 | Rosenfeld et al. |
| 20040044493 | March 4, 2004 | Coulthard |
| 20040047498 | March 11, 2004 | Mulet-Parada et al. |
| 20040078219 | April 22, 2004 | Kaylor et al. |
| 20040078220 | April 22, 2004 | Jackson |
| 20040081441 | April 29, 2004 | Sato et al. |
| 20040106958 | June 3, 2004 | Mathis et al. |
| 20040122294 | June 24, 2004 | Hatlestad et al. |
| 20040122295 | June 24, 2004 | Hatlestad et al. |
| 20040122296 | June 24, 2004 | Hatlestad et al. |
| 20040122297 | June 24, 2004 | Stahmann et al. |
| 20040122333 | June 24, 2004 | Nissila |
| 20040122484 | June 24, 2004 | Hatlestad et al. |
| 20040122485 | June 24, 2004 | Stahmann et al. |
| 20040122486 | June 24, 2004 | Stahmann et al. |
| 20040122487 | June 24, 2004 | Hatlestad et al. |
| 20040125073 | July 1, 2004 | Potter et al. |
| 20040130628 | July 8, 2004 | Stavely |
| 20040135898 | July 15, 2004 | Zador |
| 20040146048 | July 29, 2004 | Cotte |
| 20040148340 | July 29, 2004 | Cotte |
| 20040148341 | July 29, 2004 | Cotte |
| 20040148342 | July 29, 2004 | Cotte |
| 20040148351 | July 29, 2004 | Cotte |
| 20040176067 | September 9, 2004 | Lakhani et al. |
| 20040185821 | September 23, 2004 | Yuasa |
| 20040219910 | November 4, 2004 | Beckers |
| 20040225467 | November 11, 2004 | Vock et al. |
| 20040236500 | November 25, 2004 | Choi et al. |
| 20040242202 | December 2, 2004 | Torvinen |
| 20040247030 | December 9, 2004 | Wiethoff |
| 20040259494 | December 23, 2004 | Mazar |
| 20050015768 | January 20, 2005 | Moore |
| 20050027567 | February 3, 2005 | Taha |
| 20050033200 | February 10, 2005 | Soehren et al. |
| 20050038691 | February 17, 2005 | Babu |
| 20050048945 | March 3, 2005 | Porter |
| 20050048955 | March 3, 2005 | Ring |
| 20050078197 | April 14, 2005 | Gonzales |
| 20050079873 | April 14, 2005 | Caspi et al. |
| 20050101841 | May 12, 2005 | Kaylor et al. |
| 20050102167 | May 12, 2005 | Kapoor |
| 20050107944 | May 19, 2005 | Hovestadt et al. |
| 20050113649 | May 26, 2005 | Bergantino |
| 20050113650 | May 26, 2005 | Pacione et al. |
| 20050131736 | June 16, 2005 | Nelson et al. |
| 20050141522 | June 30, 2005 | Kadar et al. |
| 20050143106 | June 30, 2005 | Chan et al. |
| 20050146431 | July 7, 2005 | Hastings et al. |
| 20050157181 | July 21, 2005 | Kawahara et al. |
| 20050165719 | July 28, 2005 | Greenspan et al. |
| 20050168587 | August 4, 2005 | Sato et al. |
| 20050182824 | August 18, 2005 | Cotte |
| 20050183086 | August 18, 2005 | Abe et al. |
| 20050202934 | September 15, 2005 | Olrik et al. |
| 20050203430 | September 15, 2005 | Williams et al. |
| 20050210300 | September 22, 2005 | Song et al. |
| 20050212751 | September 29, 2005 | Marvit et al. |
| 20050212752 | September 29, 2005 | Marvit et al. |
| 20050212753 | September 29, 2005 | Marvit et al. |
| 20050212760 | September 29, 2005 | Marvit et al. |
| 20050216403 | September 29, 2005 | Tam et al. |
| 20050222801 | October 6, 2005 | Wulff et al. |
| 20050232388 | October 20, 2005 | Tsuji |
| 20050232404 | October 20, 2005 | Gaskill |
| 20050234676 | October 20, 2005 | Shibayama |
| 20050235058 | October 20, 2005 | Rackus et al. |
| 20050238132 | October 27, 2005 | Tsuji |
| 20050240375 | October 27, 2005 | Sugai |
| 20050243178 | November 3, 2005 | McConica |
| 20050245988 | November 3, 2005 | Miesel |
| 20050248718 | November 10, 2005 | Howell et al. |
| 20050256414 | November 17, 2005 | Kettunen et al. |
| 20050258938 | November 24, 2005 | Moulson |
| 20050262237 | November 24, 2005 | Fulton et al. |
| 20050281289 | December 22, 2005 | Huang et al. |
| 20060009243 | January 12, 2006 | Dahan et al. |
| 20060017692 | January 26, 2006 | Wehrenberg et al. |
| 20060020177 | January 26, 2006 | Seo et al. |
| 20060029284 | February 9, 2006 | Stewart |
| 20060063980 | March 23, 2006 | Hwang et al. |
| 20060064276 | March 23, 2006 | Ren et al. |
| 20060080551 | April 13, 2006 | Mantyjarvi et al. |
| 20060090088 | April 27, 2006 | Choi et al. |
| 20060098097 | May 11, 2006 | Wach et al. |
| 20060100546 | May 11, 2006 | Silk |
| 20060109113 | May 25, 2006 | Reyes et al. |
| 20060136173 | June 22, 2006 | Case, Jr. et al. |
| 20060140422 | June 29, 2006 | Zurek et al. |
| 20060149516 | July 6, 2006 | Bond et al. |
| 20060154642 | July 13, 2006 | Scannell, Jr. |
| 20060161377 | July 20, 2006 | Rakkola et al. |
| 20060161459 | July 20, 2006 | Rosenfeld et al. |
| 20060167387 | July 27, 2006 | Buchholz et al. |
| 20060167647 | July 27, 2006 | Krumm et al. |
| 20060167943 | July 27, 2006 | Rosenberg |
| 20060172706 | August 3, 2006 | Griffin et al. |
| 20060174685 | August 10, 2006 | Skvortsov et al. |
| 20060204214 | September 14, 2006 | Shah et al. |
| 20060206258 | September 14, 2006 | Brooks |
| 20060223547 | October 5, 2006 | Chin et al. |
| 20060249683 | November 9, 2006 | Goldberg et al. |
| 20060256082 | November 16, 2006 | Cho et al. |
| 20060257042 | November 16, 2006 | Ofek et al. |
| 20060259268 | November 16, 2006 | Vock et al. |
| 20060284979 | December 21, 2006 | Clarkson |
| 20060288781 | December 28, 2006 | Daumer et al. |
| 20060289819 | December 28, 2006 | Parsons et al. |
| 20070004451 | January 4, 2007 | Anderson |
| 20070005988 | January 4, 2007 | Zhang et al. |
| 20070017136 | January 25, 2007 | Mosher et al. |
| 20070024441 | February 1, 2007 | Kahn et al. |
| 20070037605 | February 15, 2007 | Logan et al. |
| 20070038364 | February 15, 2007 | Lee et al. |
| 20070040892 | February 22, 2007 | Aoki et al. |
| 20070050157 | March 1, 2007 | Kahn et al. |
| 20070061105 | March 15, 2007 | Darley et al. |
| 20070063850 | March 22, 2007 | Devaul et al. |
| 20070067094 | March 22, 2007 | Park et al. |
| 20070073482 | March 29, 2007 | Churchill et al. |
| 20070075127 | April 5, 2007 | Rosenberg |
| 20070075965 | April 5, 2007 | Huppi et al. |
| 20070082789 | April 12, 2007 | Nissila et al. |
| 20070104479 | May 10, 2007 | Machida |
| 20070106991 | May 10, 2007 | Yoo |
| 20070125852 | June 7, 2007 | Rosenberg |
| 20070130582 | June 7, 2007 | Chang et al. |
| 20070142715 | June 21, 2007 | Banet et al. |
| 20070143068 | June 21, 2007 | Pasolini et al. |
| 20070145680 | June 28, 2007 | Rosenberg |
| 20070150136 | June 28, 2007 | Doll et al. |
| 20070156364 | July 5, 2007 | Rothkopf |
| 20070161410 | July 12, 2007 | Huang et al. |
| 20070165790 | July 19, 2007 | Taori |
| 20070169126 | July 19, 2007 | Todoroki et al. |
| 20070176898 | August 2, 2007 | Suh |
| 20070192483 | August 16, 2007 | Rezvani et al. |
| 20070208531 | September 6, 2007 | Darley et al. |
| 20070213126 | September 13, 2007 | Deutsch et al. |
| 20070239399 | October 11, 2007 | Sheynblat et al. |
| 20070250261 | October 25, 2007 | Soehren |
| 20070259685 | November 8, 2007 | Engblom et al. |
| 20070259716 | November 8, 2007 | Mattice et al. |
| 20070259717 | November 8, 2007 | Mattice et al. |
| 20070260418 | November 8, 2007 | Ladetto et al. |
| 20070260482 | November 8, 2007 | Nurmela et al. |
| 20070263995 | November 15, 2007 | Park et al. |
| 20070281762 | December 6, 2007 | Barros et al. |
| 20080005738 | January 3, 2008 | Imai et al. |
| 20080030586 | February 7, 2008 | Helbing et al. |
| 20080046888 | February 21, 2008 | Appaji |
| 20080052716 | February 28, 2008 | Theurer |
| 20080072014 | March 20, 2008 | Krishnan et al. |
| 20080082994 | April 3, 2008 | Ito et al. |
| 20080113689 | May 15, 2008 | Bailey |
| 20080140338 | June 12, 2008 | No et al. |
| 20080153671 | June 26, 2008 | Ogg et al. |
| 20080165022 | July 10, 2008 | Herz et al. |
| 20080168361 | July 10, 2008 | Forstall et al. |
| 20080171918 | July 17, 2008 | Teller et al. |
| 20080214358 | September 4, 2008 | Ogg et al. |
| 20080231713 | September 25, 2008 | Florea et al. |
| 20080231714 | September 25, 2008 | Estevez et al. |
| 20080232604 | September 25, 2008 | Dufresne et al. |
| 20080243432 | October 2, 2008 | Kato et al. |
| 20080303681 | December 11, 2008 | Herz et al. |
| 20080311929 | December 18, 2008 | Carro et al. |
| 20090017880 | January 15, 2009 | Moore et al. |
| 20090031319 | January 29, 2009 | Fecioru |
| 20090043531 | February 12, 2009 | Kahn et al. |
| 20090047645 | February 19, 2009 | Dibenedetto et al. |
| 20090067826 | March 12, 2009 | Shinohara et al. |
| 20090088204 | April 2, 2009 | Culbert et al. |
| 20090099668 | April 16, 2009 | Lehman et al. |
| 20090124348 | May 14, 2009 | Yoseloff et al. |
| 20090128448 | May 21, 2009 | Riechel |
| 20090174782 | July 9, 2009 | Kahn et al. |
| 20090213002 | August 27, 2009 | Rani et al. |
| 20090215502 | August 27, 2009 | Griffin, Jr. |
| 20090234614 | September 17, 2009 | Kahn et al. |
| 20090274317 | November 5, 2009 | Kahn et al. |
| 20090296951 | December 3, 2009 | De Haan |
| 20090319221 | December 24, 2009 | Kahn et al. |
| 20100056872 | March 4, 2010 | Kahn et al. |
| 20100057398 | March 4, 2010 | Darley et al. |
| 1 104 143 | May 2001 | EP |
| 0 833 537 | July 2002 | EP |
| 2431813 | May 2007 | GB |
| 7020547 | January 1995 | JP |
| 2005-309691 | November 2005 | JP |
| 2006-118909 | May 2006 | JP |
| WO 99/22338 | May 1999 | WO |
| WO 00/63874 | October 2000 | WO |
| WO 02/088926 | November 2002 | WO |
- “Access and Terminals (AT); Multimedia Message Service (MMS) for PSTN/ISDN; Multimedia Message Communication Between a Fixed Network Multimedia Message Terminal Equipment and a Multimedia Message Service Centre,” ETSI AT-F Rapporteur Meeting, Feb. 4-6, 2003, Gothenburg, DES/AT-030023 V0.0.1 (Mar. 2003).
- Ang, Wei Tech, et al, “Zero Phase Filtering for Active Compensation of Period Physiological Motion,” Proc 1st IEEE / RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, Feb. 20-22, 2006, pp. 182-187.
- Aylward, Ryan, et al, “Sensemble: A Wireless, Compact, Multi-User Sensor System for Interactive Dance,” International Conference on New Interfaces for Musical Expression (NIME06), Jun. 4-8, 2006, pp. 134-139.
- Baca, Arnold, et al, “Rapid Feedback Systems for Elite Sports Training,” IEEE Pervasive Computing, Oct.-Dec. 2006, pp. 70-76.
- Bakhru, Kesh, “A Seamless Tracking Solution for Indoor and Outdoor Position Location,” IEEE 16th International Symposium on Personal, Indoor, and Mobile Radio Communications, 2005, pp. 2029-2033.
- Bliley, Kara E, et al, “A Miniaturized Low Power Personal Motion Analysis Logger Utilizing MEMS Accelerometers and Low Power Microcontroller,” IEEE EMBS Special Topic Conference on Microtechnologies in Medicine and Biology, May 12-15, 2005, pp. 92-93.
- Bourzac, Katherine “Wearable Health Reports,” Technology Review, Feb. 28, 2006, <http://www.techreview.com/printer—friendly—article—aspx?id+16431>, Mar. 22, 2007, 3 pages.
- Cheng, et al, “Periodic Human Motion Description for Sports Video Databases,” Proceedings of the Pattern Recognition, 2004, 8 pages.
- Dao, Ricardo, “Inclination Sensing with Thermal Accelerometers”, MEMSIC, May 2002, 3 pages.
- “Decrease Processor Power Consumption using a CoolRunner CPLD,” XILINX XAPP347 (v1.0), May 16, 2001, 9 pages.
- Fang, Lei, et al, “Design of a Wireless Assisted Pedestrian Dead Reckoning System—The NavMote Experience,” IEEE Transactions on Instrumentation and Measurement, vol. 54, No. 6, Dec. 2005, pp. 2342-2358.
- Healey, Jennifer, et al, “Wearable Wellness Monitoring Using ECG and Accelerometer Data,” IEEE Int. Symposium on Wearable Computers (ISWC'05), 2005, 2 pages.
- Jones, L, et al, “Wireless Physiological Sensor System for Ambulatory Use,” <http://ieeexplore.ieee.org/xpl/freeabs—all.jsp?tp=&arnumber=1612917&isnumber=33861>, Apr. 3-5, 2006, 1 page.
- Jovanov, Emil, et al, “A Wireless Body Area Network of Intelligent Motion Sensors for Computer Assisted Physical Rehabilitation,” Journal of NeuroEngineering and Rehabilitation, Mar. 2005, 10 pages.
- Kalpaxis, Alex, “Wireless Temporal-Spatial Human Mobility Analysis Using Real-Time Three Dimensional Acceleration Data,” IEEE Intl. Multi-Conf. on Computing in Global IT (ICCGI'07), 2007, 7 pages.
- Margaria, Rodolfo, “Biomechanics and Energetics of Muscular Exercise”, Chapter 3, Oxford: Clarendon Press 1976, pp. 105-125.
- Milenkovic, Milena, et al, “An Accelerometer-Based Physical Rehabilitation System,” IEEE SouthEastern Symposium on System Theory, 2002, pp. 57-60.
- Mizell, David, “Using Gravity to Estimate Accelerometer Orientation”, Seventh IEEE International Symposium on Wearable Computers, 2003, 2 pages.
- Ormoneit, D, et al, Learning and Tracking of Cyclic Human Motion: Proceedings of NIPS 2000, Neural Information Processing Systems, 2000, Denver, CO, pp. 894-900.
- Otto, Chris, et al, “System Architecture of a Wireless Body Area Sensor Network for Ubiquitous Health Monitoring,” Journal of Mobile Multimedia, vol. 1, No. 4, 2006, pp. 307-326.
- Park, Chulsung, et al, “Eco: An Ultra-Compact Low-Power Wireless Sensor Node for Real-Time Motion Monitoring,” IEEE Int. Symp. on Information Processing in Sensor Networks, 2005, pp. 398-403.
- Shen, Chien-Lung, et al, “Wearable Band Using a Fabric-Based Sensor for Exercise ECG Monitoring,” IEEE Int. Symp. on Wearable Computers, 2006, 2 pages.
- Weckesser, P, et al, “Multiple Sensorprocessing for High-Precision Navigation and Environmental Modeling with a Mobile Robot,” IEEE, 1995, pp. 453-458.
- Weinberg, Harvey, “MEMS Motion Sensors Boost Handset Reliability” Jun. 2006, ≦http://www.mwrf.com/Articles/Print.cfm?ArticleID=12740>, Feb. 21, 2007, 3 pages.
- Weinberg, Harvey, “Minimizing Power Consumption of iMEMS® Accelerometers,” Analog Devices, <http://www.analog.com/static/imported-files/application—notes/5935151853362884599AN601.pdf>, 2002, 5 pages.
- Wixted, Andrew J, et al, “Measurement of Energy Expenditure in Elite Athletes Using MEMS-Based Triaxial Accelerometers,” IEEE Sensors Journal, vol. 7, No. 4, Apr. 2007, pp. 481-488.
- Yoo, Chang-Sun, et al, “Low Cost GPS/INS Sensor Fusion System for UAV Navigation,” IEEE, 2003, 9 pages.
- Anderson, Ian, et al, “Shakra: Tracking and Sharing Daily Activity Levels with Unaugmented Mobile Phones,” Mobile Netw Appl, Aug. 3, 2007, pp. 185-199.
- Hemmes, Jeffrey, et al, “Lessons Learned Building TeamTrak: An Urban/Outdoor Mobile Testbed,” 2007 IEEE Int. Conf. on Wireless Algorithms, Aug. 1-3, 2007, pp. 219-224.
- Lee, Hyunseok, et al, “A Dual Processor Solution for the MAC Layer of a Software Defined Radio Terminal,” Advanced Computer Architecture Laboratory, University of Michigan, Apr. 14, 2009, 25 pages.
- Lee, Seon-Woo, et al., “Recognition of Walking Behaviors for Pedestrian Navigation,” ATR Media Integration & Communications Research Laboratories, Kyoto, Japan, Sep. 5-7, 2001, pp. 1152-1155.
- Ricoh, “Advanced digital technology changes creativity,” <www.ricoh.com/r—dc/gx/gx200/features2.html>, Accessed May 12, 2011, 4 pages.
- “Sensor Fusion,” <www.u-dynamics.com>, accessed Aug. 29, 2008, 2 pages.
- Tapia, Emmanuel Munguia, et al, “Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor,” IEEE Cont. on Wearable Computers, Oct. 2007, 4 pages.
- Tech, Ang Wei, “Real-time Image Stabilizer,” <www.mae.ntu.edu.sg/ABOUTMAE/DIVISIONS/RRC—BIOROBOTICS/Pages/rtimage.aspx>, Mar. 23, 2009, 3 pages.
- Wang, Shu, et al, “Location Based Services for Mobiles: Technologies and Standards, LG Electronics MobileComm,” IEEE ICC, 2008, Beijing, pp. 1-66 (part 1 of 3).
- Wang, Shu, et al, “Location Based Services for Mobiles: Technologies and Standards, LG Electronics MobileComm,” IEEE ICC, 2008, Beijing, pp. 67-92 (part 2 of 3).
- Wang, Shu, et al, “Location Based Services for Mobiles: Technologies and Standards, LG Electronics MobileComm,” IEEE ICC, 2008, Beijing, pp. 93-123 (part 3 of 3).
- Wu, Winston H, et al, “Context-Aware Sensing of Physiological Signals,” IEEE Int. Conf. on Engineering for Medicine and Biology, Aug. 23-26, 2007, pp. 5271-5275.
- Zypad WL 1100 Wearable Computer, <www.eurotech.fi/products/manuals/Zypad%20WL%201100—sf.pdf>, Jan. 16, 2008, 2 pgs.
Type: Grant
Filed: Jul 27, 2007
Date of Patent: Oct 8, 2013
Assignee: DP Technologies, Inc. (Scotts Valley, CA)
Inventors: Philippe Kahn (Aptos, CA), Arthur Kinsolving (Santa Cruz, CA)
Primary Examiner: Emerson Puente
Assistant Examiner: Charles Swift
Application Number: 11/829,813
International Classification: G06F 9/46 (20060101);
