System and method for identifying and establishing preferred modalities or channels for communications based on participants' preferences and contexts
A system and method for identifying and establishing preferred modalities or channels for communications based on participants' preferences and capabilities is provided. In one approach, the system attempts to optimize the inferred or directly accessed preferences of a contactee given the accessed or inferred preferences, capabilities and goals of the contactor while keeping the rationale and context of the contactee private. Such optimization can be achieved using preferences and policies concerning handling the attempted contact based on a deterministic specification or through inferring context, content and task under uncertainty by employing decision-theoretic inferences to attempt to maximize the expected utility of the communication to the contactee. The methods may include a consideration of metadata within a standard schema that is transmitted along with a communication attempt, representing information about such attributes as the identity of the contactor, the task at hand, the overall context of the contactor, and the communication capabilities available to the contactor. The invocation of the communication service may be performed in a variety of ways, including single button invocations, and via a communication service that is more deeply integrated with other applications and functionalities. The service can also include automated rescheduling of communications based on a consideration of forecasts of availability of both the contactor and contactee.
Latest Microsoft Patents:
This application is a continuation of U.S. patent application Ser. No. 09/982,306, filed on Oct. 17, 2001, and entitled, “SYSTEM AND METHOD FOR IDENTIFYING AND ESTABLISHING PREFERRED MODALITIES OR CHANNELS FOR COMMUNICATIONS BASED ON PARTICIPANTS' PREFERENCES AND CONTEXTS,” which is a Continuation-in-Part of U.S. patent application Ser. No. 09/809,142, filed Mar. 15, 2001, and entitled, “SYSTEM AND METHOD FOR IDENTIFYING AND ESTABLISHING PREFERRED MODALITIES OR CHANNELS FOR COMMUNICATIONS BASED ON PARTICIPANTS' PREFERENCES AND CONTEXTS.” The entireties of the aforementioned applications are incorporated herein by reference. This application is also related to co-pending U.S. patent application Ser. No. 10/281,547, filed on Oct. 28, 2002, entitled, “SYSTEM FOR PERFORMING CONTEXT-SENSITIVE DECISIONS ABOUT IDEAL COMMUNICATION MODALITIES CONSIDERING INFORMATION ABOUT CHANNEL RELIABILITY,” co-pending U.S. patent application Ser. No. 10/281,718, filed on Oct. 28, 2002, entitled, “SYSTEM AND METHODS ENABLING A MIX OF HUMAN AND AUTOMATED INITIATIVES IN THE CONTROL OF COMMUNICATION POLICIES,” co-pending U.S. patent application Ser. No. 10/187,078, filed on Jun. 28, 2002, entitled, “METADATA SCHEMA FOR INTERPERSONAL COMMUNICATIONS MANAGEMENT SYSTEMS,” co-pending U.S. patent application Ser. No. 10/281,546, filed on Oct. 28, 2002, entitled, “REPRESENTATION, DECISION MODELS, AND USER INTERFACE FOR ENCODING MANAGING PREFERENCES, AND PERFORMING AUTOMATED DECISION MAKING ABOUT THE TIMING AND MODALITIES OF INTERPERSONAL COMMUNICATIONS,” co-pending U.S. patent application Ser. No. 11/100,734, filed Apr. 7, 2005, entitled, “SYSTEM AND METHOD FOR IDENTIFYING AND ESTABLISHING PREFERRED MODALITIES OR CHANNELS FOR COMMUNICATIONS BASED ON PARTICIPANTS' PREFERENCES AND CONTEXTS,” co-pending U.S. patent application Ser. No. 10/036,566, filed Dec. 21, 2001, entitled, “METHODS, TOOLS, AND INTERFACES FOR THE DYNAMIC ASSIGNMENT OF PEOPLE TO GROUPS TO ENABLE ENHANCED COMMUNICATION AND COLLABORATION,” co-pending U.S. patent application Ser. No. 11,047,066, filed on Jan. 31, 2005, entitled, “METHODS, TOOLS, AND INTERFACES FOR THE DYNAMIC ASSIGNMENT OF PEOPLE TO GROUPS TO ENABLE ENHANCED COMMUNICATION AND COLLABORATION,” co-pending U.S. patent application Ser. No. 11,047,130, filed on Jan. 31, 2005, entitled, “METHODS, TOOLS, AND INTERFACES FOR THE DYNAMIC ASSIGNMENT OF PEOPLE TO GROUPS TO ENABLE ENHANCED COMMUNICATION AND COLLABORATION,” co-pending U.S. patent application Ser. No. 11,047,318, filed on Jan. 31, 2005, entitled, “METHODS, TOOLS, AND INTERFACES FOR THE DYNAMIC ASSIGNMENT OF PEOPLE TO GROUPS TO ENABLE ENHANCED COMMUNICATION AND COLLABORATION,” and co-pending U.S. patent application Ser. No. 11,047,228, filed on Jan. 31, 2005, entitled, “METHODS, TOOLS, AND INTERFACES FOR THE DYNAMIC ASSIGNMENT OF PEOPLE TO GROUPS TO ENABLE ENHANCED COMMUNICATION AND COLLABORATION.”
TECHNICAL FIELDThe present invention relates generally to policies, including, in one example of the system, decision-theoretic policies, for identifying and establishing data communications and more particularly to facilitating optimal communication links between contactors and contactees based on deterministic and/or uncertain contactee and/or contactor preferences, capabilities and context, both present and predicted.
BACKGROUND OF THE INVENTIONAs the number of possible communication modalities between contactors and contactees has increased, it has become increasingly valuable to identify and choose optimal channel(s) by which communications are carried out to facilitate maximizing the utility of a data communication. For example, communicating parties may be able to communicate by computer (e.g., email, voice over IP, collaborative editing), by telephone (e.g., POTS, cell phone, satellite phone), face to face (e.g., personal meeting, video conference) and/or other methods, with such communication employing one or more channels (e.g., phone and collaborative editing). Maximizing the utility or expected utility of such communications may depend on the identity of the parties, the type of communication equipment available to the parties, the type of equipment used to do the initial signaling, the location of the parties and in what activities, if any, the parties are engaged or are likely to be engaged in the future.
By way of illustration, a first contactee may be employing a first tool and be intensely focused on an important task and thus may not desire to be interrupted via real-time communications except from select people whose desired communication concerns the important task. But a second contactee may be employing no tools and be lightly focused on an unimportant task and thus may not mind being interrupted via real-time communications from colleagues concerning a variety of topics. Conventionally, the contactor had limited means, if any, to determine which, if any, communication method(s) would be best employed to communicate with a contactee (e.g., contacting the contactee's secretary to figure out how and when to contact the contactee). Similarly, the contactee had limited contact control methods (e.g., leaving the phone off the hook, ignoring emails, disabling an email application, leaving instructions with a secretary). Thus, the preferences and needs of the contactees and contactors may not have been observed.
Beyond considerations of real-time methods versus methods that allow users to send potentially disruptive real-time disruptions into an asynchronous (store and forward) communication format (e.g., voicemail, email), a contactee may have preferences, depending on the contactor and the context at hand, for a particular modality. For example, a contactee may prefer to receive an instant message on an important document while working on that document to facilitate cutting and pasting from the instant message, rather than receiving a real-time phone call that would require transcribing the caller's comments. Again, conventionally the contactee had limited means, if any, to have such preferences observed (e.g., a well-trained secretary, considerate colleagues) which often lead to unfulfilled preferences and unwanted interruptions.
While conventional communications between two communicating parties was complicated, identifying and scheduling communications that optimized the utility of a communication between multiple parties (e.g., group meeting, group teleconference) was even more complicated, with the identification, scheduling, and initiating often consuming more time and resources than the actual communication. Such scheduling and initiating problems were exacerbated when the schedulers and initializers did not have complete information concerning the parties.
SUMMARY OF THE INVENTIONThe following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not an extensive overview of the invention. It is not intended to identify key or critical elements of the invention or to delineate the scope of the invention. Its sole purpose is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.
The present invention relates to a system and method for determining optimal communication modalities between contactors and contactees based on information, either complete or incomplete, associated with the contactees and/or contactors. To preserve the privacy of the contactee, contactee information employed in determining the optimal communication modality may typically not be shared with the contactor. Based on the identified optimal communication modalities, one or more communications may be scheduled, calendared and/or initiated in real-time between the contactor and contactee. The scheduled communication may rely on the current context and capabilities of the communicating parties and/or on predictions concerning the likelihoods that different communication modalities will become available and/or communicating party contexts will become more optimal. Alternatively and/or additionally, the present invention may display to the contactor the contactee's current list, ranked in order of preference based on the information being considered. In other situations, a best means may be displayed, or simply invoked.
The method can consider the optimization of a measure of priority or value for communicating parties and additionally and/or alternatively, for the contactee (including the contactee's preferences about the contactor's preferences). In another example aspect of the present invention, one or more policies may be established according to the policies of an organization, considering the preferences of contactees and contactors, but combining these at the level of the enterprise employing the participants.
Considering now a method whereby the selected communication satisfies a set of polices specified by the contactee(s), and secondarily (via preferences of the contactee about the contactor's preferences) that of the contactor(s) concerning communications. In a general formulation of this method, given communication and collaboration preferences expressed as utility functions, beliefs about context, content and communications expressed as probability distributions, and a set of decision alternatives concerning communications (e.g., establish a real-time telephony connection now, pop up an email composition form on the contactor's screen, route the contactor to voicemail, etc.), the decision making system should choose that course of action that maximizes the expected utility of the communication. In one example aspect of the present invention, the recipient of the communication is considered as the principal agent since it is the recipient's attentional resources that are requested by the contactor. But the preferences of the contactor may also be considered in an attempt to maximize the utility of the communication to the contactor within the constraints imposed while maximizing the utility to the contactee. Further, in an automated setting, where the contactor is communicating with an automated contactee, the present invention can disregard the utility of the communication to the contactee and establish maximizing the utility of the communication to the contactor as the primary goal.
The optimal communication modalities may be based on factors including, but not limited to, available communication channels (including single versus multiple simultaneous channels), the tool used in an initial attempt to communicate, the contactee preferences, contactor preferences, specially identified time periods, groupings of contactors, contactee context, contactor context, contactee communication needs, contactor communication needs, contactor communication goals, schedules, priorities, deadlines, costs, benefits, contactee capabilities and contactor capabilities, for example.
By way of illustration, a speechwriter working on the state of the union address may have several communication modalities through which she can be contacted (e.g., in person, by phone, by email, by cooperatively editing the speech, by pager). Up to two weeks before the speech, when time is not so critical, the speechwriter may be willing to accept communications from persons in different categories via different types of communications modalities. For example, the speechwriter may prefer real-time communications (e.g., telephone, cooperative editing) from a first group of persons (e.g., President, White House staff, certain family members) with the type of real-time communication being based in part on where the speechwriter is located and what the speechwriter is doing. For example, the speechwriter may prefer a phone call when not working on the document, may prefer a phone call and a joint computer screen link for cooperative editing while working on the document and may prefer high priority email and/or mobile paging while at work but away from her desk. These preferences may be intended by the speechwriter to facilitate maximizing the utility of the communication to the speechwriter and/or to customize the work environment to the contactee's desires, for example. Similarly, the speechwriter may prefer non-real-time communications (e.g., low priority email) from a second group of persons (e.g., specific members of Congress, certain press, and certain close friends) so that her workflow is not interrupted, again attempting to maximize the utility of communications and customize the workplace.
In one example aspect of the present invention, when a contactor wishes to communicate with a contactee, the contactor may employ the present invention to identify communication modalities and present ranking information concerning the modalities based on maximizing the utility of the communication with the contactee. Such utility calculations may consider both current conditions and probabilities associated with future conditions. By way of illustration, if the President wants to contact the contactee concerning the speech, then substantially all methods of communication may be available to contact the contactee, and the method that will provide the most immediate feedback may be selected. For example, if the speechwriter is at her desk, working on the speech, then cooperative editing with a simultaneous voice channel and shared computer screen may be selected. But if the speech writer is in her car (as determined by GPS, for example), then although an immediate cellular phone call may maximize the immediacy of the communication, a phone call delayed for ten minutes until the speechwriter arrives home and has her laptop available for transcribing and/or editing may produce a higher utility. If the speech writer is outside cellular coverage, and has no satellite phone available, then a runner may be dispatched with the message. By way of further illustration, if the speech-writer's veterinarian wishes to contact the contactee a month in advance concerning a reminder about an optional office visit for a healthy pet, then low priority email and/or a low priority voice mail may be chosen to maximize utility. As the illustrations point out, there can be a large number of variables to evaluate in determining the communication that will maximize utility.
The rich set of data concerning the contactee and/or contactor can be employed by the present invention to facilitate determining the communication modality that will maximize the utility of the communication. Sometimes the present invention may reason concerning the optimal communication modality with complete data, but at other times, since the set of data is large and complex, the present invention may sometimes reason concerning the decision under uncertainty. For example, the decision-making system may only have a belief, represented as a probability distribution, concerning the likelihood that a contactee is in a certain attentional state. Such a belief may be computed dynamically as a function of information from sources including, but not limited to, the contactee's calendar, desktop activity, ambient acoustics in the contactee's location and video analysis of the contactee's gaze or local activity, for example. Inferred likelihoods about a contactee's attention, location, and other aspects of a contactee's context may be employed to drive dynamic decision making about communications, motivated by an attempt to select actions that maximize the contactee's expected utility. Thus, the present invention can determine the optimal communication modality given multiple observations about the contactee and/or contactor contexts.
The present invention facilitates using multiple decision-making methods, where the best method is selected in different situations. For example, one decision may be made using simple priority rules, another by a policy that takes as input key aspects of the contactee's preferences and the communication preferences of the contactee and/or contactor. In another case, a decision may be made employing decision-theoretic reasoning concerning the value of the communication given a consideration of the uncertainties about the context. In addition, the decisions can be made sensitive to dates and times, considering specific assertions about particular time horizons to guide communications. For example, a contactee may attach great importance to communications occurring before a point in time (e.g., a speech being delivered) but then may attach very low importance to such communications for the following month.
In another example aspect, the contactor may specify desired modalities and allow the present invention to maximize communication utility within the specified modalities. Although contactors can choose an initial communication modality, the contactor can be referred (e.g., by a message, by automated routing), to the preferred modality. In one example aspect of the present invention, communication devices (e.g., phones, computer screens, faxes) can include a “BestCom” button that initiates optimizing communication modalities and which removes the need for the contactor to make decisions concerning modality and routing, with such decisions made by the present invention. Given the availability of such a service, a potential future contactee may request that the potential future contactor utilize the present invention to contact the contactee when attempting future contacts.
The present invention is not limited to communications between two parties or to a single communication channel between two parties. It is to be appreciated that multiple channels and/or multiple communicating parties can be treated as increased sets of alternatives that may complicate utility maximizing computations without changing the fundamental process of identifying and establishing one or more communication modalities based on the preferences, contexts and capabilities of the communicating parties.
Yet another aspect of the present invention considers the value of delaying the communication and rescheduling it for a later time via an automated system that scans calendars and inferred availability information-or via establishing private dialogs with each potential participant, for example. As an example, assume that a contactor attempts to contact a contactee in real-time and the contactee is in an important meeting. The best option (e.g., one that maximizes utility) may be to reschedule a real-time conversation when the contactee is predicted to be back from meeting, based on calendar information or statistics concerning the contactee's comings and goings that facilitate predicting the contactee's likely availability. One aspect of the present invention may consider the calendar of the contactor to arrange a mutually good time.
Another aspect of the present invention facilitates presenting information to contactors and/or contactees and engaging them in a dialog to facilitate scheduling a communication. The dialog may produce entity selection data concerning the communication, where such data can be employed to choose between possible communication modalities. Such interactions can similarly be employed to schedule group meetings where the cost of delay (e.g., estimated loss in value of the information being transmitted), the current attentional states of the contactor(s), the current attentional states of the contactee(s), the potential attentional states of the contactor(s), the potential attentional states of the contactee(s), the availability of other modalities, the current availability of contactee(s) and the potential availability of the contactee(s) are considered.
The present invention includes methods for predicting the likelihood of when contactee(s) may be available, where such likelihoods can be employed in scheduling group meetings where the utility of the group experience of the n participants, n being an integer, is maximized. For example, calendars for the n participants can be examined to infer times at which the participants are likely to be available to share in some common modalities (e.g., videoconferencing, collaborative editing). In other cases, there may be automated analysis about the best way to engage in a group meeting when a subset of participants will not have access to the same more ideal modality than the others. In such situations, a decision may be made to limit the methods (e.g., forego video links) so as to maintain an equivalent relationship among participants. Automated meeting request(s) can be constructed from such analysis.
To the accomplishment of the foregoing and related ends, certain illustrative aspects of the invention are described herein in connection with the following description and the annexed drawings. These aspects are indicative, however, of but a few of the various ways in which the principles of the invention may be employed and the present invention is intended to include all such aspects and their equivalents. Other advantages and novel features of the invention may become apparent from the following detailed description of the invention when considered in conjunction with the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. it may be evident, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate description of the present invention.
As used in this application, the term “component” is intended to refer to a computer-related entity, either hardware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program and a computer. By way of illustration, both an application running on a server and the server can be components. One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers.
It is to be appreciated that various aspects of the present invention may employ representations of deterministic policies specified as functions or rules that take as arguments contextual information, details about the nature of the participants, and the content or task at hand. The present invention may also employ technologies associated with facilitating inference and decision making under uncertainty and optimization of expected utility and/or minimization of expected costs. Thus, statistical inference may be performed with models constructed by hand, from data with machine learning methods, or by a mixture of machine learning and human assessment. Such models can be used in conjunction with deterministic policies where depending on the context, an inferential rule or deterministic rule is used. A variety of machine learning systems/methodologies (e.g., Bayesian learning methods that perform search over alternative dependency structures and apply a score (such as the Bayesian Information Criteria, etc.) methods, Bayesian classifiers and other statistical classifiers, including decision tree learning methods, support vector machines, linear and non-linear regression, and neural network representations, etc.) may be employed to build and update inferential models.
Referring initially to
The communication 110 may be achieved through a variety of modalities including, but not limited to, telephone modalities, computer modalities, hardcopy fax modalities, paging modalities and personal modalities, for example. Data concerning the modalities may be stored in a communication modality data store 115. The communication modality data store 115 can hold information including, but not limited to, modalities available, cost for communication using that modality, likelihood modality will become available, modality capacity and modality reliability, for example. The system 100 may consider modalities that are currently available to establish the communication 110 and may also consider predictions concerning modalities that may become available to establish the communication 110. For example, a computer may not be currently available, because it is turned off, but it may become available later, when the user of the computer arrives at work and turns it on. The telephone modalities can include, but are not limited to POTS telephony, cellular telephony, satellite telephony and Internet telephony. The computer modalities can include, but are not limited to email, collaborative editing, instant messaging, network meetings, calendaring and devices employed in home processing and/or networking. The personal modalities can include, but are not limited to videoconferencing, messengering and face-to-face meeting. Data concerning a current modality (e.g., a phone that is busy) may be analyzed, as may data concerning the likelihood that the modality may become available (e.g., phone will no longer be busy). Identifying the optimal communication may, therefore, include considering the benefits of establishing the communication 110 at a first point in time, with the communication modalities available at that point in time, and considering the costs of delaying establishing the communication 110 to a second point in time when other communication modalities may be available.
A contact manager 140 is employed to identify and determine which modalities can be employed for the communication 110 between the contactor 120 and the contactee 130. To facilitate identifying the modalities and to further facilitate determining which of the modalities should be employed for the communication 110, and at what point in time the communication should be attempted, the contact manager 140 has access to a contactor data store 150, a contactee data store 160 and a modality data store 115. The contactor data store 150, the modality data store 115 and the contactee data store 160 can store data in data structures including, but not limited to one or more lists, arrays, tables, databases, stacks, heaps, linked lists and data cubes. The contactor data store 150, the modality data store 115 and the contactee data store 160 can reside on one physical device and/or may be distributed between two or more physical devices (e.g., disk drives, tape drives, memory units). Further, the contactor data store 150, the modality data store 115 and the contactee data store 160 may reside in one logical device and/or data structure. Similarly, the contact manager 140 can be distributed between two or more cooperating processes and/or reside in one physical or logical device (e.g., computer, process).
In one example of the present invention, the contactee data 160 is not made available to the contactor 120, while one or more portions of the contactor data 150 are made available to the contactee 130. Thus, the privacy of the contactee 130 may be protected and the identity of the contactor 120 may be revealed.
The contactor data 150 may include current state information, predictions concerning future states and costs associated with delaying a communication to points in time associated with the predictions concerning future states. Similarly, the contactee data 160 may include current state information, predictions concerning future states and costs associated with delaying a communication to points in time associated with the predictions concerning future states. For example, the contactee data 160 may include information concerning the current attentional status of the contactee 130 (e.g., in conversation on the phone concerning an assigned task) and may also include information concerning predicted attentional states of the contactee 130 at one or more future points in time (e.g., 25% likelihood contactee 130 in same state in five minutes, 50% likelihood contactee 130 in lower attentional state in ten minutes).
The contact manager 140 may therefore examine the communication modality data 115, the contactor data 150 and the contactee data 160 when performing processing associated with identifying the modality that will maximize the utility of the communication 110 between the contactor 120 and the contactee 130. While one communication 110 is illustrated, it is to be appreciated that one or more communication modalities may be employed in methods including, but not limited to, parallel, serial and simultaneous communication between the contactor 120 and the contactee 130. By way of illustration, the contactor 120 and the contactee 130 may communicate by telephone at the same time that they are sharing a document via collaborative editing over a computer network communication modality.
The contact manager 140 may examine data (e.g., contactor data 150, modality data 115, contactee data 160) and find information sufficient to perform deterministic calculations for identifying the optimal modality for the communication 110. The deterministic calculations may be facilitated by applying one or more preferences based rules based on the sufficient information. By way of illustration, if a first party is attempting to telephone a second party, then the present invention may display the current best possible means, ranked by likelihood, of reaching the second party for real-time telephony given the context of the second party. By way of further illustration, if a contactor listed in a contactee's people class store as a “critical colleague” tries to reach the contactee, and the contactee is not in a meeting, and it is business hours, and the contactee is near a voice-enabled device, and the contactor is using a voice-enabled device, the present invention may route that contactor to the best voice enabled device, unless the contactee is having a conversation with someone.
Tools for displaying and editing such preferences and/or rules would ease the task of creating and managing such rules. In a more sophisticated approach, the present invention directs communications via automated methods that identify communication actions that have the value or highest expected value given uncertainties in variables under consideration. Several formulations of decision problem are feasible, depending on the variables under consideration, the preferences being represented, and the principal agent (or “owner”) of the decision.
In a general formulation of the problem, the present invention considers a “communications value function”, ƒ, that return a value for each communication modality or subset of modalities under consideration or an ordering over communication modalities in terms of acceptability of the modality or subset of modalities.
where context of contactee and contactor include the devices that are available, the time of day, tasks and situation at hand for the contactor and contactee, and the like. It is to be appreciated that the context of the contactee and contactor may be stored in one or more formats, including, but not limited to, an XML schema.
In one example aspect, the present invention orders the modalities by assigned value and attempts to create a connection or to advise the contactor and/or contactee concerning the best possible connection.
But the contact manager 140 may discover that incomplete information is available. Thus, the contact manager 140 may be uncertain concerning certain data points involved in calculations for identifying the optimal modality for the communication 110. Thus, the contact manager 140 may be required to reason under this uncertainty. For example, in one example aspect of the present invention, the contact manager 140 may require a value associated with the attentional state of the contactee 130. However, for one sample calculation, no such value may be found in the contactee data 160. Thus, the contact manager 140 may rely on one or more conditional probabilities associated with the contactee 130 attentional status based on information like desktop events, ambient noise in the location of the contactee 130 and gaze tracking when determining the maximum utility.
In general, there may be uncertainty concerning preferences and one or more parameters employed to model a context. In this situation, a probability distribution over the different states of each variable can be inferred and expected values for each modality can be computed. For example, if there is uncertainty concerning aspects of the context of the contactee, the probability distribution (here represented abstractly), given evidence E observed about the context, and sum over the uncertainties can be represented:
The present invention may order the modalities by assigned expected value and attempt to create a connection or to advise the contactor and/or contactee concerning the best connection.
Considering now more specific examples of the use of expected utility, a particular basic formulation of decision-making under uncertainty in the context of the preferences of the contactee 130 is captured by Equation 1.
where A* is the ideal communication actions, which include the modalities employed by the contactor (AC*) and contactee (Recipient) (AR*) computed by optimizing Equation 1. In the equation, Aj is the communication modality being considered, ACk is the communication modality employed by the contactor, contextRi is the context of the contactee (Recipient) of the intended communication, contextC is the context of the contactor, and C is the identity of the contactor, typically linked to a class of person (e.g., critical associate, previously replied to, family, unknown). Thus, in an example aspect of the present invention, the conditional probability p(contextRi|E) that the contactee has a certain context given the evidence E is employed in conjunction with the utility function u to determine the ideal communication actions that can be taken to maximize the utility of the communication 110 between the contactor 120 and the contactee 130.
The basic formulation for identifying optimal communication modalities can be extended by introducing uncertainty about the context of the contactor 120, which adds the summing noted in equation 2 to the uncertainty calculations of equation 1. The particular communication action and/or modality selected for the initial contact by the contactor 120 is represented as ACinit.
The contactor 120 and contactee 130 contexts represent rich sets of deterministic or uncertain variables. The contexts may contain data, including but not limited to, the available modalities for the contactor 120 and/or contactee 130 (e.g., is a private voice channel available, are channel and rich desktop available, are television cameras available), information concerning the nature of the location, and content or task of the contactor 120 and of the contactee 130. Data associated with automated assessments and/or directly marked indications of urgency or importance in the communications may also be evaluated in identifying optimal communication modalities. The contextual variables can be treated as explicit deterministic or probabilistic factors in the optimization. For example, mck can represent the modalities available to the contactor 120 and thus equation 3 considers combinations of modalities available to the contactor 120.
Thus, the system 100 can, in various example aspects, account for the preferences, contexts and capabilities of the contactor 120 and/or the contactee 130 where information concerning the contexts may be incomplete, thus requiring reasoning under uncertainty to identify the likely optimal communication modality.
Referring now to
The communication 210 that is identified by a communication manager 240 may depend, at least in part, on one or more sets of data concerning communication modalities, contactors and/or contactees, for example. One possible data set, a communication modality data set 215 concerns the available communication channels. The available communication channels can include, but are not limited to email (of various priorities), telephone (POTS, cellular, satellite, Internet), paging, runners/couriers, video conferencing, face-to-face meeting, instantaneous collaborative editing, delayed posting collaborative editing, picture in picture television, home device activation (e.g., turning on lights in the study, ringing the telephone with a distinctive pattern) and so on. A communication modality may not be a static entity, and thus information concerning the state, capacity, availability, cost etc., of the communication modalities can change. Thus, the communication modality data set 215 can contain current state information and/or data to facilitate making predictions concerning future state, capacity, availability, cost etc. associated with one or more communication modalities.
The location of the contactee 230 can determine which communication modalities, if any, are available. For example, a speechwriter may have collaborative editing, phone, email, pager, video conferencing and face-to-face communications available at her office in the White House, may have phone, face-to-face and email available while in her office at home, may only have satellite phone available while on vacation and may have no real-time capacity while in the shower or asleep. The current task of the contactee 230 can also determine which communication modalities, if any, are available. For example, if the speechwriter is currently on the phone, then the phone may not be available. Predictions concerning the likelihood that the phone will become available can be employed by the system 200 in determining the optimal modality for the communication 210. Thus, rather than sending an email at a first point in time (e.g., while the phone is busy), the present invention may schedule a real-time phone call at a second, later point in time, when it is likely that the speechwriter will be off the phone.
The communication manager 240 may also have available another set of data referred to as the contactee data 250. The contactee data 250 may include information related to hardware, software, contactee task being performed, contactee attention status, contactee context data 252 and contactee preference data 254, for example. By way of illustration, the hardware data may include information related to what hardware is available to the contactee, what hardware is being employed by the contactee (e.g., desktop, laptop, PDA), the capabilities of that hardware (e.g., enough memory and communication bandwidth for videoconferencing), the cost of employing that hardware and the state(s) in which that hardware is currently functioning (e.g., online, offline). The hardware data may also include information concerning usage patterns that facilitate determining the likelihood that an unavailable piece of hardware will become available. The software data may include information related to what software is available to the contactee, what software is currently being employed by the contactee (e.g., which word processor is being used to edit the speech), the capabilities of that software (e.g., allows collaborative editing) and the state(s) in which that software is currently functioning (e.g., running and active, running but inactive). The software data may also include information concerning usage patterns that facilitate determining the likelihood that an unavailable piece of software will become available.
The contactee data 250 may also contain preference data 254 concerning the preferences of the contactee 230. The preference data 254 can include data concerning how the contactee 250 prefers to be contacted, with those preferences varying over time with respect to various contactors 220 and various topics of communication. For example, the speechwriter may initially allow communications from a large group of persons concerning the State of the Union speech. The speechwriter may also establish preferences that allow the President to communicate with her with a best effort at real-time telephony at all times up to the deadline for the speech. But the speechwriter may gradually restrict the group of people from whom she is willing to accept real-time communications as the deadline approaches and she may further restrict the means by which such people can communicate. In the last hours before the deadline, the speechwriter may be closed to all real-time communications except in person communications with the President and telephone based emergency medical information concerning family members, for example.
The contactee preference data 254 can include data concerning, but not limited to, preferences concerning the time of day for communicating (e.g., early morning, business hours, evening, late night, sleeping hours), the time of the week for communicating (e.g., Monday through Friday, Weekend, Holiday, Vacation), identity of contactors (e.g., employer, employees, critical colleague, colleague, peers, nuclear family, extended family, close friends, friends, acquaintances, others), hardware currently available or available within a time horizon of a communication attempt (e.g., desktop, laptop, home computer), preferred software (e.g., email, word processing, calendaring ) and preferred interruptability (e.g., do not interrupt while focused on work, only interrupt while not focused), for example. While six preferences are identified in the preceding sentence, it is to be appreciated that a greater or lesser number of preferences may employed in accordance with the present invention.
The contactee data 250 may also include a context data 252. The context data 252 is generally related to observations about the contactee 230. For example, observations concerning the type of activity in which the contactee 230 is involved (e.g., on task, not on task), location of the contactee 230 (e.g., office, home, car, shower), calendar (e.g., appointment status, appointment availability), history of communications with other party (e.g., have replied to email in the past, have spoken to on the telephone recently, the utility of the interaction, the duration of the interaction), background ambient noise at current location, number of hours at work that day and attentional status (e.g., high focus, focus, light focus, conversation with another person, light activity) may be stored in the context data 252. While seven observations are listed in the preceding sentence it is to be appreciated that a greater or lesser number of observations may be stored in the context data 252. On some occasions the context data 252 may be incomplete (e.g., video analysis data unavailable because video camera broken). Thus, the communication manager 240 may need to reason concerning the optimal communication while relying on such incomplete data. Thus, the contactee data 250 may also include information to facilitate producing one or more probabilities associated with a missing data element. By way of illustration, the contactee data 250 may contain information operable to predict the likelihood that the contactee 230 is in a high attentional state even though gaze tracking information is unavailable.
The contactee data 250 may further include information concerning the long-term and/or acute, dynamically changing communication needs of the contactee 250. By way of illustration, the contactee 250 may need to have no interruptions for the next hour (e.g., “hold everything unless high critical on this task or an hour from now”). By way of further illustration, to prevent a contactor 220 from “ducking” the contactee 230 by leaving an email or a voice mail when the contactee 230 desires to speak with the contactor 220, the contactee 230 may require that contacts from the contactor 220 be made in a certain way within X units of time of notification that the contactor 220 desires communication (e.g., if research assistant tasked with finding a crucial fact tries to contact speechwriter by email, speechwriter wants real-time phone conversation within ten seconds of assistant's attempt).
Thus, returning to equation 1,
the contactee data 250 is seen to contribute to the utility function u through the contextRi component, which can include the contactee context data 252 discussed above.
In addition to the contactee data 250 employed in determining the optimal communication, data concerning the contactor 220 may also be employed. The contactor data 260 may include hardware, software, context, preference and communication needs data similar to that available for the contactee 230, but different in that it is prepared from the point of view of the contactor 220.
Thus, returning again to equation 1,
the contactor data 260 is seen to contribute to the utility function u through the contextC component, which can include the contactor context data 262 discussed above.
The present invention is not limited to communications between two parties or to a single communication channel between two parties. It is to be appreciated that multiple channels and/or multiple communicating parties can be treated as increased sets of alternatives that may complicate utility maximizing computations without changing the fundamental process of identifying and establishing one or more communication modalities based on the preferences, contexts and capabilities of the communicating parties.
The communication manager 240 may include several components responsible for performing portions of the functionality of the communication manager 240. For example, the communication manager may include a preference resolver 242. The preference resolver 242 can examine the contactee preference data 254 and the contactor preference data 264 to find correlations between the two sets of data. For group communications, the preference resolver 242 may examine multiple sets of preference data to find correlations between the preferences. By way of illustration, for a communication between two parties, the preference resolver 242 may determine that both parties would prefer to communicate by high priority email for communications associated with a first task. Similarly, the preference resolver 242 may determine that the contactee 230 would prefer to communicate by collaborative editing and phone for communications concerning a particular document, while the contactor 220 would prefer to communicate only by telephone. Thus, the preference resolver 242 may produce data or initiate processing that assigns values to the correlations between the contactee 230 preferences and the contactor preferences 220. In one example aspect of the present invention, the preferences of the contactee 230 are given more weight, and thus, if the contactor 220 attempted a phone conversation concerning the document for which the contactee 230 preferred both phone and collaborative editing, then the preference resolver 242 may produce data or initiate processing that would make it more likely that the contactor 220 would communicate by both phone and collaborative editing. In another example aspect of the present invention, the preferences of the contactor 220 are given priority over the preferences of the contactee. By way of illustration, when a human contactor 220 is attempting to communicate with an electronic contactee 230, the preferences of the contactor 220 may be considered more important, and thus the preference resolver 242 may produce values or initiate processing that makes it more likely that the preferences of the contactor 220 are observed. In another example aspect of the present invention, the preference resolver 242 may produce a list of potential communication modalities ranked on their responsiveness to the preferences.
The communication manager 240 may also include a context analyzer 244. The context analyzer 244 can examine the contactee context data 252 and the contactor context data 262 to find correlations between the two sets of data. For group communications, the context analyzer 244 may examine multiple sets of context data to extract information concerning the contexts. By way of illustration, for a communication between two parties, the context analyzer 244 may determine that the contactee context is such that real-time communications are not immediately available but there is an X1% likelihood that such communications will be available at a point of time T1 in the future, and an X2% likelihood that such communications will be available at a point of time T2 in the future. Further, the context analyzer 244 may determine that although the contactor 220 has requested real-time telephony that the context of the contactor 220 is such that email communication may optimize utility. For example, the context of the contactor 220 may include information concerning the ambient noise at the location of the contactor 220. The context analyzer 244 may determine that the noise level is not conducive to optimizing utility by real-time telephony and thus may produce values and/or initiate processing that will make it more likely that the contactor 220 will communicate with the contactee 230 via email. Similar to processing performed by the preference resolver 242, the context analyzer may, in different examples of the system 200, weight the context of the contactee 230 more than the context of the contactor 220 or vice versa.
Returning again to equation 1,
in one example of the present invention, the context analyzer 244 can be viewed as performing processing associated with the utility function u and its analysis of the contextRi and the contextC.
The communication manager 240 may also include a channel analyzer 246. The channel analyzer 246 can be employed to analyze the communication modality data set 215, for example. The channel analyzer 246 can produce data concerning the current availability of a communication modality and/or the likelihood of the modality becoming available. The channel analyzer 246 may examine one or more channels that the contactor 220 specified for the communication, and/or one or more channels that the contactee 230 listed as preferences in the contactee preference data 254, for example. Further, the channel analyzer 246 may examine currently available channels as determined by location information associated with the contactee 230 and channels that may become available based on the activity of the contactee 230. For example, if the contactee 230 is currently driving home (as determined by GPS and schedule, for example), then the channel analyzer 246 may examine current cellular modalities and may additionally examine the modalities available at the home of the contactee 210. Thus, the channel analyzer 246 facilitates producing data and/or initiating processing that make it more likely that a desired channel will be employed when determining the optimal communication channel(s) for the communication 210 between the contactor 220 and the contactee 230. Thus, examining equation 1,
in one example of the present invention, the channel analyzer 246 can be viewed as performing processing associated with the utility function u and its analysis of the contactor modalities Aj and the contactee modalities ACk.
The communication manager 240 may also include a communication establisher 248. Once the ideal communication actions A* have been identified, the communication establisher 248 may undertake processing to connect the contactor 220 and the contactee 230 through the identified optimal communication modality. For example, if the optimal communication 210 is identified as being email, then the communication establisher may initiate an email composing process for the contactor 220 (e.g., email screen on computer, voice to email converter on cell phone, email composer on two-way digital pager), and forward the composed email to the most appropriate email application for the contactee 230 based on the identified optimal communication 210. For example, the communication establisher 240 may forward the email to the pager of the contactee 230 based on GPS data associated with the location of the contactee 230. In an alternative embodiment of the present invention, the system 200 does not include a communication establisher 248, relying instead on contactor 220 and/or contactee 230 actions, for example, to establish the communication.
It is to be appreciated that the preference resolver 242, the context analyzer 244, the channel analyzer 246 and the communication establisher 248 may be implemented alone or in combinations of hardware, software and/or firmware. It is to be further appreciated that the preference resolver 242, the context analyzer 244, the channel analyzer 246 and the communication establisher 248 may employ one or more threads and/or processes executing alone and/or co-operating. Further, such threads and/or processes may reside on one processor and/or may be distributed over two or more processors. In one example of the present invention, the preference resolver 242, the context analyzer 244, the channel analyzer 246 and the communication establisher 248 are separate processes employing one or more threads, with each of the separate processes residing in one processor.
The invoking component 380 may perform actions including, but not limited to, scheduling, calendaring and/or initiating a communication. By way of illustration, the invoking component 380 may determine, based at least in part on data stored in the communication choices data store 370, that a real-time communication should be performed in ten minutes. Thus, rather than immediately initiate the communication, the invoking component 380 may schedule the communication and may inform the parties who are going to communicate that the communication has been scheduled. By way of further illustration, the invoking component 380 may determine that a video-conference between four parties should be performed and by examining the calendars of the four individuals, the invoking component 380 may determine that the video conference should occur at four o'clock in the afternoon on May 1st. Thus, the invoking component 380 may update the calendars of the parties, arrange for the video-conference, and inform the parties of the plans. By way of still further illustration, the invoking component 380 may determine that both parties are immediately available for the real-time communication and may dial the phones on both ends to establish the communication.
The contactee may have established preferences that indicate that for communications from a first group of contactors (e.g., traveling salesmen employees of the contactee) the contactee would prefer email, and if the contactor does not have email capability, then the contactee would prefer regular mail, and would only prefer a real-time communication if no other modality was available and the communication was high critical. Similarly, the contactee may have established preferences that indicate that for communications from a second group of contactors (e.g., nuclear family, close friends) the contactee would prefer real-time phone communications concerning a first group of topics (e.g., work-related, emergency medical information related), and would prefer an email concerning other groups of topics. By way of further illustration, the contactee may have established preferences that indicate that for communications from a third group of contactors (e.g., collaborating authors) that the contactee would prefer both a real-time phone call and a shared computer screen displaying the document at a point concerning which the contactor wishes to communicate.
Given this set of preferences, communications attempted from a contactor may take a different form than the contactor would prefer. But since the attention of the contactee is the resource that is being accessed, for certain groups that resource will be sparely provided, while for other groups it will be generously provided, depending on the preferences of the contactee and the identity of the contactor.
The preferences of the contactee are not the only data points that are evaluated by the present invention when identifying the optimal communication modality for establishing a communication between the contactor and the contactee. For example, although the contactee may prefer an email or a regular piece of mail from a traveling salesman concerning a contract the salesman has written (e.g., for documentary purposes), the salesman may not have a computer operable to send email and may not have time to send a regular piece of mail. Thus, the salesman who desires to contact the contactee may be informed by the present invention, after it analyzes the preferences and the capabilities of the parties, to send a fax using the fax machine 420. The present invention may then route the fax to the regular mail reading component 460 that can produce a communication close to what the contactee desired, thereby maximizing the utility of the communication while taking into account both the preferences and capabilities of the parties.
The preferences of the contactee may depend on where the contactee is located. Similarly, the capabilities of the contactee may depend on where the contactee is located. By way of illustration, at the office, the contactee may have a phone 450, the minicomputer 470 and the mainframe system 470 available. But at home the contactee may have only a phone 450, a laptop 455 and a television 480. Furthermore, while on the road, the contactee may have only the laptop 455. Thus, the present invention is able to examine the context of the contactee, which includes the location of the contactee, to determine capabilities. Even within a location, the capabilities of the contactee can vary from time to time. For example, at certain times during the day at work, the ambient noise level may be so high that real-time communications are impractical, and little, if any information could be communicated (e.g., while a particularly noisy piece of equipment is running near the telephone of the contactee). Thus, if a contactor attempts to contact the contactee employing real-time telephony, the present invention may schedule the phone call for a few minutes after the noisy equipment typically spins down, or may take a voice mail that is converted to email and displayed on the contactee's pager, for example. In this way, the present invention seeks to maximize the utility of the communication given the contactee's preferences and the contactee's capabilities, as those preferences and capabilities are affected by the dynamic environment in which the contactee exists.
The television 430 and the television 480 are examples of home devices that may be employed by the present invention to maximize the utility of a communication. For example, if the contactee's security company is trying to alert the contactee to an important piece of information (e.g., a theft in progress at the plant), and the contactee is at home watching a movie, then the present invention facilitates the contactor reaching the contactee by real-time phone communication and simultaneous video streamed to the contactee's television. Thus, the utility of the communication may be maximized as the contactee may be able to identify the thief or inform the security company that the apparent break-in is really a scheduled late-night pick-up.
Thus, it is to be appreciated that devices (e.g., televisions, telephones, heating systems, air filtration systems, etc.) may employ the present invention. By way of illustration, the contactor may be the local electric company computer, and the contactee may be a factory heating and air filtration system. The contactor may seek to inform the heating and filtration system, by the best means possible, that a rolling brownout is going to impact the plant in approximately thirty minutes. Thus, the present invention may attempt, based on the preferences and capabilities of the heating and filtration system and the preferences and capabilities of the electric company computer to communicate information concerning the length, duration and severity of the impending brownout. Thus, the factory may be able to act proactively, rather than reactively, to the brownout. This example is intended to illustrate that the present invention may be employed between computer processes. If the present invention informs the electric company computer that no communication is possible with the plant heating and filtration system, but that communication with the plant manager is possible via real-time telephony, then the electric company computer may place such a call. This escalation example is intended to illustrate that the present invention may be employed between computer processes and humans.
One example aspect of the present invention provides initiating means (e.g., button, icon, voice command) that can be employed to initiate identifying and establishing communications. The initiating means may, for example, be a button labeled BestCom, an icon with a star surrounding a data communication link or a voice command “Best Com Please”. When the initiating means are employed, the context of the contactor is considered to be deterministic, and the context of the contactee is considered to be uncertain. Such may be the case where there is a relatively small amount of deterministic information available from the contactor, but rich, sensed context information available for the contactee. By way of illustration, the laptop 410 may include an icon that signifies that the contactor desires the attempted communication to employ the present invention. Thus, in this example of the present invention, the context of the contactor would be considered deterministic and the context of the contactee would be considered uncertain, triggering processing associated with reasoning under uncertainty.
In view of the exemplary systems shown and described above, methodologies, which may be implemented in accordance with the present invention will be better appreciated with reference to the flow diagrams of
Turning now to
At 520, data including, but not limited to, contactor data, contactee data and communication modality data is analyzed. The contactor data can include, but is not limited to, situation data and contactor preference data. The situation data can include observed data, for example, data gathered by watching the contactor and or observing the contactor's environment. For example, ambient noise levels may be analyzed to determine whether voice communications are practical. The contactor situation data can include, but is not limited to contactor application data (e.g., which applications are being employed), contactor user data (e.g., who is using the application) and contactor capability data. The contactor preference data refers to how the contactor would like the communication to be achieved. The contactor preference data includes, but is not limited to time data, location data, task data, goal data and communication needs data. In addition to the contactor and contactee preference data, there may be organization preference data. For example, when both a contactor and contactee belong to the same organization, then the contactor preferences and the contactor preferences may be blended together in accordance with organization policies. The communication needs data may, for example, include information that the contactor must contact the specified contactee within a specified period of time (e.g., investor must reach broker before the stock market closes). The contactee data includes, but is not limited to contactee situation data and contactee preference data. The contactee situation data can include but is not limited to contactee application data, contactee user data and contactee capability data. The contactee preference data includes but is not limited to time data, location data, task data, goal data and communication needs data.
The contactor data, the contactee data and the modality data may include information describing current conditions and information that facilitates predicting future conditions. For example, a phone may currently be in use, but data concerning phone usage patterns may be analyzed to facilitate determining the likelihood that that phone will be available at a point of time in the future.
The analysis of 520 can model utilities that consider the relationships between contactor and contactee preferences. For example, if both parties prefer real-time telephone communications, then there may be a high utility to arranging real-time telephony, but if one party prefers email and another party prefers video-conferencing, then real-time communications may not be preferred. In addition to blending the contactor preference data with the contactee preference data, there may be blending with organization preference data. For example, when both a contactor and contactee belong to the same organization, then the contactor preferences and the contactor preferences may be blended together in accordance with organization policies. The best communication actions may also be influenced by the capabilities of communication devices available at the time the communication is attempted and/or at some future time by the contactor and contactee. For example, if the contactor has video conferencing equipment available and the contactee similarly has video conferencing equipment available, then video conferencing may receive a high value in the analysis of preferences. But if the contactor has email capability, and the contactee has only regular mail capability, then video conferencing may be untenable even if it would have been the most desirable feature. In such a case, if the cost (e.g., delay time, effort, and/or dollars) of one of the participants finding a video conferencing facility is lower than the cost of moving to the next best modality, then it may be optimal to delay the communication until the initially deficient participant locates and executes communication with tools allowing for such rich communication.
At 530, one or more rules may be selected from a set of possible rules, where the rules can be employed to determine expected utilities. For example, given a large set of communication modalities and/or preferences, a first set of rules may be selected but given a small set of communication modalities and/or preferences, a second set of rules may be selected. The rules may be selected on other parameters including, but not limited to, the number of matching preferences, the number of matching capabilities, the nature and quality of the contexts, the type and number of communications requested and the time critical nature of the desired communication. The rules may have been specified by the contactee, for example. By way of illustration, contactees can specify groups of people and attributes concerning the nature of the contact and rules for communicating given the context (e.g., time, task, goals, location, contactor).
At 540, the rules selected at 530 are employed to determine one or more expected utilities for the candidate communication modalities. By determining a set of expected utilities, that include both immediately available modalities and modalities predicted to be available at a point of time in the future, the present invention facilitates optimizing the utility of the communication, thus providing improvements over conventional systems.
At 550, information concerning the possible communication modalities and their expected utilities can be presented to a contactor and/or contactee. Thus, the contactor and/or contactee can select from the possible communications that are identified as maximizing the utility of the communication. For example, a contactor may want to place a real-time telephone call, but may be presented with a list of other communication modalities that may produce higher utilities (e.g., high priority page to a person in a meeting where there is no telephone, real-time telephone call to contactee's assistant). Similarly, the contactee may be informed that the contactor is trying to contact them, and the contactee may be given the opportunity to override their preferences based on their current capabilities. By way of illustration, the contactee may be at home watching a movie at two a.m. when the preferences indicate that no real-time phone communications are desired. Since the present invention determined that the contactee was immediately reachable, the contactee may be presented, on the television, with a list of options for being contacted by the contactor (e.g., phone call, email, streaming video) and may be given the opportunity to override the preferences (e.g., willing to accept a phone call from the police department).
At 560, once the optimal communication modality or modalities have been identified, by the method and/or by the contactor and/or contactee, then the communication can be scheduled, calendared and/or initiated. By way of illustration, a real-time phone call, with both parties immediately capable and available can be initiated by ringing the phones, a collaborative editing session, with simultaneous instant messaging and cell phone communication may be scheduled for later in the day with email reminders sent to both parties and a video conference may be calendared for May 1st at four o'clock in the afternoon, with calendar updates made for all invited parties.
At 570 a determination is made concerning whether another communication is desired. If the determination at 570 is no, then processing concludes, otherwise processing continues at 520.
The method 500 is not limited to one on one communications. Groups may be linked together using method 500 by analyzing data (e.g., hardware, software, context, preferences) of more than two communicators. By way of illustration, one or more participants may attempt to establish a communication between six people. The method 500 may determine that four people are ready, willing and able to communicate via a videoconference, while two others may only communicate with email (one due to preferences and one due to lack of a video camera). The method 500 may, therefore, alert the user with the email preference concerning overriding the preferences for this particular real-time communication, and may connect the person without a camera by voice only, while alerting the camera enabled group that this member cannot see them and can only hear them.
Turning now to
At 620, data including, but not limited to, contactor data, contactee data and communication modality data is analyzed to determine correlations that can be made and inferences that need to be made. The contactor data, which may be incomplete, can include, but is not limited to, situation data and contactor preference data. The situation data, which can also be incomplete, can include data gathered by watching the contactor and or observing the contactor's environment. For example, light levels may be analyzed to determine whether textual communications are practical. But there may be gaps in the contactor situation data. For example, information concerning the light level of the contactor may not be available, and thus inferences concerning such light may be required to be made from data like the location of the contactor (e.g., in a darkroom, in a truck) and the time of day (e.g., during daylight hours, late at night).
The contactee data, which may similarly be incomplete, includes, but is not limited to contactee situation data and contactee preference data. The contactee situation data, which is analogous to the contactor situation data, except that it is gathered from the point of view of the contactee, can similarly be incomplete and may include, but is not limited to contactee application data, contactee user data and contactee capability data. By way of illustration, data concerning the contactee's attentional state may be observed by monitoring data like gaze tracking data and desktop events (e.g., keyboard strikes, mouse movements). Such observed data may be combined to produce a likelihood that the contactee is in a certain attentional state (e.g., focused, not focused). Such a likelihood may then be combined with information concerning the assignment of the contactee and the current task being performed by the contactee to determine a value associated with the interruptability of the contactee. By way of illustration, if the contactee is focused on a task that is related to the contactee's assignment, then the contactee interruptability value may be very low while if the contactee is not focused and is not performing a task related to the contactee's assignment, then the contactee interruptability value may be very high. Calculating such an interruptability parameter may be a step in determining the optimal communication modality. But if a piece of data employed in calculating such interruptability is missing, then the present invention may make inferences concerning the missing data point so that likely optimal communications can be calculated.
The contactor data, the contactee data and the modality data may include information describing current conditions and information that facilitates predicting future conditions. For example, a phone may currently be in use, but data concerning phone usage patterns may be analyzed to facilitate determining the likelihood that that phone will be available at a point of time in the future.
Thus, at 630, selected inferences may be made. For example, p(contextRi|E) may be inferred to produce the conditional probability that a recipient (contactee) has a given context given certain evidence E. Similarly, an inference concerning the likelihood of obtaining access to a modality within a time frame t, where the likelihood that modalities could be made available by t time is represented by p(mck(t)|E) can be made.
At 640, values associated with the inferences of 630 can be analyzed to determine one or more values that may be employed in inference formulae that are employed to determine a communication with a maximum utility. The inference formulae may be, for example, decision-theoretic formulae.
At 650, inference formulae may be employed to determine the maximum utility for a communication. In one example aspect of the present invention, a basic decision-theoretic formula employed in decision-making under uncertainty in the context of a contactee is:
where A* is the ideal communication actions, which include the modalities employed by the contactor (AC*) and contactee (Recipient) (AR*) computed by optimizing Equation 1. In the equation, Aj is the communication modality being considered, ACk is the communication modality employed by the contactor, contextRi is the context of the contactee (Recipient) of the intended communication, contextC is the context of the contactor, and C is the identity of the contactor, typically linked to a class of person (e.g., critical associate, previously replied to, family, unknown).
The basic formulation for identifying optimal communication modalities can be extended by introducing uncertainty about the contactor's context, which adds summing over the additional uncertainty to equation 1.
Variables associated with contactor and/or contactee contexts can be treated as explicit deterministic or probabilistic factors in optimization processing associated with identifying the optimal communication modality. Thus, in equation 3, mck represents the modalities available to the contactor and thus equation 3 considers combinations of such modalities.
The present invention may further compare the best option for communication available now with the best communication option that will be available later, and update the value of the communication for the losses based in delays in communication, and potential gains or losses based on changes in disruptiveness if the communication should come at the later time t when the contactee is in a different state (e.g., more available or less available).
The present invention also facilitates considering the value of delaying the communication and rescheduling it for a later time. As an example, assume that a contactor attempts to contact a contactee in real-time and the contactee is in an important meeting. The best option (e.g., one that maximizes utility) may be to reschedule a real-time conversation when the contactee is back from meeting, based on the calendar information or on statistics about the contactee's coming and going that facilitate predicting the contactee's likely availability. One aspect of the present invention may also consider the calendar of the contactor to arrange a mutually good time.
Thus, decision-theoretic formulae like those described in equations 1 through 4 may be employed at 650 to produce one or more expected utilities. In one example aspect of the present invention, a communication would automatically be initiated, scheduled and/or calendared based on such information. But in another aspect of the present invention, information concerning those expected utilities may be presented to one or more parties, as at 660. By way of illustration, a contactor may be presented with a list of communications with high utilities determined in accordance with the preferences of the contactee. The contactor may then select from the list.
Based, at least in part on the selection of 660, one or more communications may be initiated (e.g., phones dialed, email composer/receiver popped up), scheduled and/or calendared at 670. At 680 a determination is made concerning whether another communication is to be processed. If the determination at 680 is YES, then processing continues at 620, otherwise processing concludes.
In order to provide additional context for various aspects of the present invention,
With reference to
The system bus 718 can be any of several types of bus structure including a memory bus or memory controller, a peripheral bus and a local bus using any of a variety of commercially available bus architectures. The system memory 722 includes read only memory (ROM) 720 and random access memory (RAM) 722. A basic input/output system (BIOS), containing the basic routines that help to transfer information between elements within the computer 712, such as during start-up, is stored in ROM 720.
The computer 712 further includes a hard disk drive 724, a magnetic disk drive 726, (e.g, to read from or write to a removable disk 728) and an optical disk drive 730, (e.g., for reading a CD-ROM disk 732 or to read from or write to other optical media). The hard disk drive 724, magnetic disk drive 726 and optical disk drive 730 can be connected to the system bus 718 by a hard disk drive interface 734, a magnetic disk drive interface 736 and an optical drive interface 738, respectively. The drives and their associated computer-readable media provide nonvolatile storage of data, data structures, computer-executable instructions, etc. for the computer 712, including for the storage of broadcast programming in a suitable digital format. Although the description of computer-readable media above refers to a hard disk, a removable magnetic disk and a CD, it should be appreciated by those skilled in the art that other types of media which are readable by a computer, such as zip drives, magnetic cassettes, flash memory cards, digital video disks, cartridges, and the like, may also be used in the exemplary operating environment, and further that any such media may contain computer-executable instructions for performing the methods of the present invention.
A number of program modules can be stored in the drives and RAM 722, including an operating system 740, one or more application programs 742, other program modules 744 and program data 746. It is to be appreciated that the present invention can be implemented with various commercially available operating systems or combinations of operating systems.
A user can enter commands and information into the computer 712 through a keyboard 748 and a pointing device, such as a mouse 750. Other input devices (not shown) may include a microphone, an IR remote control, a joystick, a game pad, a satellite dish, a scanner, or the like. These and other input devices are often connected to the processing unit 714 through a serial port interface 752 that is coupled to the system bus 718, but may be connected by other interfaces, such as a parallel port, a game port, a universal serial bus (“USB”), an IR interface, etc. A monitor 754 or other type of display device is also connected to the system bus 718 via an interface, such as a video adapter 756. In addition to the monitor, a computer typically includes other peripheral output devices (not shown), such as speakers, printers etc.
The computer 712 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer(s) 758. The remote computer(s) 758 may be a workstation, a server computer, a router, a personal computer, microprocessor based entertainment appliance, a peer device or other common network node, and typically includes many or all of the elements described relative to the computer 712, although, for purposes of brevity, only a memory storage device 760 is illustrated. The logical connections depicted include a local area network (LAN) 762 and a wide area network (WAN) 764. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
When used in a LAN networking environment, the computer 712 is connected to the local network 762 through a network interface or adapter 766. When used in a WAN networking environment, the computer 712 typically includes a modem 768, or is connected to a communications server on the LAN, or has other means for establishing communications over the WAN 764, such as the Internet. The modem 768, which may be internal or external, is connected to the system bus 718 via the serial port interface 752. In a networked environment, program modules depicted relative to the computer 712, or portions thereof, may be stored in the remote memory storage device 760. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
The context 850 may vary widely depending on the location and task of the contactee. For example, a first contactee in a car moving 85 m.p.h. during rush hour is likely to have one context while a second contactee in a car moving 5 m.p.h. during rush hour is likely to have a different context. Similarly, a contactee piloting a jet fighter that is on autopilot, in clear skies, with no enemies within a thousand miles is likely to have a different context than a pilot currently engaged by surface to air missiles over enemy territory. Closer to home, a parent of grade school aged children at home during school hours on a school day is likely to have a different context than the same parent in the car with the school aged children ten minutes before school starts.
The communication manager 810 examines the context 850 and the preferences 840 in light of the possible communication modalities currently available or likely to become available. The communication modalities can include, but are not limited to, a set 870 of desktops (e.g., person with more than one computer, person with alternate contacts (e.g., secretary, assistant)), a set 875 of room capabilities (e.g., person reachable in more than one meeting room, conference room, office), a cell phone 880 and a POTS telephone 885. After performing such analyses, the communication manager 810 is then available to engage or be engaged by other communicating parties employing the present invention, as illustrated in
The contactor communication manager 910, after gathering information and/or making inferences concerning a context 965 (derived from a plurality of context sources 960), preferences 970 and capabilities 975 may transmit contactor schema 950 to the connection manager 900. The schema 950 can hold information including, but not limited to, contactor identity, contactor history, registered documents, tasks, source modality, requested means and capabilities, for example. Similarly, the contactee communication manager 920 may be queried, for example, by the connection manager 900 for information including, but not limited to, contactee context 985 (derived from a plurality of context sources 980), contactee preferences 990 and contactee capabilities 995. It is to be appreciated that although the contactor communication manager 910 is described as transmitting data and the contactee communication manager 920 is described as being queried, that other data communication methods can be employed in accordance with the present invention.
The present invention provides for interacting with hardware and/or software to automatically establish the identified connections. Thus, the contactor in
As mentioned above, a communication modality and/or a contactee may not be immediately available. Thus, the present invention includes methods for predicting the likelihood of when contactee(s) may be available, where such likelihoods can be employed in scheduling group meetings where the utility of the group experience of n participants, n being an integer, is maximized. For example, calendars for the n participants can be examined to infer times at which the participants are likely to be available to share in some modality (e.g., videoconferencing, collaborative editing). Automated meeting request(s) can be constructed from such analysis.
It is noted that communications between contactors and contactees can occur between unknown parties and can be negotiated, if desired. For example, and as described above, communications can be established via decision-making processes in the contact manager and include communications preferences of the contactors and contactees. The processes can include utility-based decisions that enable communications to be established according to a value of the communications to the respective parties. To highlight these principles,
At 1020, a communications attempt is initiated by the unsolicited contactor 1010 and directed to a contact manager 1024 or other intermediary system (e.g., e-mail service, on-line messenger service, on-line phone service, and so forth). The communications attempt can include an offer to communicate and be included, described and/or updated as part of a preferences database (not shown) associated with the unsolicited contactor 1010 (See e.g., preference database reference numeral 264 in
Proceeding to 1030, the contact manager 1024 analyzes contactee preferences (See e.g., preference database reference numeral 254 in
If unsolicited communications are acceptable at 1034, the process proceeds to 1044, wherein the unsolicited contactor's offer to communicate is presented or delivered to the contactee 1014. At 1050, the contact manager 1024 and/or contactee 1014 determines if the offer is acceptable. For example, contactee preferences can enable or describe a predetermined amount of messages to be received from a predetermined category or categories of message sources (e.g., OK to receive up to 10 messages or communications a day from any music supplier if my on-line music account is updated to receive a free CD from the supplier). If the offer is acceptable at 1050 (can include explicit preference overrides, desires and/or indications of acceptance by contactee 1014), communications are then established at 1054 between the unsolicited contactor 1010 and the contactee 1014. It is to be appreciated that an agreement to communicate between parties can include an agreement for future communications and can include past considerations.
If the offer to communicate is unacceptable at 1050, the process proceeds to 1060. At 1060, the parties are given an opportunity to participate in a dialog session. If either party (contactor or contactee) decides not to engage in the dialog, then the process proceeds to 1040 wherein further communications are ended. If a dialog is desired at 1060, the process proceeds to 1064 enabling the parties to further negotiate or modify the original offer presented at 1044 (e.g., discuss counter offer or modification from contactee 1014). The process depicted at 1050, 1060, 1064 can be repeated until communications are established at 1054 or communications are ended at 1040.
The present invention as described above, facilitates management of unsolicited communications and increases the utility of such communications to the contactee 1014 while increasing the value of such communications to the contactor 1010. The contact manager 1024, along with the preference databases, can be employed to control parameters such as time, place and manner that unsolicited communications of acceptable genres or types of communications are presented to a user or contactee. The contact manager 1024 facilitates communications between the contactor 1010 (and/or group of contactors) and one or more contactees 1014 concerning the parameters of the agreement between the parties regarding unsolicited communications.
By way of illustration, in return for a consideration (e.g., free cellular phone service) the contactee 1014 may agree to receive a pre-determined amount of unsolicited communications per month. The unsolicited communications can originate from various sources (e.g., car manufacturers, banks, credit card vendors), take different forms (e.g., cellular call, satellite call, POTs call, e-mail, paper mail, video call, fax, and so forth), be of varying length (e.g., short update, lengthy prospectus, very short reminder) and be presented at different times. Such various genres, forms and times may have different value to the unsolicited contactor 1010 and provide different utilities to the contactee 1014. For example, a phone call before the market has opened in the morning may be worth five times as much as an e-mail after the market has opened and may be worth ten times as much as a fax as the market close approaches. Thus, an agreed upon pre-determined value of unsolicited communications may be received through a wide variety of combinations of received communications.
To facilitate arranging an agreement between parties, in one example of the present invention, the contact manager 1024 can include an unsolicited communication agreement manager (not shown) and an unsolicited communication receipt tracker (not shown). The unsolicited communication agreement manager can be employed, for example, to arrange the parameters (e.g., preferred modalities, preferred times, preferred communication topics (e.g., stocks, news, mortgage rates), total value to unsolicited communicator, calculation period, and so forth)) of the agreement between the parties. The unsolicited communication receipt tracker can be employed, for example, to monitor properties such as the value of received communications and the remaining value required to satisfy the agreement.
In one example of the present invention, the system 1000 may further include a consideration calculator (not shown) that can be employed, for example, to determine the amount of benefit that the contactee 1014 should receive from the unsolicited contactor 1010 based, at least in part, on the total value of unsolicited communications received during a calculation period. By way of illustration, although a first contactee can agree to receive unsolicited communications, the contactee may have been too busy during a calculation period to accept any such unsolicited communications. Thus, the consideration calculator can be employed to determine that the contactee should not receive any consideration. By way of further illustration, a second contactee may have received a large value of unsolicited communications during a calculation period and thus the consideration calculator may be employed to determine that the contactee should receive a bonus consideration above and beyond as subscribed for consideration (e.g., gift certificate in addition to free cellular service).
Although contactee's 1014 may initially identify preferred modalities (e.g., time, place, method) for receiving unsolicited communications, when an unsolicited communication is presented in accordance with such preferences, the contactee 1014 can decide (e.g., configure preference), for example, to not receive the communication, to schedule it for a later time, to change the communication modality and/or to accept the communication as offered, for example. Thus, the contactee 1014 has the opportunity to increase the utility of unsolicited communications, which in turn increases the value of the communication to the unsolicited contactor 1010.
It is noted that the components described above for handling unsolicited communications can also be extended to include a contingency-based policy(s) and/or decision(s) that guide payment and reimbursement for handling uncertainty in the identity of the contactee 1014 and/or the content of the contactee's communication. With contingency-based policy, for example, unsolicited or unrecognized contactors 1010 can be forced by default (e.g., via policy provided in preferences database) to provide payments or consideration to the contactee 1014 to access one or more modalities for communicating with that contactee 1014. However, efficient controls can be provided that enable the contactee 1014 to render the communication cost-free or less expensive for the contactor 1010 following the contactee's recognition of the contactor and/or following an analysis of the content of the communication.
Such policies can enable various functionalities. For example, the contingency-based approach enables contactees 1014 to accept communications from contactors 1010 with whom the contactee's actually desire to communicate with, but who are not yet registered nor recognized as known entities. Thus, the system 1000 enables access to the contactee 1014 at an upfront fee or other consideration that may be removed by permission of the contactee following recognition of the contactor 1010 by the contactee.
Therefore, as an example, people or other contactors may not be registered as a recognizable identity in a database of people who can communicate—or communicate via particular channels (e.g., phone communication) and/or per particular contextual states of the contactee—with the contactee. Friends, family, and colleagues who are unrecognized by the system could gain access (and perhaps become registered for future payment—free access) by committing to pay “up front” to gain access. However, these people can be reimbursed as soon as the contactee 1014 recognizes the caller and decides to make the communication cost free. As another example, an unsolicited caller or contactor 1010 interested in doing targeted sales may pay to access a contactee 1014, yet be reimbursed for the cost of the communication given a successful sales or, more generally, a decision of the contactee 1014 to reduce or remove the default payment made up front by the contactor 1010 for accessing the contactee 1014. This can occur, for example, if the contactee 1014 determines that the call, service and/or content that stemmed from the communication is actually desired after contact is made.
It is to be appreciated that aspects of the present invention may be embodied in a computer readable medium such that a computer readable medium can store computer executable components for a system that facilitates communication between entities in accordance with the present invention. For example the computer executable components can comprise an identifying component that identifies a plurality of communication modalities that respectively provide for communication between at least two entities. Furthermore, the computer executable components can comprise an analyzing component that analyzes a first communication data set associated with a first entity and a second communication data set associated with a second entity, the analyzing component identifying one or more communication modalities of the plurality of modalities based at least in part on analysis of the first and second communication data sets and the analyzing component establishing a communication between the entities.
What has been described above includes examples of the present invention. It is of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the present invention, but one of ordinary skill in the art may recognize that many further combinations and permutations of the present invention are possible. Accordingly, the present invention is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims. Furthermore, to the extent that the term “includes” is used in either the detailed description or the claims, such term is intended to be inclusive in a manner similar to the term “comprising”, as comprising is interpreted as a transitional word in a claim.
Claims
1. A computer implemented system to facilitate unsolicited communications between parties, comprising:
- a contact manager to transmit an offer to communicate from an unknown contactor to a contactee; and
- a preference component associated with the contactee to enable an acceptance of the offer based in part upon consideration presented in the offer.
2. The system of claim 1, further comprising a preference component associated with the unknown contactor to describe one or more parameters of the offer.
3. The system of claim 1, the offer includes a request to at least one of listen, view, examine and interact with at least one of a commercial, political ad, survey, and infomercial.
4. The system of claim 1, the consideration includes at least one of money, gifts, rebates, perks, and discounts on other items.
5. The system of claim 1, the contact manager automatically disables further communications with the unknown contactor based upon settings in the preference component associated with the contactee.
6. The system of claim 5, the contact manager provides feedback to the unknown contactor indicating whether communications are established with the contactee.
7. The system of claim 1, at least one of the contact manager and the contactee enable further communications via acceptance of the offer.
8. The system of claim 7, the acceptance includes an agreement to communicate in the future.
9. The system of claim 7, the acceptance is based upon past consideration.
10. The system of claim 1, the preference component enables a predetermined amount of messages to be received from a predetermined number of message sources.
11. The system of claim 1, the contact manager enables a dialog session to facilitate an agreement to communicate between the unknown contactor and the contactee.
12. A computer implemented method to facilitate communications between unknown parties, comprising:
- transmitting an offer having at least one incentive to induce communications between parties;
- analyzing preference data associated with at least one of the parties; and
- establishing communications between the parties based at least in part on the preference data, the at least one incentive, and actions between the parties.
13. The method of claim 12, further comprising determining whether to present the offer to one of the parties based on the preference data.
14. The method of claim 13, further comprising disabling further communications between the parties based on the preference data.
15. The method of claim 12, further comprising establishing a dialog to enable further negotiations of the offer.
16. A computer implemented method to facilitate communications between unknown parties, comprising:
- executing one or more contingency-based policies that guide payment and reimbursement to handle uncertainty in at least one of an identity of a contactee and content relating to communications with the contactee; and
- forcing contactors to provide consideration to the contactee to access one or more modalities for communicating with the contactee.
17. The method of claim 16, further comprising providing controls that enable the contactee to render the communications less expensive upon the contactee's recognition of the contactor.
18. The method of claim 16, further comprising providing controls that enable the contactee to render the communications less expensive upon following an analysis of the content of the communication.
19. The method of claim 16, further comprising accepting communications from contactors who are not recognized as known entities.
20. The method of claim 19, further comprising providing access to the contactee based upon an upfront consideration that may be removed by permission of the contactee following recognition of the contactor.
Type: Application
Filed: Oct 14, 2005
Publication Date: Feb 23, 2006
Applicant: Microsoft Corporation (Redmond, WA)
Inventor: Eric Horvitz (Kirkland, WA)
Application Number: 11/250,848
International Classification: G06F 15/177 (20060101);