Abstract: An image processing system includes a combined display-camera having an array of interspersed display elements and camera elements, arranged substantially in a common plane of a flat panel or other display. Each of at least a subset of the camera elements has one or more imaging angles associated therewith, with the one or more imaging angles being selected to provide a desired imaging operation for the combined display-camera. The imaging angles of the camera elements can be selected to provide an imaging operation which approximates that of a lens-based single-camera system, a pin-hole camera system or other type of system. Each of the camera elements may include multiple image sensors, such that different imaging angles can be set for the different image sensors of a given camera element, and different perspectives of a scene can be generated in the image processing system.

Abstract: An animated virtual creature is generated on a display such as a television set, in order to simulate a pet or to facilitate user interface functions. In one embodiment, one or more signals corresponding to the program being watched are monitored. When certain events are detected based on this monitoring, the animated character is controlled in a manner that corresponds to the detected event. In another embodiment, the animated virtual creature responds to program selections made by a user in a program recommendation system.

Abstract: A video processing system tracks a moving person or other object of interest using a combined audio-video tracking system. The audio-video tracking system comprises an audio locator, a video locator, and a set of rules for determining the manner in which settings of a camera are adjusted based on outputs of the audio locator and video locator. The set of rules may be configured such that only the audio locator output is used to adjust the camera settings if the audio locator and video locator outputs are not sufficiently close and a confidence indicator generated by the audio locator is above a specified threshold. For example, in such a situation, the audio locator output alone may be used to direct the camera to a new speaker in a video conference. If the audio locator and video locator outputs are sufficiently close, the system determines if a confidence indicator generated by the video locator is above a specified level, and if so, the video locator output may be used to adjust the camera settings.

Abstract: An interaction simulator, such as a chatterbot, is connected with an external database, such as an electronic program guide. The information gathered during interaction, particularly conversational, is parsed and used to augment the database data. The interaction simulator may be guided by the data residing in the database so as to help fill in recognizable gaps by, for example, intermittently asking questions relating to the subject data requirement. The interaction simulator may be provided with specific response templates based on the needs of the database and a corresponding set of templates to extract the information required by the database. Another example database may be for recording and indexing by key word stories or other free-form verbal data uttered by the user. The interaction simulator may be programmed to help the user develop the story using templates designed for this purpose.

Abstract: The appearance of a cabinet for a device (e.g., a television) is dynamically controlled. One way of controlling the appearance of the cabinet is by providing a display panel on the cabinet. At least one input is obtained from an input device and processed by a controller. Based on these inputs, the controller sends signals to the display panel to change the appearance of the display panel. Lamps and heat-sensitive materials may be used to effectuate the desired change in appearance. The cabinet display features may be controlled to give the device the appearance of having a persona or of being an independent animate being. For example, lights in the cabinet could flash to suggest the device is laughing in response to the detection of a laugh track in a sitcom being displayed on the device. Patterns and colors can be generated to reflect moods according to the preferences of an interaction-design programmer.

Abstract: An electronic assistant, incorporates electronic functions in a personal object that the user finds indispensable. Examples of personal objects include a cane, a walking stick, a walker, a wheelchair, a personal transportation vehicle, a purse, a key holder, a watch, a pendant, a hearing aid, an eyeglass frame, or a crutch. Electronics may include a PDA, a cell phone, a navigation module, a biosensor module, and an emergency alert module. The navigation module might include a GPS, an altimeter, an electronic compass, and/or a stored map. Biosensors may be directly incorporated into the personal device or communicate with a receiver therein if the biosensor is required to be attached directly to the user's body or surgically implanted. The emergency alert module may include an emergency button, and an emergency notification sequence stored in the electronic assistant capable of calling for assistance through the cell phone.

Abstract: An interaction simulator uses computer vision, and inputs of other modalities, to analyze the user's mental state and/or personality. The mental state and/or personality are classified and this information used to guide conversation and other interaction. In a chatterbot embodiment, the substance of the conversation may be altered in response to the mental state and/or personality class, for example, by changing the topic of conversation to a favorite subject when the user is sad or by telling a joke when the user is in a good mood.

Abstract: An interaction simulator has the ability to dynamically update response templates and response data by retrieving current information from a data source. The interaction simulator may interact verbally or by other means such as gesture, typed text, or other means to generate a “dialogue. ” The interaction simulator, by dynamically updating its responses, is able to be more interesting and useful to users and also more personally relevant than prior art, so-called chatterbots. The device also reduces the required number of rules and library of response data that must be retained compared to prior art conversation simulators. The criteria used to create new response data can come from fixed specifications, for example, the current weather, or from the content of previous conversations (for example, the system creating a new template about a topic indicated by the user to be of interest to him/her).

Abstract: A system and method for controlling the movement of a cursor on a monitor screen are provided. The system comprising at least one remote control unit having a plurality of push buttons for remotely controlling the moving direction of the cursor on the monitor screen; at least one light emitting element for emitting light that indicates a signal generated by the remote control unit; a light detector for extracting the light movement that is transmitted sequentially from the remote control unit; and, a control unit for displaying the moving position of the cursor on the monitor screen corresponding to the extracted movement of the light from the remote control unit, and also adapted to stop the moving position of the cursor upon releasing the push button of the remote control unit. The movement of the cursor on the monitor screen also can be stopped if the light movement transmitted from the remote control unit changes in the opposite direction.

Abstract: An interaction simulator, such as a chatterbot, is enabled to simulate an awareness of the user to generate an interaction that is more natural and appropriate than prior art chatterbots. For example, the device may employ machine vision to detect the number of persons present or the activity of the user and respond accordingly by interrupting its output or by inviting a conversation or other interaction when a user approaches. The device may modify its responses according to the user's activity, for example, by playing music when the user falls asleep or requesting an introduction when another user speaks. The device may also respond to unrecognized changes in the situation by inquiring about what is going on to stimulate interaction or generate new responses.

Abstract: The present invention is a telephone conversation quality enhancer using an emotional conversational analyzer for analyzing the conversation between a primary party and a secondary party. Its focus is on improving the nature of the conversation quality by first analyzing the nature and quality of the conversation, determining how the analysis fits into a set of conversation conditions, and then determining what conversational aids may be used to assist in the enhancement of the conversation. The apparatus includes a microprocessor which communicates with the first and second telephone units and a database which stores conversational conditions and conversational aids. A conversation analyzer in the microprocessor analyzes the conversation occurring between the first and second telephone units and provides an analysis of the conversation. The microprocessor then applies the conversational conditions to the conversation analysis to select conversational aids.

Abstract: The telephone memory aid provides a database to a primary party for storing and retrieving personal information about a secondary party, including summary information related to communication exchanges between the primary and secondary parties. The summary information includes, for example, the date and time of prior telephone calls and the topics discussed. This secondary party information, including the summaries of prior telephone calls, is available for review by the primary party during future phone calls with the secondary party. The telephone memory aid also facilitates entry of information into the database through speech recognition algorithms and through question and answer sessions with the primary and secondary parties.

Abstract: The invention relates to a communication method and a terminal (500) for use with such a method. The method uses at least two interconnected terminals (402, 404), at which input data from associated participants is captured. The input data comprises at least video and/or audio data. A monitoring unit (530) derives activity information about the participants from the input data. The monitoring unit (530) is either located in one terminal (402) for centrally deriving the activity information, or present in all terminals (402, 404) for, at least partly, deriving the activity information locally. The activity information is subsequently visualized in the form of tables and/or diagrams or by manipulating the windows in which the participants are displayed. Also this visualization step can be performed only at a central terminal (402) or at the terminal of each participant (402, 404). The activity information comprises for instance talking time and a number of key strokes of the participant.

Abstract: A home control system for automatic detection and warning of abnormal behavior includes a unit for observing behavior in a predetermined area under surveillance, a unit for processing an output of observed behavior from the unit for observing, and a pattern recognition module for recognizing whether the observed behavior is associated with predefined normal behaviors. The detection of predetermined normal behavior in progress leads to a provision of an anticipatory action. Upon recognition that the observed behavior is abnormal, an alarm signal is triggered to remind the user.

Abstract: A system and method are provided to track and convey the presence of all participants in video conferencing. The system is configured to generate a video locator output and an audio locator output to determine the presence of all participants. Initially, the system focuses on a person who is speaking and conveys a close-up view of that person based on the video and audio locator outputs. Thereafter, if the person speaking continues to speak or becomes silent for a predetermined time period, the system operates to adjust the camera setting to display other participants in sequence who are not speaking or zooms out the camera by a specified amount to include all participants, so that the presence, including facial expressions and reactions, of all participants can be conveyed to the remote receiving end. The system is also configured to capture a new person entering or an existing participant exiting during the course of a video conference session.

Abstract: Briefly, an alarm system monitors conditions of an independent person, yet one requiring some supervision, such as an elderly person living alone at home. The system monitors a variety of independent signals and combines them to recognize subtle cues that may indicate there will be a need for intervention by a supervisor.

Abstract: A method and system for recommending future events or appointments are disclosed. The inventive system stores a repeat rate provided by users in the system, then recommends future events or appointments based on what the user has rated and the past frequency of those events or appointments which the user has attended. This invention is based on the fact that people have a tendency to attend or observe similar events as in the past and will show such tendency in the future.

Abstract: The invention relates to a communication method and a terminal (500) for use with such a method. The method uses at least two interconnected terminals (402, 404), at which input data from associated participants is captured. The input data comprises at least video and/or audio data. A monitoring unit (530) derives activity information about the participants from the input data. The monitoring unit (530) is either located in one terminal (402) for centrally deriving the activity information, or present in all terminals (402, 404) for, at least partly, deriving the activity information locally. The activity information is subsequently visualized in the form of tables and/or diagrams or by manipulating the windows in which the participants are displayed. Also this visualization step can be performed only at a central terminal (402) or at the terminal of each participant (402, 404). The activity information comprises for instance talking time and a number of key strokes of the participant.

Abstract: A system and method for controlling the movement of a cursor on a monitor screen are provided. The system comprising at least one remote control unit having a plurality of push buttons for remotely controlling the moving direction of the cursor on the monitor screen; at least one light emitting element for emitting light that indicates a signal generated by the remote control unit; a light detector for extracting the light movement that is transmitted sequentially from the remote control unit; and, a control unit for displaying the moving position of the cursor on the monitor screen corresponding to the extracted movement of the light from the remote control unit, and also adapted to stop the moving position of the cursor upon releasing the push button of the remote control unit. The movement of the cursor on the monitor screen also can be stopped if the light movement transmitted from the remote control unit changes in the opposite direction.

Abstract: A system and method are provided to track and convey the presence of all participants in video conferencing. The system is configured to generate a video locator output and an audio locator output to determine the presence of all participants. Initially, the system focuses on a person who is speaking and conveys a close-up view of that person based on the video and audio locator outputs. Thereafter, if the person speaking continues to speak or becomes silent for a predetermined time period, the system operates to adjust the camera setting to display other participants in sequence who are not speaking or zooms out the camera by a specified amount to include all participants, so that the presence, including facial expressions and reactions, of all participants can be conveyed to the remote receiving end. The system is also configured to capture a new person entering or an existing participant exiting during the course of a video conference session.