Abstract: A system for and method of enabling people to share a common application context for media presentation and playback is described herein. The presentation results from input from a set of active participants where the input includes a set of media types such as music, artwork, visualizations, photographs and text messages. The participants use personal devices to couple to the system and utilize the application.

Abstract: A system and method summarizes multimedia stored in a compressed multimedia file partitioned into a sequence of segments, where the content of the multimedia is, for example, video signals, audio signals, text, and binary data. An associated metadata file includes index information and an importance level for each segment. The importance information is continuous over as closed interval. An importance level threshold is selected in the closed interval, and only segments of the multimedia having a particular importance level greater than the importance level threshold are reproduced. The importance level can also be determined for fixed-length windows of multiple segments, or a sliding window. Furthermore, the importance level can be weighted by a factor, such as the audio volume.

Abstract: The invention relates to a device (1) with an interaction dependent user interface (2). Particularly a value of a parameter of an object (5) of the interface is dependent of the user activities, i.e. an object of the interface behaves differently in dependence of how fast the user is navigating and how frequent selections are made. In one embodiment, the user interface comprises a menu (3) of selectable items (4). The function is defined such that the value of the parameter is increased by an increment every time the user selects a new item and the increment is decaying with time, the value of the parameter varying between a maximum and a minimum value.

Abstract: At least one exemplary embodiment is related to a method of device customization comprising: entering physiological data, where the physiological data is obtained from a visual image loaded by a web based software program; selecting device features using the web based software program; and selecting the device appearance using the web based software program.

Abstract: A method is presented for extracting information from a document by separating the document into segments and organizing the segments into a hierarchical structure. An audio rendition of the segments is generated and presented aurally to the user for selection of the segment to be presented. The selected segment is then presented aurally to the user. If desired an audio rendition of a summary may be generated and presented aurally to the user.

Abstract: The present invention provides a dialog system in which the subsystems are integrated under a single technology model. In particular, each of the sub-systems uses stochastic modeling to identify a probability for its respective output. The combined probabilities identify a most probable action to be taken by the dialog system given the latest input from the user and the past dialog states. An additional aspect of the present invention is an embodiment in which the sub-systems communicate with one another through XML pages, thus allowing the sub-systems to be distributed across a distributed network.

Abstract: An interactive voice response (IVR) system executes a call flow that references data objects holding information. The information within a data object includes a variable that holds a value utilized by the call flow, state information describing the state of the variable, and fulfillment type information that describes how to get a value for the variable or otherwise change the variable's state. Process and application objects in the call flow specify desired states of variables at given points in the call flow. A resolution module within the IVR system determines whether the variables are in the desired states and, if not, utilizes the fulfillment type information in the data objects to attempt to put the variables in the desired states. This dynamic resolution process provides a mechanism for resolving the values of variables in data objects as the values are required and eases the burden on the call flow developer.

Abstract: A user interface method and apparatus includes determining whether a command for user interface (UI) event occurrence is input, reading a pre-stored auditory user interface (AUI) element if the command for UI event occurrence is input is determined, generating an AUI based on the AUI element, and outputting the generated AUI to an outside. According to the method, an AUI environment using sound information is given to a user. Accordingly, the user can be guided to efficiently achieve a given task and reduce errors.

Abstract: In one embodiment, the invention provides a method for creating a voice application, the method being implemented by a computer system and comprising generating a graphical user interface comprising a text-to-topic button; receiving first input identifying a location of a text file; receiving second input selecting the text-to-topic button; partitioning content associated with the text file into subjects in response to receiving the second input; and storing information on the partitioning.

Abstract: A method for providing a response to a statement of a user, the method includes: receiving user input that comprises a portion of a user statement; selecting, before receiving a whole user statement, an answerable statement response between an answerable statement, multiple answerable statements and a response to an answerable statement; wherein the selecting is responsive to user input and to structured representations of answerable statements answerable by an answering entity; and sending to the user information representative of response to the user statement.

Abstract: A method and system for interactive interfacing with a computer gaming system is provided. The method includes providing an input device, where the input device is configured to convey mutlti-channel mixed input data that is to be interpreted by the computer gaming system. The method includes identifying an action to be performed by the computer gaming system, and the action is mapped to the mutlti-channel mixed input data provided by the input device. Then, a gearing is applied between the action to be performed by the computer gaming system and the mutlti-channel mixed input data received from the input device. The gearing scales an adjustment to impact the action to be performed by the computer gaming system. The gearing can be set dynamically by the game, by the user, or can be preset by software or user configured in accordance with a gearing algorithm.

Abstract: A computer software product is used to create applications for enabling a dialogue between a human and a computer. The software product provides a programming tool that insulates software developers from time-consuming, technically-challenging programming tasks by enabling the developer to specify generalized instructions to a Dialogue Flow Interpreter, which invokes functions to implement a speech application, automatically populating a library with dialogue objects that are available to other applications. The speech applications created through the DFI may be implemented as COM (component object model) objects, and so the applications can be easily integrated into a variety of different platforms. In addition, “translator” object classes are provided to handle specific types of data, such as currency, numeric data, dates, times, string variables, etc. These translator object classes have utility either as part of the DFI library or as a sub-library separate from dialogue implementation.

Abstract: Provided are a method and apparatus for providing information according to a user's request, and more particularly, an interactive information providing service method and apparatus for analyzing a user's request and providing information corresponding to the request on the basis of a dialog input received from the user.

Abstract: A system receives a design document, parses the design document into voice extensible markup language (VXML) elements, and creates a VXML document from the parsed VXML elements.

Abstract: An improved graphical user interface (GUI) is for use with an audio player or other device having a touchscreen or similar display, according to one embodiment of the invention. The content that is available for playing is represented on the GUI by a plurality of thumbnails, such as for example jacket cover art, displayed in a matrix. The matrix includes multiple playlists stacked vertically. A highlighted cursor or other selection indicator can be moved across the touchscreen and the thumbnails by a user, thus allowing the user to listen to the music or other content associated with a selected thumbnail. As the selection indicator moves between two thumbnails, the song/content associated with the first thumbnail crossfades into the song/content associated with the next thumbnail.

Abstract: Methods and systems for interactive interfacing with a computer gaming system are provided. A method includes providing an input device, where the input device is configured to convey inertial data that is to be interpreted by the computer gaming system. The method then identifies an action to be performed by the computer gaming system, where the action is mapped to the inertial data provided by the input device. Then, the method applies a gearing between the action to be performed by the computer gaming system and the inertial data received from the input device. The gearing scales an adjustment to impact the action to be performed by the computer gaming system. The gearing can be set dynamically by the game, by the user, or can be preset by software or user configured in accordance with a gearing algorithm.

Abstract: A method and system for enabling dynamic user interactivity between user actions and actions to be performed by a computer program is provided. The system includes a computing system and an acoustic detection analyzer that is coupled to or executed by the computing system. The system also includes an input device for interfacing with the computer program that is to be executed by the computing system. The input device has a gearing control for establishing a scaling between acoustic data produced at the input device and actions to be applied by the computer program as analyzed by the acoustic detection analyzer. The gearing can be set dynamically by the game, by the user, or can be preset by software or user configured in accordance with a gearing algorithm.

Abstract: A computing system is provided that includes a display 124 for displaying information and an audible locating agent 148 that, as a pointer moves over the display, plays audible locating signals to identify spatial locations of at least some of the displayed information.

Abstract: A method of forming a knowledge base for processing an input includes linking a plurality of attributes to a plurality of response templates using a plurality of Boolean expressions. Each attribute includes a set of patterns where each pattern within the set is equivalent.

Abstract: A system for synchronizing multiple modalities is described. A user may use multiple modalities, such as voice and browser, to interact with data on a network, such as the World Wide Web. All of the modalities may be synchronized so that all are updated when the user enters information in just one. A method of communicating between devices includes receiving a request for first-modality data that includes first content, and sending a message in response to receiving the request, the message including information allowing the request of second-modality data that includes second content overlapping the first content. Another method includes requesting first data for a first modality, the first data including first content, and automatically requesting second data for a second modality, wherein the second data includes second content that overlaps the first content.

Abstract: A system for providing audio-based information pertaining to a situation communicated to a first responder en route to the situation. The information may include real-time and current data of the on-going situation (e.g., a building fire). The information may be relayed to the first responder by a dispatch center, or other intermediary, or come directly from monitoring instrumentation at a location of the situation. Also, background and/or preplanned information about the location may be provided to the first responder via a handset or other device. The responder may request certain information via the handset or device in a vehicle en route with voice requests or button activation. Visual displays of information on the instrumentation may be converted to audio- or speech-based displays for the responder.

Abstract: A method for displaying a gain control interface having a gain level display with non-linear gain levels. The gain level display has a first end having an associated first pixel offset value and a second end having an associated second pixel offset value. A range of pixel offset values span from the first pixel offset value through the second pixel offset value. The method includes receiving a plurality of pixel offset values in the range of pixel offset values, calculating a gain level value for each of the plurality of pixel offset values (whereby a difference between two pixel offset values of two gain level values having a gain level difference is not equal to a difference of two pixel offset values of any other two gain level values having the same gain level difference), and mapping a gain level value to a pixel offset value.

Abstract: A method of manipulating a time based stream of information through use of a user interface to generate a presentation is provided in which a processing system is employed. The methods use references to a selected time based stream of information as editing tools. The user interface has functionality to display only a single time line for aligning reference elements to visual time based stream of information. The references may include a variety of edit features that enhance the presentation. Some mechanisms for moving the reference elements on the user interface are drag and drop and/or cut and paste procedures. Other aspects of the present invention relating to the processing system providing convenient user interface and editing tools for use in authoring a presentation of a time based stream of information are also described.

Abstract: Systems and methods for creating a button map for implementing remote control functions for a standard input/output device in a video playback system is described. One embodiment is directed to a method which includes first adding a button that is currently selected along with its neighboring selectable buttons to a button map, iteratively adding a new selectable button not in the button map and then adding all neighboring selectable buttons for the new button to the button map. Finally, the method includes selecting one of the buttons in the button map using a standard input/output device.

Abstract: The invention describes a graphical method for detecting and adjusting audio overload conditions. The graphical user interface provides a user complete playback control of several audio tracks, detection of overload conditions such as audio clipping, and graphical methods to correct the overload conditions. The graphical interface provides drag handles which the user can use to adjust the various characteristics of an audio file. The characteristics, such as amplitude and temp, may be adjusted as a function of time.

Abstract: An apparatus operation device for operating an apparatus comprising an operation input device configured to allow a user to input an instruction for operating the apparatus without using eyesight, and an output device configured to output information informing the user of a status of inputting the instruction for operating the apparatus and a result of inputting the instruction for operating the apparatus by a sound and a voice so that the user can operate the apparatus without using eyesight.

Abstract: The present invention relates to speech recognition using selectable recognition modes. This includes innovations such as: large vocabulary speech recognition programming that supplies recognized words to external program as they are recognized, and allows a user to select between large vocabulary recognition of an utterance with and without language context from the prior utterance independently of state of the external program; allowing a user to select between continuous and discrete speech recognition that use substantially the same vocabulary; allowing a user to select between continuous and discrete large-vocabulary speech recognition modes; allowing a user to select between at least two different alphabetic entry speech recognition modes; and allowing a user to select from among four or more of the following recognitions modes when creating text: a large-vocabulary mode, an alphabetic entry mode, a number entry mode, and a punctuation entry mode.

Abstract: A visual presentation system and method for synchronizing presentation data being viewed in a display with speech input. A system is disclosed that includes: a speech recognition system for recognizing speech input; an association system for determining a context of the speech input and matching the context with a relevant portion of the presentation data; and a visual coordination system for coordinating the display of a data item from the presentation data based on a match made by the association system.

Abstract: System and method for automatically controlling a media receiver by instructing the media receiver to use a particular receiver connection and to play a selected media unit using one of a plurality of play modes according to characteristics of the media unit. Media units may be encoded using any of a variety of encoding formats. The media management system may interface with a media receiver to select media receiver connections in accordance with the media type of the media unit. The media management system may also interface with the media receiver to set media receiver settings for playing the selected media unit according to the media receiver settings selected for a play mode corresponding to the characteristics of the selected media unit.

Abstract: A menu structure in an information presentation device enables navigation in the menu structure. The information presentation device may include a sound generating unit, at least one first user input unit, and a control unit that provides selectable items in the menu structure. The items may be related to functions, applications or settings of the information presentation device. Each item may be associated with at least one dedicated sound. Upon detection of selection of a specific item via a user input unit, the presentation device may control the sound generating unit to generate the sound associated with the selected item.

Abstract: System and method that provides audible feedback through a speaker of a handheld electronic device having a reduced alphabetic keyboard upon actuation of a navigation tool. The audible feedback produced by the speaker is capable of being modified based upon the location, speed, and other characteristics of the movement of a cursor on the display of a handheld electronic device. The sound produced by the speaker can originate from an audio file stored or otherwise available on the handheld electronic device.

Abstract: Embodiments provide a system, method, apparatus, means, and computer program code that allow multiple annotations to a document to be created and that distinguish between the annotations made by different people. The people may view documents, exchange ideas and messages, etc. via a server or conference/collaboration system at different times and/or without being in direct communication with each other. In such an off-line collaboration mode, the people may want to add listen to, view, or add annotations regarding one or more documents. The methods and systems described herein allow users to follow the trail of annotations regarding a document and to distinguish between the voice or other audible annotations created by other people.

Abstract: Methods, apparatus and computer-code for electronically providing advertisement are disclosed herein. In some embodiments, advertisements are provided in accordance with at least one feature of electronic media content of a multi-party conversation, for example, by targeting at least one advertisement to at least one individual associated with a party of the multi-party voice conversation. Optionally, the multi-party conversation is a video conversation and at least one feature is a video content feature. Exemplary features include but are not limited to speech delivery features, key word features, topic features, background sound or image features, deviation features and biometric features. Techniques for providing advertisements in accordance with any voice electronic media content, including but not limited to voice mail content, are also disclosed.

Abstract: A communication system includes a criteria matrix for calculating a dialogue score in response to a request for a dialogue model from a dialogue node within a communication action. The criteria matrix also incorporates a dialogue selection table for selecting an appropriate dialogue type, based on the calculated score.

Abstract: An apparatus has a main display screen and an auxiliary display screen being smaller in size than the main display screen, and a received mail is displayed on a scroll basis on the auxiliary display screen and is outputted in form of a voice reading aloud the received mail in synchronism with the display.

Abstract: A system, method and apparatus for facilitating communication among a number of distributed clients in a distributed network is disclosed. A user, such as through a personal digital assistant device, may select one or more sound messages for transmission to one or more other users in the network. Each sound message may be preceded by a sound identifier which identifies the sending user. Users may select or create their sounds message and/or person sound identifiers. The sound messages will typically be abbreviated melodies or note strings which are associated with certain conversational messages.

Abstract: A system for editing audio objects in which a variety of audio objects are represented as images and laid out in a 2 dimensional visual environment. The system includes a display unit, a processing unit, a user interface unit, and a device for playing/receiving audio. The system has the capability to perform a variety of editing functions, such as the recording and playback of audio content, joining and splitting audio objects, and reordering audio objects. Additionally, the system includes functionality to automatically recording new content when sound is detected above a set threshold. Furthermore, the system includes functionality for linking portions of audio objects to media objects such as HTML documents and video.

Abstract: The present invention relates to: speech recognition using selectable recognition modes; using choice lists in large-vocabulary speech recognition; enabling users to select word transformations; speech recognition that automatically turns recognition off in one or more specified ways; phone key control of large-vocabulary speech recognition; speech recognition using phone key alphabetic filtering and spelling: speech recognition that enables a user to perform re-utterance recognition; the combination of speech recognition and text-to-speech (TTS) generation; the combination of speech recognition with handwriting and/or character recognition; and the combination of large-vocabulary speech recognition with audio recording and playback.

Abstract: A network system for enabling voice interaction between communications-center applications and human agents remote from the center has a primary server connected to the network the server controlling at least one routing point used by the center, a secondary server connected to the network the secondary server for generating and serving voice extensible markup language, a voice gateway associated with the secondary server, the gateway for executing voice extensible markup language and recognizing speech input, and a software platform based in the primary server and distributed in part as a server application to the secondary server, the software suite functioning as a data transformation interface between the center applications and the gateway. In a preferred use agents and applications communicate bi-directionally using VXML.

Abstract: A mobile information network browser device with audio feedback and adaptive personalization capability that is capable of transmitting a request for information via a wireless communication interface from one or more servers in an information network. The browser device further includes an audio interface capable of receiving data from the wireless communication interface that is responsive to the request for information. The browser device interfaces with a wireless communication network so that it may be used in a mobile vehicle, such as an automobile. The order in which individual pieces of content in the requested information is presented to the user is modified based on indicators of the user's interest in a topic during previous sessions. Such indicators can include whether the user input a command to skip, fast-forward, rewind, or request more detail about a category, subcategory, or topic of information. The adaptive personalization capability can also prevent redundant content from being presented.

Abstract: Audio data are played back by a personal computer, a relationship with a playback process is recognized easily. Displays showing the contents of play lists are arranged and displayed so that the contents become continuous in sequence in a playback sequence from content that is currently being played back from a display of an operation element that causes an image of a playback process to appear or from a display showing the content which is currently being played back. When the playback of one piece of content of one play list from among a plurality of play lists is terminated and one piece of content of an other play list is played back, at least the content that is currently being played back and content to be subsequently played back are displayed so that the contents can be distinguished.

Abstract: The computer-implemented system stores user performance data representing multiple parts. The system also stores style data representing various different musical accompaniments that are displayed in a style data window. The user selectively copies constituent parts of the style data into a user performance data window, thereby incorporating the copied parts into the performance data. Tone pitches and musical length of the copied parts are automatically modified to suit the chord information and timing represented in the existing performance data. As the user records performance data, the on-screen start switch is displays differently (e.g., different color) to show whether the specific part corresponds to a recording part or a non-recording part.

Abstract: A fully automated, voice controlled business appointment/reservation system is provided. The system has a natural language voice user interface that emulates a live office administrator for appointment/reservation bookkeeping. It includes an efficient availability searching mechanism which enables a telephone user to quickly search and reserve available time slot based on his preference. Other described novel features and implementation improvements include method and system for voice controlled appointment/reservation cancellation, method and system for voice controlled appointment/reservation waiting list, method and system for new user service sign-up and account creation, method and system enabling sequential selective dialing of a telephone user list by voice command, and method and system for scheduling data administration by voice commands.

Abstract: An audio “desktop” user-interface is provided in which services are represented by audio labels presented in an audio field through respective synthesized sound sources. A desired service is selected by identifying it through its sound source or audio label. A user can modify the layout of service-representing sound sources and preferably add and remove services.

Abstract: A method of navigating textual information via auditory indicators is provided. Through the pervasive and immediate articulation of virtually all textual elements in response to a comparatively passive action, such as a selection device rollover, a user may quickly peruse titles, headings, list items, and so on, as well as emphasized text, paragraphs, captions, and virtually any unit of visually contiguous text. A user may also hear a particular selected word via a slightly more active action, such as clicking a mouse button. Via use of this method, a child, or other user who may understand a language, but not be able to recognize its orthography, may successfully and easily navigate textual documents. The method also resumes articulation of text that has been stopped due to a passive deindication. The articulation is restarted approximately at the word where it was stopped.

Abstract: A digital multi-media device provides features for a user unskilled in musical arts or sound handling techniques that provides automatic musical score composition in accordance with contained composition instructions. Stored sound samples and interfaces for obtaining external signals provide signals for merger with visual and sound presentations to obtain altered presentations either time shifted or in real time. In this fashion the user can create simulated radio stations for playback of prearranged and composed audio material. Further, the automatically composed musical score may be mixed with synthesized, digitized signals from the stored sound samples and external signals obtained through the device interfaces.

Abstract: The present invention relates to a method of selectively reproducing a desired type of data from a multi-session disk in which various types of data have been recorded on sessions. The method of reproducing a recording medium containing same type of contents in each session identifies each type of a plurality of sessions sequentially, composes type telling information based on the identified types wherein information indicative of same type of data sections is to be collectively placed when the type telling information is viewed, presents the type telling information with a choice button or box for a user's selecting an arbitrary type, and selectively reproduces data sections corresponding to a selected type from a user. According to this method, it is possible for a user to recognize easily all types of data recorded on a multi-session disk containing various types of data, whereby a user can request reproduction or copy of same type data quite conveniently.

Abstract: A system is described which includes a content retriever to retrieve and format data and a media file playlist generated by the content retriever from the data. The media file playlist includes a playlist entry title identifying a title for a media file, a filename identifying the media file, and a metadata tag containing data for performing an action associated with the media file. The system also includes a text file playlist generated by the content retriever from the text data, formatted in XML (extensible markup language).

Abstract: A motion based communications system having an animated device, which is controlled locally or over a network connection, and which uses motion to convey information to a user. The information can relate to a predefined system events, such as printer status changes, e-mail status, system errors or communications. Further, it can represent remote individuals in a chat room, or when playing games. Computer games can use it to represent a remote or local human or software opponent. Voice recognition software allows commands or data to be input to the system via the device. Multiple devices can be used for multiple remotely located users. A universal base unit allows characters to be replaceably attached to, and controlled by, the base unit. Different characters can be substituted for different games, etc. The device may be software controlled by any application program via a standard application program interface.

Abstract: A system and method for enabling a graphical programming development environment to provide suggested graphical programming operations, such as suggested nodes or icons to include in a graphical program. User input specifying one or more nodes to include in the graphical program may be received. The one or more specified nodes may then be included in the graphical program. One or more suggested nodes to include in the graphical program may be then be automatically displayed or otherwise suggested to the user. The one or more suggested nodes may be based on the nodes already included in the graphical program. In various embodiments, the one or more suggested nodes may be displayed or otherwise suggested in various ways.