Abstract: A driver state module for interfacing with a vehicle, with a surroundings vicinity of the vehicle and with a driver of the vehicle, the driver state module comprising: (i) a frame memory for storing representations of behaviors with related context; (ii) an evaluation system for ranking the frames based on goals and rewards; (iii) a working memory comprising a foreground sub-memory and a background sub-memory, the working memory for holding and sorting frames into foreground and background frames, and (iv) a recognition processor for identifying salient features relevant to a frame in the foreground memory ranked highest by the evaluation system.

Abstract: A method and apparatus for processing sound from a sound source. The sound from the sound source is detected. Harmonics in the sound from the sound source are identified. A distance to the sound source is identified using the harmonics and a number of atmospheric conditions.

Abstract: An automatic approach is described for the semantic analysis and conversion of video annotation metadata (e.g., Video Event Markup Language or “VEML” metadata) to propositional graphs suitable for analysis by an analogical reasoning system (ARS). Also as described herein, a system architecture implements this conversion while maintaining semantic consistency from annotation through results reporting. Further, the techniques herein leverage the same ontology to populate options for an annotation tool, provide the rules for the metadata-to-propositional graph mapping, and provide the basis for comparison in an analogical reasoning algorithm.

Abstract: Systems, methods, and apparatus for neuro-robotic tracking point selection are disclosed. A described example method to control a robot arm includes presenting one or more potential trackable features of a target object, emphasizing at least one of the potential trackable features, determining a selection of one of the emphasized features as a tracking point by monitoring a first mental response to emphasizing the feature, and effectuating an end goal via a robot by tracking the selected feature and effectuating a position based on the selected feature.

Abstract: A three dimensional audio playback system in which the audio clips are determined by location. The audio playback system being located within a vehicle to aid in navigation or for entertainment or informational or safety purposes.

Abstract: A system for intelligent goal-directed search in large volume visual imagery using a cognitive-neural subsystem is disclosed. The system comprises an imager, a display, a display processor, a cognitive-neural subsystem, a system controller, and operator controls. The cognitive-neural subsystem comprises a cognitive module, a neural module, and an adaptation module. The cognitive module is configured to extract a set of regions of interest from the image using a cognitive algorithm. The neural module is configured to refine the set of regions of interest using a neural processing algorithm. The adaptation module is configured to bias the cognitive algorithm with information gained from the neural module to improve future searches. The system functions in a plurality of operating modes, including: batch mode, semi-interactive mode, real-time mode, and roaming mode.

Abstract: An automatic approach is described for the semantic analysis and conversion of video annotation metadata (e.g., Video Event Markup Language or “VEML” metadata) to propositional graphs suitable for analysis by an analogical reasoning system (ARS). Also as described herein, a system architecture implements this conversion while maintaining semantic consistency from annotation through results reporting. Further, the techniques herein leverage the same ontology to populate options for an annotation tool, provide the rules for the metadata-to-propositional graph mapping, and provide the basis for comparison in an analogical reasoning algorithm.

Abstract: A self adapting cognitive-neural method and system for image analysis is disclosed. The method comprises detecting a set of potential items of interest in an image using a cognitive algorithm, refining the set of potential items of interest using a neural analysis, and adapting the cognitive algorithm based on information gained from the results of the neural analysis. The method may further comprise fusing the results of the cognitive and neural algorithms with a fusion classifier. The neural analysis can include eye tracked EEG, RSVP, or presentation to an operator for visual inspection.

Abstract: An apparatus configured to obtain, process, and relay data to a user in a coherent and useful manner. An active fiducial is equipped with an interface for receiving and transmitting data. The fiducial may transmit its position using a satellite-based position sensing device such as a GPS. Active fiducials may also be equipped with battery power pack regenerated with solar cells. Similarly, the fiducials can be equipped with at least one video camera or other device having a focal plane array and a computer software system, configured to recognize shapes. The fiducials may also be equipped with inductive coils or other means for sensing metal containing compounds. The active fiducials may be equipped with a gas chromatograph. The active fiducials may use a variety of propulsion means including motor driven tracks, motor driven wheels, propellers, or other device or a combination of devices.

Abstract: A beacon-augmented pose estimation system includes positionable beacons that can determine their own 3-D geospatial coordinates and transmit those coordinates back to the pose object. An imaging sensor images the field-of-view of the pose object to provide 2-D image coordinates for any of the beacons in the FOV. A pose object controller processes the sets of 3-D geospatial coordinates and 2-D image coordinates to refine a pose estimate of the pose object. The positionable beacons may include both static beacons that are pre-positioned and mobile beacons that are command-guided to position themselves in the pose object's likely or actual FOV.

Abstract: A handheld virtual overlay system (HVOS) device is presented that includes a global positioning system (GPS) receiver for detecting a global position of the HVOS device; a compass/tilt sensor for detecting a direction and tilt of the HVOS device; a communication module for transmitting the global position, the direction, and the tilt to a data store; and an input/output display configured to receive and display a rendered image. The data store is configured to receive the global position, the direction, and the tilt, and to generate geo-coded data for transmission to a server, where the server is configured to receive the geo-coded data and to transform and render the geo-coded data into a rendered image. A user can point the HVOS device at a scene, with the HVOS device producing a rendered image representing the scene.

Abstract: A beacon-augmented pose estimation system includes positionable beacons that can determine their own 3-D geospatial coordinates and transmit those coordinates back to the pose object. An imaging sensor images the field-of-view of the pose object to provide 2-D image coordinates for any of the beacons in the FOV. A pose object controller processes the sets of 3-D geospatial coordinates and 2-D image coordinates to refine a pose estimate of the pose object. The positionable beacons may include both static beacons that are pre-positioned and mobile beacons that are command-guided to position themselves in the pose object's likely or actual FOV.

Abstract: An apparatus and method is disclosed for enabling accurate registration of virtual information upon real objects in selected environments from the perspective of a moveable observation platform having a position and an orientation within an observation space positioned within the environment, the position and orientation defining the registration of the virtual information within the observation space within the environment, which may comprise: a plurality of at least three tracking fiducials selectively each respectively located in fixed predetermined locations in the observation space; the observation platform including a position sensor apparatus adapted to sense an estimated position of the observation platform in the observation space and a heading sensor apparatus adapted to sense an estimated heading of the observation platform within the observation space; the observation platform further including a wide view fiducial detection apparatus mounted on the observation platform and adapted to detect the r

Abstract: A method for transforming a map based on associated geospatial data. A map is segmented into logical segments representing map-based entities. The geospatial data is then associated with the logical segments. The logical segments are scaled based upon the associated data. The logical segments are then repositioned to avoid overlapping other logical segments and a new map display based on the scaled and repositioned logical segments is provided.

Abstract: A system and method for encoding the speech of multiple speakers for transmission on a limited medium such as ISDN or ADSL. The system and method encode one or more “dominant” speakers on a first channel, and merges all other speakers into a second channel. A “dominant” speaker may be defined according to the needs of the application, but intuitively it is a speaker in a collaboration session who has the “floor”. The method and system transmit speech through a teleconferencing system having an available bandwidth. Speech from a speaking one, or ones, of the plurality of participants is passed while speech from non-speaking participants is rejected. The system responds to the speech from the one, or ones of the speaking participants passed by the speech detector, and determines which of the detected speaking one, or ones, thereof is a dominant speaker.

Abstract: An apparatus and method is disclosed for enabling accurate registration of virtual information upon real objects in selected environments from the perspective of a moveable observation platform having a position and an orientation within an observation space positioned within the environment, the position and orientation defining the registration of the virtual information within the observation space within the environment, which may comprise: a plurality of at least three tracking fiducials selectively each respectively located in fixed predetermined locations in the observation space; the observation platform including a position sensor apparatus adapted to sense an estimated position of the observation platform in the observation space and a heading sensor apparatus adapted to sense an estimated heading of the observation platform within the observation space; the observation platform further including a wide view fiducial detection apparatus mounted on the observation platform and adapted to detect the r

Abstract: A method for transforming a map based on associated geospatial data. A map is segmented into logical segments representing map-based entities. The geospatial data is then associated with the logical segments. The logical segments are scaled based upon the associated data. The logical segments are then repositioned to avoid overlapping other logical segments and a new map display based on the scaled and repositioned logical segments is provided.

Abstract: A system and method for encoding the speech of multiple speakers for transmission on a limited medium such as ISDN or ADSL. The system and method encode one or more “dominant” speakers on a first channel, and merges all other speakers into a second channel. A “dominant” speaker may be defined according to the needs of the application, but intuitively it is a speaker in a collaboration session who has the “floor”. The method and system transmit speech through a teleconferencing system having an available bandwidth. Speech from a speaking one, or ones, of the plurality of participants is passed while speech from non-speaking participants is rejected. The system responds to the speech from the one, or ones of the speaking participants passed by the speech detector, and determines which of the detected speaking one, or ones, thereof is a dominant speaker.

Abstract: A system and method for producing and receiving electronically-mediated collaboration is presented. The electronically-mediated collaboration system and method include a high-fidelity audio system as well as application and cursor sharing, and a session manager module to synchronize among participants. In one embodiment, the system includes an eye contact collaboratory that manipulates video and eye position input to synthesize virtual camera images which simulate ordinary gaze behavior in a collaboratory system. An audio component optionally spatializes the voices of the participants to appear to coincide with their images.

Abstract: A high resolution real-time multi-user augmented reality system broadcasts a wide FOV video signal from a plurality of image sources over a distribution bus to a plurality of users that independently select and view different portions of the video signal such that the angular resolution of the displayed video signal is constant over the range of possible viewing orientations. This is accomplished by assuming that each user's position is fixed at the center of a virtual sphere, the image sources' positions are known relative to the center of the virtual sphere, and that the users are looking at a portion of the inner surface of the sphere. As a result, the “flat” images generated by the image sources and the “flat” images viewed by the users can be efficiently mapped onto the virtual sphere and represented as index pairs (d,n). Thus, each user extracts those pixels on the virtual sphere corresponding to the user's current FOV and remaps them to a flat display.