Abstract: An apparatus for rendering a visual scene includes: a content visualization stage configured: to obtain as a first input a set of images of one or more objects, and to obtain as a second input a geometry representation of the one or more objects in a 3D-space; to obtain a final image representing the visual scene from a perspective of a target position, the visual scene including the one or more objects; to consider at least one of a lighting effect and/or an object interaction effect between the one or more objects and one or more further objects contained in the visual scene; the content visualization stage is configured to obtain a target view image from the set of images irrespective of the geometry representation. The apparatus is configured to map the target view image on the geometry representation under consideration of the target position.

Abstract: Described is a system for automatic adjustment of neurostimulation. The system controls stimulation of specific neural regions through a neural device positioned on a human subject, while simultaneously performing recordings from the neural device using a targeted arrangement of stimulating electrodes and distinct types of recording electrodes of the neural device. Stimulation of the specific neural regions is adjusted in real-time based on the recordings from the neural device.

Abstract: An apparatus for rendering a visual scene includes: a content visualization stage configured: to obtain as a first input a set of images of one or more objects, and to obtain as a second input a geometry representation of the one or more objects in a 3D-space; to obtain a final image representing the visual scene from a perspective of a target position, the visual scene including the one or more objects; to consider at least one of a lighting effect and/or an object interaction effect between the one or more objects and one or more further objects contained in the visual scene; the content visualization stage is configured to obtain a target view image from the set of images irrespective of the geometry representation. The apparatus is configured to map the target view image on the geometry representation under consideration of the target position.

Abstract: Described is system for mapping user behavior to brain regions of interest. Using a cognitive-behavior model, a behavioral task is selected that is suited for a desired brain state. Using a functional-anatomical model coupled to the cognitive-behavior model, a set of high-definition neurostimulations is selected to be applied to the user during performance of the selected behavioral task. The selected set of high-definition neurostimulations targets specific regions of the user's brain. Changes in the user's brain state are sensed during application of the set of high-definition neurostimulations and performance of the selected behavioral task using at least one brain monitoring technique. The coupled functional-anatomical and cognitive-behavior models are adapted until the desired brain state is reached.

Abstract: An apparatus comprises a first interface for receiving a plurality of partially overlapping images of an object from a corresponding plurality of cameras being arranged along a first and a second direction according to a camera pattern. The apparatus comprises an analyzing unit configured for selecting at least one corresponding reference point in an overlap area of a set of images, and for determining displacement information along the first and the second direction of the reference point in each of the other images of the set of images. A misalignment of the plurality of images along the first and the second direction is compensated by the displacement information so as to obtain aligned images. The apparatus comprises a determining unit configured for determining offset information between principal points of the plurality of cameras using at least three aligned images.

Abstract: Described is a system for proactive and reactive cognitive control using a neural module. The system calculates, for each hypothesis of a set of hypotheses, a probability that an event will occur. The neural module comprises a plurality of neurons and includes the PC module, a prefrontal cortex (PFC) module, an anterior cingulate cortex (ACC) module, a locus coeruleus (LC) module, and a basal forebrain (BF) module. The set of hypotheses are related to tasks to be performed by a plurality of groups, each group having a corresponding hypothesis. For each probability, the system calculates a conflict value across all hypotheses with the ACC module, compares each conflict value to a predetermined threshold using the BF and LC modules. A determination is made whether to directly output the calculated probability or perform an additional probability calculation and output an updated probability.

Abstract: Described is a system for explaining how the human brain represents conceptual knowledge. A semantic model is developed, and a behavioral exam is performed to assess a calibration subject into a cohort and reveal semantic relationships to modify a personalized semantic space developed by the semantic model. Semantic features are extracted from the personalized semantic space. Neural features are extracted from neuroimaging of the human subject. A neuroceptual lattice is created having nodes representing attributes by aligning the semantic features and the neural features. Structures in the neuroceptual lattice are identified to quantify an extent to which the set of neural features represents a target concept. The identified structures are used to interpret conceptual knowledge in the brain of a test subject.

Abstract: An apparatus comprises a first interface for receiving a plurality of partially overlapping images of an object from a corresponding plurality of cameras being arranged along a first and a second direction according to a camera pattern. The apparatus comprises an analyzing unit configured for selecting at least one corresponding reference point in an overlap area of a set of images, and for determining displacement information along the first and the second direction of the reference point in each of the other images of the set of images. A misalignment of the plurality of images along the first and the second direction is compensated by the displacement information so as to obtain aligned images. The apparatus comprises a determining unit configured for determining offset information between principal points of the plurality of cameras using at least three aligned images.

Abstract: Described is a system for online characterization of biomechanical and cognitive factors relevant to physical rehabilitation and training efforts. A biosensing subsystem senses biomechanical states of a user based on the output of sensors and generates a set of biomechanical data. The set of biomechanical data is transmitted in real-time to an analytics subsystem. The set of biomechanical data is analyzed by the analytics subsystem, and control guidance is sent through a real-time control interface to adjust the user's motions. In one aspect control guidance is sent to a robotic exoskeleton worn by the user to adjust the user's motions.

Abstract: The invention provides a light-field camera for capturing multiple views of a scene, representing samples of a light-field, having: a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array having a plurality of secondary cameras, each of the secondary cameras being configured for capturing a secondary digital two-dimensional image of the scene to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged such that an incident light beam originating from the scene is split up in a first partial light beam, directed to the primary camera, and a second partial light beam, directed to the camera array; and a processing unit configured for receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corr

Abstract: Described is a system for automatic adjustment of neurostimulation. The system controls stimulation of specific neural regions through a neural device positioned on a human subject, while simultaneously performing recordings from the neural device using a targeted arrangement of stimulating electrodes and distinct types of recording electrodes and sensors of the neural device. Stimulation of the specific neural regions is adjusted in real-time based on the recordings from the neural device.

Abstract: Described is system and method for cognitive recognition. The system receives a multi-dimensional scene array as input data. A foveation module divides the multi-dimensional scene array into a plurality of sub-arrays and outputs contents of a currently selected sub-array. The contents are clustered with a hierarchical clustering module to generate a spatially invariant hierarchical cluster of the contents comprising a plurality of components which are based on a statistical distribution of co-occurrence of features across the currently selected sub-array. Task-relevant components are selectively gated and robustly maintained into a component memory location of a pattern bank with a working memory module with an input gating module. If the task-relevant components activate an abstract category module based on pattern matching, then a category recognition label is generated for the contents of the currently selected sub-array with an executive control module.

Abstract: Described is a system for patient-specific rehabilitation that can be performed outside a clinic. The system monitors a patient in real-time to generate a quantitative assessment of a physical state and a motivational state of the patient using sensor data obtained from sensors. Predictions related to the patient are generated utilizing patient-specific biomechanical and neurocognitive models implemented with predictive simulations. Video feed of the patient is registered with sensor data and a set of simulation data. Rehabilitation guidance instructions are conveyed to the patient through dialog-based interactions.

Abstract: Described is a system for enhancing memories during sleep. The system detects, via at least one sensor, brain activity of a user as the user learns a new episode pattern or recalls an episode pattern. The episode pattern is temporally compressed. A specific sleep stage is detected in the user. Upon detection of the specific sleep stage, the system automatically recreates the temporally compressed episode pattern by applying neural stimulation to the user to ensure the consolidation of the episode pattern in the user.

Abstract: Described is system for mapping user behavior to brain regions of interest. Using a cognitive-behavior model, a behavioral task is selected that is suited for a desired brain state. Using a functional-anatomical model coupled to the cognitive-behavior model, a set of high-definition neurostimulations is selected to be applied to the user during performance of the selected behavioral task. The selected set of high-definition neurostimulations targets specific regions of the user's brain. Changes in the user's brain state are sensed during application of the set of high-definition neurostimulations and performance of the selected behavioral task using at least one brain monitoring technique. The coupled functional-anatomical and cognitive-behavior models are adapted until the desired brain state is reached.

Abstract: Described is a system for system for gait intervention and fall prevention. The system is incorporated into a body suit having a plurality of distributed sensors and a vestibulo-muscular biostim array. The sensors are operable for providing biosensor data to the analytics module, while the vestibulo-muscular biostim array includes a plurality of distributed effectors. The analytics module is connected with the body suit and sensors and is operable for receiving biosensor data and analyzing a particular user's gait and predicting falls. Finally, a closed-loop biostim control module is included for activating the vestibulo-muscular biostim array to compensate for a risk of a predicted fall.

Abstract: Described is a system for augmenting team performance via individual neurostimulation. An assessment is generated for each team member of a team while the team member is performing a behavioral task using neuroimaging data. A target brain state is selected in team members for team performance enhancement. The target brain state is associated with specific brain regions, and the system determines a HD-tCS neurostimulation needed to reach the specific brain regions to induce the target brain state in the team members. The determined HD-tCS neurostimulation is applied to the team members while simultaneously sensing, via real-time neuroimaging, neural activity in each team member while the team member performs a behavioral task. Team performance is enhanced by adjusting the HD-tCS neurostimulation of each team member, based on the sensed neural activity, to direct each team member toward the target brain state.

Abstract: Described is a system for automatic adjustment of neurostimulation. The system controls stimulation of specific neural regions through a neural device positioned on a human subject, while simultaneously performing recordings from the neural device using a targeted arrangement of stimulating electrodes and distinct types of recording electrodes of the neural device. Stimulation of the specific neural regions is adjusted in real-time based on the recordings from the neural device.

Abstract: Described is a system for training and assessment. In operation, the system classifies a subject's baseline brain state and behavioral performance. Training goals are assessed to specify tasks the subject is to perform and a desired level of performance. The subject is subjected to neurological stimulation while the subject performs specified tasks. Behavioral data is assessed to determine if the subject has achieved the training goals. If the subject has achieved the training goals, the system stops. Alternatively, if the individual has not achieved the training goals, then neurological data is reviewed to identify activation states and values of the neurological stimulation that resulted in increased performance values from the baseline behavioral performance. The activation states and values of the neurological stimulation are adjusted to match those that resulted in increased performance values. The process is repeated until the subject has achieved the training goals.

Abstract: Described is a system for system for gait intervention and fall prevention. The system is incorporated into a body suit having a plurality of distributed sensors and a vestibulo-muscular biostim array. The sensors are operable for providing biosensor data to the analytics module, while the vestibulo-muscular biostim array includes a plurality of distributed effectors. The analytics module is connected with the body suit and sensors and is operable for receiving biosensor data and analyzing a particular user's gait and predicting falls. Finally, a closed-loop biostim control module is included for activating the vestibulo-muscular biostim array to compensate for a risk of a predicted fall.