Public Deliverables

Workpackage 1: Sensors

 D1.1 Omni-directional Sensor, and Features for Tracking and 3D Reconstruction
 D1.2 Feature Detectors for Body Parts, Tracking, and Fast Object Detection
 D1.3 Acoustic Features that Employ Limited Frequency Ranges and Longer Temporal Spans
 D1.4 Omnidirectional Image Acquisition and Processing Using High-Level Information
 D1.5
Head-Geometry Beamformerwith Binaural Output and its Perceptual Quality Assessment
 D1.7 Low level processing modules for AWEAR demonstrator 
 D1.8 Incongruence detection for detecting, removing and repairing incorrect functionality in low level processing

Workpackage 2: Audio Representations

 D2.1 Data Recorded from Different Acoustic Environments
 D2.2 Recordings of Spectro-Temporal Receptive Fields (STRFs) from Gerbil Auditory Cortex
 D2.3 Features of Audio Signals, Obtained with Different Modeling Techniques
 D2.4 Results of Processing with Advanced Hierarchical Model Including Results on an Accepted ASR Task
 D2.5
Acoustic Classification Method
 D2.6 Detection of Unexpected Words In Machine Recognition of Speech

 

Workpackage 3: Visual Representations

 D3.1 Framework for Bottom-Up 3D Reconstruction
 D3.2 Setup and Stimuli for Neurophysiological Experiments
 D3.3 Conclusions from the First Neurophysiological STP Single-Cell Experiments
 D3.4 Biological Motion Detection Based on the Learned, Statistical Representations
 D3.5
Dynamic 3D Scene Analysis Using Cognitive Loops
 D3.6 Results on Biological and Computational Action Recognition
 D3.7
Dynamic 3D Scene Analysis on Omni-Directional Video Data
 D3.8
Camera tracking and autocalibration for detecting and correcting camera de-calibration
 D3.9
Incongruences detected between trackers working with weaker and stronger expectations about the world
 D3.10
Report on single STS neurons to stimuli showing walking and running, as well as rare events, and qualitative comparison with conclusions from computational models for the same stimuli
 D3.11
Qualitative comparison of neurophysiological findings and computation models for the same stimuli
 D3.12
Fully functional implementation of a tracker tree pre-learned for a specific location and tested there, i.c. the OHSU Living Lab
 D3.13
Concepts for self-learning tracker trees available as a report

 

Workpackage 4: Learning and Categorization

 D4.1 Evaluation of Localization Algorithm and Retrieval
 D4.2 Prototype of the VR Environment
 D4.3 Learning-induced plasticity in cortical receptive fields
 D4.4 Test & evaluation of motion boundary detection algorithm
 D4.5
Conclude Categorization Study with PEC/NEC, Design Developmental Study, Feature Category Relationship
 D4.6 Categorization of Level and/or Temporal Dynamics
 D4.7 Object Detection from Small Sample, Optimization
 D4.8
Adaptive Distance Learning and Classification
 D4.9
Neuronal Correlates of Categorization
 D4.10
Learning-induced plasticity in cortical dynamics
 D4.11
Information Transfer between Categories & Hierarchy Learning
 D4.12
Incremental Learning with Bounded Memory Growth
 D4.13
Modeling cortical cells with distance functions
 D4.14
Transfer of knowledge for learning of rare events
 D4.15
Adaptive learning of hierarchies
 D4.16
Current source density analysis of auditory cortex

 

Workpackage 5: Multi-Sensory Information Fusion

 D5.1 Setup of experimental paradigm for studying audio-visual fusion in rodent cortex
 D5.2 Combination of Nonlinear Classsification
 D5.3 Framework for Cognition-Based Fusion
 D5.4 Report on High Level (Categorical) Audio-Visual Integration Results
 D5.5
Example/Demo of Hierarchical Multimodal Fusion
 D5.6 Report on electrophysiological correlates of audio-visual temporal order judgments
 D5.9
Report on Knowledge Transfer in Artificial and Living Cognitive Systems
 D5.11
Discriminative methods for multi-cue classification
 D5.14
Measure of rareness of incongruent events

 

Workpackage 6: Integration

 D6.1 Application Scenario
 D6.2 Omnidirectional Camera Tracking
 D6.3 Annotated Bibliography Webpage
 D6.4 Website for Audio-Visual Data
 D6.5
Technical Report on Detection of Audio-Visual Rare Events
 D6.6 First audio-visual data collection with AWEAR and OHSU system
 D6.7 Database of low level incongruencies
 D6.8
Database of incongruent human locomotion
 D6.9
Database of recordings of scenario 1
 D6.11
Testing and validation plan
 D6.12
Catalogue of basic scenes containing incongruent events
 D6.13
Evaluation Results
 D6.14
The DIRAC databases

 

Workpackage 7: Training and Education

 M7.1 Bundled notes of the Ice Breaker Workshop
 M7.2 Establishment of Internship Programs (undergraduate & graduate)
 M7.3
Establishment of Liaison with other (European) Consortia - list of contact person
 D7.1 First DIRAC Summer School on Cognitive Engineering