3DTV - Integrated Three-Dimensional Television - Capture, Transmission and Display
Primary goal is to align the research works of Participating European researchers along the 3DTV focus.
Objectives are recording, processing, interacting with and displaying 3D visual information.
AMI - Augmented Multi-party Interaction
AMI is an overarching community of research partners and associated organizations united by a common vision. Business productivity, by way of collaboration between and during business meetings, can be dramatically enhanced with the use of advanced signal processing and knowledge management.
The AMI Consortium consists of partners working together on the AMI Project and organizations which have joined to advance the state of the art through their contributions to AMIDA.
BIOSECURE - Biometrics for Secure Authentication
The main objective of this network is to strengthen and to integrate multidisciplinary research efforts in order to investigate biometrics-based identity authentication methods, for the purpose of meeting the trust and security requirements in our progressing digital information society.
CHIL - Computers In the Human Interaction Loop
The goal of the CHIL project is to make everybody’s daily life easier.
Therefore we are developing a fundamental shift in the way we use computers today. We aim to realize computer services that are delivered to people in an implicit, indirect and unobtrusive way. This will free people to interact with people and reposition machines to be in the background and - like electronic butlers - attempting to anticipate and serve people’s needs. Computers in the Human Interaction Loop (CHIL) aims to introduce computers into a loop of humans interacting with humans, rather than condemning a human to operate in a loop of computers. This will give humans the most valuable gift: more time.
CoSy - Cognitive Systems for Cognitive Assistants
The main goal of the project is to advance the science of cognitive systems through a multi-disciplinary investigation of requirements, design options and trade-offs for human-like, autonomous, integrated, physical (eg., robot) systems, including requirements for architectures, for forms of representation, for perceptual mechanisms, for learning, planning, reasoning and motivation, for action and communication.
ENACTIVE - Enactive Interfaces
The general objective of the ENACTIVE Network is the creation of a multidisciplinary research community with the aim of structuring the research on a new generation of human-computer interfaces called Enactive Interfaces.
Enactive Interfaces are related to a fundamental “interaction” concept which is not exploited by most of the existing human-computer interface technologies. As stated by the famous cognitive psychologist Jerome Bruner, the traditional interaction with the information mediated by a computer is mostly based on symbolic or iconic knowledge, and not on enactive knowledge. While in the symbolic way of learning knowledge is stored as words, mathematical symbols or other symbol systems, in the iconic stage knowledge is stored in the form of visual images, such as diagrams and illustrations that can accompany verbal information. On the other hand, enactive knowledge is a form of knowledge based on the active use of the hand for apprehension tasks.
HUMAINE - Human-Machine Interaction Network on Emotion
HUMAINE aims to lay the foundations for European development of systems that can register, model and/or influence human emotional and emotion-related states and processes - 'emotion-oriented systems'. Such systems may be central to future interfaces, but their conceptual underpinnings are not sufficiently advanced to be sure of their real potential or the best way to develop them. One of the reasons is that relevant knowledge is dispersed across many disciplines.
HUMAINE brings together leading experts from the key disciplines in a programme designed to achieve intellectual integration. It identifies six thematic areas that cut across traditional groupings and offer a framework for an appropriate division of labour - theory of emotion; signal/sign interfaces; the structure of emotionally coloured interactions; emotion in cognition and action; emotion in communication and persuasion; and usability of emotion-oriented systems. Teams linked to each area will run a workshop in it and carry out joint research to define an exemplar embodying guiding principles for future work in their area. Cutting across these are plenary sessions where teams from all areas report; activities to create necessary infrastructure (databases recognising cultural and gender diversity, an ethical framework, an electronic portal); and output to the wider community in the form of a handbook and recommendations of good practice (as precursors to formal standards).
K-SPACE - Knowledge Space of Semantic Inference for Automatic Content
K-Space integrates leading European research teams to create a Network of Excellence in semantic inference for semi-automatic annotation and retrieval of multimedia content. The aim is to narrow the gap between content descriptors that can be computed automatically by current machines and algorithms, and the richness and subjectivity of semantics in high-level human interpretations of audiovisual media:
The Semantic Gap.
MUSCLE - Multimedia Understanding through Semantics, Computation and Learning
MUSCLE is an EC-sponsored Network of Excellence that aims at establishing and fostering closer collaboration between research groups in multimedia datamining and machine learning. The Network integrates the expertise of over forty research groups working on image and video processing, speech and text analysis, statistics and machine learning. The goal is to explore the full potential of statistical learning and cross-modal interaction for the (semi-)automatic generation of robust meta-data with high semantic value for multimedia documents.
In particular, MUSCLE researchers are developing software tools and research strategies to enable users to move away from labor-intensive case-by-case modelling of individual applications, and allow them to take full advantage of generic adaptive and self-learning solutions that need minimal supervision.
PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning
The objective is to build a Europe-wide Distributed Institute which will pioneer principled methods of pattern analysis, statistical modelling and computational learning as core enabling technologies for multimodal interfaces that are capable of natural and seamless interaction with and among individual human users.
At each stage in the process, machine learning has a crucial role to play. It is proving an increasingly important tool in Machine Vision, Speech, Haptics, Brain Computer Interfaces, Information Extraction and Natural Language Processing; it provides a uniform methodology for multimodal integration; it is an invaluable tool in information extraction; while on-line learning provides the techniques needed for adaptively modelling the requirements of individual users. Though machine learning has such potential to improve the quality of multimodal interfaces, significant advances are needed, in both the fundamental techniques and their tailoring to the various aspects of the applications, before this vision can become a reality.
TC-Star - Technology and Corpora for Speech to Speech Translation
The project targets a selection of unconstrained conversational speech domains—speeches and broadcast news—and three languages: European English, European Spanish, and Mandarin Chinese. Accurate translation of unrestricted speech is well beyond the capability of today's state-of-the-art research systems. Therefore, advances are needed to improve the state-of the-art technologies for speech recognition and speech translation.
