INDUX-R
Transforming European Industrial Ecosystems through eXtended Reality
January 2024 - ongoing
INDUX-R envisions a human-centric XR ecosystem that will transform European industrial sectors by empowering humans and creating innovate XR products and services of significant added value. It targets for concrete scientific breakthroughs integrated in technological enablers that will be applied in use cases driven from real-life needs while having the potential to be replicated in several other applications. These breakthroughs are focused on core XR technologies, namely, digitisation and creation of XR assets, realistic animation, light-field HMDs, XR media streaming and egocentric perception.
5Dculture
Deploying and Demonstrating a 3D Cultural Heritage Space
September 2023 - ongoing
5Dculture enriches the offer of European 3D digital cultural heritage assets in the data space and fosters their reuse in important domains such as education, tourism and the wider cultural and creative sectors towards socially and economically sustainable outcomes.
TRANSMIXR
Ignite the Immersive Media Sector by Enabling New Narrative Visions
October 2022 - ongoing
The future of media experiences poses a series of thrilling challenges, and the maturity of eXtended Reality (XR) and Artificial Intelligence (AI) technologies provides a unique window of opportunity for the European Creative and Cultural Sector (CCS) to reimagine digital co-creation, interaction and engagement possibilities. In TRANSMIXR, we aim to create a range of human-centric tools for remote content production and consumption via social virtual reality. The TRANSMIXR consortium includes 19 organisations from 12 European countries holding advanced and complementary expertise and skillsets in European research, media and innovation programs, as well as in-depth knowledge of AI & XR and their application to the media sector.
VOXReality
Voice-driven interaction in XR Spaces
October 2022 - ongoing
VOXReality is an initiative that aims to facilitate the convergence of Natural Language Processing (NLP) and Computer Vision (CV) technologies in the Extended Reality (XR) field. The project will develop innovative models that will combine language as a core interaction medium supported by visual understanding to deliver next-generation applications that provide comprehension of users goals, surrounding environment and context. The resulting virtual assistants will be deployed in three use cases: a factory setting, a virtual conference (Immersive Tech Week), and a theatre play (Athens Epidaurus Festival).
User-centered Optimization for Immersive Multimedia Systems
NWO WISE Grant
September 2021 - ongoing
The project will focus on optimizing transmission and rendering of immersive media contents. In particular, the focus is on designing and integrating novel algorithms to improve compression and transmission efficiency of immersive media contents through Quality of Experience (QoE) optimization. We want to explore how to maximize the QoE for the user, while adhering to the technological constraints. Such optimization can be performed at the acquisition, transmission and rendering stage.
AI, Media and Democracy Lab
ELSA Lab: Ethical Legal Societal Aspects Labs from Netherlands AI Coalition (NL AIC)
July 2021 - ongoing
There cannot be a democracy without a healthy media landscape, there is no free media without a democracy, and the media cannot function without technology. We are an Ethical Legal Societal laboratory focused on the implications of AI for Media and Democracy. At the lab, you can find a place to: multidisciplinary research, imaginative transformation, responsible artificial intelligence, and media innovation. The AI, Media & Democracy Lab is a collaboration between the research teams of the UvA’s Human(e) AI and ICDS - Information, Communication and the Data Society, the CWI research groups Human-Centered Data Analytics, Distributed and Interactive Systems and Intelligent and Autonomous Systems, and the HvA research groups Responsible IT, Network Cultures, Civic Interaction Design, Creative Media for Social Change and Visual Methodologies.
TRACTION
EU H2020-DT-TRANSFORMATIONS-11-2019
January 2020 - December 2022
Opera uses all the visual and performing arts to create extraordinary worlds of passion and sensibility. It is rightly recognized as a great achievement of European culture. And yet a form that once inspired social and artistic revolutions is often seen as the staid preserve of the elite. With rising inequality and social exclusion, many see opera—if they think of it at all—as symbolic of what is wrong in Europe today. TRACTION aims to change that using opera as a path for social and cultural inclusion, making it once again a force for radical transformation. We do not want to make opera palatable to those who don’t attend. We want to define new forms of artistic creation through which the most marginalized groups (migrants, the rural poor, young offenders and others) can work with artists to tell the stories that matter now. By combining best practice in participatory art with digital technology’s innovations of language, form and process, we will define new approaches to co-creation and innovate in three fields: a) Opera creation and production; b) Immersive and interactive digital media; and c) Social integration and community development. Experimental projects in inner-city Barcelona (ES), a youth prison in Leiria (PT) and rural communities in Ireland will test and share new ideas.
MediaScape XR
Private-Public Partnership
June 2020 - January 2022
MediaScape XR is a Public-Private project, together with Sound and Vision (Nederlands Instituut voor Beeld en Geluid), researching innovative interaction technologies for providing enriched access to cultural collections. MediaScape explored novel mechanisms for making audiovisual content more approachable, accessible, and understandable in context. This new museum experience allows visitors to relive the history of museum pieces through the new medium of Social Virtual Reality. It illustrates how the traditional model of a museum experience as a passive observation is decisively shifting to active, interpretive engagement. Museums are rethinking and reworking their spaces to promote deeper understanding of their collections and mission, greater interactivity with their audiences, a fuller range of activities, and a more advanced usage of immersive technologies. The ongoing effort of digitizing museum collections has focused on the creation of digital surrogates as part of the preservationplan. MediaScape XR facilitates novel manners to enjoy and experience the artifacts or interact with them in meaningful and socially engaging ways.
Affective Computing in the Automotive Domain
Private-Public Partnership
July 2019 - November 2021
This two-year project will explore the future of cars and interactive systems, with a focus on creating intelligent and emotion-aware systems that can contribute to better automotive user interfaces. This joint-industrial project aim to produce research that is working on real-world problems in the automotive domain. This project has a strong HCI component where we are working with users in a driving simulator and/or test track setting, physical prototyping with physiological sensors, designing and running controlled simulator) studies. Apart from that, the project also involves areas such as signal processing and machine learning, drawing upon recent advances in machine learning for affective and attentional state classification and/or regression using image and physiological data.
Joint PhD Program with Xinhuanet
Private-Public Partnership
July 2018 - January 2021
Centrum Wiskunde & Informatica (CWI) has launched a joint industrial PhD program with Xinhuanet in the research area of Social Internet of Things (IoT), smart textiles, and physiological computing. Xinhuanet Co. Ltd. is a key website in China with global influence, sponsored by Xinhua News Agency, the Chinese national news agency. The Distributed and Interactive Systems (DIS) group, together with Xinhuanet, has hired a full-time PhD student, who will work together with Dr. Pablo Cesar and Dr. Abdallah El Ali, and with the Future Media Convergence Institute at Xinhuanet. The program provides the unique opportunity for conducting research in a top research institute in Europe, based on real-world problems related to healthcare or to the creative industries. This project additionally strengthens bilateral relationships between CWI and Xinhuanet.
http://www.dis.cwi.nl/news/2018-06-07-008-joint-industrial-phd-program-with-xinhuanet/
VRTogether
An end-to-end system for the production and delivery of photorealistic social immersive virtual reality experiences - VRTogether [EU H2020-ICT-19-2017 Project]
October 2017 - January 2021
VR-Together will offer new ground-breaking virtual reality experiences based on social photorealistic immersive content. For this purpose, it will develop and assemble an end-to-end pipeline integrating state-of-the-art technologies and off-the-shelf components. The challenge of VR-Together is to create photorealistic truly social virtual reality experiences in a cost effective manner. Immersive media production and delivery through innovative capture, encoding, delivery and rendering technologies. It will introduce new methods for social VR evaluation and quantitative platform benchmarking for both live and interactive content production, thus providing production and delivery solutions with significant commercial value
W3C Standardization Activities
January 2010 - January 2021
CWI has worked with the World Wide Web Consortium (W3C) ever since its establishment in 1994. The presence of researchers as well as R&D projects in the development of Web technologies and standards has always been seen as essential in the development of the Web; CWI is proud to have contributed actively to this evolution. Researchers from the CWI have been active in the past in the development of technologies and standards such as HTML, CSS, SMIL, RDF, RDFa, XForms, OWL, R2RML, JSON-LD, and SPARQL. Beyond the participation in the relevant Working Groups, representatives of the DIS group also acted as Working Group (co-)chairs, as well as activity leads for HTML and the Semantic Web as part of the core staff of W3C. The current activities at W3C concentrate, on the one hand, on the further development of the XForms standard and, on the other hand, taking the technical leadership role in the Publishing@W3C Activity at the W3C. Finally, work is also continuing in areas related to data on the Web, in particular in the latest developments around JSON-LD.
See the separate page on W3C and the separate page on digital publishing for further details.
2-IMMERSE
Delivering Single & Multi-Screen Content Services for Immersive, Customised and Shared Experiences in Homes and Social Spaces - 2-IMMERSE [EU H2020-ICT-2015]
December 2015 - December 2018
Surveys show that although around 80% of people are using a second device (phone, tablet or laptop) when watching TV only 20% of them are engaging with ‘companion content’. The 2-IMMERSE project will innovate around the delivery of experiences that are created to be multi-screen in production yet delivered to be flexible across single and multi-screens and responsive to the preferences of individual audience members. We will build and trial services that delivery multi-screen experiences of high value content including theatre, Grand Prix motorcycle racing and live professional football in the home, in school, and in public venues.
Project Cairo: an intelligent soft-robotic jacket
NWO Humanities - Knowledge Innovation Mapping (KIEM)
October 2017 - March 2018
Project Cairo is a joint effort between CWI, AMOLF, and the Dutch textile designer SME ByBorre to create an urban jacket that pushes the state-of-the-art of smart-textiles. The jacket will sense and reason about the wearer activity, profile and external conditions to trigger changes in its structure and insulation. To build it, we will exploit new materials developed by AMOLF, i.e. soft-robotic matter, as a way of changing the physical properties of textiles. This will be added to the proven expertise in merging sensor technology and artificial intelligence, developed by CWI, with the innovative textile design and fabrication techniques of ByBorre.
Personalized Aftermovies and Festival Experiences
NWO - Creative industry - Knowledge Innovation Mapping (KIEM)
January 2017 - December 2017
A multidisciplinary and collaborative project with the Lectoraat CrossMedia Hogeschool van Amsterdam, Fonk Mobile and Festival deBechaving. The project looks into the technical challenges and the appropiate bussiness models to enrich the experience of festival visitors. In specific, it focuses on the impact of after movies.
ByBorre
An exploration of the future of club culture. ByBorre Private-Public Partnership.
August 2016 - October 2016
As part of the Amsterdam Dance Event the Distribute and Interactive of CWI was asked to utilize technology to explore how the club of the future could react to the levels of excitement of the clubbers. The group developed a system that could capture the energy levels of the crowd and feed them in real time to a visualization engine as well as alter the stimuli of a room to match the activity levels of the crowd. Furthermore, the logged data was summarized in personal experience summary artifacts, delivered to the guests after the event.
Xinhuanet
Xinhuanet Private-Public Partnership
October 2014 - September 2016
CWI will be helping Xinhuanet to build the first advanced user experience laboratory in China. Both institutions will explore the use of sensor technology to better assess the user experience during media consumption. Offering rich, personalized media content is a major research topic in the creative industry. The Distributed and Interactive Systems (DIS) group at CWI, a major international player on user experience research, will help improve Xinhuanet’s media offerings. Traditional evaluation methodologies like questionnaires do not always lead to accurate and reliable results. By using biosensors, like skin conductance sensors, the level of attention of the users can be reliably measured. Collecting and analyzing this data provide Xinhua with valuable insights for applications ranging from media content to remote teaching and precision marketing.
https://www.cwi.nl/news/2014/cwi-and-xinhuanet-sign-cooperation-agreement
REVERIE
REal and Virtual Engagement in Realistic Immersive Environments - Reverie [EU FP7 IP Project]
September 2011 - June 2015
REVERIE revolutionizes the way of immersive media distribution from a passive centralized context to a personalized highly distributed framework. The research outcome of REVERIE will provide for the individuals new ways of 3D/immersive media sharing and distribution under a socially aware, personalized, collaborative and distributed framework. REVERIE maintains the quality of media content and offers to the individual’s high definition immersive media experiences under, however, an optimized end‐to‐end approach. These research outcomes will strengthen the positioning of European Industries especially SME’s in the area of immersive and interactive multimedia content / services delivery. Within REVERIE, we believe that the time is ripe to push social networking towards the next logical step in its evolution: to immersive collaborative environments that support realistic inter‐personal communication.
http://cordis.europa.eu/project/rcn/100323_en.html
Vconect
Video Communications for Networked Communities - Vconect [EU FP7 STREP Project]
December 2011 - November 2014
The Vconect vision is the adoption of high-quality enriched video as a medium for mass communication within communities. Vconect is building a video communication platform which models and supports the complex communication topologies that characterize conversations between group members. The system will take intelligent decisions to mediate the communication at the level of audio-visual choices, screen layout and network capabilities. Vconect is ensuring the wide applicability of the platform by implementing, testing and evaluating it in the context of two different use cases. The first based on the integration of video conferencing into social networking services, the second based on group mediated performance.
https://cordis.europa.eu/project/rcn/100230_en.html
TA2
February 2008 - March 2012
The TA2 vision: Making communications and engagement easier among groups of people separated in space and time. How can technology help to nurture family-to-family relationships? This was the question asked by the collaborative project “Together Anywhere, Together Anytime”(TA2). For many people, families form the key social unit. Many of our enduring experiences, holidays, celebrations and moments of fun and laughter are framed as family events. This is something that current technology does not address well: modern media and communications serve individuals best, with phones, computers and electronic games devices tending to be individually owned and providing individual experiences. TA2 tried to redress this imbalance, by exploring how technology can support group to group communication.
https://cordis.europa.eu/project/rcn/86215_en.html
iNEM4U
Interactive Networked Experiences in Multimedia for You - iNEM4U [EU FP7 STREP Project]
January 2008 - December 2009
In a perfect world, networked electronic media enable individuals and groups of users to share their interactive media experiences in an intuitive and seamless manner, regardless of their choice of device and networks. iNEM4U will design, prototype and evaluate a distributed service infrastructure that supports these goals. To accomplish this, the project will extend and combine existing services from different technology domains, such as Web 2.0, IMS, peer-to-peer and IPTV services. In particular, iNEM4U will investigate innovative solutions in three areas: new generic services that facilitate cross-domain interoperability (identity management, media synchronization and metadata integration), user-centric services for enhanced shared media experiences (context-dependent cross-domain recommendation system, community management), and business models that provide benefits for the entire content distribution value chain.
http://cordis.europa.eu/projects/rcn/85349_en.html
BRICKS
BRICKS PD-3 [NWO Project]
November 2005 - June 2009
In our current and future knowledge society, ICT plays a key role. Examples of important developments already omnipresent in society are fixed and mobile networks, distributed ubiquitous computing, personalized information systems with context awareness, ambient intelligence systems, etc. These developments are driven by high-level, innovative research which in turn generates new challenging research questions addressing new issues of economic and societal relevance; for example, increased attention for security, dependability, authentication, identification and privacy protection. Innovations in the ICT sector lead to new products and services and thus to economic activities and wealth creation. ICT improves products, services and labor productivity in many different sectors: industry, commerce, transportation, health care, education, safety, and the environment. BRICKS is addressing the need for a strong impulse in fundamental research in informatics. This impulse is necessary for improving the innovation climate in the Netherlands and for generating sustainable economic growth driven by ICT.
SPICE
Service Platform for Innovative Communication Environment - SPICE [EU FP6 IP Project]
March 2006 - July 2008
SPICE (Service Platform for Innovative Communication Environment)is addressing the still unsolved problem of designing, developing and putting into operation efficient and innovative mobile Service creation/execution platforms for networks beyond 3G. This project will research, prototype and evaluate an extendable overlay architecture and framework to support, easy and quick service creation, test and deployment of intelligent mobile communication and information services. Building on significant advances in IT technologies, the SPICE platform will support multiple heterogeneous execution platforms allowing for new, innovative services to be spread across different operator domains and over different countries realizing a variety of business models.
https://cordis.europa.eu/project/rcn/80707_en.html
Passepartout
Passepartout [EU EUREKA ITEA Project]
November 2005 - June 2007
PASSEPARTOUT focused on bringing tailored high-definition (HD) media content into the lives of the family. Results not only help to make sense of the input available but also to select, filter, scale and schedule HD content for presentation in the best possible way in the networked home on multiple large and small display devices. Work included seamless integration into home media centers and networks, with smart graphic displays controlling systems operation and interactive contents packaging.
https://itea3.org/project/passepartout.html
