Follow us on: GitHub YouTube Twitter

Virtual Reality and Immersive Media

Virtual Reality (VR) and 360 video are reshaping the media landscape, changing our daily lives and the way we interact with each other. They are creating a fertile business environment, enabling new social and interactive VR formats, where viewers connect more empathically with the content and with others. The combination of photorealistic capture techniques and immersive displays result in a new set of research challenges. In particular, DIS focuses on novel strategies for compression and transmission of real-time reconstructed 3D data in Internet infrastructures, and on the objective and subjective evaluation of such technologies. Our work, partly distributed as open source, has led to the start of a consumer industry standardization activity in Moving Picture Experts Group (MPEG) on point cloud compression, serving as the basis to generate the anchors included in the recent call for proposals. All these activities and results position DIS as a leading expert on immersive media technologies and QoE evaluation.

Read more

Experience Aware Networking

Experience Aware Networking leverages novel network paradigms (i.e. Software Defined Networking) and the state-of-the-art of Quality of Experience (QoE) research to optimize the experience of users in adaptive media applications. Video is already the #1 traffic source in the Internet and new services are emerging rapidly, such as VR or AR. As a consequence, networks suffer from bottlenecks due too heavy traffic loads, too many users, or a combination of both. Current network resource allocation techniques, such as bitrate-fairness or client-based adaptation algorithms, do not translate in overall user experience optimization. We create QoE-aware models, optimization algorithms, and software prototypes with the aim of understanding how these applications scale and how network resources can be managed to improve the QoE of users.

Read more

Social IoT and Smart Textiles

We live in a society based on experiences. Whether we look at a commercial for a holiday destination or interact with social media, the consumer experience plays a crucial role in our behavior. Yet, it is surprising to see how little it is actually known about how consumers value these experiences. The high-end technical solutions for shaping experiences sharply contrast with the rather conventional mechanisms used to measure them. DIS explores the use of smart textiles and wearable sensors as a source for collecting reliable and quantified data about everyday life experiences. In particular, we are interested on better understanding social IoT in the environment of smart cities. Based on realistic testing grounds, collaborating with several commercial and academic partners, we have deployed our technology and infrastructure in places such as the National Theatre of China in Shanghai and the Amsterdam Dance Event in the Netherlands. Our approach is to seamless connecting fashion and textiles with sensing technology, and with the environment. The final objective is to create intelligent and empathic systems that can react to the audience and their experience.

Read more

Multi-Screen Media Production, Consumption and Sharing

Technological advances are resulting in a complex media ecosystem, in which streaming media can reach a variety of end-devices using a heterogeneous set of delivery methods. Such development allows ubiquitous media consumption, where users to consume digital content via a connected ecosystem of devices, whenever they want and wherever they are. Still many challenges remain at the production, distribution, and user levels. DIS is developing novel mechanisms for group-based consumption, enriching, and sharing of media content. This results in research breakthroughs such as production tools for facilitating “on demand” temporal media-based compilations for multi-screen consumption of media, optimization algorithms for ubiquitous rendering of media based on the user context and intention, and seminal works on secondary screens and social TV.

Read more

Quality of Experience

In Quality of Experience (QoE) we want to understand how the quality of a system or service affects the experience of users. When does a long delay in tele-communication disrupt the conversation and when do we not even notice at all? How much bandwidth does a videostream need that we really feel we are getting a better quality? It turns out, to understand the experience of users, taking personal and situational factors into account is as important as the actual quality of the system. Media consumption has become a ubiquitous part of life and if we want to optimize our systems understanding the interplay of situation, personality and system quality is a key requirement.

Read more

Connected Shared Experiences

Multimedia systems support for social interactions between remote participants in small (multi-party and domestic video conferencing) and large (distributed theatre) mediated communication scenarios.

Read more

Digital publishing

The mission of the recently formed Publishing Working Group (https://www.w3.org/publishing/groups/publ-wg/) from W3C (https://www.w3.org) is to enable all publications — with all their specificities and traditions — to become first-class entities on the Web. The WG will provide the necessary technologies on the Open Web Platform to make the combination of traditional publishing and the Web complete in terms of accessibility, usability, portability, distribution, archiving, offline access, and reliable cross-referencing. A Web Publication is considered as a collection of (Web) resources, organized together through a manifest into a single logical work with a default reading order. Ivan Herman from CWI has played a seminal role in the creation of this new activity, and is now part of the technical leadership and the management of this activity, in cooperation with core players of the Web as well as the publishing industries.

Read more

Web technologies at W3C

It is not an exaggeration to say that the Web has become an essential part of modern society. The presence of researchers has always been seen as essential in the development of the Web and CWI is proud to have contributed actively to this evolution. CWI has been active in the development of HTML, CSS, SMIL, RDF, RDFa, XForms, OWL, R2RML, SPARQL and many more. Beyond the participation in the relevant Working Groups, members of the DIS group have also acted as Working Group (co-)chairs, as well as activity leads for HTML and the Semantic Web within W3C. Current activities concentrate on the further development of the XForms standard, designing declarative techniques for representing functionality in network-based documents, and applying web-related methods to managing the Internet of Things.

Read more

Socially-Aware Multimedia Authoring

Facilitating ‘on demand’ temporal compilations based on the dynamic and time-variant constraints for the social sharing of personal media and storytelling.

Read more

Modeling Time in Multimedia Documents

Defining languages for the coordinated presentation of temporal objects within container documents. This includes the modeling of user interaction and of metadata.

Read more