Media Production, Consumption and Sharing

Technological advances are resulting in a complex media ecosystem, in which streaming media can reach a variety of end-devices using a heterogeneous set of delivery methods. Such development allows ubiquitous media consumption, where users consume digital content via a connected ecosystem of devices, whenever they want and wherever they are. Still many challenges remain at the production, distribution, and user levels. The group is developing novel mechanisms for group-based consumption, enriching, and sharing of media content. This results in research breakthroughs such as the use of AI and immersive media technologies for improving the way audiences experience media and cultural heritage production tools for facilitating “on demand” temporal media-based compilations for multi-screen consumption of media, communication infrastructures that enable rich media-based shared experiences, optimization algorithms for ubiquitous rendering of media based on the user context and intention, and seminal works on secondary screens and social TV.

Topics

• AI-based tools and technologies for the creation, distribution and consumption of news and media;
• Production workflows in the area of digital humanities, for providing enriched access to cultural collections and heritage, and enabling social transformation;
• Object-based production platforms for developing and deploying immersive and interactive multi-screen productions;
• Socially-aware multimedia authoring for empowering end-users to create and share media based on storytelling principles;
• Multimedia systems support for social interaction between remote participants in small (multi-party and domestic video conferencing) and large (distributed theatre) mediated communication scenarios;
• Definition of languages (e.g. SMIL) for the coordinated presentation of temporal objects within container documents. This includes the modeling of user interaction and metadata

Funding

• AI, Media and Democracy Lab
• MediaScape
• TRACTION
• 2-IMMERSE
• Vconect
• TA2
• iNEM4U
• SPICE
• Passepartout
• BRICKS

Videos

• MediaScape XR: https://youtu.be/zzB7B6EAU9c
• Object Based Broadcasting Production Tools: https://www.youtube.com/watch?v=sueyA-D3MOo
• Dick Bulterman on Media Annotation: https://www.youtube.com/watch?v=wwoSTJo1LeU

Software and Datasets

• 2-IMMERSE
• Ambulant Player
• MDCS

Publications

• A. Striner, A. Webb, J. Hammer, A. Cook Mapping Design Spaces for Audience Participation in Game Live Streaming. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2021), Yokohama, JP, 2021.
  
  DOI10.1145/3411764.3445511 
• H. Rivas Pagador, A. Dominguez, S. Masneri, I. Tamayo, M. Zorrilla, P. Almeida, J. Li, A. Striner, P. Cesar Co-creation Stage: A Web-based Tool for Collaborative and Participatory Co-located Art Performances. In Proceedings of ACM International Conference on Interactive Media Experiences (IMX 2021), New York, NY, USA, 2021.
  
  DOI10.1145/3452918.3465483 
• T. Röggla, J. Li, S. Fjellsten, J. Jansen, I. Kegel, L. Pilgrim, M. Trimby, D. Williams, and P. Cesar From the Lab to the OB Truck: Object-based Broadcasting at the FA Cup in Wembley Stadium. In Extended Abstracts of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI), Glasgow, UK, 2019. pp. 1-8.
  
  DOI10.1145/3290607.3299038 
• Best Paper
  J. Li, T. Röggla, M. Glancy, J. Jansen, and P. Cesar A New Production Platform for Authoring Object-based Multiscreen TV Viewing Experiences. In Proceedings of the ACM International Conference on Interactive Experiences for Television and Online Video (ACM TVX 2018), Seoul, South Korea, 2018. pp. 115-126.
  
  DOI10.1145/3210825.3210834 
• M. Montagud, P. Cesar, F. Boronat, J. Jansen MediaSync: Handbook on Multimedia Synchronization. Handbook on Multimedia Synchronization, Springer-Verlag, 2018, ISBN: 978-3-319-65839-1
  
  DOI10.1007/978-3-319-65840-7 
• M.O. van Deventer, H. Stokking, M. Hammond, J. Le Feuvre, and P. Cesar Standards for Multi-stream and Multi-device Media Synchronization. IEEE Communications Magazine, 54(3): pp. 16-21, 2016 .
  
  DOI10.1109/MCOM.2016.7432166 
• M. Obrist, P. Cesar, D. Geerts, T. Bartindale, and E.F. Churchill Online Video and Interactive TV Experiences. ACM Interactions, 22(5): pp. 32-37, 2015 .
  
  DOI10.1145/2799629 
• D. Williams, P. Cesar, M.F. Ursu, I. Kegel, J. Jansen, and E. Geelhoed Experiments with Distributed Theatre. IEEE MultiMedia (IEEE MM), 22(3): pp. 4-9, 2015 .
  
  DOI10.1109/MMUL.2015.65 
• D.C.A. Bulterman, P. Cesar, and R.L. Guimaraes Socially-aware Multimedia Authoring: Past, Present, and Future. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 9(1s): pp. , 2013 .
  
  DOI10.1145/2491893 
• J. Jansen, P. Cesar, D.C.A. Bulterman, T. Stevens, I. Kegel, and J. Issing Enabling Composition-Based Video-Conferencing for the Home. IEEE Transactions on Multimedia, 13(5): pp. 869-881, 2011 .
  
  DOI10.1109/TMM.2011.2159369 
• R.L. Guimaraes, P. Cesar, D.C.A. Bulterman, V. Zsombori, and I. Kegel Creating Personalized Memories from Social Events: Community-Based Support for Multi-Camera Recordings of School Concerts. In In Proceedings of the ACM Multimedia Conference (MM'11), Scottsdale, AZ, USA, 2011. pp. 303-312.
  
  DOI10.1145/2072298.2072339 
• P. Cesar, D.C.A. Bulterman, J. Jansen, D. Geerts, H. Knoche, and W. Seager Fragment, Tag, Enrich, and Send: Enhancing the Social Sharing of Videos. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 5(3): pp. 1-27, 2009 .
  
  DOI10.1145/1556134.1556136 
• J. Jansen, and D.C.A Bulterman SMIL State: an architecture and implementation for adaptive time-based web applications. International Journal on Multimedia Tools and Applications, 43(3): pp. 203, 2009 .
  
  DOI10.1007/s11042-009-0270-3 
• P. Cesar, D.C.A. Bulterman, and J.A. Jansen Usages of the Secondary Screen in an Interactive Television Environment: Control, Enrich, Share, and Transfer Television Content. In European Conference on Interactive Television (EuroITV), Salzburg, Austria, 2008. pp. 168-177.
  
  DOI10.1007/978-3-540-69478-6_22 

Standards

• SMIL

Theses

• Mario Montagud Climent, Design, Development and Evaluation of an Adaptive RTCP-based IDMS Solution, Universidad Politecnica de Valencia, Spain. PhD Thesis, 2015.
• Rodrigo Laiola Guimaraes, Socially-Aware Multimedia Authoring, Vrije Universiteit Amsterdam, The Netherlands. PhD Thesis, 2014.
• Ishan Vaishnavi, Coherence in Synchronous Shared Experiences, Vrije Universiteit Amsterdam, The Netherlands. PhD Thesis, 2011.