ICoSOLE EU FP7 reseach Project
bitmovin GmbH is from October 2013 one of the seven companies involved in the research project ICoSOLE, which target is to develop a platform for a context-adapted hybrid broadcast-Internet service, funded by European Union Seventh Framework Program(FP7).
Immersive Coverage of Spatially Outspread Live Events (ICoSOLE) was established in October 2013 when the first meeting to kick off the project was held by seven founding companies: bitmovin GmbH, JOANNEUM RESEARCH, Deutsche Thomson OHG, Vlaamse Radio- en Televisieomroeporganisatie NV, iMinds, British Broadcasting Corporation (BBC) and Tools at Work Hard+Soft Vertriebsgmbh (TaW).
ICoSOLE aims at enabling users to experience live events that are spatially spread out, such as festivals, parades, marathons or bike races, in an immersive way by combining high-quality video and audio and user generated content. The project will develop a platform for providing efficient tools for capturing, producing and distributing audiovisual content captured by a heterogeneous set of devices spread over the event site. The approach uses a variety of sensors, ranging from mobile consumer devices over professional broadcast capture equipment to panoramic and/or free-viewpoint video and spatial audio.
The project team will research real-time capable algorithms for automatic and reference-free assessment of the quality of video streams originating from low quality devices and from suboptimal capture conditions (hand-held cameras, insufficient lighting). Therefore, a key challenge in ICoSOLE is to achieve robust matching among user generated content items and between user generated and professional content items, while still keeping the approach scalable.
Technically, ICoSOLE will research and develop a spatiotemporal video navigation, distribution and presentation environment providing a user experience comparable to photosynth, but exceeding it in the following areas:
- video of dynamic events is organized rather than photographs of static scenery and a time line is added as a fourth dimension in addition to 3D spatial navigation in video-on-demand.
- professional broadcast and virtual cameras are integrated, as well as user contributed content, in real-time.
- a tool for conventional television production is provided, and for second screen, in addition to web.
- quality of UGC is ensured through use of metadata and automated Content analysis.
- a new spatial audio experience based on binaural reproduction is created, navigable just like the imagery.
Follow the project progress at http://icosole.eu
FP7 is the short name for the Seventh Framework Program for Research and Technological Development – EU’s main instrument for funding research in Europe during 2007-2013. FP7 is also designed to respond to Europe’s employment needs, competitiveness and quality of life. It bundles all research-related EU initiatives together under a common roof playing a crucial role in reaching the goals of growth, competitiveness and employment.