ShapeShiftedTV Tutorial
Definition. ShapeShiftedTV denotes programmes that adapt their content, on the fly, to suit the preferences of the viewer. “On the fly” refers to the main trait of this approach, namely that programmes are automatically edited at the time of delivery to reflect the choices of their viewers. If the delivery medium is broadband, then ShapeShiftedTV can address an audience of one – a ShapeShiftedTV programme can be a unique experience for each individual viewer. ShapeShiftedTV programmes are made primarily with recorded audio-visual material, but may include graphics and animation. Well defined fragments of the media content – i.e. “media items” representing micro-narratives – are the building blocks of the programmes. They are organised, by the programme makers, into structures that specify their place and role within the story/programme. Through them, the programme is automatically shaped at viewing time, such that cogent and sensible narrative strands are produced dynamically according to the preferences of the engagers.
Context. ShapeShiftedTV was created as a result of the IST Framework 6 collaborative research and development project NM2: new millennium, new media (www.ist-nm2.org). NM2 is about creating a new media genre using all of the facilities of modern broadband communication and interactive terminals. The project has created new production tools for the media industry that will allow the easy production of ShapeShiftedTV programmes. Eight individual NM2 productions for broadband delivery, ranging across news, documentary and fiction, will demonstrate the possibilities for the new media genre – and the tutorial will showcase several of these. NM2 unites leading creative and technology experts from across Europe. Its 13 partners bring together film schools and production houses, media and content researchers and consumer behaviour and business analysts.
Aim and Themes. This tutorial introduces the main aspects of ShapeShiftedTV and the thinking behind it. The main themes include:
- principles and narrative grammars for interactive and reconfigurable storytelling
- interaction between technologists and content producers in the research process
- the architecture of the NM2 software system that supports ShapeShiftedTV
- new media production workflows which facilitate the production of ShapeShiftedTV.
- aspects
pertaining to computational representations of ShapeShiftedTV programmes,
including:
- representing a “story world” – the narrative space of a programme
- metadata annotations and ontologies
- operational representation schemes and reasoning
- aspects pertaining to the testing and evaluation of ShapeShiftedTV programmes
- the NM2 Production Tools (a component of the NM2 software)
- aspects
pertaining to the delivery of ShapeShiftedTV programmes, including:
- the use of SMIL and Microsoft’s XTL to create dynamic playlists
- techniques for the just-in-time composition of multi-layer audio and video streams
- encapsulating the video stream in an intelligent user interface which enables the viewer to interact and adapt the programme
- the NM2 Delivery System (a component of the NM2 software)
- potential business opportunities and pitfalls for ShapeShiftedTV productions.
Delivery. The tutorial will be delivered as a series of interactive sessions organised to include the themes listed above. Each session will have two parts:
- an overview presentation of the theme, followed by questions and answers
- discussion along open issues
The presentations will be accompanied by comprehensive software demonstrations and illustrations with NM2 production fragments. A final session is reserved for the isues selected for further consideration from the thematic sessions and for concluding remarks.
Target Audience. The tutorial is suitable to both researchers and practitioners in the field of Interactive TV. It balances the “what” with the “how” questions: “what is the thinking behind ShapeShiftedTV and what are the features of the NM2 software” and “how are the features of the NM2 software implemented”.