SlideShare a Scribd company logo
Television Linked To The Web
www.linkedtv.eu
Lyndon Nixon, MODUL University Vienna GmbH
Raphael Troncy, EURECOM
Johan Oomen, Sound and Vision
Towards New Media Applications with
Linked Media – using the LinkedTV
project toolset
18 May 2015 LiME Workshop WWW2015
2
www.linkedtv.eu
What is Linked Media?
1. Web media descriptions need a common representation
of media structure
2.2. Web media descriptions need a common representationWeb media descriptions need a common representation
of media contentof media content
3.3. Web media descriptions need to use a media ontologyWeb media descriptions need to use a media ontology
which supports description of both the structure andwhich supports description of both the structure and
content of mediacontent of media
4.4. The descriptions of media in terms of common representations ofThe descriptions of media in terms of common representations of
structure and content are the basis for deriving links acrossstructure and content are the basis for deriving links across
media on the Web (Linked Media)media on the Web (Linked Media)
3
www.linkedtv.eu
LinkedTV: background
40% of TV viewers are using a companion
device alongside the TV program.*
* J. Abreu, P. Almeida, B. Teles, and M. Reis. Viewer behaviors and practices in the (new)
television environment. In Proceedings of the 11th European Conference on Interactive TV
and Video, EuroITV '13.
http://www.linkedtv.eu
Ever saw something
on TV and wanted to
know more about it,
but didn‘t even know
how to search for it?
4
www.linkedtv.eu
LinkedTV: applications
Scenario 1:
LinkedNews app
 Easy access to
background to the news
 Focus on key concepts of
interest in each item
 hbbTV single screen and
dual screen apps
Scenario 2:
LinkedCulture app
 Easy access to
information on the art
objects discussed in the
program
 Secondary screen-
orientation, cast TV
program to main screen
LinkedNews demo:
https://vimeo.com/1062
LinkedCulture
demo:
https://vimeo.com/1088
5
www.linkedtv.eu
LinkedTV technology
“...schilderij van Jan Sluijters....”
Video object and
word detection
dbpedia.org/resource/Jan_Sluyters
Connection to
concepts
Paintings by Jan Sluijters
Selection of
related concepts
Selection of
related content
Presentation
engine
6
www.linkedtv.eu
Annotation task: LinkedTV Ontology
Published at
http://www.linkedtv.eu/ontology
(Enquiries: r.troncy@eurecom.fr)
Annotation
Concept
Keyword
ANALYSIS RESULTS (Support for segmentation)
Ontology for
Media
Resources
(W3C)
Open Annotation
Core Data Model
EXTERNAL DATASETS
Entity
NERD
Provenance
Ontology for
Provenance
Management
Scene
Shot
MediaFragment
Face
7
www.linkedtv.eu
Annotation task: manual approaches
The LinkedTV Editor Tool code is open source (GNU GPL 3.0) -
https://github.com/linkedtv/editortool
A test installation can be used at http://editortoolv2.linkedtv.eu/trial
(Enquiries: jblom@beeldengeluid.nl)
8
www.linkedtv.eu
Annotation storage: LinkedTV Platform
LinkedTV Platform demo video https://vimeo.com/107047604
Further information & test access contact rolf.fricke@condat.de
9
www.linkedtv.eu
Annotation retrieval: Platform SPARQL endpoint and
REST API
Survey of Semantic Media Annotation Tools for the Web:
Towards new Media Applications with Linked Media
LinkedTV Platform SPARQL endpoint https://data.linkedtv.eu/sparql
Further information & test access to add your own content:
contact rolf.fricke@condat.de
10
www.linkedtv.eu
Examples
Annotate videos by chapter in the Editor Tool
Query the metadata on the LinkedTV Platform
Try out some media linking via DBPedia paths!
-----------------------------------------------------------------
Want more LinkedTV?
•http://showcase.linkedtv.eu
•lyndon.nixon@modul.ac.at
•@linkedtv

More Related Content

LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)

  • 1. Television Linked To The Web www.linkedtv.eu Lyndon Nixon, MODUL University Vienna GmbH Raphael Troncy, EURECOM Johan Oomen, Sound and Vision Towards New Media Applications with Linked Media – using the LinkedTV project toolset 18 May 2015 LiME Workshop WWW2015
  • 2. 2 www.linkedtv.eu What is Linked Media? 1. Web media descriptions need a common representation of media structure 2.2. Web media descriptions need a common representationWeb media descriptions need a common representation of media contentof media content 3.3. Web media descriptions need to use a media ontologyWeb media descriptions need to use a media ontology which supports description of both the structure andwhich supports description of both the structure and content of mediacontent of media 4.4. The descriptions of media in terms of common representations ofThe descriptions of media in terms of common representations of structure and content are the basis for deriving links acrossstructure and content are the basis for deriving links across media on the Web (Linked Media)media on the Web (Linked Media)
  • 3. 3 www.linkedtv.eu LinkedTV: background 40% of TV viewers are using a companion device alongside the TV program.* * J. Abreu, P. Almeida, B. Teles, and M. Reis. Viewer behaviors and practices in the (new) television environment. In Proceedings of the 11th European Conference on Interactive TV and Video, EuroITV '13. http://www.linkedtv.eu Ever saw something on TV and wanted to know more about it, but didn‘t even know how to search for it?
  • 4. 4 www.linkedtv.eu LinkedTV: applications Scenario 1: LinkedNews app  Easy access to background to the news  Focus on key concepts of interest in each item  hbbTV single screen and dual screen apps Scenario 2: LinkedCulture app  Easy access to information on the art objects discussed in the program  Secondary screen- orientation, cast TV program to main screen LinkedNews demo: https://vimeo.com/1062 LinkedCulture demo: https://vimeo.com/1088
  • 5. 5 www.linkedtv.eu LinkedTV technology “...schilderij van Jan Sluijters....” Video object and word detection dbpedia.org/resource/Jan_Sluyters Connection to concepts Paintings by Jan Sluijters Selection of related concepts Selection of related content Presentation engine
  • 6. 6 www.linkedtv.eu Annotation task: LinkedTV Ontology Published at http://www.linkedtv.eu/ontology (Enquiries: r.troncy@eurecom.fr) Annotation Concept Keyword ANALYSIS RESULTS (Support for segmentation) Ontology for Media Resources (W3C) Open Annotation Core Data Model EXTERNAL DATASETS Entity NERD Provenance Ontology for Provenance Management Scene Shot MediaFragment Face
  • 7. 7 www.linkedtv.eu Annotation task: manual approaches The LinkedTV Editor Tool code is open source (GNU GPL 3.0) - https://github.com/linkedtv/editortool A test installation can be used at http://editortoolv2.linkedtv.eu/trial (Enquiries: jblom@beeldengeluid.nl)
  • 8. 8 www.linkedtv.eu Annotation storage: LinkedTV Platform LinkedTV Platform demo video https://vimeo.com/107047604 Further information & test access contact rolf.fricke@condat.de
  • 9. 9 www.linkedtv.eu Annotation retrieval: Platform SPARQL endpoint and REST API Survey of Semantic Media Annotation Tools for the Web: Towards new Media Applications with Linked Media LinkedTV Platform SPARQL endpoint https://data.linkedtv.eu/sparql Further information & test access to add your own content: contact rolf.fricke@condat.de
  • 10. 10 www.linkedtv.eu Examples Annotate videos by chapter in the Editor Tool Query the metadata on the LinkedTV Platform Try out some media linking via DBPedia paths! ----------------------------------------------------------------- Want more LinkedTV? •http://showcase.linkedtv.eu •lyndon.nixon@modul.ac.at •@linkedtv

Editor's Notes

  1. Fragment media assets (since a consumer may be interested in only a part of a larger asset) Annotate those fragments (so that media retrieval can be at the fragment level) With Linked Data concepts (so programs can access metadata about any concept in an annotation and have a shared understanding of the semantics of the annotation) And use the Links in Linked Data to derive Links between Annotated Media.
  2. Space for Editor Tool: automated annotation can be inaccurate, process allows for editor checking and correcting annotations, use of named graphs/LinkedTV Ontology to maintain provenance information between automated and curated annotations in the media metadata