Conviva at Inter BEE 2017
- 1. 1 ©2017 Conviva. All Rights Reserved.
Measurement & Analytics for the Next Gen TV
“How to realize broadcast quality
with Internet video delivery?”
Olivier Wellmann, VP Product Management
Conviva’s Video AI Platform
- 3. 3 ©2017 Conviva. All Rights Reserved.
Critical To Engagement
Source: Conviva, “2015 Consumer Survey Report”
-3
-8
-11
-14
-16
2011 2012 2013 2014 2015
Engagement Reduction (in minutes)
with 1% increase in buffering
minutes
minutes
minutes
minutes
A 1% change in
quality of experience
can decrease video
views by 16 minutes
minutes
- 4. 4 ©2017 Conviva. All Rights Reserved.
INTROHow & Why?
Monitoring QoE & Audience Engagement is a Critical Priority as the
OTT Market Matures
When Problems Arise, Quickly Identifying Root Cause is the Biggest
Challenge
Publishers Monitoring Services Need the Right Quantity & Quality of
Alerts
Automation and Artificial Intelligence Helps Publishers Improve and
Optimize
- 5. 5 ©2017 Conviva. All Rights Reserved.
Leaders and Innovators
AVODSVODInfra
ITALIA UK
Liberty
Global
Liberty
Global
SKY SKY SKY
FOX
FOX FOX FOX NBC NBC NBC NBC NFL NFL
Turner Turner Turner Turner
HBO HBO HBO HBO HBO
Liberty
Global
NBC
Turner
- 6. 6 ©2017 Conviva. All Rights Reserved.
Video AI Architecture
VIDEO SENSOR VIDEO AI PLATFORM
ALL VIDEO
METRICS
AND METADATA
MEASUREMENT
AND
ANALYTICS
PRODUCTS & APIs
- 7. 7 ©2017 Conviva. All Rights Reserved.
Scale Of Deployment
14B+
Streaming Hours/Year
3B+
Devices/Year
180+
Countries
3M
Events/Sec
all
Global CDNs
1200+
Global ISPs
2100+
Video App Types
- 8. 8 ©2017 Conviva. All Rights Reserved.
What Exactly Do We Collect?
QoE
Metrics
Audience
Engagement
Content
Metadata
Infrastructure
Metadata
Average Bitrate Minutes per Play Asset name CDN
Bandwidth Plays Genre ASN
Concurrent Plays Top Content for Last 15 Minutes Length Error name
Concurrent Plays Map Top Content Summary Custom tags per stream City
Duration versus Average Bitrate Top Rising Content for Last 30 Minutes Channel / Site Device OS & version
Duration versus Play Rebuffering Ratio Total Attempts Show & season & episode App or player type
Ended Plays Total Ended Plays Viewer ID Device & client ID
Exits Before Video Start Total Unique Viewers Ad pod ID Screen size & resolution
Failures Unique Viewers … many more Browser & version
Rebuffered Plays Viewer Hours Device type & model
Rebuffering Ratio Pods Started Connection type & speed
Resource Quality Switches Pods Ended Geolocation
Video Start Failures Pods Completed
Video Start Saves Pods Abandoned
Video Startup Time Pods Actual Duration
Video Startup Time Distribution Pods/Ended Play
Wait Time Before Exit Pods/Unique Device
Pods Cumulative Duration
- 9. 9 ©2017 Conviva. All Rights Reserved.9 ©2017 Conviva. All Rights Reserved.
Essential Elements
There is a massive amount
of data that must be
processed in real time
Timely
Validate each metric,
enforce consistency,
and remove noise
Accurate
Use global data and
machine learning to make
the data actionable
Actionable
- 10. 10 ©2017 Conviva. All Rights Reserved.
Experience Insights
Provides a comprehensive view into your online
video business, enabling you to make critical
decisions that ensure the best viewing experience
- 11. 11 ©2017 Conviva. All Rights Reserved.
Issues Causing Churn in SVOD Businesses
$21.6B
2020 OTT SVOD
revenues
21%
of subs are
churning
Lack engaging content
Unavailable rights
Content protection issues
Interrupted Experience
Resolution issues
Device challenges
Mismatched consumer
expectations
$4.5B
CHURN
REPLACEMENT
COST
250M subs
Source: Global OTT TV & Video Forecasts Report (Digital TV Research) & Conviva projections
$4.5B of 2020 OTT SVOD revenues are at risk
- 12. 12 ©2017 Conviva. All Rights Reserved.
Real-Time Analysis of Quality Issues
One second granularity,
2 second updates
enables fast time-to-
resolution
Identify QoE
issues in real
time
Popularity of
concurrent plays
to enable fast
editorial
improvements
Top Content
Peak Concurrent Plays,
startup, playback, and
fidelity KPIs help track
content delivery issues.
Actionable
real-time KPIs
- 13. 13 ©2017 Conviva. All Rights Reserved.
Video AI Models
Artificial Intelligence
with Transfer Learning
PREDICTION
Prediction of system and user behavior
DETECTION
Real-time detection of “events of importance”
DIAGNOSIS
Recommended actions based on diagnostic
predictions and event detection
- 14. 14 ©2017 Conviva. All Rights Reserved.
Precision Delivery
Intelligence
Provides OTT providers the power to tailor and
optimize the viewing experience with automated
resource decisioning
- 15. 15 ©2017 Conviva. All Rights Reserved.
GLOBAL
DATA IN
Predictive Models &
Algorithms for Viewer
Engagement
Real-time
Ingest & Control
Real-time Big-data
Processing for Video
Data Validation
and Accuracy
FROM 2.5B
PLAYERS
All this data collected
into the Conviva Platform
CONVIVA PLATFORM
Precision Delivery Intelligence
ISP 1
POLICY ENGINE:
Cost & QoE
decisioning
Precision Delivery
Intelligence
CDN A
CDN B
CDN A
buffering
issue
- 16. 16 ©2017 Conviva. All Rights Reserved.
POLICY ENGINE:
Cost & QoE
decisioning
GLOBAL
DATA IN
Predictive Models &
Algorithms for Viewer
Engagement
Real-time
Ingest & Control
Real-time Big-data
Processing for Video
Data Validation
and Accuracy
FROM 2.5B
PLAYERS
Data collects into the
Conviva Platform
CONVIVA PLATFORM
Precision Delivery Intelligence
ISP 1
Precision Delivery
Intelligence
CDN B
CDN A
CDN A
switch
to CDN B
- 18. 18 ©2017 Conviva. All Rights Reserved.
• Conviva and Sky partnered to
delivering the highest OTT video quality
possible for Sky viewers while minimizing
CDN costs
• Conviva’s quality of experience (QoE)
analytics helped Sky discover a direct
correlation between viewer
engagement and buffering
• Sky realized that viewer engagement
dropped significantly when the
buffering ratio hit or exceeded
0.4%
Case Study
- 19. 19 ©2017 Conviva. All Rights Reserved.
In Sky case, Precision is configured to analyze real time data grouped by
the following dimensions:
• ISP, CDN, Live or VOD, Streaming Protocol
• For every minute, Precision Computes Buffering for example for:
• CDN a – ISP 1 - VOD HLS
• CDN b - ISP 1 - VOD HLS
• CDN c - ISP 1 - VOD HLS
Earlier this year there was an issue affecting Now TV viewers connected
through Sky’s primary CDN that caused a buffering spike and an increase
of terminated sessions.
Precision Setup and Situation
- 20. 20 ©2017 Conviva. All Rights Reserved.
Buffering Ratio
Time ISP 1 and CDN a ISP 1 and CDN b
12:00 AM 0.23 0.39
12:05 AM 0.21 0.3
12:10 AM 0.22 0.2
12:15 AM 0.21 0.05
12:20 AM 0.23 0.19
12:25 AM 4.7 0.15
12:30 AM 45.72 0.32
12:35 AM 8.67 0.17
12:40 AM 0.85 0.19
12:45 AM 0.7 0.14
12:50 AM 0.58 0.19
12:55 AM 0.56 0.18
1:00 AM 0.37 0.22
- 21. 21 ©2017 Conviva. All Rights Reserved.
Total Attempts
Time ISP 1 and CDN A ISP 1 and CDN B
12:00 AM 1470 101
12:05 AM 1359 101
12:10 AM 1334 96
12:15 AM 1252 87
12:20 AM 1196 86
12:25 AM 1111 117
12:30 AM 1345 3035
12:35 AM 102 1324
12:40 AM 523 541
12:45 AM 930 64
12:50 AM 964 70
12:55 AM 871 57
1:00 AM 971 66
- 22. 22 ©2017 Conviva. All Rights Reserved.
Total Attempts
Sky receives a periodic blacklisting log which shows exactly what CDN was blacklisted, where (delivery pattern)
and why (QoE metrics). This is the extract from this incident:
ISP X
ISP X
ISP X
ISP X
ISP X
ISP
ISP X
ISP X
ISP X
ISP X
ISP X
ISP X
ISP X
- 23. 23 ©2017 Conviva. All Rights Reserved.
CDN Outage – AI Alerts
AI Alerts detected and reported the issue for several Conviva customers. For the
customers with a Multi CDN strategy powered by Precision, the service was
automatically restored.
- 24. 24 ©2017 Conviva. All Rights Reserved.
Experience Benchmarks
Empowers customers to understand global OTT best
practices, compete in local regions, and seize
future market opportunities
- 25. 25 ©2017 Conviva. All Rights Reserved.
Experience Benchmarks
Enable what-if scenario planning to achieve targeted KPI
at country & state level compared to industry data
- 26. 26 ©2017 Conviva. All Rights Reserved.
Subscriber Intelligence
Provides SVOD providers the intelligence to acquire,
manage, and grow their subscription business
- 27. 27 ©2017 Conviva. All Rights Reserved.
DATA
• Video start
• Bit rate
• Buffering
• Engagement
Automated
Data Feed
Process – Cleanse - Analyze
Subscribers
Subscriber Marketing
Conviva Platform
Identify quality-impacted subscribers
Subscriber
Intelligence
• In App Messages
• Marketing Automation
• Customer Care
Customer touch
data
Optimize thresholds based on
continuing analysis
Subscriber Intelligence
- 28. 28 ©2017 Conviva. All Rights Reserved.
Customer Care
Intelligence
Provides OTT providers the timely and actionable
insights to proactively detect root cause of customer
issues and accelerate time to resolution
- 29. 29 ©2017 Conviva. All Rights Reserved.
Customer
Care API
Integration with Your Dashboards
Your Customer Care
Dashboard
CONSUMPTION DATA:
• Engagement data by asset, type,
genre and other custom
dimensions
• Identify issues using engagement &
QoE benchmarks
• Set alerts using viewer KPI
thresholds
QoE OVERVIEW:
• View multiple QoE metrics
across many dimensions
• Benchmark against regional
and/or subscriber class peer
groups
• Quickly uncover issues using
real-time data
GLOBAL
DATA IN
Predictive Models &
Algorithms for Viewer
Engagement
Real-time
Ingest & Control
Real-time Big-data
Processing for Video
Data Validation
and Accuracy
QoE
ANALYTICS
OUT
CONSUMER VIDEO
EXPERIENCE
- 31. 31 ©2017 Conviva. All Rights Reserved.
Things to Remember
• Robust ‘Big Data” Platform for the Next Generation TV
– A lightweight continuous measurement sensor combined with a real-
time cleansing, and computation thanks to the video AI platform
• Unique Global Data Set: Granular and Extremely Accurate
– 180+ countries, 10B+ streaming hours per year, 3M events per second,
1200 global ISPs, 3B+ devices per year…
• Unparalleled Artificial Intelligence and Optimization
– Industry-leading AI modeling: Leverage continuous improvement to
increase prediction accuracy for QoE, content, users, and devices