Best Practices for End-to-End Workflow Monitoring

Project Status:

Stage 1

Start:

October 1, 2019

Estimated Completion:

July 1, 2020

Share this page:

Share on facebook
Share on twitter
Share on linkedin
Share on email
Share on print

Problem Statement

The streaming video workflow is a complex system of multiple technologies and components. Up until now, much of the emphasis on understanding the performance of streaming video has centered around the quality-of-experience of the viewer. But that does not paint a clear picture of where delivery and other issues may occur within the workflow. It’s critical to understand all of the performance data throughout the different systems and components in order to have a holistic picture of performance.

Project Description

There has been an increasing consensus in the streaming video industry that the design and operation of the entire video workflow needs to be driven by quality assurance and quality controls at points throughout the delivery chain. In this document, we propose best practices for end-to-end workflow monitoring to provide a clear picture to stakeholders (network operation center agents, operation engineers, video delivery architects, managing executives, content owners, and content providers) about potential factors that impact a consumer’s streaming experience. The document will then offer recommendations for a framework which provides end-to-end monitoring and improved failure detection in order to enhance overall quality as well as increase customer retention and resulting market share.

Current Document

Best Practices for End-to-End Workflow Monitoring

As the video streaming industry continues to mature, QoE expectations continue to rise in importance both as a value proposition to the consumer as well as a differentiator between competing video streaming services. Yet, consistent, systematic, standardized, objectively measured, and business-rules-driven QoE assurance continues to be an elusive goal. This document outlines factors that impact consumer QoE, sheds light on some of the underlying challenges to diagnosing QoE impact and provides a set of best practices for end-to-end QoE monitoring in video streaming workflows.

Goals and Objectives

The goals and objectives of this project include:
  • Creating a re-usable framework for measuring and assessing the end-to-end performance of a streaming video workflow
  • Providing recommendations regarding the measurement of individual components or technologies within the framework

Project Scope

The document produced by this project WILL PROVIDE:
  • An end-to-end workflow monitoring framework which addresses live content workflows, Internet Protocol television (IPTV), and over-the-top (OTT) systems from video streaming sources to device output for a variety of operational use cases
  • Recommendations of measurement thresholds for each component included in the framework
  • Recommendations for improving performance of each component included in the framework
The document produced by this project WILL NOT PROVIDE:
  • Recommendations of specific vendor solutions or technologies for measuring component within the framework
  • Recommendations or discussions for any component not identified as part of the framework

Contributors

The following members have contributed to this project. Click on their name to visit their profile. If the have not published their profile, the link will redirect to their LinkedIn profile.

Additional References

There are no additional references or other required readings need to participate in this project.

Working Group Presentations

The following presentations delivered during Measurement/QoE working group sessions may provide additional information about this project.
Scroll to Top