FAMIUM Streaming Media Test Suite

This module automates the testing of media players and content across real devices under varying network conditions. It ensures that ABR algorithms within players – such as Web/dash.js, hls.js, Shaka, Android/ExoPlayer, Apple/AVFoundation, Tizen, and WebOS-function optimally, enabling smooth playback across all bitrates in VoD and Live streams. The ABR Testbed uses Selenium/Appium to automate and schedule player tests, with results reported to a SAND/CMCD streaming analytics server and accessible via a detailed analytics dashboard.

The Content Conformance Validator by the DASH Industry Forum integrates flawlessly into the FAMIUM Streaming Media Test Suite. It is designed to ensure that your streaming content adheres to the latest industry standards and specifications. This powerful validator checks your media content against key standards such as DASH, HLS, and CMAF, ensuring that it performs as expected across all platforms and devices.

Key Features:

• Media Presentation Description (MPD) Validation: The validator thoroughly examines the MPD to ensure it is a well-formed XML file, properly structured according to the DASH schema. It also checks that MPD-level signaling is correctly implemented, guaranteeing that your media presentation is compliant and ready for smooth playback.
• Segment Validation: This feature dives into the media content referenced by the MPD, validating it at the container level. It ensures that each segment of your media is properly formatted and in line with the standards required for seamless delivery.
• Cross Validation: The tool performs a comprehensive cross-validation of MPD-level elements and attributes against the media content they signal. This ensures that the hierarchy and relationships between your content's components are correctly aligned, minimizing the risk of unexpected behavior during playback.

The Content Conformance Validator is aligned with a broad set of industry standards, including MPEG-DASH, ISO BMFF, DASH-IF IOP, CMAF, DVB-DASH, HbbTV, and CTA WAVE. By validating your content against these specifications, you can confidently deliver media that meets the highest standards of quality and compatibility, reducing the risk of playback issues and enhancing the overall streaming experience for your audience.

The Device Playback Capability and Web Media API Test Suite is an advanced tool designed to thoroughly test media playback across a wide range of devices and platforms, enhancing interoperability between applications and devices for seamless media presentation using web APIs. This suite focuses on validating compatibility and performance with modern streaming technologies, such as CMAF, MSE, and EME, ensuring that your content is accessible and functions flawlessly across different environments.

Key features:

• Mezzanine Content: This feature includes specially annotated video content available in various resolutions to facilitate automated testing and validation. The annotations includes green/red frames that signal the start and end of the video, rotating QR codes that provide information about the current visible video frame, and flashing squares with beeps to test simple A/V sync. Red triangles ensure that all content is visible, allowing for precise and thorough playback verification.
• CMAF Test Content: The suite includes a collection of encoded and validated CMAF test content, accompanied by additional metadata that describes media segments provided through a DASH MPD. The content is used to test the handling and playback of CMAF streams on different devices, ensuring that your media complies with the latest industry standards.
• HTML and JavaScript Tests: A comprehensive set of media playback tests are provided, following the algorithms documented in the CTA WAVE Device Playback Specification. These tests include Sequential Track Playback, Switching Set Playback, Buffer Underrun and Recovery, and many more. The suite allows for the easy generation of different combinations of HTML and JavaScript templates along with CMAF test content, enabling targeted and effective testing.
• Test Runner: The test suite includes an extended version of the test runner used in the open-source ‘Web Platform Tests’ project, tailored to simplify installation and use for a wider audience. This test runner enables automated testing on a variety of devices, including smart TVs and streaming sticks, where automated testing is typically complex or infeasible. It also features a companion Web UI and dashboard for configuring and monitoring test sessions, generating test reports, thus making the process user-friendly and efficient.
• Observation Framework: The suite includes an observation framework that records test sessions running on playback devices. This framework processes the recordings based on the embedded annotations, such as QR codes in the mezzanine content, and additional information provided by the test runner. This allows for detailed analysis, ensuring that any issues are identified and addressed promptly.