This page provides all the information related to Design Module 3 - VCU TRD Multi stream Audio-Video design.
Table of Contents
| Table of Contents | ||
|---|---|---|
|
1 Overview
The primary goal of this Design is to demonstrate the capabilities of VCU hard block present in Zynq UltraScale+ EV devices with soft audio codec. The TRD will serve as a platform to tune the performance parameters of VCU and arrive at optimal configurations for encoder and decoder blocks with audio-video synchronization.
This design supports the following video interfaces:
Sources:
- HDMI-Rx capture pipeline implemented in the PL.
- MIPI CSI-2 Rx capture pipeline implemented in the PL.
- File source (SD card, USB storage, SATA hard disk).
- Stream-In from network or internet.
Sinks:
- DP Tx display pipeline in the PS.
- HDMI-Tx display pipeline implemented in the PL.
VCU Codec:
- Video Encode/Decode capability using VCU hard block in PL
- AVC/HEVC encoding.
- Encoder/decoder parameter configuration.
Streaming Interfaces:
- 1G Ethernet PS GEM
Video format:
- NV12
Audio Configuration:
- Codec: AAC
- Format: S24_32LE
- Channel: 2
- Sampling rate: 48kHz
- Source: HDMI-Rx/ I2S-Rx
- Renderer: HDMI-Tx/ I2S-Tx/DP
Audio Deliverables:
| Pipeline | Video Input source | Audio Input Source | Video Output Type | Audio Output Type | ALSA drivers | Resolution | Audio Codec Type | Audio Configuration | Video encode/Decoder type | Deliverables |
Record/Stream-Out pipeline | 1.HDMI-Rx | 1.HDMI-Rx 2.I2S-Rx | File-Sink Stream-Out | File-Sink Stream-Out | HDMI-Rx ALSA drivers | 4K/1080p | AAC | 2 channel @ 48 kHz | HEVC/AVC | HDMI Rx Audio encode with soft codec and video with VCU and store it in a container format. |
Playback pipeline | File Source/ Stream-In | File Source/ Stream-In | DP HDMI –Tx | 1.HDMI-Tx 2.I2S-Tx 3. DP | HDMI-Tx ALSA drivers | 4K/1080p | AAC | 2 channel @ 48 kHz | HEVC/AVC | Playback of the local-file/stream-in with video decoded using VCU and Audio using GStreamer soft codec. |
Capture--> Display | 1.HDMI-Rx | 1.HDMI-Rx 2.I2S-Rx | DP HDMI -Tx | 1.HDMI-Tx 2.I2S-Tx 3. DP | HDMI-Rx/Tx ALSA drivers | 4K/1080p | NA | 2 channel @ 48 kHz | HEVC/AVC | HDMI Rx Audio /Video pass to HDMI-Tx without VCU/Audio-Codec. |
Capture--> Encode--> Decode--> Display | 1.HDMI-Rx | 1.HDMI-Rx 2.I2S-Rx | DP HDMI -Tx | 1.HDMI-Tx 2.I2S-Tx 3. DP | HDMI-Rx/Tx ALSA drivers. | 4K/1080p | NA | 2 channel @ 48 kHz | HEVC/AVC | HDMI Rx raw audio and video with VCU encoder and decode to achieve AV sync. |
...