This page provides all the information related to Design Module 7 - VCU TRD Xilinx low latency(LLP2) PS DDR NV12 HDMI Audio Video Capture and Display design.
...
For PetaLinux related known issues please Refer to: PetaLinux 2023.1 - Product Update Release Notes and Known Issues
For VCU related known issues please Refer to AR# 76600: LogiCORE H.264/H.265 Video Codec Unit (VCU) - Release Notes and Known Issues and Xilinx Zynq UltraScale+ MPSoC Video Codec Unit.
To reduce performance issues with llp2 4x serial pipelines, please refer to IRQ Balancing in PG252.
...
For PetaLinux related limitations please refer to: PetaLinux 2023.1 - Product Update Release Notes and Known Issues
For VCU related limitations please refer to Answer Record 76600: LogiCORE H.264/H.265 Video Codec Unit (VCU) - Release Notes and Known Issues, Xilinx Zynq UltraScale+ MPSoC Video Codec Unit and PG252.
...
Pixel Format | GStreamer Format | Media Bus Format | GStreamer HEVC Profile | GStreamer AVC Profile | Kmssink Plane-id |
|---|---|---|---|---|---|
NV12 | NV12 | VYYUYY8_1X24 | main | high | 34 and 35 |
Video0in the each gst-launch pipelines indicates a video node for the input source.HDMI-Rx should be configured to 4kp60 mode while running below example pipelines.
LLP1/LLP2 video / audio+video stream-in pipelines are not supported using vcu_gst_app.
For LLP1/LLP2 Multi-stream HEVC serial and stream-out use-cases (2-4kp30, 2-1080p60, 4-1080p60), use
ENC_EXTRA_OP_BUFFERS=10variable before gst-launch-1.0 command.For LLP1/LLP2 Multi-stream serial and stream-in use-cases (2-4kp30, 2-1080p60, 4-1080p60), use
internal-entropy-buffers=3property in decoder.latency-timeandbuffer-timein Audio+Video serial and streaming pipelines are very aggressive here compared to upstream GStreamer default values to get optimize latency for LLP2 Audio+Video pipeline. You can tune and experiment these parameters in case of any issue with audio/video sync, audio/video packet drop and audio distortion for your use-case. You might observe higher latency when increasinglatency-timeandbuffer-timevalues in pipeline (e.g. In LLP2 HDMI video and raw HDMI audio display pipeline we have used higherlatency-timeandbuffer-timevalues to prevent audio distortion).
...