• under construction
  • Zynq UltraScale+ MPSoC VCU TRD 2024.1

    This page provides an overview of the 2024.1 version of the Zynq UltraScale+ MPSoC VCU TRD. This TRD is made up of several design modules. A description of the design modules and links to the individual design module pages can be found in the Design Modules below.

    This page complements the TRD User Guide: UG1250

    Table of Contents

    1 Revision History

    Change Log:

    Updated all projects, IPs, and tools versions to 2024.1

     

    2 Overview

    This is the main page of the VCU TRD wiki, which has links to wiki pages corresponding to the individual design modules. It also explains the complete feature list and the supported resources of all the designs. A TRD package web link is provided for the user to download. This page also gives information on the required software tools and IP licenses.

    The Zynq® UltraScale+™ MPSoC Video Codec Unit (VCU) Targeted Reference Design (TRD) consists of an embedded video encoding/decoding application that runs on the Processing System (PS). The overall functionality of the TRD is partitioned between the Processing System (PS), Video Codec Unit, and Programmable Logic (PL) for optimal performance. 

    The primary goal of this TRD is to demonstrate the capabilities of the VCU core which is an integrated hard block present in Zynq UltraScale+ MPSoC EV devices. The TRD serves as a platform for the user to tune the performance parameters of the VCU and arrive at an optimal configuration for encoder and decoder blocks for their specific use case. The TRD uses a Vivado IP Integrator (IPI) flow for building the hardware design and Xilinx Yocto PetaLinux flow for software design. It uses Xilinx IPs and software drivers to demonstrate the capabilities of different components.

    2.1 TRD Support

    The TRD supports the following video interfaces.

    Sources up-to 4K(3840 x 2160/4096 x 2160)-60FPS:

    • Test pattern generator (TPG) implemented in the PL.

    • HDMI-Rx capture pipeline implemented in the PL.

    • MIPI CSI-2 Rx capture pipeline implemented in the PL.

    • File source (SD card, USB storage, SATA hard disk).

    • Stream-In from network or internet.

    • SDI-Rx capture pipeline implemented in the PL.

    Sinks up-to 4K(3840 x 2160/4096 x 2160)-60FPS for HDMI/SDI and 4K-30FPS for Display Port

    • DP Tx display pipeline in the PS.

    • HDMI-Tx display pipeline implemented in the PL.

    • SDI-Tx display pipeline implemented in the PL.

    • DP display pipeline implemented in the PL.

    • Stream-out to network or internet

    VCU Codec

    • Video Encode/Decode capability using the VCU hard block in the PL.

      • H.264/H.265 encoding

      • Encoder/decoder parameter configuration using OMX interface.

      • Demonstrate the multi-stream capability of VCU at 4k 60 Hz throughput.

    Audio Codec

    • Opus 2 channel 48KHz 

    Streaming Interfaces

    • 1G Ethernet PS GEM

    Video formats

    • NV12 (YUV420 8-bit semi-planar format)

    • NV16 (YUV422 8-bit semi-planar format)

    • XV15 (YUV420 10-bit semi-planar format)

    • XV20 (YUV422 10-bit semi-planar format)

    • YU24 (YUV444 8-bit planar format)

    • X403 (YUV444 10-bit planar format)
      NOTE: 8-bit or 10-bit in above video formats represents color depth.

    The below figure shows the TRD block diagram. It consists of all the Design Modules. The components of each design module are highlighted in unique colors in the diagram. The remaining blocks are common to all design modules as shown.

    image-20220412-085027.png

     

    image-20220412-085116.png

     

    2.2 Design Modules

    The VCU TRD 2024.1 version consists of seven design-modules as described below. Individual links below will redirect to the corresponding wiki pages and build and run the flow of individual designs modules.

    Design Module #

    Project Name

    TRD Pre-built images
    (rdf0428-zcu106-vcu-trd-2024-1/images)

    Hardware design
    (rdf0428-zcu106-vcu-trd-2024-1/pl/designs)

    Description

    1

    VCU TRD Multi Stream Video Capture and Display

    vcu_multistream_nv12

    zcu106_trd

    Multi-stream design supporting HDMI-Rx, TPG, MIPI, HDMI-Tx, DP along with showcasing the capabilities of the VCU

    2

    PL DDR HLG SDI Audio Video Capture and Display

    This Design Module is merged with Design Module #10. All functionality of this Design Module is now available in Design Module #13.

    3

    Multi Stream Audio Video Capture and Display

    vcu_audio

    zcu106_audio

    Design supporting I2S and HDMI Audio with video capture of HDMI-Rx/MIPI-Rx and showcasing the capabilities of the VCU

    4

    10G HDMI Video Capture and Display

    This Design Module is discontinued in the 2021.2 VCU TRD release.

    5

    PCIe Encode, Decode and Transcode

    This Design Module is discontinued in the 2022.1 VCU TRD release.

    6

    PL DDR HDR10 HDMI Video Capture and Display

    vcu_plddrv1_hdr10_hdmi
    vcu_plddrv2_hdr10_hdmi

    zcu106_HDR10_DCI4K

    VCU based HDMI design to showcase encoding with the PS DDR and decoding with the PL DDR. It supports the reception and insertion of HDR10 static metadata for HDMI and also the DCI4K Feature.

    HDR10 PLDDR_V1 corresponds to the old PLDDR part   :  MT40A256M16GE-075E
    HDR10 PLDDR_V2 corresponds to the new PLDDR part :  MT40A256M16LY-062E

    7

    Xilinx Low Latency PS DDR NV12 HDMI Audio Video Capture and Display

    vcu_llp2_hdmi_nv12

    zcu106_llp2_audio_nv12

    VCU based HDMI audio video design to showcase ultra low latency support using the Sync IP, encoding and decoding with PS DDR for NV12 format

    8

    Xilinx Low latency PL DDR NV16 HDMI Video Capture and Display

    9

    Xilinx Low latency PL DDR NV20 HDMI Video Capture and Display

    10

    Xilinx Low Latency PL DDR XV20 SDI Video Capture and Display

    11

    Quad Sensor MIPI CSI Video Capture and HDMI Display

    12

    Xilinx Low Latency PL DDR HDMI Video Capture and Display

    vcu_llp2_plddr_hdmi

    zcu106_llp2_xv20_nv16

    VCU based HDMI design to showcase ultra low latency support using Sync IP, encoding with PS DDR and decoding with PL DDR for NV16 and XV20 format

    13

    Xilinx Low Latency PL DDR HLG SDI Audio Video Capture and Display

    vcu_llp2_hlg_sdi

    zcu106_llp2_hlg_sdi

    Design showcasing HLG/Non-HLG Video + 2/8 channels Audio Capture and Display through SDI interface along with the capabilities of the VCU with PL DDR supporting 4:2:2 10-bit XV20 format encoding from the PS DDR and decoding from PL DDR. It also showcases ultra low latency support using Sync IP, encoding with PS DDR and decoding with PL DDR for XV20 format.

    14

    YUV444 Video Capture and Display

    vcu_yuv444

    zcu106_yuv444

    VCU based HDMI/DP video design to showcase YUV444 8-bit and 10-bit functionality.

    The VCU TRD User guide has more details about the list of features, software architecture, and hardware architecture of individual designs.

    3 Software Tools and System Requirements

    3.1 Hardware

    Required:

    • ZCU106 evaluation board (rev C/D/E/F/1.0) with power cable

    • Monitor with DisplayPort/HDMI input supporting 4096x2160 or 3840x2160 or 1920x1080 resolution

    • HDR10 supported Monitor with HDMI input supporting 4096x2160, 3840x2160 or 1920x1080 resolution

    • YUV444 10-bit supported Monitor with DisplayPort/HDMI input supporting up to 3840x2160p30 resolution

    • Display Port cable (DP certified)

    • HDMI cable 2.0 certified

    • Class-10 SD card

    • HDMI Receiver - NVIDIA SHIELD Pro for 4kp60, Panasonic Lumix GH5S for DCI 4kp60

    • HDMI Receiver - GooBang Doo ABOX 2017 player with the resolution set to 4KP30

    • HDMI Receiver - NVIDIA SHIELD / NVIDIA SHIELD Pro for YUV444 8-bit video capture

    • HDMI Receiver - MI-BOX for YUV444 10-bit video capture

    • USB mouse

    • Ethernet cable

    • SFP+ optical module

    • SDI Receiver - Black Magic Teranex Mini HDMI to 12G converter / AJA HA5-12G HDMI to 12G SDI converter

    • SDI Transmitter - Black Magic Teranex Mini 12G to HDMI converter / AJA HI5-12G 12G SDI to HDMI converter

    • LI-IMX274MIPI-FMC image sensor daughter card

    • Digilent PMOD Audio card [I2S2]

    • Phabrix Qx Analyzer

    • 3.5mm Aux Cables and Speakers.

    Optional:

    • USB pen drive formatted with the FAT32 file system and hub.

    • SATA drive formatted with the FAT32 file system, external power supply, and data cable.

    3.2 Software Tools

    Required:

    3.3 Download, Installation, and Licensing

    The Vivado Design Suite User Guide explains how to download and install the Vivado® Design Suite tools, which include the Vivado Integrated Design Environment (IDE), High-Level Synthesis tool, and System Generator for DSP. This guide also provides information about licensing and administering evaluation and full copies of Xilinx design tools and intellectual property (IP) products. The Vivado Design Suite can be downloaded from here.

    LogiCORE IP Licensing

    The following IP cores require a license to build the design.

    • Video Test Pattern Generator (TPG) - Included with Vivado - PG103

    • Video Timing Controller (VTC) - Included with Vivado - PG016

    • Video Mixer- Included with Vivado - PG243

    • Video PHY Controller - Included with Vivado - PG230

    • HDMI-Rx/Tx Subsystem - Purchase license (Hardware evaluation available) - PG235 & PG236

    • Video Processing Subsystem (VPSS) - Included with Vivado - PG231

    • MIPI CSI Controller Subsystems (mipi_csi2_rx_subsystem) - Purchase license (Hardware evaluation available) - PG232

    • SDI-Rx/Tx Subsystem - Included with Vivado - PG289 & PG290

    • XDMA - Included with Vivado - PG195

    To obtain the LogiCORE IP license, please visit the respective IP product page and get the license.

    Note: Hardware Evaluation keys allow you to simulate and implemen