Zynq UltraScale+ MPSoC ZCU104 VCU HDMI ROI 2020.2

Owned by Ronak Shah (Unlicensed)
Last updated: Mar 23, 2021 by Nayan Bhavsar (Unlicensed)
9 min read

This page provides all the information related to VCU HDMI ROI designs for ZCU104.

  • This design is based on the ZCU106 VCU HDMI ROI TRD which can be found at the following link

  • The two designs are functionally equivalent, please refer to the page linked above for details related to the system architecture, gstreamer plugin info, DPU configuration and usage, etc.  The sections below provide direct links to the relevant information.

Table of Contents

1 Overview

The primary goal of this VCU ROI design is to demonstrate the use of DPU (Deep learning Processor Unit) block for extracting the ROI (Region of Interest) from input video frames and to use this information to perform ROI based encoding using VCU (Video Codec Unit) encoder hard block present in Zynq UltraScale+ EV devices.

  • For detailed overview please refer to this link.

1.1 System Architecture

  • For system architecture please refer to this link. System architecture diagram shown in above refer link is applicable for ZCU104 board.

1.2 Hardware Architecture

This section gives a detailed description of the blocks used in the hardware design. 

1.3 VCU ROI Software

1.3.1 GStreamer Pipeline

The GStreamer plugin demonstrates the DPU capabilities with Xilinx VCU encoder’s ROI(Region of Interest) feature. The plugin will detect ROI (i.e. face co-ordinates) from input frames using DPU IP and pass the detected ROI information to the Xilinx VCU encoder.

1.3.2 DPU(Deep Learning Processor Unit)

DPU is a programmable engine optimized for deep neural networks. It is a group of parameterizable IP cores pre-implemented on the hardware with no place and route required. The DPU is released with the Vitis AI specialized instruction set, allowing efficient implementation of many deep learning networks.

1.4 Software Tools and System Requirements

Hardware

Required:

  • ZCU104 evaluation board rev 1.0 with power cable

  • Monitor with HDMI input supporting 3840x2160 resolution or 1920x1080 resolution

  • HDMI Receiver - NVIDIA SHIELD Pro for 4Kp60

  • Two HDMI cables 2.0 certified

  • Class-10 Micro-SD card (ZCU104)

  • Ethernet cable

Optional:

  • USB pen drive formatted with the FAT32 file system and hub

  • SATA drive formatted with the FAT32 file system, external power supply, and data cable

Software Tools

Required:

Download, Installation, and Licensing of Vivado Design Suite 2020.2

The Vivado Design Suite User Guide explains how to download and install the Vivado® Design Suite tools, which include the Vivado Integrated Design Environment (IDE), High-Level Synthesis tool, and System Generator for DSP. This guide also provides information about licensing and administering evaluation and full copies of Xilinx design tools and intellectual property (IP) products. The Vivado Design Suite can be downloaded from here.

LogiCORE IP Licensing 

The following IP cores require a license to build the design.

  • Video Mixer- Included with Vivado - PG243

  • Video PHY Controller - Included with Vivado - PG230

  • HDMI-Rx/Tx Subsystem - Purchase license (Hardware evaluation available) - PG235 & PG236

  • Video Processing Subsystem (VPSS) - Included with Vivado - PG231

To obtain the LogiCORE IP license, please visit the respective IP product page and get the license.

Compatibility

The reference design has been tested successfully with the following user-supplied components.

HDMI Monitor:

Make/Model

Resolutions

LG 24UD58

3840 x 2160 @ 30Hz

Samsung LU28E90DS/XL

3840 x 2160 @ 30Hz