This page gives an overview of how to use the Linux device driver for the Xilinx Zynq UltraScale+ MPSoC PS PCIe End Point DMA functionality.

The driver runs on the host machine on which the end point is connected. The driver DMA and PIO functionality on the End Point can be tested using an application. Details are provided below on the required setup, how to compile the driver, applications and how to test the DMA and PIO functionality on the End Point.

Table of Contents

Controller for PCI Express DMA

PCI Express (abbreviated as PCIe) is the newest bus standard designed to replace the old PCI/PCI-X and AGP standards. PCIe is used in servers, consumer, and industrial applications either as a motherboard-level interconnection to link peripherals or as an expansion card interface for add-on boards. Zynq® UltraScale+™ MPSoC devices provide a controller for the integrated block for PCI Express® v2.1 compliant, AXI-PCIe bridge, and DMA modules. The AXI-PCIe bridge provides high-performance bridging between PCIe and AXI.

The controller for PCIe supports both Endpoint and Root Port modes of operations and provides support for up to x4 Gen2 links.

The DMA controller for PCIe contains a high-performance 4-channel direct memory access (DMA) engine. Each channel can be programmed for either transmit or receive DMA operation. Each channel can be controlled from either the PCIe or AXI domains. The DMA supports separate source and destination scatter-gather queues. The DMA hardware is responsible for merging the source and destination information for data movement. The scatter-gather elements can be located in either PCIe or AXI memory.

For more information about the controller for PCI Express, please refer to the Zynq UltraScale+ MPSoC TRM (UG1085).

Hardware Setup

• x86_64 host system with at least one Gen 2x4 PCIe slot.

• The End Point is tested with an x86 machine with Ubuntu 20.04 LTS installed.

• Xilinx Zynq UltraScale+ MPSoC PS PCIe EndPoint Board connected on an x86 machine’s PCIe Slot.

Software

The DMA driver is available at https://github.com/Xilinx/zynqmp-pspcie-epdma for reference.

Set up the Host machine (x86 Ubuntu)

Power on and Open the terminal in the x86 Host system with Ubuntu and follow the below steps.

• OS

Verified drivers on Ubuntu 20.04.04 LTS

• Clone the Xilinx Zynq UltraScale+ MPSoC PS PCIe End point drivers by executing the below command:

• Change directory to the cloned directory:

• Compile the Kernel Module Driver and application using the below command:

Testing

Program the Zynq MP as End Point board with the required boot files where the device is configured as the end point and then reboot the x86 Ubuntu Host system. Wait until boot.

Verify whether the device has been detected by the host system or not, by executing the below command in the host terminal.

Open the host Ubuntu Terminal and follow the below steps to test the PS PCIe using a simple-test DMA Application.

• Change directory to the cloned directory:

•  Insert the PS PCIe DMA drivers into the running kernel by executing the below commands:

• Change the permission ps_pcie* nodes, so that the application can run without sudo permission:

• Navigate to the apps directory in the terminal.

• Execute the DMA transfers application by providing command line parameters:

• Execute the PIO test application.

Pre-requisite:

Before executing the pci_pio_test app, the user needs to run the bare-metal application https://github.com/Xilinx/embeddedsw/blob/master/XilinxProcessorIPLib/drivers/pciepsu/examples/xpciepsu_ep_enable_example.c on the PCIe endpoint device.

This standalone application will set up end point bridge ingress translation on BAR2 that is translated to the PS-DDR on the endpoint.

• PIO Command line parameters:

• Remove the driver by executing the below command:

Related Links

• UG1085