Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
Introduction

This page provides information about the ZynqMP  and Versal QSPI driver which can be found on Xilinx Git as spi-zynqmp-gqspi.c
Drivers can be found at /drivers/spi/spi-zynqmp-gqspi.c

MTD layer handles all the flash devices used with QSPI. This layer handles flash devices of different makes (Micron/Numonyx, Winbond and Spansion being
the most common)
of different sizes from 128Mbit to 1Gbit. The features of all flash devices are not alike and hence handled through different flags indicating the support.
This layer was customized by xilinx to support parallel and stacked configurations. It can be found at drivers/mtd/devices/m25p80.c on Xilinx Git

HW/IP Features

The GQSPI controller used in Zynqmp and Versal supports the following features.
  • Support Low level (Generic) Access
  • Support Future Commands
  • Supports 3,4,6…N byte addressing
  • Supports Command Queuing (Generic FIFO depth is 32)
  • Supports 4 or 8-bit interface
  • Supports 2 Chip Select Lines
  • Supports 4-Bit Bi-Directional I/O signals
  • Supports x1/x2/x4 Read/Write
  • Supports 44-bit address space on AXI in DMA mode
  • Supports byte stripe when two data buses are connected
  • Supports single interrupt for QSPI/DMA Interrupt status

Driver Features

The Zynqmp and Versal GQSPI supports the following features:
  • Supports DMA for receiving the aligned data from the tx fifo.
  • Supports PIO read for receiving the unaligned data from the rx fifo.
  • Supports PIO write from programing page to the flash.
  • Supports extended addressing.
  • Supports SIngle,Dual Parallel and Dual Stacked configurations.
  • Supports Normal and Quad read modes

Missing Features and known Issues/Limitations in Driver

  • This driver supports GenericQSPI(GQSPI) not Linear QSPI(LQSPI)

Important AR links

  • Kernel boot failed while mounting JFFS2 filesystem in QSPI boot mode - AR-71114

Kernel Configuration Options

The following config options need to be enabled
CONFIG_SPI_ZYNQMP_GQSPI
It depends on SPI_MASTER and HAS_DMA
Code Block
themeMidnight
CONFIG_SPI_ZYNQMP_GQSPI:                                                                                                                                                                                                                              │
  │                                                                                                                                                                                                                                                       │
  │ Enables Xilinx GQSPI controller driver for Zynq UltraScale+ MPSoC.                                                                                                                                                                                    │
  │                                                                                                                                                                                                                                                       │
  │ Symbol: SPI_ZYNQMP_GQSPI [=y]                                                                                                                                                                                                                         │
  │ Type  : tristate                                                                                                                                                                                                                                      │
  │ Prompt: Xilinx ZynqMP GQSPI controller                                                                                                                                                                                                                │
  │   Location:                                                                                                                                                                                                                                           │
  │     -> Device Drivers                                                                                                                                                                                                                                 │
  │       -> SPI support (SPI [=y])                                                                                                                                                                                                                       │
  │   Defined at drivers/spi/Kconfig:716                                                                                                                                                                                                                  │
  │   Depends on: SPI [=y] && SPI_MASTER [=y] && HAS_DMA [=y]
If required, enable MTD block devices support - MTD_BLKDEVS

Device-tree

Refer to spi-zynqmp-qspi.txt for complete description.
These are some specific points to be noted about the qspi properties:
- is-dual - Set if parallel. Reset if single or stacked.

Example:
The following example shows adding a QSPI node to the devicetree in single mode.
Code Block
themeMidnight
spi@ff0f0000 {
    compatible = "xlnx,zynqmp-qspi-1.0", "xlnx,versal-qspi-1.0";
    status = "okay";
    clock-names = "ref_clk", "pclk";
    interrupts = <0x0 0xf 0x4>;
    interrupt-parent = <0x1>;
    num-cs = <0x1>;
    reg = <0x0 0xff0f0000 0x0 0x1000 0x0 0xc0000000 0x0 0x8000000>;
    #address-cells = <0x1>;
    #size-cells = <0x0>;
    power-domains = <0x13>;
    clocks = <0x14 0x14>;
    is-dual = <0x0>;
 
    flash@0 {
        compatible = "m25p80";
        reg = <0x0>;
        #address-cells = <0x1>;
        #size-cells = <0x1>;
        spi-max-frequency = <0x66ff300>;
        spi-tx-bus-width = <0x1>;
        spi-rx-bus-width = <0x4>;
 
        partition@0x00000000 {
            label = "qspi-fsbl-uboot";
            reg = <0x0 0x4000000>;
        };
        partition@0x01e40000 {
            label = "qspi-linux";
            reg = <0x1e40000 0x1a00000>;
        };
        partition@0x03840000 {
            label = "qspi-device-tree";
            reg = <0x3840000 0x10000>;
        };
        partition@qspi-linux {
            label = "qspi-rootfs";
            reg = <0x100000 0x500000>;
        };
           partition@qspi-rootfs {
            label = "qspi-bitstream";
            reg = <0x620000 0x5e0000>;
        };
    };
};
 
* If driver needs to operate only in IO mode, then add has-io-mode in dts.
 
 

Testing Procedure


This section details the common tests using jffs2 and flashcp.
In order to test different flash sizes and configurations (single, parallel, stacked), the above devicetree should be modified and relevant hardware and design should be used.

QSPI flash testing with flashcp


#List the MTD partitions present and select a partition
cat /proc/mtd
Code Block
themeMidnight
dev:    size   erasesize  name
mtd0: 00400000 00020000 "qspi-fsbl-uboot"
mtd1: 01a00000 00020000 "qspi-linux"
mtd2: 00010000 00020000 "qspi-device-tree"
mtd3: 00500000 00020000 "qspi-rootfs"
mtd4: 005e0000 00020000 "qspi-bitstream"
#Creating a file to be written to the flash\
dd if=/dev/urandom of=./sample.bin bs=1024 count=4096
Code Block
themeMidnight
4096+0 records in
4096+0 records out
4194304 bytes (4.0MB) copied, 3.227253 seconds, 1.2MB/s
#Write the file to the partition - this erases the partition, writes the file and verifies
flashcp -v ./smaple.bin /dev/mtd0
Code Block
themeMidnight
Erasing block: 32/32 (100%)
Writing kb: 4088/4096 (99%)
Verifying kb: 4088/4096 (99%)

QSPI flash testing with jffs2

Code Block
themeMidnight
[[code]]
#List the MTD partitions present and select a partition
cat /proc/mtd
dev: size erasesize name


mtd0: 00400000 00020000 "qspi-fsbl-uboot"
mtd1: 01a00000 00020000 "qspi-linux"
mtd2: 00010000 00020000 "qspi-device-tree"
mtd3: 05000000 00020000 "qspi-rootfs"
mtd4: 005e0000 00020000 "qspi-bitstream"


Code Block
themeMidnight
#Erase a the whole partition with jffs2 markers
flash_eraseall -j /dev/mtd3
Erasing 128 Kibyte @ 5c0000 - 97% complete. Cleanmarker written at 5c0000.


Erasing 128 Kibyte @ 5e0000 - 100% complete.


Code Block
themeMidnight
#create a directory
mkdir qspi_flash0
#Mount the partition to spi_flash0
mount -t jffs2 /dev/mtdblock3 /qspi_flash0
#Create a file to be written to the flash
dd if=/dev/urandom of=./sample.bin bs=1024 count=4096
4096+0 records in


4096+0 records out
4194304 bytes (4.0MB) copied, 3.227253 seconds, 1.2MB/s


Code Block
themeMidnight
#Write the file to the flash
cp ./sample.bin /qspi_flash0/
#Check the presence of the file(s) in spi_flash0
ls /qspi_flash0
sample.bin


Code Block
themeMidnight
#Unmount
umount spi_flash0
#Mount again - MTD 0 to spi_flash0
mount -t jffs2 /dev/mtdblock3 /qspi_flash0
#Compare the files - there should be no differences
diff ./sample.bin /qspi_flash0/sample.bin
#Unmount
umount qspi_flash0
The data can be verified again after a power on reset if desired.

Expected Ouput

Code Block
themeMidnight
root@xilinx-zcu102-2017_3:~#
root@xilinx-zcu102-2017_3:~# cat /proc/mtd
dev: size erasesize name
mtd0: 00000000 00001000 "boot"
mtd1: 01e00000 00001000 "bootenv"
mtd2: 01e40000 00001000 "kernel"
mtd3: 04240000 00001000 "spare"
root@xilinx-zcu102-2017_3:~#
root@xilinx-zcu102-2017_3:~# dmesg | grep "spi"
[ 3.251532] m25p80 spi0.0: n25q512a (65536 Kbytes)
[ 3.256268] 4 ofpart partitions found on MTD device spi0.0
[ 3.261723] Creating 4 MTD partitions on "spi0.0":
[ 3.266495] 0x000000000000-0x000001e00000 : "boot"
[ 3.271737] 0x000001e00000-0x000001e40000 : "bootenv"
[ 3.277138] 0x000001e40000-0x000004240000 : "kernel"
[ 3.292288] 0x000004240000-0x000004000000 : "spare"
root@xilinx-zcu102-2017_3:~#


Code Block
themeMidnight
MTD Speed test:
root@xilinx-zcu102-2017_3:~#
root@xilinx-zcu102-2017_3:~# insmod /lib/modules/`uname -r`/kernel/drivers/mtd/tests/mtd_speedtest.ko dev=1
[ 171.224852] =================================================
[ 171.236148] mtd_speedtest: MTD device: 1
[ 171.241983] mtd_speedtest: not NAND flash, assume page size is 512 bytes.
[ 171.250738] mtd_speedtest: MTD device size 262144, eraseblock size 4096, page size 512, count of eraseblocks 64, pages per eraseblock 8, OOB size 0
[ 171.290736] random: crng init done
[ 173.685005] mtd_speedtest: testing eraseblock write speed
[ 174.021975] mtd_speedtest: eraseblock write speed is 778 KiB/s
[ 174.029997] mtd_speedtest: testing eraseblock read speed
[ 174.049392] mtd_speedtest: eraseblock read speed is 23272 KiB/s
[ 176.490258] mtd_speedtest: testing page write speed
[ 176.810197] mtd_speedtest: page write speed is 820 KiB/s
[ 176.817678] mtd_speedtest: testing page read speed
[ 176.865196] mtd_speedtest: page read speed is 6400 KiB/s
[ 179.355572] mtd_speedtest: testing 2 page write speed
[ 179.692173] mtd_speedtest: 2 page write speed is 778 KiB/s
[ 179.699762] mtd_speedtest: testing 2 page read speed
[ 179.732696] mtd_speedtest: 2 page read speed is 10240 KiB/s
[ 179.740320] mtd_speedtest: Testing erase speed
[ 182.248575] mtd_speedtest: erase speed is 102 KiB/s
[ 182.255472] mtd_speedtest: Testing 2x multi-block erase speed
[ 182.524665] mtd_speedtest: 2x multi-block erase speed is 980 KiB/s
[ 182.532856] mtd_speedtest: Testing 4x multi-block erase speed
[ 182.801950] mtd_speedtest: 4x multi-block erase speed is 980 KiB/s
[ 182.810074] mtd_speedtest: Testing 8x multi-block erase speed
[ 183.079170] mtd_speedtest: 8x multi-block erase speed is 980 KiB/s
[ 183.087321] mtd_speedtest: Testing 16x multi-block erase speed
[ 183.356782] mtd_speedtest: 16x multi-block erase speed is 980 KiB/s
[ 183.364980] mtd_speedtest: Testing 32x multi-block erase speed
[ 183.634492] mtd_speedtest: 32x multi-block erase speed is 980 KiB/s
[ 183.642689] mtd_speedtest: Testing 64x multi-block erase speed
[ 183.911867] mtd_speedtest: 64x multi-block erase speed is 980 KiB/s
[ 183.920022] mtd_speedtest: finished
[ 183.925333] =================================================
root@xilinx-zcu102-2017_3:~#

Performance Details

Single

Read: 32000 LB/s
Write: 759 KB/s

Dual

Read: 51200 KB/s
Write: 907 KB/s

Mainline Status

Not Mainlined

Change Log

  • 2016.3

    • Summary
      • Add support for 44-bit address space on AXI in DMA mode
      • Don't change spi clock frequency for every transfer 
      • Added tap dealy support for higher frequencies
    • Commits
  • 2016.4

    • Summary
      • None
    • Commits
      • None
  • 2017.1

    • Summary
      • Update driver to support both IO and dma modes
      • Add support for context loss
      • Add support for context loss
    • Commits
  • 2017.2

    • Summary
      • None
    • Commits
      • None
  • 2017.3

    • Summary
      • Cut the clock after restore
      • Fixed warnings reported by kernel-doc
      • Fixed warnings reported by checkpatch
      • Fixed sparse warning in driver
      • Use new firmware.h instead of pm.h
    • Commits
  • 2017.4

    • Summary
      • Direct read of data from the flash made word aligned.
    • Commits
  • 2018.1

    • Summary
      • Added a support for variable tx bus width
      • Use firmware IOCTL for device control
    • Commits
  • 2018.2

    • Summary
      • Fix for qspi dma when accessing address space beyond 32-bit.
      • Use dma mode only if the buffer is not vmalloced.
    • Commits
  • 2018.3

    • Summary
      • Fixed kerneldoc format
      • Removed the interrupts not required to be handled
      • Added runtime idle support
    • Commits
  • 2019.1

    • Summary
      • Defer driver probe if ZynqMp firmware is not ready.
      • Updated driver as per the new spi-nor framework.
      • Updated driver to set recommended clock and data tap delay values
    • Commits
  • 2019.2

    • Summary
      • Set recommended tap delay values for Versal 
      • Fixed erase size issue in dual parallel connection.
      • Fixed die crossover issue.
      • Fix incorrect buffer access.
  • 2020.1

    • Summary
      • Resolved slab-out-of-bounds bug.
      • Update driver to write appropriate dummy cycle as per tx_buswidth
    • Commits
  • 2020.2

    • Summary
      • Do hardware initialization later in probe
      • Update correct value for DLY1 bit field
      • Set correct clock and data tap delay values in probe
      • Disable interrupts before registering interrupt handler
    • Commits

Related Links