Downloads‎ > ‎



Development Version

The Soft RoCEV2 distribution is under development and available at the following link SoftRXEV2

Please refer to instuctions below or the most recent updates to the github wiki for interim installation instructions at RXEV2 Wiki

Build Instructions

Compile and install kernel:

  1. Clone kernel git:
    1. git clone
  2. Compile kernel:
    1. Enter the source directory cd rxe-dev
    2. cp /boot/config-$(uname –r) .config
    3. make menuconfig
      1. Need to enable “Software RDMA over Ethernet (RoCE) driver” in category "Device Drivers -> Infiniband"
      2. Need to enable CONFIG_INFINIBAND_ADDR_TRANS=y andCONFIG_INFINIBAND_ADDR_TRANS_CONFIGFS=y in new config file .config
    4. make –j 32
    5. make modules_install
    6. make install
  3. Verify that the new kernel entry is added (e.g. to grub); if not, need to add it manually.
  4. Boot with new kernel.

Install user space library (librxe):

  1. Install the following package (example shown using RedHat):
    1. yum install perl-Switch (name might vary according to distribution)
  2. Make sure that the following upstream user space libraries are installed:
    1. libibverbs
    2. libibverbs-devel
    3. libibverbs-utils
    4. librdmacm
    5. librdmacm-devel
    6. librdmacm-utils
  3. Compile and install user space library librxe:
    1. git clone
    2. cd librxe-dev
    3. ./configure --libdir=/usr/lib64/ --prefix=
    4. make
    5. make install

Configure Soft-RoCE (RXE):

  1. Load ib_rxe kernel module using the rxe_cfg script included in the librxe RPM:
    1. rxe_cfg start (this might require sudo or root privileges)
  2. Create RXE device over network interface (e.g. eth0):
    1. rxe_cfg add eth0
  3. Use the status command to display the current configuration:
    1. rxe_cfg status
  4. If configured successfully, you should see output similar to the following:
    Name  Link  Driver   Speed  NMTU  IPv4_addr  RDEV  RMTU         
    eth0  yes   mlx4_en                          rxe0  1024  (3) 
  1. If you are using a Mellanox HCA: Need to make sure that the mlx4_ib kernel module is not loaded (modprobe –rv mlx4_ib) in the soft-RoCE machine.
  2. Now you have an Infiniband device called “rxe0” that can be used to run any RoCE app.

Previous Release

The previous version was developed as a specially patched OFED-1.5.2 distribution.  Users familiar with the installation and configuration of OFED software will find this easy to use.

Download Soft RoCE OFED Distribution

Source Code

The Soft RoCE / RXE source code can be browsed and searched on the OFED Cross Reference Server, hosted by System Fabric Works:

OFED-1.5.1-rxe Cross Reference

Source code is contained in the OFED-1.5.2-rxe tarball, in source rpm format.

Further Information

For more information email