10GbE vs 25GbE Latency or … How to DUT

PingPong Results

A pingpong benchmark is well known into measuring latency, in which it reports roundtrip times divided by 2. This allows taking a timestamp right before sending (via the host) and right after its reply has been received.

C:\ExaNIC\bin>fsock_pingpong.exe -h 10.0.0.102 -l 10.0.0.103 -E 2
fsock_pingpong.exe[4284] FSOCK 4.002-0007-08222021 Copyright NEIO Systems, Ltd. 2020-2021
> Successfully received Remote MAC Address : 64:3f:5f:01:c0:56
> Successfully received Local MAC Address : 64:3f:5f:01:c0:54
Half Round-Trip latency benchmark [UDP:FSOCK_RECV_DEFAULT]
Size 1: 710 (ns) (mean=830 median=800, 99%=950)
Size 2: 720 (ns) (mean=840 median=805, 99%=950)
Done.
C:\ExaNIC\bin>fsock_pingpong.exe -h 10.0.0.102 -l 10.0.0.103 -E 2
fsock_pingpong.exe[3024] FSOCK 4.002-0007-08222021 Copyright NEIO Systems, Ltd. 2020-2021
> Successfully received Remote MAC Address : 64:3f:5f:01:c0:56
> Successfully received Local MAC Address : 64:3f:5f:01:c0:54
Half Round-Trip latency benchmark [UDP:FSOCK_RECV_DEFAULT]
Size 1: 652 (ns) (mean=762 median=750, 99%=950)
Size 2: 653 (ns) (mean=763 median=752, 99%=950)
Done.

DUT Results

Another way is to use the device under test (DUT) approach. A device under test, also known as equipment under test (EUT) and unit under test (UUT), is a manufactured product undergoing testing. The benefit is that no technical details need to be known and we can treat it as a black box.

DUT Overview
DUT using ExaNIC X25 relying on its TX and RX hardware timestamps
C:\ExaNIC\bin>fsock_pingpong.exe -h 10.0.0.102 -l 10.0.0.103 -E 2 -d
fsock_pingpong.exe[1840] FSOCK 4.002–0007–08222021 Copyright NEIO Systems, Ltd. 2020–2021
> Successfully received Remote MAC Address : 64:3f:5f:01:c0:56
> Successfully received Local MAC Address : 64:3f:5f:01:c0:54
Measuring dev_under_test. time elapsed (NIC TX — RX)
Size 1: 748.00 (ns) (mean=857.75 median=828.00)
Size 2: 752.00 (ns) (mean=856.83 median=828.00)
Done.
C:\ExaNIC\bin>fsock_pingpong.exe -h 10.0.0.102 -l 10.0.0.103 -E 2 -d
fsock_pingpong.exe[4468] FSOCK 4.002-0007-08222021 Copyright NEIO Systems, Ltd. 2020-2021
> Successfully received Remote MAC Address : 64:3f:5f:01:c0:56
> Successfully received Local MAC Address : 64:3f:5f:01:c0:54
Measuring dev_under_test. time elapsed (NIC TX - RX)
Size 1: 696.00 (ns) (mean=800.57 median=772.00)
Size 2: 696.00 (ns) (mean=801.51 median=772.00)
Done.

Summary

Switching from 10GbE to 25GbE does show a noticeable and measureable improvement. As a basic rule we can say it improves the latency by 50ns

References:

[1] FastSockets, http://www.fastsockets.com , NEIO Systems, Ltd.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
NEIO Systems, Ltd.

NEIO Systems, Ltd.

16 Followers

http://fastsockets.com || low latency, networking experts, 10GbE++, FPGA trading, Linux and Windows internals gurus