base on dperf is a 100Gbps network load tester. # dperf [](https://github.com/baidu/dperf/blob/main/LICENSE) <a href="https://hellogithub.com/repository/67958cc5d1f44a6a84f3544e3c007e5f" target="_blank"><img src="https://abroad.hellogithub.com/v1/widgets/recommend.svg?rid=67958cc5d1f44a6a84f3544e3c007e5f&claim_uid=Thc9mJByaKSbdng&theme=small" alt="Featured｜HelloGitHub" /></a> English | [中文](README-CN.md) dperf is a DPDK based 100Gbps network performance and load testing software. ## Advantage - High performance： - Based on DPDK, dperf can generate huge traffic with a single x86 server: tens of millions of HTTP CPS，hundreds of Gbps throughput and billions of concurrent connections. - Detailed statistics： - Provides detailed statistics and identify every packet loss. - Support multiple scenarios： - Load testing and stability testing for Layer 4 Load Balancer and other Layer 4 gateways. - Network performance testing for servers on cloud. - Performance test of network package processing capability for NIC and CPU. - Can be used as a high performance HTTP server or client for load testing. ## Performance ### HTTP Connections per Second |Client Cores|Server Cores|HTTP CPS| |------------|------------|--------| |1|1|2,101,044| |2|2|4,000,423| |4|4|7,010,743| |6|6|10,027,172| ### HTTP Throughput per Second |Client Cores|Server Cores|RX(Gbps)|TX(Gbps)|Client CPU Usage(%)|Server CPU Usage(%)| |------------|------------|--------|--------|-------------------|-------------------| |1|1|18|18|60|59| |2|2|35|35|60|59| |4|4|46|46|43|43| ### HTTP Current Connections |Client Cores|Server Cores|Current Connections|Client CPU Usage(%)|Server CPU Usage(%)| |------------|------------|-------------------|-------------------|-------------------| |1|1|100,000,000|34|39| |2|2|200,000,000|36|39| |4|4|400,000,000|40|41| ### UDP TX PPS |Client Cores|TX MPPS|Client CPU Usage(%)| |------------|-------|-------------------| |1|15.96|95| |2|29.95|95| |4|34.92|67| |6|35.92|54| |8|37.12|22| Note: this test is under one 25Gbps Mellanox CX4 ### Client & Server Configuration Above performance is obtained with below configurations: - MEM: 512GB(hugepage 100GB) - NIC: Mellanox MT27710 25Gbps * 2 - Kernel: 4.19.90 ## Statistics dperf outputs various statistics every second： - TPS, CPS, various PPS - Errors of TCP/Socket/HTTP - Packets loss/drop - Retransmissions of TCP Flags ``` seconds 22 cpuUsage 52 pktRx 3,001,058 pktTx 3,001,025 bitsRx 2,272,799,040 bitsTx 1,920,657,600 dropTx 0 arpRx 0 arpTx 0 icmpRx 0 icmpTx 0 otherRx 0 badRx 0 synRx 1,000,345 synTx 1,000,330 finRx 1,000,350 finTx 1,000,350 rstRx 0 rstTx 0 synRt 0 finRt 0 ackRt 0 pushRt 0 tcpDrop 0 skOpen 1,000,330 skClose 1,000,363 skCon 230 skErr 0 httpGet 1,000,345 http2XX 1,000,350 httpErr 0 ierrors 0 oerrors 0 imissed 0 ``` ## Getting Started ### Set hugepages #edit '/boot/grub2/grub.cfg' like this, and reboot the OS linux16 /vmlinuz-... nopku transparent_hugepage=never default_hugepagesz=1G hugepagesz=1G hugepages=8 ### Build DPDK #edit 'config/common_base' to enable PMDs #Mellanox CX4/CX5 requires 'CONFIG_RTE_LIBRTE_MLX5_PMD=y' #HNS3 requires 'CONFIG_RTE_LIBRTE_HNS3_PMD=y' #VMXNET3 requires 'CONFIG_RTE_LIBRTE_VMXNET3_PMD=y' TARGET=x86_64-native-linuxapp-gcc #or arm64-armv8a-linuxapp-gcc cd /root/dpdk/dpdk-stable-19.11.10 make install T=$TARGET -j16 ### Build dperf cd dperf make -j8 RTE_SDK=/root/dpdk/dpdk-stable-19.11.10 RTE_TARGET=$TARGET ### Bind interface #Mellanox NIC skip this step! #Suppose your PCI number is 0000:1b:00.0 modprobe uio modprobe uio_pci_generic /root/dpdk/dpdk-stable-19.11.10/usertools/dpdk-devbind.py -b uio_pci_generic 0000:1b:00.0 ### Start dperf server #dperf server bind at 6.6.241.27:80, gateway is 6.6.241.1 ./build/dperf -c test/http/server-cps.conf ### Send request from a client #the client IP must be in the range of 'client' in the configuration file ping 6.6.241.27 curl http://6.6.241.27/ ## Running the tests Below example will start a HTTP CPS stress test. #run dperf server ./build/dperf -c test/http/server-cps.conf #from another host, run dperf client ./build/dperf -c test/http/client-cps.conf ## Documentation See the website at [https://dperf.org/](https://dperf.org/). ## Limitation - dperf requires that the HTTP message is in one packet, which is not suitable for the test of layer 7 load balancer. - dperf requires exclusive use of the network interfaces. - dperf does not have routing capability. It is recommended to build a test environment with a switch. ## Contributing dperf welcomes your contribution. See the [CONTRIBUTING](CONTRIBUTING.md) file for details. ## Patent - Jianzhang Peng(2024). Testing Method and Apparatus for Network Devices. CN114205274B. Issued June 11, 2024. ## Author * [Jianzhang Peng](https://github.com/pengjianzhang), a Ph.D. graduate in Computer Science from the University of Science and Technology of China, served as a Principal Engineer at both Huawei and Baidu. He participated in the development of 7-layer and 4-layer load balancing systems. During his tenure at Baidu, he developed the dperf project. Even after leaving Baidu, he remains dedicated to the maintenance of the dperf project. Currently, he works in Singapore, focusing on researching and implementing low-latency network systems for high-frequency crypto quantitative trading. ## License dperf is distributed under the [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0). ", Assign "at most 3 tags" to the expected json: {"id":"4770","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"