[libmicrohttpd] 回复:Re: 回复:回复:Re: Help : Any HTTP Performance Benchmark Comparison for Microhttpd with Go HTTP Servers

[lingweicai]

Hi Evgeny: 

Thank you for your quick reply. It is very helpful. I built the master of microhttpd and run the benchmark comparing with hello.go (golang), on my laptop running on a vm with 10x CPU processors and 11GB Memory on Linux oe23 6.1.19-7.0.0.17.oe2303. The results of microhttp has a lot of improvement, please refer to below output. Now I am to rebuild microhttpd with gcc-13.1, to if it can improve more performance. Will advise you my results after my benchmark.

I do not understand, why with the same size of http response ( containing 3 bytes in body )  of Hello.go and microhttp, hello.go can achieve much bandwidth ( Transfer/sec).  

THANK YOU! 

Forrest 

WRK Testing: 

This is testing for microhttpd: 

[root@oe23 tools]# wrk -t 4 -c 1000 -d 10s  http://127.0.0.1:8888/

Running 10s test @ http://127.0.0.1:8888/

  4 threads and 1000 connections

  Thread Stats   Avg      Stdev     Max   +/- Stdev

    Latency     4.23ms    1.79ms  55.21ms   96.13%

    Req/Sec    60.50k     4.31k   73.26k    86.87%

  2383966 requests in 10.04s, 93.21MB read

Requests/sec: 237419.41

Transfer/sec:      9.28MB

This is the testing for hello.go:

[root@oe23 tools]# wrk -t 4 -c 1000 -d 10s  http://127.0.0.1:10000/

Running 10s test @ http://127.0.0.1:10000/

  4 threads and 1000 connections

  Thread Stats   Avg      Stdev     Max   +/- Stdev

    Latency     4.44ms    6.08ms 114.21ms   88.77%

    Req/Sec    70.09k    11.66k   96.44k    78.03%

  2785615 requests in 10.08s, 316.13MB read

Requests/sec: 276362.92

Transfer/sec:     31.36MB

AB Benchmark: 

Microhttpd :

[root@oe23 tools]# ab -c100 -n100000  http://127.0.0.1:8888/

Concurrency Level:      100

Time taken for tests:   3.499 seconds

Complete requests:      100000

Failed requests:        0

Total transferred:      6000000 bytes

HTML transferred:       300000 bytes

Requests per second:    28577.94 [#/sec] (mean)

Time per request:       3.499 [ms] (mean)

Time per request:       0.035 [ms] (mean, across all concurrent requests)

Transfer rate:          1674.49 [Kbytes/sec] received

hello.go:

[root@oe23 tools]# ab -c100 -n100000  http://127.0.0.1:10000/

Concurrency Level:      100

Time taken for tests:   3.767 seconds

Complete requests:      100000

Failed requests:        0

Total transferred:      11900000 bytes

HTML transferred:       300000 bytes

Requests per second:    26549.81 [#/sec] (mean)

Time per request:       3.767 [ms] (mean)

Time per request:       0.038 [ms] (mean, across all concurrent requests)

Transfer rate:          3085.38 [Kbytes/sec] received

----- 原始邮件 -----

发件人：Evgeny Grin<k2k@yandex.ru>

发送时间：2023-07-04 00:40:33

收件人：libmicrohttpd development and user mailinglist<libmicrohttpd@gnu.org>

抄送：lingweicai<lingweicai@sohu.com>

主 题：Re: [libmicrohttpd] 回复:回复:Re: Help : Any HTTP Performance Benchmark Comparison for Microhttpd with Go HTTP Servers

Hi all,

I've published the new tool on git master branch. You can find it at src/tools/perf_replies
Please try it and report any problems.
Performance report are appreciated as well.

The suggested test tools:
wrk, h2load --h1

--
Evgeny

On 01.07.2023 14:15, lingweicai via libmicrohttpd wrote:

Hi Evgeny: 

Could you please help to share the benchmark source file with me by email ? I want to run it on my system ASAP. 

  Thanks,

Forrest

----- 原始邮件 -----

发件人：lingweicai<lingweicai@sohu.com>

发送时间：2023-07-01 17:30:20

收件人：Evgeny Grin<k2k@yandex.ru>;libmicrohttpd development and user mailinglist<libmicrohttpd@gnu.org>

主 题：回复:Re: [libmicrohttpd] Help : Any HTTP Performance Benchmark Comparison for Microhttpd with Go HTTP Servers

Hi Evgeny: 

The results are really exciting. Really apreciate your efforts. 

Thanks,

Forrest 

----- 原始邮件 -----

发件人：Evgeny Grin<k2k@yandex.ru>

发送时间：2023-06-30 03:29:17

收件人：libmicrohttpd development and user mailinglist<libmicrohttpd@gnu.org>

抄送：lingweicai<lingweicai@sohu.com>

主 题：Re: [libmicrohttpd] Help : Any HTTP Performance Benchmark Comparison for Microhttpd with Go HTTP Servers

Hi Forrest,

   The tool for performance replies is shaping, I have alpha version and
   made some test with suggested wrk.
   Here are the initial results:
   -----------------------------------------
   $ wrk -c100 -d30s -t4 http://127.0.0.1:39683
   Running 30s test @ http://127.0.0.1:39683
   4 threads and 100 connections
   Thread Stats Avg Stdev Max +/- Stdev
   Latency 143.75us 57.42us 1.93ms 69.18%
   Req/Sec 102.70k 2.45k 108.02k 70.92%
   12262004 requests in 30.00s, 479.45MB read
   Requests/sec: 408721.22
   Transfer/sec: 15.98MB

   $ wrk -c100 -d30s -t8 http://127.0.0.1:39683
   Running 30s test @ http://127.0.0.1:39683
   8 threads and 100 connections
   Thread Stats Avg Stdev Max +/- Stdev
   Latency 110.83us 251.91us 23.18ms 99.77%
   Req/Sec 101.68k 15.28k 130.87k 65.28%
   24297494 requests in 30.10s, 0.93GB read
   Requests/sec: 807215.36
   Transfer/sec: 31.56MB

   $ wrk -c400 -d30s -t8 http://127.0.0.1:39683
   Running 30s test @ http://127.0.0.1:39683
   8 threads and 400 connections
   Thread Stats Avg Stdev Max +/- Stdev
   Latency 387.42us 159.03us 13.43ms 74.39%
   Req/Sec 109.04k 13.31k 133.24k 59.58%
   26036491 requests in 30.04s, 0.99GB read
   Requests/sec: 866619.04
   Transfer/sec: 33.89MB

   $ wrk -c400 -d30s -t4 http://127.0.0.1:39683
   Running 30s test @ http://127.0.0.1:39683
   4 threads and 400 connections
   Thread Stats Avg Stdev Max +/- Stdev
   Latency 482.26us 266.28us 25.07ms 94.71%
   Req/Sec 108.71k 4.57k 120.72k 80.42%
   12979154 requests in 30.06s, 507.49MB read
   Requests/sec: 431811.63
   Transfer/sec: 16.88MB

   $ wrk -c1000 -d30s -t4 http://127.0.0.1:39683
   Running 30s test @ http://127.0.0.1:39683
   4 threads and 1000 connections
   Thread Stats Avg Stdev Max +/- Stdev
   Latency 1.17ms 475.29us 29.10ms 70.65%
   Req/Sec 101.63k 8.46k 126.45k 81.94%
   12121757 requests in 30.05s, 473.97MB read
   Requests/sec: 403322.87
   Transfer/sec: 15.77MB

   $ wrk -c1000 -d30s -t8 http://127.0.0.1:39683
   Running 30s test @ http://127.0.0.1:39683
   8 threads and 1000 connections
   Thread Stats Avg Stdev Max +/- Stdev
   Latency 1.20ms 368.89us 20.19ms 88.20%
   Req/Sec 89.15k 8.66k 116.86k 71.04%
   21283031 requests in 30.09s, 832.18MB read
   Requests/sec: 707233.60
   Transfer/sec: 27.65MB
   -----------------------------------------
   I'll let you know when tool is published.

   --
   Evgeny


   On 26.06.2023 3:52, lingweicai via libmicrohttpd wrote:


    ), the results :