Latency performance from HTTP awaitable server examples

[shuwens]

Hey,

Thank you all for all the work on boost/beast, it is a great library to use. I am working on a project which needs an embedded HTTP server, and I switched from civetweb to beast. One thing I am wondering is the actual achievable latency of beast. My project will be doing a large amount of HTTP requests so throughput and latency matter to me.

I run the http awaitable server with 1.86 against wrk. The benchmarking result is ranging from 250us to 400us. Is this the lowest latency I can achieve with boost beast, or am i missing anything here?

Regards,

An example is as follows.

16 threads and 80 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   258.48us  335.09us  17.77ms   98.98%
    Req/Sec    20.56k   800.05    26.78k    80.45%
  3304893 requests in 10.10s, 267.90MB read
Requests/sec: 327223.28
Transfer/sec:     26.53MB