Java Parallel HTTP requests with CompleteableFuture not very performant

I have a web service that makes http calls to another service. The web service breaks down one-to-many requests and attempts to make parallel one-to-one requests. For testing performance, I have kept the throughput to the backend constant. For example, I was able to achieve a throughput of 1000 req/sec with a 99th percentile latency of 100ms. So to test parallel requests that get broken down to 2 requests to the backend per each request to the web service, I sent 500 req/sec but achieved only a 150ms 99th percentile...

Read More »

By: StackOverFlow - 6 days ago

Related Posts