Benchmarking Renaissance on OpenJDK and Azul Platform Prime

August 19, 2021 John Ceccarelli

The Renaissance Suite is an increasingly popular Java benchmark and one of the many benchmarks that Azul uses internally to measure performance of Azul Platform Prime from release to release and against OpenJDK. In this blog, we will look at how we run Renaissance and how Azul Platform Prime performs against OpenJDK.

Benchmark Methodology

We ran Renaissance on the following machine:

  • Intel(R) Xeon(R) CPU E3-1220 v5 @ 3.00GHz
  • 4 Cores
  • SSD hard drive
  • Hyperthreading disabled
  • Turbo Boost disabled

We tested these JDK versions:

  • Azul Platform Prime: Azul Zulu Prime Builds of OpenJDK 21.07
  • OpenJDK: Azul Zulu Builds of OpenJDK 11.0.11

We gave the JVMs 12GB of heap. To ensure that both JVMs are sufficiently warmed up, we run each benchmark inside the Renaissance Suite for at least 700 repetitions. The value in our results is the best value of the ten last repetitions. The Detailed Run Instructions section shows the exact commands we used for running each benchmark.

If you are trying this at home, make sure you run each benchmark for 700 repetitions. Renaissance benchmark results are unstable at low repetition counts and different benchmarks in the suite take different amounts of time to warm up properly.

Result: Azul Platform Prime Outperforms OpenJDK by 37%

Taking the geomean of all benchmark scores, Azul Platform Prime performs 37% better than OpenJDK on the entire Renaissance Suite. Individual benchmark scores are listed below.

Best run time for one repetition (ms – lower is better)

BenchmarkAzul Platform PrimeOpenJDKRatio
akka-uct10549.4988028.826-23.89%
naive-bayes328.679306.087-6.87%
philosophers15381537-0.07%
fj-kmeans3599.6833711.7313.11%
reactors11545.39111927.2243.31%
movie-lens6318.396812.4197.82%
finagle-http1196.8081388.69216.03%
dotty1753.3852047.93516.80%
page-rank2537.7162968.95116.99%
future-genetic1501.8891819.68121.16%
scala-stm-bench7  782.727951.46221.56%
finagle-chirper   1176.1521482.2726.03%
dec-tree1066.931348.83726.42%
scala-kmeans197.251264.68234.19%
db-shootout3342.4614609.73937.92%
rx-scrabble180.222265.86847.52%
als1813.852799.99354.37%
chi-square902.211402.55555.46%
gauss-mix670.1271042.11855.51%
scrabble270.147423.27256.68%
log-regression1294.1462155.79266.58%
par-mnemonics1623.9633848.12136.96%
mnemonics2075.1044972.762139.64%
scala-doku1883.2644699.728149.55%
neo4j-analytics3514.991 9190.704 161.47%

Detailed Run Instructions

Here are the exact commands we used for each of the benchmarks. For each tests we run the following command:

$JAVA_HOME/bin/java -Xms12g -Xmx12g -jar $RENAISSANCE_HOME/renaissance-0.11.0.jar -r 700 all

Try It Yourself

Azul Platform Prime Stream Builds are free for testing and evaluation. Try it yourself.

The post Benchmarking Renaissance on OpenJDK and Azul Platform Prime appeared first on Azul | Better Java Performance, Superior Java Support.

Previous Flipbook
MEMX Stock Exchange
MEMX Stock Exchange

Brand-new, Fast Growing Stock Exchange MEMX Relies on the Azul Platform for Best Cost, Performance, and Sup...

Next Flipbook
Azul's Momentum in Financial Services
Azul's Momentum in Financial Services

All 10 of the World's Top 10 Trading Companies and Six of the Top 10 US Financial Companies have Switched f...