Benchmarking Renaissance on OpenJDK and Azul Platform Prime

August 19, 2021 John Ceccarelli

The Renaissance Suite is an increasingly popular Java benchmark and one of the many benchmarks that Azul uses internally to measure performance of Azul Platform Prime from release to release and against OpenJDK. In this blog, we will look at how we run Renaissance and how Azul Platform Prime performs against OpenJDK.

Benchmark Methodology

We ran Renaissance on the following machine:

  • Intel(R) Xeon(R) CPU E3-1220 v5 @ 3.00GHz
  • 4 Cores
  • SSD hard drive
  • Hyperthreading disabled
  • Turbo Boost disabled

We tested these JDK versions:

  • Azul Platform Prime: Azul Zulu Prime Builds of OpenJDK 21.07
  • OpenJDK: Azul Zulu Builds of OpenJDK 11.0.11

We gave the JVMs 12GB of heap. To ensure that both JVMs are sufficiently warmed up, we run each benchmark inside the Renaissance Suite for at least 700 repetitions. The value in our results is the best value of the ten last repetitions. The Detailed Run Instructions section shows the exact commands we used for running each benchmark.

If you are trying this at home, make sure you run each benchmark for 700 repetitions. Renaissance benchmark results are unstable at low repetition counts and different benchmarks in the suite take different amounts of time to warm up properly.

Result: Azul Platform Prime Outperforms OpenJDK by 37%

Taking the geomean of all benchmark scores, Azul Platform Prime performs 37% better than OpenJDK on the entire Renaissance Suite. Individual benchmark scores are listed below.

Best run time for one repetition (ms – lower is better)

BenchmarkAzul Platform PrimeOpenJDKRatio
akka-uct10549.4988028.826-23.89%
naive-bayes328.679306.087-6.87%
philosophers15381537-0.07%
fj-kmeans3599.6833711.7313.11%
reactors11545.39111927.2243.31%
movie-lens6318.396812.4197.82%
finagle-http1196.8081388.69216.03%
dotty1753.3852047.93516.80%
page-rank2537.7162968.95116.99%
future-genetic1501.8891819.68121.16%
scala-stm-bench7  782.727951.46221.56%
finagle-chirper   1176.1521482.2726.03%
dec-tree1066.931348.83726.42%
scala-kmeans197.251264.68234.19%
db-shootout3342.4614609.73937.92%
rx-scrabble180.222265.86847.52%
als1813.852799.99354.37%
chi-square902.211402.55555.46%
gauss-mix670.1271042.11855.51%
scrabble270.147423.27256.68%
log-regression1294.1462155.79266.58%
par-mnemonics1623.9633848.12136.96%
mnemonics2075.1044972.762139.64%
scala-doku1883.2644699.728149.55%
neo4j-analytics3514.991 9190.704 161.47%

Detailed Run Instructions

Here are the exact commands we used for each of the benchmarks. For each tests we run the following command:

$JAVA_HOME/bin/java -Xms12g -Xmx12g -jar $RENAISSANCE_HOME/renaissance-0.11.0.jar -r 700 all

Try It Yourself

Azul Platform Prime Stream Builds are free for testing and evaluation. Try it yourself.

The post Benchmarking Renaissance on OpenJDK and Azul Platform Prime appeared first on Azul | Better Java Performance, Superior Java Support.

Previous Flipbook
Azul Platform Prime Information Sheet
Azul Platform Prime Information Sheet

Exploring Azul Platform Prime? Benefits include infrastructure savings, delivered by better performing, mor...

Next Article
The Importance of Java Security Updates
The Importance of Java Security Updates

Recently, I was in discussion with a Java user at a bank about the possibilities of using Azul Platform Cor...