Programming Language and compiler
Benchmarks

OCaml VS Java benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 672ms 7.4ms 412.4MB 670ms 97ms openjdk 20
java 2.java 673ms 14ms 413.9MB 690ms 80ms openjdk 22
java 2.java 799ms 50ms 666.8MB 807ms 187ms graal/jvm 17.0.7
java 2.java 1336ms 56ms 1147.9MB 903ms 630ms openjdk/zgc 20
ocaml 1.ml 4948ms 10ms 153.4MB 4887ms 43ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 165ms 6.2ms 108.9MB 160ms 27ms openjdk 22
java 2.java 165ms 3.9ms 108.4MB 157ms 33ms openjdk 20
java 2.java 187ms 9.1ms 164.5MB 217ms 40ms graal/jvm 17.0.7
java 2.java 298ms 0.3ms 235.9MB 193ms 137ms openjdk/zgc 20
ocaml 1.ml 341ms 3.5ms 22.9MB 323ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 1660ms 24ms 92.0MB 3147ms 30ms graal/jvm 17.0.7
java 1-m.java 1678ms 19ms 43.4MB 3203ms 13ms openjdk 22
java 1-m.java 1706ms 16ms 42.4MB 3177ms 57ms openjdk/zgc 20
java 1-m.java 1751ms 60ms 40.7MB 3347ms 10ms openjdk 20
ocaml 2.ml 3984ms 14ms 2.8MB 3973ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 275ms 5.3ms 40.7MB 440ms 13ms openjdk 20
java 1-m.java 283ms 13ms 92.9MB 453ms 20ms graal/jvm 17.0.7
java 1-m.java 285ms 8.9ms 43.6MB 443ms 17ms openjdk 22
java 1-m.java 311ms 6.6ms 42.4MB 427ms 53ms openjdk/zgc 20
ocaml 2.ml 331ms 1.3ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 425ms 0.3ms 22.7MB 407ms 3ms ocaml 5.0.0
java 4.java 512ms 6.3ms 41.0MB 587ms 13ms openjdk 22
java 4.java 521ms 11ms 40.5MB 583ms 17ms openjdk 20
java 4.java 558ms 4.2ms 40.2MB 583ms 57ms openjdk/zgc 20
java 4.java 612ms 3.2ms 97.1MB 797ms 27ms graal/jvm 17.0.7

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 2.4ms 4.9MB 37ms 0ms ocaml 5.0.0
java 4.java 147ms 14ms 39.8MB 167ms 7ms openjdk 20
java 4.java 149ms 10ms 40.2MB 170ms 7ms openjdk 22
java 4.java 158ms 3.6ms 86.0MB 183ms 17ms graal/jvm 17.0.7
java 4.java 189ms 7.0ms 39.3MB 170ms 50ms openjdk/zgc 20

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.7ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0
java 1.java 72ms 3.2ms 61.2MB 70ms 8ms graal/jvm 17.0.7
java 1.java 76ms 1.1ms 41.5MB 76ms 8ms openjdk 22
java 1.java 81ms 4.5ms 39.3MB 78ms 10ms openjdk 20
java 1.java 118ms 5.5ms 38.2MB 74ms 52ms openjdk/zgc 20

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 264ms 2.8ms 6.7MB 250ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 781ms 8.1ms 6.7MB 767ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 118ms 1.6ms 6.0MB 110ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 512ms 13ms 287.9MB 523ms 67ms openjdk 22
java 1.java 521ms 6.6ms 286.6MB 533ms 67ms openjdk 20
java 1.java 573ms 65ms 370.7MB 733ms 83ms graal/jvm 17.0.7
java 1.java 957ms 46ms 764.8MB 643ms 447ms openjdk/zgc 20
ocaml 1.ml 1524ms 6.3ms 69.4MB 1483ms 23ms ocaml 5.0.0
ocaml 2.ml 3227ms 33ms 74.1MB 3187ms 23ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 229ms 7.2ms 25.6MB 213ms 3ms ocaml 5.0.0
java 1.java 230ms 13ms 223.6MB 233ms 47ms openjdk 22
java 1.java 233ms 11ms 222.5MB 247ms 43ms openjdk 20
java 1-m.java 269ms 18ms 279.1MB 370ms 57ms graal/jvm 17.0.7
java 1.java 433ms 5.6ms 346.0MB 257ms 217ms openjdk/zgc 20
ocaml 2.ml 576ms 3.7ms 30.2MB 557ms 3ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 470ms 0.5ms 2.9MB 460ms 0ms ocaml 5.0.0
java 1.java 546ms 4.8ms 87.4MB 567ms 27ms graal/jvm 17.0.7
java 1.java 568ms 7.8ms 40.5MB 577ms 13ms openjdk 20
java 1.java 569ms 5.5ms 43.6MB 580ms 10ms openjdk 22
java 1.java 608ms 2.8ms 41.6MB 577ms 60ms openjdk/zgc 20
java 2.java 1893ms 12ms 514.6MB 1927ms 103ms openjdk 20
java 2.java 1933ms 5.9ms 506.0MB 1947ms 120ms openjdk 22
java 2.java 2609ms 2.3ms 1195.5MB 2063ms 730ms openjdk/zgc 20

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 50ms 0.6ms 2.9MB 40ms 0ms ocaml 5.0.0
java 1.java 141ms 3.4ms 84.6MB 173ms 13ms graal/jvm 17.0.7
java 1.java 148ms 3.9ms 40.8MB 160ms 17ms openjdk 20
java 1.java 149ms 5.8ms 41.7MB 163ms 10ms openjdk 22
java 1.java 197ms 7.3ms 41.7MB 167ms 57ms openjdk/zgc 20
java 2.java 424ms 2.6ms 338.1MB 493ms 60ms openjdk 20
java 2.java 425ms 2.7ms 330.8MB 493ms 67ms openjdk 22
java 2.java 762ms 1.2ms 522.5MB 547ms 360ms openjdk/zgc 20

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 694ms 14ms 85.4MB 700ms 23ms openjdk 22
java 1.java 734ms 33ms 84.7MB 750ms 23ms openjdk 20
java 1.java 970ms 84ms 110.1MB 930ms 87ms openjdk/zgc 20
java 2.java 1000ms 5.3ms 48.9MB 980ms 57ms openjdk/zgc 20
java 2.java 1017ms 8.0ms 51.9MB 1053ms 7ms openjdk 22
java 2.java 1020ms 4.5ms 50.9MB 1043ms 13ms openjdk 20
java 1-m.java 1226ms 33ms 242.1MB 1830ms 90ms graal/jvm 17.0.7
java 2-m.java 1700ms 6.4ms 190.7MB 3000ms 70ms graal/jvm 17.0.7
ocaml 1.ml 1999ms 32ms 550.5MB 1893ms 87ms ocaml 5.0.0
ocaml 2.ml 2424ms 16ms 19.0MB 2410ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 240ms 8.0ms 59.6MB 257ms 23ms openjdk 22
java 1.java 241ms 1.4ms 58.8MB 257ms 20ms openjdk 20
java 1.java 290ms 3.0ms 59.3MB 263ms 63ms openjdk/zgc 20
java 2.java 327ms 5.8ms 45.0MB 350ms 17ms openjdk 20
java 2.java 330ms 7.5ms 47.6MB 350ms 17ms openjdk 22
java 1-m.java 339ms 12ms 151.2MB 477ms 40ms graal/jvm 17.0.7
ocaml 1.ml 339ms 11ms 140.3MB 307ms 17ms ocaml 5.0.0
java 2.java 360ms 6.3ms 44.3MB 340ms 53ms openjdk/zgc 20
ocaml 2.ml 609ms 28ms 9.1MB 590ms 0ms ocaml 5.0.0
java 2-m.java 623ms 7.0ms 150.9MB 1083ms 63ms graal/jvm 17.0.7

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3.java timeout 0.0ms 250.5MB 5317ms 63ms graal/jvm 17.0.7
java 3.java timeout 0.0ms 204.5MB 5253ms 63ms openjdk 20
java 3.java timeout 0.0ms 228.0MB 5277ms 57ms openjdk 22
java 3.java timeout 0.0ms 331.8MB 4970ms 223ms openjdk/zgc 20
ocaml 2.ml timeout 0.0ms 181.9MB 4927ms 47ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 705ms 2.8ms 52.5MB 683ms 10ms ocaml 5.0.0
java 3.java 1019ms 5.8ms 167.1MB 1397ms 50ms graal/jvm 17.0.7
java 3.java 1043ms 13ms 98.4MB 1397ms 27ms openjdk 22
java 3.java 1066ms 8.2ms 111.9MB 1410ms 23ms openjdk 20
java 3.java 1170ms 23ms 156.7MB 1343ms 123ms openjdk/zgc 20

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 4198ms 143ms 90.9MB 8130ms 17ms graal/jvm 17.0.7
java 2-m.java 4416ms 29ms 45.5MB 8555ms 15ms openjdk 22
java 2.java timeout 0.0ms 40.2MB 9730ms 13ms openjdk 20
java 2.java timeout 0.0ms 42.4MB 9590ms 40ms openjdk/zgc 20
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 1192ms 17ms 43.5MB 2213ms 13ms openjdk 22
java 2-m.java 1208ms 38ms 91.5MB 2243ms 20ms graal/jvm 17.0.7
ocaml 2.ml 1639ms 5.6ms 3.7MB 1623ms 0ms ocaml 5.0.0
java 2-m.java 1701ms 17ms 40.6MB 3223ms 3ms openjdk 20
java 2-m.java 1845ms 184ms 40.3MB 3417ms 60ms openjdk/zgc 20

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 412ms 0.4ms 3.3MB 400ms 0ms ocaml 5.0.0
java 2-m.java 418ms 13ms 43.6MB 710ms 7ms openjdk 22
java 2-m.java 435ms 10ms 93.6MB 717ms 33ms graal/jvm 17.0.7
java 2-m.java 595ms 5.3ms 40.9MB 1060ms 10ms openjdk 20
java 2-m.java 638ms 37ms 42.3MB 1057ms 57ms openjdk/zgc 20