Programming Language and compiler
Benchmarks

OCaml VS Java benchmarks

Current benchmark data was generated on Thu May 04 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 760ms 15ms 411.4MB 753ms 127ms openjdk 21
java 2.java 796ms 69ms 410.1MB 707ms 147ms openjdk 20
java 2.java 943ms 154ms 896.1MB 940ms 253ms graal/jvm 17.0.7
java 2.java 1387ms 14ms 1006.5MB 1000ms 623ms openjdk/zgc 20
ocaml 1.ml timeout 0.0ms 145.4MB 4903ms 73ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 184ms 8.1ms 110.1MB 177ms 30ms openjdk 20
java 2.java 190ms 15ms 109.9MB 170ms 40ms openjdk 21
java 2.java 208ms 22ms 163.1MB 237ms 67ms graal/jvm 17.0.7
java 2.java 342ms 5.5ms 238.9MB 177ms 187ms openjdk/zgc 20
ocaml 1.ml 359ms 8.8ms 22.9MB 337ms 7ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 1508ms 127ms 91.9MB 2813ms 43ms graal/jvm 17.0.7
java 1-m.java 1523ms 27ms 40.7MB 2870ms 20ms openjdk 20
java 1-m.java 1561ms 54ms 40.6MB 2873ms 60ms openjdk/zgc 20
java 1-m.java 1592ms 97ms 43.3MB 3020ms 20ms openjdk 21
ocaml 2.ml 3637ms 2.2ms 2.7MB 3620ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 263ms 8.1ms 42.9MB 417ms 20ms openjdk 21
java 1-m.java 270ms 1.9ms 40.7MB 410ms 20ms openjdk 20
java 1-m.java 294ms 7.3ms 91.6MB 460ms 37ms graal/jvm 17.0.7
ocaml 2.ml 303ms 0.9ms 2.8MB 290ms 0ms ocaml 5.0.0
java 1-m.java 320ms 10ms 42.1MB 417ms 63ms openjdk/zgc 20

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 387ms 4.7ms 22.7MB 360ms 7ms ocaml 5.0.0
java 4.java 470ms 7.5ms 42.9MB 543ms 20ms openjdk 21
java 4.java 472ms 5.3ms 40.4MB 543ms 17ms openjdk 20
java 4.java 515ms 15ms 42.0MB 537ms 63ms openjdk/zgc 20
java 4.java 546ms 2.3ms 97.6MB 750ms 30ms graal/jvm 17.0.7

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 42ms 0.4ms 4.9MB 30ms 0ms ocaml 5.0.0
java 4.java 149ms 9.4ms 39.8MB 170ms 10ms openjdk 20
java 4.java 156ms 2.6ms 42.3MB 177ms 10ms openjdk 21
java 4.java 176ms 14ms 87.9MB 203ms 23ms graal/jvm 17.0.7
java 4.java 199ms 6.4ms 38.8MB 160ms 70ms openjdk/zgc 20

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.9ms 0.5ms 2.7MB 0ms 0ms ocaml 5.0.0
java 1.java 84ms 7.3ms 60.1MB 66ms 20ms graal/jvm 17.0.7
java 1.java 90ms 7.4ms 41.4MB 80ms 18ms openjdk 21
java 1.java 92ms 6.2ms 39.2MB 80ms 20ms openjdk 20
java 1.java 136ms 5.9ms 38.5MB 72ms 72ms openjdk/zgc 20

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 250ms 4.9ms 6.7MB 240ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 727ms 1.6ms 6.7MB 717ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 110ms 0.4ms 6.0MB 93ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 598ms 6.9ms 289.1MB 613ms 87ms openjdk 21
java 1.java 601ms 11ms 286.7MB 593ms 100ms openjdk 20
java 1.java 680ms 69ms 380.0MB 887ms 117ms graal/jvm 17.0.7
java 1.java 1084ms 8.4ms 728.2MB 723ms 500ms openjdk/zgc 20
ocaml 1.ml 1931ms 14ms 69.1MB 1880ms 30ms ocaml 5.0.0
ocaml 2.ml 3617ms 28ms 74.2MB 3557ms 43ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 261ms 14ms 224.4MB 250ms 70ms openjdk 21
java 1.java 264ms 10ms 222.4MB 253ms 63ms openjdk 20
ocaml 1.ml 275ms 3.8ms 25.6MB 253ms 3ms ocaml 5.0.0
java 1-m.java 315ms 15ms 283.2MB 417ms 70ms graal/jvm 17.0.7
java 1.java 462ms 6.1ms 329.4MB 273ms 230ms openjdk/zgc 20
ocaml 2.ml 629ms 19ms 30.1MB 610ms 7ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 546ms 8.2ms 2.9MB 533ms 0ms ocaml 5.0.0
java 1.java 588ms 5.5ms 89.6MB 607ms 33ms graal/jvm 17.0.7
java 1.java 637ms 4.7ms 42.0MB 643ms 20ms openjdk 21
java 1.java 649ms 5.6ms 40.4MB 647ms 17ms openjdk 20
java 1.java 710ms 8.6ms 41.8MB 667ms 70ms openjdk/zgc 20
java 2.java 2285ms 14ms 489.1MB 2303ms 120ms openjdk 21
java 2.java 2295ms 14ms 516.0MB 2287ms 140ms openjdk 20
java 2.java 3392ms 24ms 1591.2MB 2457ms 1127ms openjdk/zgc 20

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 59ms 0.7ms 2.8MB 50ms 0ms ocaml 5.0.0
java 1.java 154ms 4.6ms 88.0MB 183ms 30ms graal/jvm 17.0.7
java 1.java 164ms 3.9ms 40.7MB 167ms 13ms openjdk 20
java 1.java 168ms 2.4ms 42.6MB 167ms 23ms openjdk 21
java 1.java 224ms 8.8ms 42.0MB 163ms 83ms openjdk/zgc 20
java 2.java 487ms 3.9ms 345.5MB 530ms 90ms openjdk 21
java 2.java 492ms 7.0ms 340.3MB 517ms 103ms openjdk 20
java 2.java 806ms 5.1ms 484.6MB 577ms 380ms openjdk/zgc 20

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 1027ms 10ms 50.9MB 1057ms 17ms openjdk 20
java 2.java 1029ms 12ms 52.3MB 1063ms 20ms openjdk 21
java 2.java 1043ms 2.9ms 50.8MB 1007ms 83ms openjdk/zgc 20
java 1.java 1347ms 62ms 86.3MB 1370ms 23ms openjdk 21
java 1.java 1439ms 80ms 85.0MB 1457ms 37ms openjdk 20
java 1.java 1524ms 5.5ms 108.7MB 1457ms 110ms openjdk/zgc 20
java 1.java 1774ms 138ms 236.8MB 2413ms 107ms graal/jvm 17.0.7
java 2-m.java 1888ms 238ms 278.5MB 3250ms 110ms graal/jvm 17.0.7
ocaml 2.ml 2718ms 31ms 19.1MB 2703ms 0ms ocaml 5.0.0
ocaml 1.ml 3571ms 30ms 550.6MB 3400ms 157ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 246ms 8.7ms 60.2MB 273ms 17ms openjdk 21
java 1.java 247ms 6.3ms 58.8MB 270ms 23ms openjdk 20
java 1.java 318ms 8.6ms 57.5MB 270ms 93ms openjdk/zgc 20
java 2.java 330ms 4.0ms 45.0MB 360ms 13ms openjdk 20
java 2.java 333ms 4.9ms 46.6MB 350ms 20ms openjdk 21
java 1.java 351ms 12ms 121.8MB 483ms 33ms graal/jvm 17.0.7
java 2.java 374ms 3.0ms 42.1MB 340ms 70ms openjdk/zgc 20
ocaml 2.ml 640ms 4.4ms 9.3MB 627ms 0ms ocaml 5.0.0
java 2-m.java 665ms 4.4ms 163.4MB 1143ms 83ms graal/jvm 17.0.7
ocaml 1.ml 763ms 24ms 140.2MB 713ms 30ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3.java timeout 0.0ms 252.3MB 5367ms 90ms graal/jvm 17.0.7
java 3.java timeout 0.0ms 202.3MB 5253ms 60ms openjdk 20
java 3.java timeout 0.0ms 241.0MB 5237ms 83ms openjdk 21
java 3.java timeout 0.0ms 337.3MB 4933ms 263ms openjdk/zgc 20
ocaml 2.ml timeout 0.0ms 181.9MB 4887ms 90ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 715ms 2.6ms 52.5MB 673ms 27ms ocaml 5.0.0
java 3.java 1003ms 11ms 102.7MB 1307ms 47ms openjdk 21
java 3.java 1035ms 19ms 169.4MB 1463ms 67ms graal/jvm 17.0.7
java 3.java 1037ms 24ms 112.3MB 1353ms 40ms openjdk 20
java 3.java 1156ms 14ms 156.1MB 1313ms 140ms openjdk/zgc 20

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 4343ms 20ms 90.0MB 8373ms 20ms graal/jvm 17.0.7
java 2.java timeout 0.0ms 40.5MB 9717ms 17ms openjdk 20
java 2.java timeout 0.0ms 41.8MB 9700ms 27ms openjdk 21
java 2.java timeout 0.0ms 42.2MB 9607ms 60ms openjdk/zgc 20
ocaml 2.ml timeout 0.0ms 4.2MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 1240ms 3.4ms 88.9MB 2287ms 27ms graal/jvm 17.0.7
ocaml 2.ml 1540ms 14ms 3.5MB 1527ms 0ms ocaml 5.0.0
java 2-m.java 1862ms 90ms 42.5MB 3503ms 33ms openjdk 21
java 2-m.java 1993ms 62ms 40.8MB 3773ms 20ms openjdk 20
java 2-m.java 2007ms 19ms 40.3MB 3713ms 77ms openjdk/zgc 20

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 394ms 0.4ms 3.3MB 380ms 0ms ocaml 5.0.0
java 2-m.java 433ms 5.1ms 91.3MB 710ms 33ms graal/jvm 17.0.7
java 2-m.java 604ms 20ms 42.4MB 1047ms 17ms openjdk 21
java 2-m.java 612ms 8.9ms 40.5MB 1067ms 23ms openjdk 20
java 2-m.java 675ms 22ms 42.2MB 1073ms 80ms openjdk/zgc 20