Programming Language and compiler
Benchmarks

Chapel VS Java benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 470ms 7.7ms 638.0MB 577ms 97ms openjdk 23
java 2.java 471ms 26ms 576.1MB 553ms 93ms openjdk 21
java 2-m.java 471ms 4.1ms 646.9MB 670ms 100ms graal/jvm 17.0.8
java 2.java 1177ms 9.4ms 1047.0MB 560ms 777ms openjdk/zgc 21
chapel 4.chpl 1955ms 6.7ms 66.3MB 1940ms 3ms chpl 1.31.0
chapel 3.chpl 2044ms 11ms 66.3MB 2033ms 3ms chpl 1.31.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 121ms 3.3ms 98.0MB 150ms 37ms openjdk 23
java 2.java 123ms 1.3ms 167.1MB 143ms 37ms openjdk 21
java 2-m.java 170ms 4.2ms 230.2MB 260ms 47ms graal/jvm 17.0.8
chapel 4.chpl 192ms 0.3ms 36.4MB 183ms 0ms chpl 1.31.0
chapel 3.chpl 196ms 2.7ms 34.4MB 183ms 0ms chpl 1.31.0
java 2.java 309ms 1.6ms 242.5MB 163ms 200ms openjdk/zgc 21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 1914ms 216ms 260.7MB 7217ms 110ms openjdk 21
chapel 1-m.chpl 2249ms 48ms 525.8MB 4357ms 87ms chpl 1.31.0
java 1-m.java 2372ms 102ms 240.5MB 9013ms 113ms openjdk 23
java 1-m.java 2694ms 224ms 1170.6MB 8560ms 1093ms openjdk/zgc 21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 176ms 5.9ms 231.6MB 287ms 23ms chpl 1.31.0
java 1-m.java 413ms 6.1ms 91.0MB 1353ms 50ms openjdk 23
java 1-m.java 422ms 18ms 122.6MB 1387ms 63ms openjdk 21
java 1-m.java 641ms 15ms 216.0MB 1743ms 227ms openjdk/zgc 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 79ms 0.6ms 36.5MB 70ms 3ms chpl 1.31.0
java 1-m.java 640ms 33ms 265.7MB 1690ms 80ms openjdk 21
java 1-m.java 642ms 52ms 228.2MB 1693ms 77ms openjdk 23
java 1-m.java 643ms 11ms 376.6MB 1230ms 117ms graal/jvm 17.0.8
java 1-m.java 949ms 30ms 530.5MB 1617ms 407ms openjdk/zgc 21

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 41ms 0.9ms 34.5MB 30ms 0ms chpl 1.31.0
java 1-m.java 326ms 41ms 231.0MB 630ms 70ms graal/jvm 17.0.8
java 1-m.java 356ms 19ms 124.5MB 953ms 67ms openjdk 23
java 1-m.java 388ms 12ms 196.0MB 1040ms 63ms openjdk 21
java 1-m.java 524ms 36ms 217.6MB 1027ms 217ms openjdk/zgc 21

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 113ms 0.6ms 32.4MB 190ms 0ms chpl 1.31.0
java 4.java 450ms 4.7ms 47.5MB 527ms 20ms openjdk 21
java 4.java 453ms 13ms 106.3MB 630ms 47ms graal/jvm 17.0.8
java 4.java 466ms 10ms 49.3MB 560ms 17ms openjdk 23
java 4.java 560ms 11ms 45.2MB 537ms 127ms openjdk/zgc 21

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 29ms 0.2ms 32.4MB 20ms 3ms chpl 1.31.0
java 4.java 122ms 1.2ms 46.7MB 167ms 17ms openjdk 21
java 4-m.java 126ms 2.6ms 47.9MB 163ms 27ms openjdk 23
java 4-m.java 130ms 3.9ms 97.0MB 177ms 43ms graal/jvm 17.0.8
java 4.java 243ms 1.7ms 45.8MB 170ms 130ms openjdk/zgc 21

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 16ms 0.3ms 32.8MB 10ms 0ms chpl 1.31.0
java 1.java 64ms 3.0ms 58.5MB 62ms 24ms graal/jvm 17.0.8
java 1.java 68ms 5.7ms 44.4MB 68ms 20ms openjdk 23
java 1.java 71ms 3.9ms 43.8MB 72ms 22ms openjdk 21
java 1.java 186ms 3.8ms 44.8MB 76ms 136ms openjdk/zgc 21

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 751ms 2.5ms 103.0MB 1410ms 10ms chpl 1.31.0
java 3-m.java 997ms 74ms 129.0MB 3383ms 50ms openjdk 21
java 3-m.java 1028ms 48ms 160.8MB 3493ms 63ms openjdk 23
java 3-m.java 1086ms 55ms 180.1MB 3670ms 77ms graal/jvm 17.0.8
java 3-m.java 1378ms 17ms 178.8MB 4300ms 213ms openjdk/zgc 21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 121ms 0.9ms 91.1MB 193ms 7ms chpl 1.31.0
java 3-m.java 326ms 2.0ms 99.6MB 943ms 47ms openjdk 21
java 3-m.java 334ms 11ms 138.4MB 887ms 57ms graal/jvm 17.0.8
java 3-m.java 350ms 15ms 90.0MB 1040ms 50ms openjdk 23
java 3-m.java 421ms 3.4ms 100.2MB 847ms 167ms openjdk/zgc 21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 328ms 1.8ms 32.8MB 320ms 0ms chpl 1.31.0
java 1.java 441ms 0.5ms 44.8MB 473ms 17ms openjdk 21
java 1.java 443ms 0.5ms 48.2MB 473ms 20ms openjdk 23
java 1.java 448ms 4.1ms 87.2MB 477ms 33ms graal/jvm 17.0.8
java 1.java 561ms 5.7ms 44.9MB 477ms 143ms openjdk/zgc 21
java 2.java 1229ms 2.7ms 655.9MB 1363ms 70ms openjdk 21
java 2.java 1235ms 8.6ms 756.2MB 1357ms 87ms openjdk 23
java 2.java 3343ms 165ms 2671.0MB 1647ms 1893ms openjdk/zgc 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 52ms 0.1ms 32.9MB 37ms 7ms chpl 1.31.0
java 1.java 112ms 4.9ms 45.5MB 147ms 13ms openjdk 21
java 1.java 119ms 3.9ms 47.9MB 147ms 20ms openjdk 23
java 1.java 124ms 8.9ms 87.2MB 153ms 30ms graal/jvm 17.0.8
java 1.java 239ms 6.7ms 46.6MB 147ms 147ms openjdk/zgc 21
java 2-m.java 296ms 11ms 364.7MB 430ms 60ms openjdk 21
java 2-m.java 307ms 7.8ms 389.9MB 443ms 60ms openjdk 23
java 2.java 699ms 7.2ms 532.4MB 463ms 420ms openjdk/zgc 21

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 450ms 0.4ms 34.3MB 440ms 0ms chpl 1.31.0
java 1.java 3201ms 24ms 449.2MB 3637ms 93ms graal/jvm 17.0.8
java 1.java 3712ms 28ms 353.0MB 4583ms 120ms openjdk 21
java 1.java 3720ms 47ms 393.7MB 4540ms 113ms openjdk 23
java 1.java timeout 0.0ms 1888.5MB 4683ms 1183ms openjdk/zgc 21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 121ms 0.8ms 34.4MB 113ms 0ms chpl 1.31.0
java 1-m.java 892ms 9.3ms 370.8MB 1247ms 97ms graal/jvm 17.0.8
java 1-m.java 979ms 26ms 350.8MB 1753ms 90ms openjdk 21
java 1-m.java 1036ms 15ms 389.8MB 1740ms 103ms openjdk 23
java 1.java 2005ms 40ms 1329.4MB 1683ms 1067ms openjdk/zgc 21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1387ms 3.4ms 224.1MB 1337ms 37ms chpl 1.31.0
java 3.java timeout 0.0ms 409.5MB 5413ms 93ms graal/jvm 17.0.8
java 3.java timeout 0.0ms 302.4MB 5333ms 47ms openjdk 21
java 3.java timeout 0.0ms 305.1MB 5333ms 53ms openjdk 23
java 3.java timeout 0.0ms 469.2MB 4950ms 310ms openjdk/zgc 21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 170ms 0.4ms 52.9MB 147ms 13ms chpl 1.31.0
java 3-m.java 790ms 35ms 183.2MB 1160ms 67ms graal/jvm 17.0.8
java 3-m.java 807ms 10ms 132.0MB 1210ms 30ms openjdk 21
java 3-m.java 831ms 18ms 132.5MB 1220ms 40ms openjdk 23
java 3.java 947ms 6.5ms 135.2MB 1103ms 187ms openjdk/zgc 21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1210ms 50ms 33.1MB 1200ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 312ms 3.8ms 33.1MB 303ms 0ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1932ms 20ms 32.9MB 3827ms 0ms chpl 1.31.0
java 2-m.java 1961ms 4.4ms 47.6MB 7457ms 33ms openjdk 21
java 2-m.java 1968ms 4.8ms 48.4MB 7473ms 27ms openjdk 23
java 2-m.java 2079ms 15ms 45.4MB 7450ms 147ms openjdk/zgc 21
java 2-m.java 2453ms 9.0ms 99.2MB 8760ms 27ms graal/jvm 17.0.8
chapel 1.chpl 3718ms 11ms 32.8MB 3707ms 0ms chpl 1.31.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 496ms 0.6ms 32.9MB 957ms 0ms chpl 1.31.0
java 2-m.java 584ms 3.8ms 48.4MB 2047ms 17ms openjdk 23
java 2-m.java 584ms 2.4ms 47.5MB 2050ms 23ms openjdk 21
java 2-m.java 710ms 3.8ms 47.5MB 2070ms 140ms openjdk/zgc 21
java 2-m.java 739ms 5.6ms 96.7MB 2483ms 43ms graal/jvm 17.0.8
chapel 1.chpl 947ms 4.7ms 32.8MB 937ms 3ms chpl 1.31.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 140ms 0.2ms 32.9MB 243ms 0ms chpl 1.31.0
java 2-m.java 243ms 3.7ms 48.4MB 690ms 17ms openjdk 23
java 2-m.java 252ms 12ms 48.0MB 717ms 23ms openjdk 21
chapel 1.chpl 253ms 1.1ms 32.8MB 243ms 0ms chpl 1.31.0
java 2-m.java 281ms 21ms 98.1MB 813ms 33ms graal/jvm 17.0.8
java 2-m.java 358ms 5.7ms 47.1MB 680ms 140ms openjdk/zgc 21