Programming Language and compiler
Benchmarks

Chapel VS Java benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 672ms 7.4ms 412.4MB 670ms 97ms openjdk 20
java 2.java 673ms 14ms 413.9MB 690ms 80ms openjdk 22
java 2.java 799ms 50ms 666.8MB 807ms 187ms graal/jvm 17.0.7
java 2.java 1336ms 56ms 1147.9MB 903ms 630ms openjdk/zgc 20
chapel 4.chpl 2278ms 2.2ms 64.2MB 2247ms 20ms chpl 1.31.0
chapel 3.chpl 2393ms 13ms 50.2MB 2373ms 10ms chpl 1.31.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 165ms 6.2ms 108.9MB 160ms 27ms openjdk 22
java 2.java 165ms 3.9ms 108.4MB 157ms 33ms openjdk 20
java 2.java 187ms 9.1ms 164.5MB 217ms 40ms graal/jvm 17.0.7
chapel 4.chpl 220ms 1.8ms 28.0MB 203ms 7ms chpl 1.31.0
chapel 3.chpl 225ms 0.7ms 24.1MB 207ms 7ms chpl 1.31.0
java 2.java 298ms 0.3ms 235.9MB 193ms 137ms openjdk/zgc 20

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 4044ms 31ms 83.4MB 7847ms 37ms chpl 1.31.0
java 1.java timeout 0.0ms 142.9MB 9613ms 87ms openjdk 20
java 1.java timeout 0.0ms 146.5MB 9657ms 77ms openjdk 22
java 1.java timeout 0.0ms 931.7MB 9253ms 423ms openjdk/zgc 20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 286ms 15ms 54.0MB 510ms 7ms chpl 1.31.0
java 1-m.java 796ms 16ms 113.4MB 1413ms 57ms openjdk 20
java 1-m.java 887ms 100ms 102.5MB 1617ms 37ms openjdk 22
java 1-m.java 899ms 17ms 206.7MB 1447ms 160ms openjdk/zgc 20

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 2.0ms 36.0MB 93ms 0ms chpl 1.31.0
java 1-m.java 814ms 88ms 182.0MB 1423ms 77ms openjdk 20
java 1-m.java 834ms 39ms 326.2MB 1440ms 113ms graal/jvm 17.0.7
java 1-m.java 888ms 79ms 197.5MB 1563ms 90ms openjdk 22
java 1-m.java 1052ms 56ms 468.2MB 1553ms 307ms openjdk/zgc 20

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 47ms 1.4ms 34.0MB 30ms 7ms chpl 1.31.0
java 1-m.java 383ms 16ms 161.4MB 613ms 53ms graal/jvm 17.0.7
java 1-m.java 430ms 5.0ms 118.4MB 703ms 33ms openjdk 22
java 1-m.java 447ms 27ms 115.5MB 730ms 40ms openjdk 20
java 1-m.java 527ms 17ms 206.2MB 743ms 147ms openjdk/zgc 20

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 148ms 2.2ms 32.0MB 253ms 0ms chpl 1.31.0
java 4.java 512ms 6.3ms 41.0MB 587ms 13ms openjdk 22
java 4.java 521ms 11ms 40.5MB 583ms 17ms openjdk 20
java 4.java 558ms 4.2ms 40.2MB 583ms 57ms openjdk/zgc 20
java 4.java 612ms 3.2ms 97.1MB 797ms 27ms graal/jvm 17.0.7

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 32ms 1.1ms 32.0MB 30ms 0ms chpl 1.31.0
java 4.java 147ms 14ms 39.8MB 167ms 7ms openjdk 20
java 4.java 149ms 10ms 40.2MB 170ms 7ms openjdk 22
java 4.java 158ms 3.6ms 86.0MB 183ms 17ms graal/jvm 17.0.7
java 4.java 189ms 7.0ms 39.3MB 170ms 50ms openjdk/zgc 20

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 17ms 0.6ms 32.3MB 10ms 0ms chpl 1.31.0
java 1.java 72ms 3.2ms 61.2MB 70ms 8ms graal/jvm 17.0.7
java 1.java 76ms 1.1ms 41.5MB 76ms 8ms openjdk 22
java 1.java 81ms 4.5ms 39.3MB 78ms 10ms openjdk 20
java 1.java 118ms 5.5ms 38.2MB 74ms 52ms openjdk/zgc 20

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 933ms 1.9ms 85.0MB 1723ms 13ms chpl 1.31.0
java 3-m.java 1459ms 35ms 114.5MB 2660ms 40ms openjdk 20
java 3-m.java 1485ms 8.5ms 114.9MB 2710ms 33ms openjdk 22
java 3-m.java 1563ms 84ms 169.6MB 2880ms 53ms graal/jvm 17.0.7
java 3-m.java 1945ms 74ms 171.7MB 3443ms 137ms openjdk/zgc 20

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 163ms 3.3ms 76.4MB 270ms 10ms chpl 1.31.0
java 3-m.java 457ms 23ms 84.8MB 763ms 17ms openjdk 20
java 3-m.java 462ms 17ms 86.8MB 783ms 13ms openjdk 22
java 3-m.java 465ms 26ms 134.9MB 763ms 43ms graal/jvm 17.0.7
java 3-m.java 476ms 21ms 94.0MB 710ms 93ms openjdk/zgc 20

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 363ms 1.0ms 32.3MB 353ms 3ms chpl 1.31.0
java 1.java 546ms 4.8ms 87.4MB 567ms 27ms graal/jvm 17.0.7
java 1.java 568ms 7.8ms 40.5MB 577ms 13ms openjdk 20
java 1.java 569ms 5.5ms 43.6MB 580ms 10ms openjdk 22
java 1.java 608ms 2.8ms 41.6MB 577ms 60ms openjdk/zgc 20
java 2.java 1893ms 12ms 514.6MB 1927ms 103ms openjdk 20
java 2.java 1933ms 5.9ms 506.0MB 1947ms 120ms openjdk 22
java 2.java 2609ms 2.3ms 1195.5MB 2063ms 730ms openjdk/zgc 20

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 55ms 1.2ms 32.3MB 47ms 3ms chpl 1.31.0
java 1.java 141ms 3.4ms 84.6MB 173ms 13ms graal/jvm 17.0.7
java 1.java 148ms 3.9ms 40.8MB 160ms 17ms openjdk 20
java 1.java 149ms 5.8ms 41.7MB 163ms 10ms openjdk 22
java 1.java 197ms 7.3ms 41.7MB 167ms 57ms openjdk/zgc 20
java 2.java 424ms 2.6ms 338.1MB 493ms 60ms openjdk 20
java 2.java 425ms 2.7ms 330.8MB 493ms 67ms openjdk 22
java 2.java 762ms 1.2ms 522.5MB 547ms 360ms openjdk/zgc 20

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 596ms 3.6ms 34.1MB 577ms 3ms chpl 1.31.0
java 1.java 4975ms 15ms 338.9MB 5350ms 67ms graal/jvm 17.0.7
java 1.java timeout 0.0ms 299.0MB 5433ms 90ms openjdk 20
java 1.java timeout 0.0ms 285.3MB 5593ms 80ms openjdk 22
java 1.java timeout 0.0ms 1177.0MB 5083ms 597ms openjdk/zgc 20

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 156ms 3.1ms 34.1MB 147ms 0ms chpl 1.31.0
java 1.java 1328ms 19ms 352.8MB 1673ms 63ms graal/jvm 17.0.7
java 1.java 1448ms 18ms 250.9MB 1840ms 73ms openjdk 20
java 1.java 1460ms 5.9ms 305.3MB 1907ms 63ms openjdk 22
java 1.java 1985ms 21ms 968.9MB 1903ms 623ms openjdk/zgc 20

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1933ms 23ms 221.8MB 1793ms 130ms chpl 1.31.0
java 3.java timeout 0.0ms 250.5MB 5317ms 63ms graal/jvm 17.0.7
java 3.java timeout 0.0ms 204.5MB 5253ms 63ms openjdk 20
java 3.java timeout 0.0ms 228.0MB 5277ms 57ms openjdk 22
java 3.java timeout 0.0ms 331.8MB 4970ms 223ms openjdk/zgc 20

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 216ms 2.4ms 52.8MB 183ms 23ms chpl 1.31.0
java 3.java 1019ms 5.8ms 167.1MB 1397ms 50ms graal/jvm 17.0.7
java 3.java 1043ms 13ms 98.4MB 1397ms 27ms openjdk 22
java 3.java 1066ms 8.2ms 111.9MB 1410ms 23ms openjdk 20
java 3.java 1170ms 23ms 156.7MB 1343ms 123ms openjdk/zgc 20

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1543ms 3.8ms 32.4MB 1533ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 404ms 1.8ms 32.4MB 383ms 7ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2241ms 4.7ms 32.2MB 4403ms 3ms chpl 1.31.0
java 2-m.java 4198ms 143ms 90.9MB 8130ms 17ms graal/jvm 17.0.7
chapel 1.chpl 4378ms 1.3ms 32.3MB 4367ms 3ms chpl 1.31.0
java 2-m.java 4416ms 29ms 45.5MB 8555ms 15ms openjdk 22
java 2.java timeout 0.0ms 40.2MB 9730ms 13ms openjdk 20
java 2.java timeout 0.0ms 42.4MB 9590ms 40ms openjdk/zgc 20

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 592ms 12ms 32.2MB 1117ms 0ms chpl 1.31.0
chapel 1.chpl 1114ms 1.0ms 32.3MB 1100ms 0ms chpl 1.31.0
java 2-m.java 1192ms 17ms 43.5MB 2213ms 13ms openjdk 22
java 2-m.java 1208ms 38ms 91.5MB 2243ms 20ms graal/jvm 17.0.7
java 2-m.java 1701ms 17ms 40.6MB 3223ms 3ms openjdk 20
java 2-m.java 1845ms 184ms 40.3MB 3417ms 60ms openjdk/zgc 20

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 165ms 1.0ms 32.2MB 287ms 3ms chpl 1.31.0
chapel 1.chpl 298ms 4.4ms 32.3MB 290ms 0ms chpl 1.31.0
java 2-m.java 418ms 13ms 43.6MB 710ms 7ms openjdk 22
java 2-m.java 435ms 10ms 93.6MB 717ms 33ms graal/jvm 17.0.7
java 2-m.java 595ms 5.3ms 40.9MB 1060ms 10ms openjdk 20
java 2-m.java 638ms 37ms 42.3MB 1057ms 57ms openjdk/zgc 20