Chapel VS Javascript benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
javascript 1.js 1299ms 21ms 243.8MB 1663ms 47ms bun 0.1.13
chapel 4.chpl 2299ms 1.2ms 58.2MB 2277ms 13ms chpl 1.27.0
chapel 3.chpl 2433ms 5.5ms 50.3MB 2413ms 13ms chpl 1.27.0
javascript 1.js 3480ms 97ms 266.7MB 2650ms 1267ms node 18.9.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
javascript 1.js 117ms 2.5ms 102.8MB 100ms 13ms bun 0.1.13
javascript 1.js 204ms 1.9ms 84.2MB 180ms 30ms node 18.9.0
chapel 3.chpl 222ms 0.5ms 13.1MB 210ms 3ms chpl 1.27.0
chapel 4.chpl 222ms 7.3ms 26.1MB 210ms 0ms chpl 1.27.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
javascript 1.js 2393ms 45ms 80.6MB 2417ms 43ms node 18.9.0
javascript 1.js 3485ms 11ms 115.3MB 3500ms 40ms bun 0.1.13
chapel 1-m.chpl 4004ms 54ms 169.4MB 7737ms 47ms chpl 1.27.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
javascript 1.js 250ms 5.2ms 105.1MB 270ms 13ms bun 0.1.13
javascript 1.js 255ms 1.2ms 61.8MB 203ms 20ms node 18.9.0
chapel 1-m.chpl 263ms 2.4ms 30.2MB 480ms 3ms chpl 1.27.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 0.5ms 36.1MB 90ms 0ms chpl 1.27.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 46ms 1.3ms 34.1MB 37ms 3ms chpl 1.27.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 147ms 2.2ms 32.0MB 250ms 3ms chpl 1.27.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 34ms 1.5ms 32.0MB 30ms 7ms chpl 1.27.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
javascript 1.js 15ms 0.4ms 50.6MB 0ms 0ms bun 0.1.13
chapel 1.chpl 18ms 3.7ms 32.4MB 10ms 0ms chpl 1.27.0
javascript 1.js 56ms 0.9ms 41.9MB 40ms 2ms node 18.9.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 936ms 1.2ms 100.4MB 1733ms 13ms chpl 1.27.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 157ms 2.7ms 90.4MB 257ms 10ms chpl 1.27.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 363ms 2.4ms 32.4MB 350ms 7ms chpl 1.27.0
javascript 6.js 627ms 5.8ms 46.8MB 613ms 7ms node 18.9.0
javascript 6.js 1046ms 25ms 69.7MB 1037ms 3ms bun 0.1.13

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 56ms 1.3ms 32.4MB 50ms 0ms chpl 1.27.0
javascript 6.js 123ms 0.9ms 46.9MB 100ms 10ms node 18.9.0
javascript 6.js 125ms 4.6ms 67.4MB 117ms 3ms bun 0.1.13

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 593ms 1.5ms 34.1MB 580ms 7ms chpl 1.27.0
javascript 3.js timeout 0.0ms 0.0MB 0ms 0ms node 18.9.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 154ms 1.9ms 34.1MB 143ms 3ms chpl 1.27.0
javascript 3.js 1611ms 2.4ms 62.8MB 1600ms 13ms node 18.9.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 2015ms 13ms 251.7MB 1870ms 133ms chpl 1.27.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 222ms 1.0ms 56.8MB 203ms 10ms chpl 1.27.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1536ms 10.0ms 32.3MB 1527ms 0ms chpl 1.27.0
javascript 1.js 2952ms 5.6ms 100.1MB 2980ms 20ms bun 0.1.13
javascript 1.js 3484ms 5.4ms 52.0MB 3490ms 13ms node 18.9.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 398ms 0.9ms 32.3MB 383ms 3ms chpl 1.27.0
javascript 1.js 759ms 1.2ms 104.8MB 770ms 13ms bun 0.1.13
javascript 1.js 924ms 1.8ms 49.9MB 927ms 7ms node 18.9.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2299ms 91ms 32.5MB 4450ms 7ms chpl 1.27.0
javascript 6-m.js 2762ms 13ms 70.4MB 5210ms 17ms node 18.9.0
chapel 1.chpl 4375ms 0.8ms 32.5MB 4363ms 3ms chpl 1.27.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 581ms 0.2ms 32.5MB 1107ms 0ms chpl 1.27.0
javascript 6-m.js 864ms 2.9ms 70.0MB 1537ms 23ms node 18.9.0
chapel 1.chpl 1110ms 0.7ms 32.4MB 1100ms 3ms chpl 1.27.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 165ms 2.1ms 32.5MB 287ms 0ms chpl 1.27.0
chapel 1.chpl 306ms 19ms 32.4MB 283ms 10ms chpl 1.27.0
javascript 6-m.js 404ms 4.4ms 67.7MB 577ms 30ms node 18.9.0