Programming Language and compiler
Benchmarks

Chapel VS Lua benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2509ms 8.4ms 66.1MB 2477ms 20ms chpl 1.26.0
chapel 3.chpl 2721ms 5.2ms 64.1MB 2687ms 23ms chpl 1.26.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 234ms 1.7ms 34.1MB 213ms 10ms chpl 1.26.0
chapel 3.chpl 245ms 1.0ms 36.1MB 230ms 3ms chpl 1.26.0
lua 1.lua 542ms 22ms 25.2MB 523ms 7ms luajit 2.1.0
lua 1.lua 1204ms 6.2ms 17.3MB 1183ms 3ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 579ms 3.1ms 5.0MB 567ms 0ms luajit 2.1.0
chapel 1-m.chpl 4218ms 372ms 111.4MB 7983ms 47ms chpl 1.26.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 38ms 2.0ms 3.0MB 27ms 0ms luajit 2.1.0
chapel 1-m.chpl 289ms 3.3ms 44.2MB 510ms 23ms chpl 1.26.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 92ms 1.1ms 36.1MB 70ms 10ms chpl 1.26.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 46ms 0.8ms 34.1MB 27ms 7ms chpl 1.26.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 135ms 2.9ms 32.0MB 220ms 7ms chpl 1.26.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 30ms 1.5ms 32.0MB 27ms 3ms chpl 1.26.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.1ms 0.7ms 2.2MB 0ms 0ms luajit 2.1.0
lua 1.lua 3.1ms 1.1ms 1.1MB 0ms 0ms lua 5.4.4
chapel 1.chpl 18ms 1.8ms 32.4MB 2ms 8ms chpl 1.26.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 982ms 4.5ms 99.0MB 1783ms 33ms chpl 1.26.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 168ms 1.4ms 88.3MB 243ms 30ms chpl 1.26.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 406ms 1.2ms 32.4MB 383ms 7ms chpl 1.26.0
lua 4.lua 1120ms 8.4ms 1.1MB 1107ms 0ms luajit 2.1.0
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 61ms 1.2ms 32.4MB 40ms 7ms chpl 1.26.0
lua 4.lua 116ms 1.0ms 1.0MB 100ms 0ms luajit 2.1.0
lua 4.lua 1449ms 38ms 1.1MB 1433ms 0ms lua 5.4.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 487ms 1.8ms 34.1MB 473ms 3ms chpl 1.26.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 129ms 0.5ms 34.1MB 110ms 3ms chpl 1.26.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 2026ms 1.2ms 250.5MB 1817ms 197ms chpl 1.26.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 213ms 0.5ms 56.8MB 190ms 7ms chpl 1.26.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1538ms 3.6ms 32.3MB 1520ms 7ms chpl 1.26.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 399ms 2.2ms 32.3MB 380ms 7ms chpl 1.26.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1899ms 4.4ms 32.4MB 3597ms 7ms chpl 1.26.0
chapel 1.chpl 3781ms 2.3ms 32.4MB 3760ms 7ms chpl 1.26.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 495ms 1.7ms 32.4MB 930ms 7ms chpl 1.26.0
chapel 1.chpl 964ms 0.8ms 32.4MB 950ms 0ms chpl 1.26.0
lua 1.lua 1357ms 86ms 2.4MB 1347ms 0ms luajit 2.1.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 141ms 3.2ms 32.4MB 233ms 7ms chpl 1.26.0
chapel 1.chpl 257ms 0.8ms 32.4MB 240ms 3ms chpl 1.26.0
lua 1.lua 325ms 27ms 2.4MB 313ms 0ms luajit 2.1.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4