Programming Language and compiler
Benchmarks

Julia VS Chapel benchmarks

Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 17ms 1.4ms 22.2MB 7ms 3ms chpl 1.29.0
julia 1.jl 236ms 5.1ms 167.8MB 138ms 110ms julia/aot 1.8.5
julia 1.jl 250ms 5.6ms 171.5MB 152ms 114ms julia 1.8.5

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 485ms 2.4ms 22.2MB 467ms 7ms chpl 1.29.0
julia 7.jl 646ms 1.6ms 168.0MB 587ms 163ms julia/aot 1.8.5
julia 7.jl 833ms 13ms 225.8MB 763ms 180ms julia 1.8.5

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 70ms 1.7ms 32.2MB 47ms 7ms chpl 1.29.0
julia 7.jl 317ms 22ms 167.0MB 240ms 147ms julia/aot 1.8.5
julia 7.jl 526ms 2.9ms 227.5MB 423ms 200ms julia 1.8.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 519ms 11ms 156.1MB 467ms 163ms julia/aot 1.8.5
julia 1.jl 636ms 7.2ms 203.7MB 587ms 150ms julia 1.8.5

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 301ms 26ms 149.8MB 190ms 150ms julia/aot 1.8.5
julia 1.jl 405ms 6.3ms 197.2MB 327ms 180ms julia 1.8.5

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 1444ms 14ms 241.6MB 1307ms 233ms julia 1.8.5
chapel 4.chpl 2946ms 5.9ms 64.3MB 2910ms 20ms chpl 1.29.0
chapel 3.chpl 3233ms 39ms 64.3MB 3197ms 17ms chpl 1.29.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 279ms 2.6ms 34.3MB 260ms 7ms chpl 1.29.0
chapel 3.chpl 294ms 2.5ms 32.1MB 270ms 7ms chpl 1.29.0
julia 4.jl 392ms 4.3ms 225.4MB 323ms 170ms julia 1.8.5

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1982ms 6.8ms 210.4MB 3410ms 180ms julia 1.8.5

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 674ms 29ms 211.1MB 830ms 190ms julia 1.8.5

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 164ms 5.7ms 32.0MB 277ms 3ms chpl 1.29.0
julia 7-m.jl 797ms 8.6ms 298.9MB 1077ms 200ms julia 1.8.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 33ms 3.1ms 22.0MB 30ms 7ms chpl 1.29.0
julia 7.jl 570ms 8.1ms 227.5MB 683ms 167ms julia 1.8.5

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 1180ms 16ms 85.0MB 2157ms 33ms chpl 1.29.0
julia 8.jl 1412ms 8.8ms 274.1MB 1860ms 193ms julia 1.8.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 201ms 2.7ms 76.7MB 310ms 23ms chpl 1.29.0
julia 8.jl 950ms 17ms 262.9MB 1040ms 200ms julia 1.8.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 582ms 3.7ms 30.1MB 560ms 3ms chpl 1.29.0
julia 3.jl 856ms 22ms 178.0MB 807ms 157ms julia 1.8.5
julia 1.jl 1650ms 5.6ms 261.1MB 1530ms 227ms julia 1.8.5

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 151ms 2.2ms 20.8MB 130ms 3ms chpl 1.29.0
julia 3.jl 418ms 15ms 175.4MB 353ms 170ms julia 1.8.5
julia 1.jl 1002ms 43ms 261.2MB 880ms 207ms julia 1.8.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1489ms 28ms 193.8MB 2493ms 173ms julia 1.8.5
chapel 1-m.chpl 2324ms 13ms 32.3MB 4533ms 10ms chpl 1.29.0
julia 3-m.jl 2607ms 78ms 208.5MB 4643ms 157ms julia 1.8.5
chapel 1.chpl 4465ms 18ms 32.4MB 4443ms 7ms chpl 1.29.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 654ms 50ms 32.3MB 1177ms 10ms chpl 1.29.0
julia 2-m.jl 682ms 15ms 194.1MB 940ms 170ms julia 1.8.5
julia 3-m.jl 1012ms 20ms 208.1MB 1503ms 173ms julia 1.8.5
chapel 1.chpl 1147ms 4.0ms 32.3MB 1130ms 3ms chpl 1.29.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 179ms 4.2ms 32.3MB 300ms 10ms chpl 1.29.0
chapel 1.chpl 309ms 5.9ms 32.3MB 287ms 7ms chpl 1.29.0
julia 2.jl 473ms 2.6ms 195.0MB 543ms 163ms julia 1.8.5
julia 3.jl 600ms 8.7ms 208.4MB 713ms 183ms julia 1.8.5