Chapel VS Go benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2316ms 24ms 60.2MB 2290ms 13ms chpl 1.28.0
chapel 3.chpl 2468ms 4.1ms 50.3MB 2450ms 10ms chpl 1.28.0
go 1.go 2979ms 18ms 45.5MB 4293ms 50ms go 1.19.1
go 1.go 4141ms 20ms 38.9MB 4123ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 220ms 0.8ms 26.1MB 207ms 3ms chpl 1.28.0
chapel 3.chpl 229ms 1.1ms 18.1MB 217ms 3ms chpl 1.28.0
go 1.go 256ms 1.9ms 8.2MB 337ms 3ms go 1.19.1
go 1.go 305ms 2.0ms 6.0MB 290ms 0ms tinygo 0.25.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 774ms 126ms 13.6MB 1500ms 0ms go 1.19.1
go 1.go 1695ms 3.7ms 257.3MB 1643ms 33ms tinygo 0.25.0
chapel 1-m.chpl 3847ms 71ms 87.6MB 7483ms 30ms chpl 1.28.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 66ms 16ms 5.4MB 107ms 0ms go 1.19.1
chapel 1-m.chpl 259ms 1.5ms 32.2MB 480ms 0ms chpl 1.28.0
go 1.go 270ms 1.9ms 64.5MB 250ms 10ms tinygo 0.25.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 1.7ms 36.0MB 83ms 3ms chpl 1.28.0
go 1.go 168ms 3.8ms 8.2MB 157ms 0ms go 1.19.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 47ms 1.1ms 34.0MB 37ms 0ms chpl 1.28.0
go 1.go 52ms 0.2ms 8.2MB 37ms 3ms go 1.19.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 147ms 0.4ms 32.1MB 253ms 3ms chpl 1.28.0
go 3-m.go 241ms 1.5ms 2.9MB 447ms 0ms go 1.19.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 31ms 1.5ms 2.9MB 40ms 0ms go 1.19.1
chapel 5.chpl 33ms 0.9ms 32.1MB 33ms 0ms chpl 1.28.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2.4ms 2.4ms 0.0MB 0ms 0ms tinygo 0.25.0
go 1.go 2.7ms 0.2ms 2.9MB 0ms 0ms go 1.19.1
chapel 1.chpl 20ms 3.3ms 32.4MB 10ms 3ms chpl 1.28.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 965ms 11ms 96.7MB 1783ms 17ms chpl 1.28.0
go 7-m.go 1518ms 53ms 38.8MB 2787ms 30ms go 1.19.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 167ms 2.3ms 87.2MB 263ms 17ms chpl 1.28.0
go 7-m.go 226ms 5.6ms 22.4MB 367ms 13ms go 1.19.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 377ms 3.1ms 32.4MB 363ms 0ms chpl 1.28.0
go 1.go 454ms 2.6ms 2.9MB 440ms 0ms go 1.19.1
go 1.go 843ms 0.3ms 0.0MB 833ms 0ms tinygo 0.25.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 2.2ms 2.9MB 40ms 0ms go 1.19.1
chapel 2.chpl 58ms 0.7ms 32.4MB 47ms 3ms chpl 1.28.0
go 1.go 87ms 1.4ms 2.0MB 80ms 0ms tinygo 0.25.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 594ms 3.6ms 34.1MB 583ms 3ms chpl 1.28.0
go 8.go 1418ms 0.7ms 10.5MB 1403ms 0ms go 1.19.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 152ms 0.4ms 34.1MB 147ms 0ms chpl 1.28.0
go 8.go 339ms 1.7ms 10.2MB 327ms 0ms go 1.19.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1965ms 33ms 221.9MB 1803ms 147ms chpl 1.28.0
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 217ms 2.1ms 52.8MB 183ms 23ms chpl 1.28.0
go 3.go 2469ms 6.8ms 22.0MB 2450ms 20ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 171ms 1.2ms 10.0MB 160ms 3ms go 1.19.1
chapel 1.chpl 1533ms 0.6ms 32.3MB 1520ms 0ms chpl 1.28.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 1.0ms 10.2MB 43ms 0ms go 1.19.1
chapel 1.chpl 400ms 0.4ms 32.3MB 390ms 3ms chpl 1.28.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2302ms 99ms 32.3MB 4450ms 3ms chpl 1.28.0
go 4-m.go 2504ms 30ms 5.4MB 4837ms 0ms go 1.19.1
chapel 1.chpl 4379ms 1.9ms 32.3MB 4363ms 7ms chpl 1.28.0
go 1.go 4900ms 5.4ms 5.5MB 4893ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 581ms 1.0ms 32.3MB 1110ms 0ms chpl 1.28.0
go 4-m.go 629ms 1.6ms 2.9MB 1193ms 3ms go 1.19.1
chapel 1.chpl 1113ms 1.7ms 32.3MB 1100ms 0ms chpl 1.28.0
go 1.go 1229ms 2.2ms 2.9MB 1217ms 0ms go 1.19.1
go 1.go 2576ms 1.1ms 0.0MB 2563ms 0ms tinygo 0.25.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 166ms 1.7ms 32.3MB 290ms 0ms chpl 1.28.0
go 4-m.go 167ms 1.5ms 2.9MB 300ms 0ms go 1.19.1
chapel 1.chpl 296ms 1.4ms 32.3MB 287ms 3ms chpl 1.28.0
go 1.go 310ms 2.0ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 647ms 0.3ms 0.0MB 640ms 0ms tinygo 0.25.0