Programming Language and compiler
Benchmarks

Chapel VS Go benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2509ms 8.4ms 66.1MB 2477ms 20ms chpl 1.26.0
chapel 3.chpl 2721ms 5.2ms 64.1MB 2687ms 23ms chpl 1.26.0
go 1.go 3203ms 14ms 45.3MB 4650ms 50ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 234ms 1.7ms 34.1MB 213ms 10ms chpl 1.26.0
chapel 3.chpl 245ms 1.0ms 36.1MB 230ms 3ms chpl 1.26.0
go 1.go 267ms 12ms 8.2MB 310ms 3ms go 1.18.2
go 1.go 418ms 1.6ms 6.6MB 410ms 0ms tinygo 0.23.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 906ms 100ms 15.3MB 1760ms 0ms go 1.18.2
go 1.go 1828ms 5.3ms 253.7MB 1727ms 87ms tinygo 0.23.0
chapel 1-m.chpl 4218ms 372ms 111.4MB 7983ms 47ms chpl 1.26.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 69ms 9.2ms 5.4MB 113ms 0ms go 1.18.2
go 1.go 266ms 2.8ms 68.7MB 227ms 20ms tinygo 0.23.0
chapel 1-m.chpl 289ms 3.3ms 44.2MB 510ms 23ms chpl 1.26.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 92ms 1.1ms 36.1MB 70ms 10ms chpl 1.26.0
go 1.go 164ms 2.5ms 10.0MB 153ms 0ms go 1.18.2

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 46ms 0.8ms 34.1MB 27ms 7ms chpl 1.26.0
go 1.go 49ms 1.5ms 8.1MB 33ms 0ms go 1.18.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 135ms 2.9ms 32.0MB 220ms 7ms chpl 1.26.0
go 3-m.go 209ms 1.8ms 2.9MB 370ms 0ms go 1.18.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 27ms 0.6ms 2.9MB 33ms 0ms go 1.18.2
chapel 5.chpl 30ms 1.5ms 32.0MB 27ms 3ms chpl 1.26.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.1ms 0.5ms 0.0MB 0ms 0ms tinygo 0.23.0
go 1.go 3.0ms 0.5ms 2.8MB 0ms 0ms go 1.18.2
chapel 1.chpl 18ms 1.8ms 32.4MB 2ms 8ms chpl 1.26.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 982ms 4.5ms 99.0MB 1783ms 33ms chpl 1.26.0
go 7-m.go 1376ms 28ms 41.2MB 2520ms 33ms go 1.18.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 168ms 1.4ms 88.3MB 243ms 30ms chpl 1.26.0
go 7-m.go 229ms 3.1ms 21.3MB 357ms 10ms go 1.18.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 406ms 1.2ms 32.4MB 383ms 7ms chpl 1.26.0
go 1.go 443ms 3.4ms 4.8MB 430ms 0ms go 1.18.2
go 1.go 705ms 0.5ms 0.0MB 697ms 0ms tinygo 0.23.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 54ms 2.0ms 2.8MB 43ms 0ms go 1.18.2
chapel 2.chpl 61ms 1.2ms 32.4MB 40ms 7ms chpl 1.26.0
go 1.go 74ms 1.3ms 0.0MB 60ms 0ms tinygo 0.23.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 487ms 1.8ms 34.1MB 473ms 3ms chpl 1.26.0
go 8.go 1276ms 0.8ms 8.5MB 1253ms 7ms go 1.18.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 129ms 0.5ms 34.1MB 110ms 3ms chpl 1.26.0
go 8.go 309ms 2.7ms 8.5MB 290ms 3ms go 1.18.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 2026ms 1.2ms 250.5MB 1817ms 197ms chpl 1.26.0
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 213ms 0.5ms 56.8MB 190ms 7ms chpl 1.26.0
go 3.go 2430ms 14ms 18.2MB 2413ms 30ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 151ms 0.9ms 9.4MB 137ms 0ms go 1.18.2
chapel 1.chpl 1538ms 3.6ms 32.3MB 1520ms 7ms chpl 1.26.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 51ms 0.8ms 11.5MB 33ms 0ms go 1.18.2
chapel 1.chpl 399ms 2.2ms 32.3MB 380ms 7ms chpl 1.26.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1899ms 4.4ms 32.4MB 3597ms 7ms chpl 1.26.0
go 4-m.go 2219ms 4.5ms 5.3MB 4303ms 3ms go 1.18.2
chapel 1.chpl 3781ms 2.3ms 32.4MB 3760ms 7ms chpl 1.26.0
go 1.go 4402ms 2.2ms 5.3MB 4397ms 0ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 495ms 1.7ms 32.4MB 930ms 7ms chpl 1.26.0
go 4-m.go 568ms 0.8ms 3.3MB 1077ms 0ms go 1.18.2
chapel 1.chpl 964ms 0.8ms 32.4MB 950ms 0ms chpl 1.26.0
go 1.go 1113ms 2.6ms 3.3MB 1097ms 3ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 141ms 3.2ms 32.4MB 233ms 7ms chpl 1.26.0
go 4-m.go 151ms 1.3ms 2.8MB 267ms 0ms go 1.18.2
chapel 1.chpl 257ms 0.8ms 32.4MB 240ms 3ms chpl 1.26.0
go 1.go 284ms 0.9ms 2.8MB 270ms 0ms go 1.18.2
go 1.go 1604ms 0.3ms 0.0MB 1590ms 0ms tinygo 0.23.0