Programming Language and compiler
Benchmarks

Chapel VS Go benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1944ms 12ms 66.2MB 1933ms 7ms chpl 1.31.0
chapel 3.chpl 2115ms 17ms 66.3MB 2100ms 0ms chpl 1.31.0
go 1-m.go 2665ms 13ms 44.2MB 5553ms 47ms go 1.21.6
go 1.go 4172ms 25ms 51.6MB 4157ms 3ms tinygo 0.30.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 191ms 2.3ms 36.3MB 180ms 7ms chpl 1.31.0
chapel 3.chpl 198ms 1.7ms 34.3MB 183ms 7ms chpl 1.31.0
go 1-m.go 237ms 1.8ms 7.8MB 393ms 3ms go 1.21.6
go 1.go 316ms 4.0ms 6.6MB 307ms 0ms tinygo 0.30.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 464ms 54ms 15.4MB 1767ms 0ms go 1.21.6
chapel 1-m.chpl 2296ms 27ms 506.1MB 4477ms 70ms chpl 1.31.0
go 1.go 2438ms 2.9ms 256.6MB 2400ms 23ms tinygo 0.30.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 39ms 4.8ms 7.2MB 127ms 0ms go 1.21.6
chapel 1-m.chpl 203ms 23ms 450.8MB 333ms 33ms chpl 1.31.0
go 1.go 387ms 1.7ms 65.8MB 373ms 0ms tinygo 0.30.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 79ms 0.6ms 36.5MB 70ms 0ms chpl 1.31.0
go 1.go 119ms 0.4ms 10.2MB 110ms 0ms go 1.21.6

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 35ms 1.4ms 8.3MB 27ms 0ms go 1.21.6
chapel 1.chpl 40ms 0.2ms 34.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 111ms 1.0ms 32.4MB 193ms 0ms chpl 1.31.0
go 3-m.go 123ms 0.2ms 5.3MB 370ms 0ms go 1.21.6

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 17ms 0.4ms 5.3MB 30ms 0ms go 1.21.6
chapel 5.chpl 29ms 0.6ms 32.4MB 23ms 3ms chpl 1.31.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.6ms 0.1ms 0.1MB 0ms 0ms tinygo 0.30.0
go 1.go 1.5ms 0.1ms 3.1MB 0ms 0ms go 1.21.6
chapel 1.chpl 16ms 0.2ms 32.8MB 10ms 0ms chpl 1.31.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 766ms 18ms 101.0MB 1443ms 7ms chpl 1.31.0
go 7-m.go 783ms 4.0ms 40.2MB 2817ms 27ms go 1.21.6

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 120ms 0.8ms 90.9MB 207ms 3ms chpl 1.31.0
go 7-m.go 147ms 4.5ms 30.6MB 373ms 37ms go 1.21.6

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 329ms 2.0ms 32.8MB 313ms 7ms chpl 1.31.0
go 1.go 348ms 1.1ms 2.1MB 340ms 0ms tinygo 0.30.0
go 1.go 364ms 0.9ms 3.3MB 350ms 0ms go 1.21.6

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 36ms 0.1ms 0.1MB 30ms 0ms tinygo 0.30.0
go 1.go 39ms 0.2ms 3.3MB 30ms 0ms go 1.21.6
chapel 2.chpl 51ms 1.6ms 32.9MB 47ms 0ms chpl 1.31.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 452ms 1.3ms 34.4MB 443ms 0ms chpl 1.31.0
go 8.go 1129ms 7.4ms 8.4MB 1110ms 7ms go 1.21.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 122ms 1.3ms 34.2MB 113ms 0ms chpl 1.31.0
go 8.go 271ms 3.7ms 8.5MB 257ms 3ms go 1.21.6

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1388ms 3.3ms 224.1MB 1340ms 40ms chpl 1.31.0
go 3.go timeout 0.0ms 128.0MB 4977ms 47ms go 1.21.6
go 3.go timeout 0.0ms 106.6MB 4980ms 7ms tinygo 0.30.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 169ms 0.9ms 52.9MB 150ms 10ms chpl 1.31.0
go 3.go 1859ms 155ms 20.2MB 1833ms 33ms go 1.21.6
go 3.go 2681ms 113ms 30.4MB 2667ms 0ms tinygo 0.30.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 141ms 1.0ms 12.2MB 137ms 3ms go 1.21.6
chapel 1.chpl 1183ms 3.7ms 33.0MB 1170ms 3ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 46ms 1.0ms 11.9MB 40ms 0ms go 1.21.6
chapel 1.chpl 311ms 1.6ms 33.1MB 307ms 0ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1911ms 0.6ms 32.9MB 3783ms 0ms chpl 1.31.0
go 4-m.go 1911ms 7.7ms 5.3MB 7327ms 0ms go 1.21.6
go 1.go 3639ms 25ms 5.4MB 3630ms 0ms go 1.21.6
chapel 1.chpl 3712ms 4.9ms 32.8MB 3703ms 0ms chpl 1.31.0
go 1.go timeout 0.0ms 2.4MB 4990ms 0ms tinygo 0.30.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 479ms 0.9ms 5.3MB 1817ms 3ms go 1.21.6
chapel 1-m.chpl 496ms 1.2ms 32.9MB 953ms 0ms chpl 1.31.0
go 1.go 928ms 8.2ms 3.3MB 923ms 0ms go 1.21.6
chapel 1.chpl 944ms 2.4ms 32.8MB 933ms 0ms chpl 1.31.0
go 1.go 1394ms 5.3ms 0.4MB 1383ms 0ms tinygo 0.30.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 126ms 1.3ms 5.3MB 437ms 0ms go 1.21.6
chapel 1-m.chpl 140ms 0.8ms 33.0MB 240ms 7ms chpl 1.31.0
go 1.go 236ms 5.1ms 3.3MB 223ms 0ms go 1.21.6
chapel 1.chpl 252ms 1.7ms 32.8MB 247ms 0ms chpl 1.31.0
go 1.go 349ms 0.4ms 0.3MB 340ms 0ms tinygo 0.30.0