Programming Language and compiler
Benchmarks

Go VS Chapel benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2346ms 6.5ms 64.0MB 2320ms 17ms chpl 1.26.0
chapel 3.chpl 2513ms 24ms 64.0MB 2487ms 17ms chpl 1.26.0
go 1.go 3208ms 18ms 45.7MB 4603ms 63ms go 1.18.2
go 1.go 4543ms 15ms 39.4MB 4520ms 7ms tinygo 0.23.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 226ms 2.7ms 34.1MB 207ms 3ms chpl 1.26.0
chapel 3.chpl 228ms 2.1ms 34.3MB 213ms 3ms chpl 1.26.0
go 1.go 282ms 9.2ms 8.2MB 330ms 0ms go 1.18.2
go 1.go 360ms 1.9ms 6.3MB 350ms 0ms tinygo 0.23.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 838ms 145ms 13.6MB 1630ms 0ms go 1.18.2
go 1.go 1779ms 20ms 257.5MB 1707ms 57ms tinygo 0.23.0
chapel 1-m.chpl 4114ms 58ms 71.5MB 8013ms 37ms chpl 1.26.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 62ms 0.8ms 5.4MB 97ms 0ms go 1.18.2
go 1.go 275ms 1.2ms 66.3MB 257ms 3ms tinygo 0.23.0
chapel 1-m.chpl 281ms 1.3ms 44.2MB 503ms 10ms chpl 1.26.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 2.3ms 36.1MB 83ms 7ms chpl 1.26.0
go 1.go 170ms 2.3ms 8.4MB 160ms 0ms go 1.18.2

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 47ms 1.5ms 34.1MB 40ms 0ms chpl 1.26.0
go 1.go 53ms 0.8ms 7.2MB 40ms 0ms go 1.18.2

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1435ms 21ms 4.9MB 2760ms 0ms go 1.18.2
go 3.go 2953ms 2.1ms 49.1MB 2937ms 0ms tinygo 0.23.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 146ms 1.6ms 4.9MB 220ms 0ms go 1.18.2
go 3.go 333ms 0.7ms 48.9MB 317ms 3ms tinygo 0.23.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 150ms 1.4ms 32.0MB 253ms 7ms chpl 1.26.0
go 3-m.go 250ms 1.9ms 2.9MB 453ms 3ms go 1.18.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 32ms 0.5ms 2.9MB 37ms 0ms go 1.18.2
chapel 5.chpl 33ms 0.6ms 32.0MB 30ms 3ms chpl 1.26.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.7ms 0.1ms 0.0MB 0ms 0ms tinygo 0.23.0
go 1.go 2.9ms 0.3ms 2.8MB 0ms 0ms go 1.18.2
chapel 1.chpl 18ms 0.9ms 32.4MB 8ms 3ms chpl 1.26.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 207ms 52ms 54.5MB 287ms 33ms go 1.18.2
go 2-m.go 548ms 19ms 165.5MB 467ms 393ms go 1.18.2
go 1-m.go 624ms 90ms 186.4MB 577ms 403ms go 1.18.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 30ms 19ms 20.5MB 35ms 15ms go 1.18.2
go 2.go 124ms 16ms 39.2MB 77ms 53ms go 1.18.2
go 1.go 137ms 2.7ms 38.9MB 93ms 50ms go 1.18.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 81ms 2.9ms 45.2MB 67ms 7ms go 1.18.2
go 1.go 171ms 3.0ms 20.4MB 163ms 3ms go 1.18.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 385ms 6.8ms 211.3MB 387ms 40ms go 1.18.2
go 1.go 1052ms 3.0ms 110.5MB 1023ms 40ms go 1.18.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 954ms 13ms 98.6MB 1727ms 27ms chpl 1.26.0
go 7-m.go 1495ms 29ms 39.7MB 2737ms 40ms go 1.18.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 168ms 8.5ms 77.1MB 263ms 20ms chpl 1.26.0
go 7-m.go 229ms 1.6ms 21.5MB 353ms 20ms go 1.18.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 165ms 0.4ms 2.0MB 153ms 0ms tinygo 0.23.0
go 3.go 173ms 2.5ms 2.9MB 160ms 0ms go 1.18.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 490ms 0.9ms 2.0MB 480ms 0ms tinygo 0.23.0
go 3.go 506ms 3.4ms 2.9MB 490ms 0ms go 1.18.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 80ms 0.2ms 0.0MB 70ms 0ms tinygo 0.23.0
go 3.go 90ms 0.8ms 3.8MB 80ms 0ms go 1.18.2

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4108ms 1.3ms 7.3MB 4090ms 7ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 174ms 2.1ms 4.9MB 160ms 0ms go 1.18.2
go 1.go 245ms 0.5ms 2.0MB 233ms 0ms tinygo 0.23.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2093ms 7.9ms 40.0MB 2973ms 50ms go 1.18.2
go 2.go 2355ms 17ms 49.2MB 3370ms 53ms go 1.18.2
go 1.go 4907ms 0.8ms 160.4MB 4863ms 27ms tinygo 0.23.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 433ms 9.3ms 12.2MB 590ms 10ms go 1.18.2
go 2.go 497ms 3.8ms 12.9MB 697ms 7ms go 1.18.2
go 1.go 861ms 4.0ms 38.3MB 843ms 0ms tinygo 0.23.0
go 2.go 1481ms 5.6ms 38.6MB 1467ms 0ms tinygo 0.23.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 363ms 1.3ms 32.4MB 350ms 0ms chpl 1.26.0
go 1.go 456ms 2.9ms 2.8MB 447ms 0ms go 1.18.2
go 1.go 844ms 2.5ms 2.0MB 830ms 0ms tinygo 0.23.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 52ms 0.6ms 2.8MB 37ms 0ms go 1.18.2
chapel 2.chpl 56ms 0.5ms 32.4MB 50ms 0ms chpl 1.26.0
go 1.go 87ms 1.1ms 2.0MB 80ms 0ms tinygo 0.23.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2.go 646ms 5.3ms 17.4MB 637ms 0ms tinygo 0.23.0
go 1.go 821ms 37ms 73.6MB 800ms 3ms go 1.18.2
go 1.go 864ms 3.5ms 42.3MB 847ms 3ms tinygo 0.23.0
go 2.go 929ms 3.5ms 20.1MB 923ms 0ms go 1.18.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 120ms 1.0ms 21.9MB 103ms 3ms go 1.18.2
go 1.go 133ms 1.9ms 13.3MB 117ms 0ms tinygo 0.23.0
go 2.go 154ms 2.0ms 5.6MB 140ms 0ms tinygo 0.23.0
go 2.go 221ms 2.3ms 9.5MB 210ms 0ms go 1.18.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 598ms 3.9ms 34.1MB 580ms 7ms chpl 1.26.0
go 8.go 1377ms 4.0ms 8.6MB 1357ms 3ms go 1.18.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 152ms 0.7ms 34.1MB 143ms 0ms chpl 1.26.0
go 8.go 329ms 1.8ms 8.5MB 310ms 0ms go 1.18.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1944ms 8.6ms 251.1MB 1770ms 160ms chpl 1.26.0
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 214ms 1.0ms 56.8MB 193ms 10ms chpl 1.26.0
go 3.go 2553ms 26ms 18.0MB 2543ms 17ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 172ms 1.0ms 9.7MB 157ms 7ms go 1.18.2
chapel 1.chpl 1551ms 1.4ms 32.3MB 1540ms 7ms chpl 1.26.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 1.5ms 9.5MB 43ms 0ms go 1.18.2
chapel 1.chpl 404ms 1.2ms 32.3MB 393ms 7ms chpl 1.26.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2311ms 70ms 32.5MB 4457ms 10ms chpl 1.26.0
go 4-m.go 2513ms 5.8ms 5.3MB 4870ms 7ms go 1.18.2
chapel 1.chpl 4377ms 1.0ms 32.4MB 4360ms 7ms chpl 1.26.0
go 1.go 4978ms 9.8ms 5.4MB 4963ms 0ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 582ms 1.7ms 32.4MB 1110ms 3ms chpl 1.26.0
go 4-m.go 636ms 1.3ms 3.3MB 1207ms 0ms go 1.18.2
chapel 1.chpl 1110ms 0.6ms 32.4MB 1097ms 3ms chpl 1.26.0
go 1.go 1246ms 1.8ms 3.3MB 1230ms 3ms go 1.18.2
go 1.go 2576ms 0.3ms 0.0MB 2567ms 0ms tinygo 0.23.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 165ms 0.5ms 32.4MB 283ms 3ms chpl 1.26.0
go 4-m.go 168ms 1.2ms 2.8MB 300ms 0ms go 1.18.2
chapel 1.chpl 295ms 1.0ms 32.4MB 283ms 3ms chpl 1.26.0
go 1.go 317ms 2.2ms 2.8MB 303ms 0ms go 1.18.2
go 1.go 647ms 0.4ms 2.0MB 640ms 0ms tinygo 0.23.0