Programming Language and compiler
Benchmarks

Go VS Chapel benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2299ms 1.2ms 58.2MB 2277ms 13ms chpl 1.27.0
chapel 3.chpl 2433ms 5.5ms 50.3MB 2413ms 13ms chpl 1.27.0
go 1.go 3006ms 7.3ms 46.0MB 4327ms 47ms go 1.19.1
go 1.go 4239ms 23ms 37.9MB 4220ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 222ms 0.5ms 13.1MB 210ms 3ms chpl 1.27.0
chapel 4.chpl 222ms 7.3ms 26.1MB 210ms 0ms chpl 1.27.0
go 1.go 259ms 1.5ms 8.1MB 337ms 3ms go 1.19.1
go 1.go 349ms 0.6ms 6.0MB 340ms 0ms tinygo 0.25.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 787ms 149ms 13.6MB 1523ms 3ms go 1.19.1
go 1.go 1694ms 7.1ms 257.2MB 1627ms 53ms tinygo 0.25.0
chapel 1-m.chpl 4004ms 54ms 169.4MB 7737ms 47ms chpl 1.27.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 57ms 8.6ms 5.4MB 87ms 0ms go 1.19.1
chapel 1-m.chpl 263ms 2.4ms 30.2MB 480ms 3ms chpl 1.27.0
go 1.go 272ms 0.3ms 68.7MB 247ms 10ms tinygo 0.25.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 0.5ms 36.1MB 90ms 0ms chpl 1.27.0
go 1.go 168ms 2.7ms 8.5MB 157ms 0ms go 1.19.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 46ms 1.3ms 34.1MB 37ms 3ms chpl 1.27.0
go 1.go 49ms 1.8ms 8.2MB 37ms 0ms go 1.19.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1443ms 1.4ms 3.0MB 2800ms 0ms go 1.19.1
go 3.go 2937ms 1.2ms 49.1MB 2913ms 7ms tinygo 0.25.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 147ms 2.4ms 3.0MB 223ms 0ms go 1.19.1
go 3.go 314ms 1.1ms 49.9MB 283ms 7ms tinygo 0.25.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 147ms 2.2ms 32.0MB 250ms 3ms chpl 1.27.0
go 3-m.go 242ms 1.6ms 2.9MB 440ms 0ms go 1.19.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 30ms 0.1ms 2.9MB 40ms 0ms go 1.19.1
chapel 5.chpl 34ms 1.5ms 32.0MB 30ms 7ms chpl 1.27.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.6ms 0.9ms 0.0MB 0ms 0ms tinygo 0.25.0
go 1.go 2.6ms 0.5ms 2.9MB 0ms 0ms go 1.19.1
chapel 1.chpl 18ms 3.7ms 32.4MB 10ms 0ms chpl 1.27.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 172ms 6.5ms 55.9MB 260ms 40ms go 1.19.1
go 2-m.go 551ms 17ms 170.1MB 487ms 367ms go 1.19.1
go 1-m.go 613ms 42ms 165.7MB 613ms 370ms go 1.19.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 31ms 20ms 22.7MB 45ms 5ms go 1.19.1
go 1.go 131ms 9.7ms 38.4MB 73ms 67ms go 1.19.1
go 2.go 135ms 3.5ms 39.1MB 83ms 60ms go 1.19.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 71ms 3.9ms 45.0MB 57ms 3ms go 1.19.1
go 1.go 171ms 1.4ms 18.7MB 157ms 3ms go 1.19.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 407ms 3.6ms 165.2MB 370ms 113ms go 1.19.1
go 1.go 1043ms 0.4ms 109.0MB 1030ms 47ms go 1.19.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 936ms 1.2ms 100.4MB 1733ms 13ms chpl 1.27.0
go 7-m.go 1505ms 5.6ms 42.6MB 2817ms 23ms go 1.19.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 157ms 2.7ms 90.4MB 257ms 10ms chpl 1.27.0
go 7-m.go 224ms 3.0ms 22.4MB 363ms 17ms go 1.19.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 166ms 1.1ms 0.3MB 160ms 0ms tinygo 0.25.0
go 3.go 175ms 0.9ms 2.9MB 160ms 0ms go 1.19.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 491ms 0.4ms 0.3MB 480ms 0ms tinygo 0.25.0
go 3.go 513ms 2.7ms 3.4MB 500ms 0ms go 1.19.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 81ms 1.2ms 0.0MB 70ms 0ms tinygo 0.25.0
go 3.go 94ms 1.0ms 3.9MB 83ms 0ms go 1.19.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4105ms 9.6ms 7.3MB 4087ms 3ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 172ms 1.6ms 2.8MB 160ms 0ms go 1.19.1
go 1.go 248ms 4.4ms 0.0MB 240ms 0ms tinygo 0.25.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1976ms 5.3ms 48.1MB 2803ms 43ms go 1.19.1
go 2.go 2305ms 5.9ms 41.3MB 3270ms 43ms go 1.19.1
go 1.go 3286ms 4.0ms 212.1MB 3233ms 33ms tinygo 0.25.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 413ms 2.9ms 12.3MB 567ms 13ms go 1.19.1
go 2.go 485ms 2.0ms 13.0MB 663ms 17ms go 1.19.1
go 1.go 792ms 1.5ms 52.1MB 773ms 3ms tinygo 0.25.0
go 2.go 1083ms 3.6ms 39.4MB 1057ms 10ms tinygo 0.25.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 363ms 2.4ms 32.4MB 350ms 7ms chpl 1.27.0
go 1.go 455ms 2.1ms 2.9MB 443ms 0ms go 1.19.1
go 1.go 843ms 0.9ms 0.0MB 830ms 0ms tinygo 0.25.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 50ms 1.4ms 2.9MB 40ms 0ms go 1.19.1
chapel 2.chpl 56ms 1.3ms 32.4MB 50ms 0ms chpl 1.27.0
go 1.go 88ms 2.5ms 0.0MB 80ms 0ms tinygo 0.25.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2.go 621ms 1.4ms 17.1MB 603ms 0ms tinygo 0.25.0
go 1.go 759ms 9.3ms 73.5MB 737ms 10ms go 1.19.1
go 1.go 797ms 15ms 42.5MB 777ms 7ms tinygo 0.25.0
go 2.go 905ms 4.0ms 19.8MB 890ms 7ms go 1.19.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 129ms 1.0ms 13.6MB 120ms 0ms tinygo 0.25.0
go 1.go 131ms 3.7ms 23.9MB 117ms 3ms go 1.19.1
go 2.go 148ms 1.7ms 5.4MB 140ms 0ms tinygo 0.25.0
go 2.go 216ms 2.6ms 7.6MB 203ms 0ms go 1.19.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 593ms 1.5ms 34.1MB 580ms 7ms chpl 1.27.0
go 8.go 1424ms 4.4ms 8.5MB 1400ms 7ms go 1.19.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 154ms 1.9ms 34.1MB 143ms 3ms chpl 1.27.0
go 8.go 341ms 0.8ms 8.4MB 323ms 3ms go 1.19.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 2015ms 13ms 251.7MB 1870ms 133ms chpl 1.27.0
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 222ms 1.0ms 56.8MB 203ms 10ms chpl 1.27.0
go 3.go 2503ms 23ms 18.2MB 2473ms 33ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 171ms 1.4ms 7.9MB 157ms 3ms go 1.19.1
chapel 1.chpl 1536ms 10.0ms 32.3MB 1527ms 0ms chpl 1.27.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 0.2ms 9.6MB 43ms 0ms go 1.19.1
chapel 1.chpl 398ms 0.9ms 32.3MB 383ms 3ms chpl 1.27.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2299ms 91ms 32.5MB 4450ms 7ms chpl 1.27.0
go 4-m.go 2511ms 29ms 5.4MB 4843ms 7ms go 1.19.1
chapel 1.chpl 4375ms 0.8ms 32.5MB 4363ms 3ms chpl 1.27.0
go 1.go 4887ms 5.0ms 5.5MB 4870ms 3ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 581ms 0.2ms 32.5MB 1107ms 0ms chpl 1.27.0
go 4-m.go 630ms 0.5ms 4.9MB 1200ms 0ms go 1.19.1
chapel 1.chpl 1110ms 0.7ms 32.4MB 1100ms 3ms chpl 1.27.0
go 1.go 1229ms 3.9ms 2.9MB 1213ms 3ms go 1.19.1
go 1.go 2577ms 1.0ms 0.0MB 2560ms 0ms tinygo 0.25.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 165ms 2.1ms 32.5MB 287ms 0ms chpl 1.27.0
go 4-m.go 166ms 0.9ms 4.9MB 293ms 0ms go 1.19.1
chapel 1.chpl 306ms 19ms 32.4MB 283ms 10ms chpl 1.27.0
go 1.go 309ms 0.2ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 648ms 0.7ms 0.0MB 637ms 0ms tinygo 0.25.0