Programming Language and compiler
Benchmarks

Go VS Chapel benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2278ms 2.2ms 64.2MB 2247ms 20ms chpl 1.31.0
chapel 3.chpl 2393ms 13ms 50.2MB 2373ms 10ms chpl 1.31.0
go 1.go 3509ms 41ms 45.0MB 5013ms 43ms go 1.20.6
go 1.go 4400ms 25ms 50.6MB 4380ms 3ms tinygo 0.28.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 220ms 1.8ms 28.0MB 203ms 7ms chpl 1.31.0
chapel 3.chpl 225ms 0.7ms 24.1MB 207ms 7ms chpl 1.31.0
go 1.go 308ms 4.5ms 8.1MB 397ms 0ms go 1.20.6
go 1.go 440ms 1.4ms 6.9MB 427ms 0ms tinygo 0.28.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 930ms 108ms 13.5MB 1800ms 7ms go 1.20.6
go 1.go 3070ms 9.5ms 253.2MB 2970ms 77ms tinygo 0.28.1
chapel 1-m.chpl 4044ms 31ms 83.4MB 7847ms 37ms chpl 1.31.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 79ms 17ms 5.4MB 130ms 0ms go 1.20.6
chapel 1-m.chpl 286ms 15ms 54.0MB 510ms 7ms chpl 1.31.0
go 1.go 477ms 0.5ms 65.4MB 457ms 3ms tinygo 0.28.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 2.0ms 36.0MB 93ms 0ms chpl 1.31.0
go 1.go 163ms 1.2ms 8.3MB 153ms 0ms go 1.20.6

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 47ms 1.4ms 34.0MB 30ms 7ms chpl 1.31.0
go 1.go 48ms 1.4ms 8.1MB 37ms 0ms go 1.20.6

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1447ms 30ms 4.9MB 2773ms 3ms go 1.20.6
go 3.go 3013ms 2.7ms 50.3MB 2997ms 3ms tinygo 0.28.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 144ms 0.9ms 2.9MB 217ms 3ms go 1.20.6
go 3.go 407ms 0.1ms 48.9MB 390ms 3ms tinygo 0.28.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 148ms 2.2ms 32.0MB 253ms 0ms chpl 1.31.0
go 3-m.go 255ms 4.3ms 2.9MB 457ms 0ms go 1.20.6

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 31ms 0.6ms 2.9MB 40ms 0ms go 1.20.6
chapel 5.chpl 32ms 1.1ms 32.0MB 30ms 0ms chpl 1.31.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.6ms 0.4ms 0.0MB 0ms 0ms tinygo 0.28.1
go 1.go 3.0ms 0.2ms 2.9MB 0ms 0ms go 1.20.6
chapel 1.chpl 17ms 0.6ms 32.3MB 10ms 0ms chpl 1.31.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 11ms 2.3ms 17.3MB 0ms 0ms go 1.20.6
go 2-m.go 560ms 15ms 159.4MB 537ms 350ms go 1.20.6
go 1-m.go 610ms 23ms 175.2MB 570ms 397ms go 1.20.6

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 39ms 2.0ms 26.1MB 43ms 3ms go 1.20.6
go 1.go 122ms 7.7ms 37.4MB 87ms 50ms go 1.20.6
go 2.go 128ms 8.4ms 38.4MB 87ms 53ms go 1.20.6

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 59ms 2.4ms 37.6MB 33ms 13ms go 1.20.6
go 1.go 173ms 1.2ms 18.4MB 163ms 0ms go 1.20.6

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 389ms 3.3ms 174.9MB 350ms 97ms go 1.20.6
go 1.go 1070ms 4.8ms 101.9MB 1040ms 63ms go 1.20.6

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 933ms 1.9ms 85.0MB 1723ms 13ms chpl 1.31.0
go 7-m.go 1492ms 12ms 45.7MB 2787ms 23ms go 1.20.6

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 163ms 3.3ms 76.4MB 270ms 10ms chpl 1.31.0
go 7-m.go 226ms 12ms 24.8MB 357ms 23ms go 1.20.6

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 174ms 0.2ms 0.4MB 160ms 0ms tinygo 0.28.1
go 3.go 177ms 1.4ms 3.4MB 163ms 0ms go 1.20.6

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 516ms 1.1ms 0.4MB 503ms 0ms tinygo 0.28.1
go 3.go 519ms 1.6ms 3.4MB 503ms 0ms go 1.20.6

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 85ms 0.8ms 0.0MB 70ms 0ms tinygo 0.28.1
go 3.go 93ms 3.6ms 3.6MB 80ms 0ms go 1.20.6

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4379ms 2.8ms 7.3MB 4363ms 0ms go 1.20.6
go 1.go timeout 0.0ms 5.4MB 4983ms 0ms tinygo 0.28.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 182ms 0.2ms 2.9MB 170ms 0ms go 1.20.6
go 1.go 243ms 0.5ms 0.0MB 230ms 0ms tinygo 0.28.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2080ms 20ms 37.6MB 2947ms 27ms go 1.20.6
go 2.go 2382ms 46ms 49.9MB 3403ms 57ms go 1.20.6
go 1.go 2858ms 2.3ms 51.9MB 2840ms 3ms tinygo 0.28.1
go 2.go 4300ms 6.9ms 120.1MB 4273ms 10ms tinygo 0.28.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 444ms 5.6ms 12.3MB 607ms 7ms go 1.20.6
go 2.go 510ms 1.8ms 13.2MB 720ms 7ms go 1.20.6
go 1.go 607ms 1.8ms 13.1MB 593ms 0ms tinygo 0.28.1
go 2.go 833ms 2.9ms 29.9MB 820ms 0ms tinygo 0.28.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 363ms 1.0ms 32.3MB 353ms 3ms chpl 1.31.0
go 1.go 430ms 0.7ms 0.0MB 420ms 0ms tinygo 0.28.1
go 1.go 456ms 1.6ms 2.9MB 450ms 0ms go 1.20.6

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 45ms 0.7ms 0.0MB 37ms 0ms tinygo 0.28.1
go 1.go 52ms 0.6ms 2.9MB 40ms 0ms go 1.20.6
chapel 2.chpl 55ms 1.2ms 32.3MB 47ms 3ms chpl 1.31.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 600ms 68ms 43.8MB 580ms 7ms tinygo 0.28.1
go 1.go 633ms 64ms 72.4MB 607ms 7ms go 1.20.6
go 2.go 640ms 9.9ms 16.3MB 627ms 0ms tinygo 0.28.1
go 2.go 915ms 12ms 21.8MB 887ms 10ms go 1.20.6

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 136ms 2.3ms 21.5MB 117ms 0ms go 1.20.6
go 1.go 138ms 4.4ms 13.4MB 127ms 0ms tinygo 0.28.1
go 2.go 153ms 3.0ms 5.6MB 143ms 0ms tinygo 0.28.1
go 2.go 217ms 1.8ms 7.3MB 207ms 0ms go 1.20.6

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 596ms 3.6ms 34.1MB 577ms 3ms chpl 1.31.0
go 8.go 1388ms 2.0ms 8.5MB 1373ms 0ms go 1.20.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 156ms 3.1ms 34.1MB 147ms 0ms chpl 1.31.0
go 8.go 334ms 0.9ms 8.5MB 320ms 0ms go 1.20.6

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1933ms 23ms 221.8MB 1793ms 130ms chpl 1.31.0
go 3.go timeout 0.0ms 125.9MB 4963ms 93ms go 1.20.6
go 3.go timeout 0.0ms 104.1MB 4960ms 20ms tinygo 0.28.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 216ms 2.4ms 52.8MB 183ms 23ms chpl 1.31.0
go 3.go 2500ms 12ms 20.9MB 2480ms 20ms go 1.20.6
go 3.go 3216ms 9.2ms 30.0MB 3193ms 7ms tinygo 0.28.1

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 170ms 2.7ms 9.4MB 163ms 3ms go 1.20.6
chapel 1.chpl 1543ms 3.8ms 32.4MB 1533ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 55ms 1.5ms 9.4MB 43ms 0ms go 1.20.6
chapel 1.chpl 404ms 1.8ms 32.4MB 383ms 7ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2241ms 4.7ms 32.2MB 4403ms 3ms chpl 1.31.0
go 4-m.go 2512ms 26ms 5.5MB 4843ms 0ms go 1.20.6
chapel 1.chpl 4378ms 1.3ms 32.3MB 4367ms 3ms chpl 1.31.0
go 1.go 4902ms 6.8ms 5.5MB 4893ms 0ms go 1.20.6
go 1.go timeout 0.0ms 2.0MB 4990ms 0ms tinygo 0.28.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 592ms 12ms 32.2MB 1117ms 0ms chpl 1.31.0
go 4-m.go 631ms 3.4ms 3.4MB 1200ms 0ms go 1.20.6
chapel 1.chpl 1114ms 1.0ms 32.3MB 1100ms 0ms chpl 1.31.0
go 1.go 1228ms 11ms 2.9MB 1213ms 0ms go 1.20.6
go 1.go 2577ms 1.8ms 0.0MB 2560ms 0ms tinygo 0.28.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 165ms 1.0ms 32.2MB 287ms 3ms chpl 1.31.0
go 4-m.go 167ms 1.5ms 3.4MB 297ms 0ms go 1.20.6
chapel 1.chpl 298ms 4.4ms 32.3MB 290ms 0ms chpl 1.31.0
go 1.go 312ms 3.2ms 2.9MB 300ms 0ms go 1.20.6
go 1.go 646ms 1.0ms 0.0MB 637ms 0ms tinygo 0.28.1