Go VS Hack benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2979ms 18ms 45.5MB 4293ms 50ms go 1.19.1
go 1.go 4141ms 20ms 38.9MB 4123ms 0ms tinygo 0.25.0
hacklang 1.hack timeout 0.0ms 0.0MB 0ms 0ms hhvm 4.169.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 256ms 1.9ms 8.2MB 337ms 3ms go 1.19.1
go 1.go 305ms 2.0ms 6.0MB 290ms 0ms tinygo 0.25.0
hacklang 1.hack 1624ms 11ms 190.8MB 1550ms 40ms hhvm 4.169.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 774ms 126ms 13.6MB 1500ms 0ms go 1.19.1
go 1.go 1695ms 3.7ms 257.3MB 1643ms 33ms tinygo 0.25.0
hacklang 1.hack 1966ms 12ms 176.4MB 1900ms 37ms hhvm 4.169.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 66ms 16ms 5.4MB 107ms 0ms go 1.19.1
go 1.go 270ms 1.9ms 64.5MB 250ms 10ms tinygo 0.25.0
hacklang 1.hack 962ms 4.6ms 173.3MB 893ms 37ms hhvm 4.169.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 168ms 3.8ms 8.2MB 157ms 0ms go 1.19.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 52ms 0.2ms 8.2MB 37ms 3ms go 1.19.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1455ms 14ms 5.0MB 2800ms 0ms go 1.19.1
go 3.go 2939ms 3.9ms 49.9MB 2913ms 7ms tinygo 0.25.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 147ms 1.4ms 5.0MB 217ms 3ms go 1.19.1
go 3.go 311ms 0.3ms 50.1MB 290ms 10ms tinygo 0.25.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 241ms 1.5ms 2.9MB 447ms 0ms go 1.19.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 31ms 1.5ms 2.9MB 40ms 0ms go 1.19.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2.4ms 2.4ms 0.0MB 0ms 0ms tinygo 0.25.0
go 1.go 2.7ms 0.2ms 2.9MB 0ms 0ms go 1.19.1
hacklang 1.hack 775ms 1.9ms 173.0MB 712ms 38ms hhvm 4.169.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 180ms 17ms 60.5MB 263ms 47ms go 1.19.1
go 2-m.go 614ms 113ms 179.5MB 590ms 367ms go 1.19.1
go 1-m.go 704ms 12ms 186.5MB 727ms 440ms go 1.19.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 29ms 16ms 22.8MB 35ms 15ms go 1.19.1
go 1.go 124ms 9.9ms 38.8MB 90ms 37ms go 1.19.1
go 2.go 125ms 16ms 39.1MB 73ms 57ms go 1.19.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 72ms 4.2ms 44.2MB 57ms 10ms go 1.19.1
go 1.go 177ms 0.9ms 18.8MB 163ms 3ms go 1.19.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 406ms 4.5ms 182.2MB 360ms 120ms go 1.19.1
go 1.go 1037ms 3.0ms 102.8MB 1020ms 43ms go 1.19.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1518ms 53ms 38.8MB 2787ms 30ms go 1.19.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 226ms 5.6ms 22.4MB 367ms 13ms go 1.19.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 166ms 1.0ms 0.3MB 160ms 0ms tinygo 0.25.0
go 3.go 174ms 2.3ms 4.8MB 160ms 0ms go 1.19.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 490ms 1.3ms 2.0MB 480ms 0ms tinygo 0.25.0
go 3.go 512ms 1.0ms 2.8MB 500ms 0ms go 1.19.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 81ms 1.1ms 0.0MB 70ms 0ms tinygo 0.25.0
go 3.go 93ms 2.6ms 6.1MB 83ms 0ms go 1.19.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4115ms 9.8ms 7.4MB 4107ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 173ms 2.0ms 2.8MB 163ms 0ms go 1.19.1
go 1.go 246ms 0.5ms 0.0MB 233ms 0ms tinygo 0.25.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1925ms 30ms 40.0MB 2697ms 50ms go 1.19.1
go 2.go 2277ms 32ms 41.4MB 3220ms 33ms go 1.19.1
go 1.go 3090ms 7.1ms 159.9MB 3043ms 27ms tinygo 0.25.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
hacklang 1.hack timeout 0.0ms 0.0MB 0ms 0ms hhvm 4.169.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 408ms 1.4ms 12.4MB 560ms 7ms go 1.19.1
go 2.go 480ms 2.4ms 14.3MB 663ms 17ms go 1.19.1
go 1.go 811ms 0.9ms 39.4MB 793ms 3ms tinygo 0.25.0
go 2.go 1365ms 7.7ms 51.8MB 1343ms 3ms tinygo 0.25.0
hacklang 1.hack 1794ms 4.0ms 202.3MB 1743ms 27ms hhvm 4.169.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 454ms 2.6ms 2.9MB 440ms 0ms go 1.19.1
go 1.go 843ms 0.3ms 0.0MB 833ms 0ms tinygo 0.25.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 2.2ms 2.9MB 40ms 0ms go 1.19.1
go 1.go 87ms 1.4ms 2.0MB 80ms 0ms tinygo 0.25.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 614ms 8.2ms 71.7MB 587ms 10ms go 1.19.1
go 2.go 621ms 1.4ms 17.4MB 610ms 0ms tinygo 0.25.0
go 1.go 649ms 24ms 42.8MB 637ms 0ms tinygo 0.25.0
go 2.go 909ms 0.8ms 19.8MB 890ms 7ms go 1.19.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 126ms 0.4ms 12.8MB 117ms 0ms tinygo 0.25.0
go 1.go 132ms 1.7ms 22.1MB 120ms 0ms go 1.19.1
go 2.go 146ms 1.2ms 5.1MB 140ms 0ms tinygo 0.25.0
go 2.go 219ms 1.7ms 7.3MB 200ms 3ms go 1.19.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1418ms 0.7ms 10.5MB 1403ms 0ms go 1.19.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 339ms 1.7ms 10.2MB 327ms 0ms go 1.19.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 2469ms 6.8ms 22.0MB 2450ms 20ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 171ms 1.2ms 10.0MB 160ms 3ms go 1.19.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 1.0ms 10.2MB 43ms 0ms go 1.19.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2504ms 30ms 5.4MB 4837ms 0ms go 1.19.1
go 1.go 4900ms 5.4ms 5.5MB 4893ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 629ms 1.6ms 2.9MB 1193ms 3ms go 1.19.1
go 1.go 1229ms 2.2ms 2.9MB 1217ms 0ms go 1.19.1
go 1.go 2576ms 1.1ms 0.0MB 2563ms 0ms tinygo 0.25.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 167ms 1.5ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 310ms 2.0ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 647ms 0.3ms 0.0MB 640ms 0ms tinygo 0.25.0