Go VS Codon benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 2710ms 23ms 43.6MB 5730ms 53ms go 1.23.3
go 1.go 3491ms 59ms 52.2MB 3473ms 3ms tinygo 0.34.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 229ms 5.1ms 5.6MB 213ms 0ms tinygo 0.34.0
go 1-m.go 238ms 2.0ms 8.2MB 400ms 7ms go 1.23.3

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 475ms 53ms 15.6MB 1840ms 0ms go 1.23.3
go 1.go 1414ms 6.0ms 256.2MB 1393ms 7ms tinygo 0.34.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 40ms 5.4ms 7.5MB 123ms 0ms go 1.23.3
go 1.go 257ms 2.0ms 66.7MB 240ms 0ms tinygo 0.34.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 119ms 0.4ms 8.4MB 110ms 0ms go 1.23.3

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 36ms 1.0ms 8.3MB 27ms 0ms go 1.23.3

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 737ms 23ms 5.5MB 2773ms 7ms go 1.23.3
go 3.go 2272ms 8.6ms 50.2MB 2253ms 0ms tinygo 0.34.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 75ms 0.6ms 5.5MB 200ms 3ms go 1.23.3
go 3.go 485ms 0.5ms 50.2MB 470ms 3ms tinygo 0.34.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 128ms 0.9ms 5.4MB 397ms 3ms go 1.23.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 18ms 0.2ms 5.5MB 37ms 0ms go 1.23.3

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.7ms 0.3ms 0.1MB 0ms 0ms tinygo 0.34.0
go 1.go 1.5ms 0.1ms 3.4MB 0ms 0ms go 1.23.3
codon 1.py 4.2ms 0.5ms 6.9MB 0ms 0ms codon 0.17.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 121ms 2.2ms 65.8MB 333ms 80ms go 1.23.3
go 1-m.go 469ms 13ms 178.2MB 657ms 693ms go 1.23.3
go 2-m.go 471ms 13ms 172.3MB 627ms 700ms go 1.23.3

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 28ms 3.1ms 23.0MB 57ms 10ms go 1.23.3
go 1-m.go 96ms 6.3ms 36.5MB 77ms 127ms go 1.23.3
go 2-m.go 112ms 12ms 42.5MB 93ms 133ms go 1.23.3

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 45ms 1.4ms 40.7MB 40ms 0ms go 1.23.3
go 1.go 140ms 2.7ms 18.4MB 133ms 0ms go 1.23.3

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 243ms 4.9ms 150.6MB 227ms 37ms go 1.23.3
go 1.go 777ms 6.4ms 106.8MB 757ms 23ms go 1.23.3

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 794ms 3.9ms 40.6MB 2797ms 37ms go 1.23.3

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 147ms 0.5ms 25.9MB 380ms 27ms go 1.23.3

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 132ms 1.8ms 3.4MB 123ms 0ms go 1.23.3
go 3.go 135ms 3.9ms 0.3MB 127ms 0ms tinygo 0.34.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 380ms 0.4ms 3.4MB 370ms 0ms go 1.23.3
go 3.go 391ms 5.4ms 2.3MB 383ms 0ms tinygo 0.34.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 68ms 0.8ms 5.4MB 57ms 0ms go 1.23.3
go 3.go 69ms 1.6ms 0.1MB 60ms 0ms tinygo 0.34.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2674ms 30ms 7.4MB 2667ms 0ms go 1.23.3
go 1.go 4013ms 30ms 5.4MB 4000ms 0ms tinygo 0.34.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 113ms 1.1ms 3.4MB 100ms 0ms go 1.23.3
go 1.go 169ms 3.0ms 0.3MB 160ms 0ms tinygo 0.34.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 1640ms 27ms 40.9MB 3297ms 47ms go 1.23.3
go 2-m.go 1886ms 10ms 43.0MB 3980ms 47ms go 1.23.3
go 1.go 1934ms 5.2ms 52.1MB 1923ms 0ms tinygo 0.34.0
go 2.go 3292ms 35ms 90.4MB 3277ms 0ms tinygo 0.34.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 365ms 2.1ms 14.1MB 707ms 20ms go 1.23.3
go 1.go 383ms 2.4ms 13.4MB 367ms 0ms tinygo 0.34.0
go 2-m.go 412ms 1.3ms 14.1MB 833ms 33ms go 1.23.3
go 2.go 634ms 12ms 29.7MB 623ms 0ms tinygo 0.34.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 344ms 0.4ms 0.1MB 337ms 0ms tinygo 0.34.0
go 1.go 361ms 1.5ms 3.4MB 347ms 0ms go 1.23.3
codon 1.py 1306ms 9.3ms 7.7MB 1293ms 0ms codon 0.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 38ms 0.6ms 0.1MB 30ms 0ms tinygo 0.34.0
go 1.go 40ms 1.0ms 3.4MB 30ms 0ms go 1.23.3
codon 1.py 136ms 1.5ms 7.7MB 120ms 0ms codon 0.17.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 312ms 0.7ms 73.6MB 293ms 3ms go 1.23.3
go 1.go 318ms 4.6ms 42.9MB 307ms 0ms tinygo 0.34.0
codon 1.py 388ms 15ms 46.5MB 370ms 3ms codon 0.17.0
go 2.go 432ms 2.1ms 18.0MB 420ms 0ms tinygo 0.34.0
go 2.go 787ms 2.3ms 21.9MB 780ms 0ms go 1.23.3
codon 2.py 904ms 9.6ms 99.9MB 880ms 20ms codon 0.17.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 57ms 0.9ms 13.7MB 47ms 0ms tinygo 0.34.0
go 1.go 60ms 4.2ms 21.6MB 50ms 0ms go 1.23.3
codon 1.py 74ms 3.4ms 17.3MB 63ms 0ms codon 0.17.0
go 2.go 117ms 6.5ms 5.9MB 107ms 0ms tinygo 0.34.0
go 2.go 196ms 2.3ms 6.3MB 183ms 0ms go 1.23.3
codon 2.py 199ms 0.4ms 25.7MB 190ms 0ms codon 0.17.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1129ms 4.6ms 8.4MB 1110ms 7ms go 1.23.3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 272ms 4.4ms 8.4MB 263ms 0ms go 1.23.3

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 122.2MB 4977ms 47ms go 1.23.3
go 3.go timeout 0.0ms 104.3MB 4980ms 3ms tinygo 0.34.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 1824ms 69ms 20.0MB 1810ms 20ms go 1.23.3
go 3.go 2414ms 11ms 29.9MB 2403ms 0ms tinygo 0.34.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 141ms 1.8ms 13.5MB 130ms 3ms go 1.23.3

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 47ms 0.4ms 12.0MB 37ms 0ms go 1.23.3

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 1907ms 17ms 5.4MB 7330ms 10ms go 1.23.3
go 1.go 3680ms 35ms 5.4MB 3673ms 0ms go 1.23.3
go 1.go timeout 0.0ms 0.5MB 4990ms 0ms tinygo 0.34.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 479ms 0.2ms 5.5MB 1817ms 3ms go 1.23.3
go 1.go 934ms 5.6ms 3.4MB 927ms 0ms go 1.23.3
go 1.go 1390ms 1.4ms 0.4MB 1380ms 0ms tinygo 0.34.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 126ms 0.7ms 5.4MB 447ms 0ms go 1.23.3
go 1.go 234ms 4.3ms 3.4MB 223ms 0ms go 1.23.3
go 1.go 349ms 0.1ms 0.3MB 340ms 0ms tinygo 0.34.0