Programming Language and compiler
Benchmarks

Go VS OCaml benchmarks

Current benchmark data was generated on Wed Sep 28 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2897ms 7.4ms 44.7MB 4130ms 57ms go 1.19.1
go 1.go 3962ms 29ms 39.1MB 3947ms 0ms tinygo 0.25.0
ocaml 1.ml 3974ms 21ms 120.8MB 3930ms 23ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 257ms 2.9ms 8.2MB 333ms 3ms go 1.19.1
ocaml 1.ml 268ms 4.6ms 17.4MB 253ms 0ms ocaml 4.14.0
go 1.go 303ms 0.3ms 6.0MB 290ms 0ms tinygo 0.25.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 741ms 41ms 13.6MB 1443ms 0ms go 1.19.1
go 1.go 1717ms 3.5ms 253.7MB 1650ms 50ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 56ms 5.7ms 5.4MB 93ms 0ms go 1.19.1
go 1.go 270ms 0.7ms 66.7MB 243ms 7ms tinygo 0.25.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 169ms 2.8ms 8.5MB 153ms 3ms go 1.19.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 2.5ms 8.2MB 40ms 0ms go 1.19.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1448ms 9.9ms 3.0MB 2803ms 0ms go 1.19.1
go 3.go 2930ms 1.7ms 49.1MB 2910ms 10ms tinygo 0.25.0
ocaml 2.ml 3925ms 2.1ms 2.6MB 3910ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 144ms 1.8ms 5.0MB 223ms 0ms go 1.19.1
go 3.go 309ms 0.7ms 50.1MB 297ms 0ms tinygo 0.25.0
ocaml 2.ml 328ms 2.0ms 2.6MB 320ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 238ms 0.4ms 2.9MB 440ms 0ms go 1.19.1
ocaml 6.ml 423ms 0.6ms 24.5MB 410ms 0ms ocaml 4.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 30ms 0.2ms 2.9MB 40ms 0ms go 1.19.1
ocaml 6.ml 49ms 2.6ms 6.0MB 33ms 0ms ocaml 4.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.8ms 0.7ms 2.0MB 0ms 0ms tinygo 0.25.0
ocaml 1.ml 2.2ms 0.6ms 2.6MB 0ms 0ms ocaml 4.14.0
go 1.go 2.7ms 0.4ms 2.9MB 0ms 0ms go 1.19.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 162ms 5.8ms 58.4MB 243ms 37ms go 1.19.1
go 1-m.go 567ms 30ms 179.2MB 543ms 323ms go 1.19.1
go 2-m.go 585ms 63ms 176.1MB 580ms 343ms go 1.19.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 40ms 3.1ms 22.7MB 40ms 10ms go 1.19.1
go 2.go 113ms 1.2ms 39.1MB 80ms 43ms go 1.19.1
go 1.go 119ms 8.4ms 38.0MB 77ms 50ms go 1.19.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 71ms 0.4ms 39.5MB 53ms 13ms go 1.19.1
go 1.go 171ms 2.1ms 20.2MB 157ms 7ms go 1.19.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 396ms 8.4ms 187.8MB 373ms 90ms go 1.19.1
go 1.go 1039ms 5.9ms 106.0MB 1003ms 63ms go 1.19.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1510ms 5.2ms 41.1MB 2797ms 37ms go 1.19.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 226ms 3.0ms 22.4MB 360ms 13ms go 1.19.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 166ms 0.4ms 0.3MB 160ms 0ms tinygo 0.25.0
go 3.go 173ms 1.4ms 2.8MB 160ms 0ms go 1.19.1
ocaml 1.ml 238ms 0.6ms 5.9MB 227ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 491ms 0.3ms 0.3MB 480ms 0ms tinygo 0.25.0
go 3.go 514ms 3.1ms 3.4MB 500ms 0ms go 1.19.1
ocaml 1.ml 708ms 0.9ms 5.9MB 697ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 81ms 0.5ms 0.0MB 70ms 0ms tinygo 0.25.0
go 3.go 93ms 2.3ms 5.6MB 83ms 0ms go 1.19.1
ocaml 1.ml 104ms 0.6ms 5.0MB 90ms 0ms ocaml 4.14.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4110ms 15ms 6.9MB 4093ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 171ms 0.3ms 2.8MB 160ms 0ms go 1.19.1
go 1.go 245ms 0.3ms 0.0MB 233ms 0ms tinygo 0.25.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1490ms 8.9ms 62.6MB 1450ms 23ms ocaml 4.14.0
go 1.go 1891ms 8.9ms 38.2MB 2680ms 17ms go 1.19.1
go 2.go 2233ms 22ms 52.9MB 3143ms 57ms go 1.19.1
ocaml 2.ml 2549ms 8.8ms 71.5MB 2527ms 7ms ocaml 4.14.0
go 1.go 3053ms 3.0ms 159.8MB 3003ms 37ms tinygo 0.25.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 188ms 0.6ms 18.6MB 173ms 0ms ocaml 4.14.0
go 1.go 409ms 5.1ms 12.5MB 563ms 10ms go 1.19.1
ocaml 2.ml 426ms 1.7ms 23.5MB 407ms 7ms ocaml 4.14.0
go 2.go 477ms 1.5ms 14.3MB 647ms 20ms go 1.19.1
go 1.go 800ms 6.4ms 39.1MB 783ms 3ms tinygo 0.25.0
go 2.go 1329ms 3.7ms 52.1MB 1313ms 0ms tinygo 0.25.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 454ms 2.2ms 2.9MB 440ms 0ms go 1.19.1
ocaml 1.ml 469ms 0.4ms 2.6MB 457ms 0ms ocaml 4.14.0
go 1.go 842ms 0.7ms 0.0MB 830ms 0ms tinygo 0.25.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 1.8ms 2.9MB 37ms 0ms go 1.19.1
ocaml 1.ml 51ms 3.2ms 2.4MB 40ms 0ms ocaml 4.14.0
go 1.go 86ms 0.5ms 0.0MB 80ms 0ms tinygo 0.25.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 574ms 29ms 75.2MB 540ms 13ms go 1.19.1
go 2.go 632ms 2.0ms 17.4MB 613ms 0ms tinygo 0.25.0
go 1.go 749ms 39ms 43.8MB 727ms 7ms tinygo 0.25.0
go 2.go 915ms 14ms 20.0MB 897ms 10ms go 1.19.1
ocaml 1.ml 2004ms 26ms 555.9MB 1887ms 103ms ocaml 4.14.0
ocaml 2.ml 2262ms 1.0ms 20.1MB 2250ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 133ms 1.5ms 13.9MB 120ms 0ms tinygo 0.25.0
go 1.go 134ms 8.0ms 21.9MB 120ms 0ms go 1.19.1
go 2.go 146ms 0.6ms 5.4MB 133ms 0ms tinygo 0.25.0
go 2.go 218ms 2.3ms 8.1MB 200ms 3ms go 1.19.1
ocaml 1.ml 380ms 3.5ms 142.3MB 347ms 13ms ocaml 4.14.0
ocaml 2.ml 548ms 0.4ms 8.4MB 537ms 0ms ocaml 4.14.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1425ms 2.8ms 8.4MB 1393ms 10ms go 1.19.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 338ms 1.2ms 8.4MB 323ms 0ms go 1.19.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 682ms 4.2ms 50.9MB 653ms 13ms ocaml 4.14.0
go 3.go 2475ms 29ms 18.2MB 2460ms 20ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 170ms 1.5ms 8.1MB 160ms 3ms go 1.19.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 54ms 0.8ms 9.5MB 47ms 0ms go 1.19.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2499ms 19ms 5.5MB 4830ms 0ms go 1.19.1
go 1.go 4890ms 3.2ms 5.5MB 4880ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 627ms 1.2ms 2.9MB 1193ms 0ms go 1.19.1
go 1.go 1227ms 6.7ms 2.9MB 1213ms 0ms go 1.19.1
ocaml 2.ml 1647ms 1.4ms 3.4MB 1640ms 0ms ocaml 4.14.0
go 1.go 2576ms 1.3ms 0.0MB 2563ms 0ms tinygo 0.25.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 165ms 0.6ms 2.9MB 297ms 0ms go 1.19.1
go 1.go 310ms 1.4ms 2.9MB 300ms 0ms go 1.19.1
ocaml 2.ml 415ms 0.4ms 3.5MB 403ms 0ms ocaml 4.14.0
go 1.go 646ms 0.6ms 2.0MB 640ms 0ms tinygo 0.25.0