OCaml VS Rust benchmarks

Current benchmark data was generated on Wed Sep 28 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1521ms 12ms 33.8MB 1497ms 10ms rustc 1.64.0
rust 5.rs 1671ms 6.5ms 33.8MB 1650ms 7ms rustc 1.64.0
rust 3.rs 1781ms 12ms 49.9MB 1753ms 13ms rustc 1.64.0
ocaml 1.ml 3974ms 21ms 120.8MB 3930ms 23ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 139ms 0.3ms 6.0MB 127ms 0ms rustc 1.64.0
rust 5.rs 154ms 1.0ms 6.1MB 140ms 0ms rustc 1.64.0
rust 3.rs 166ms 6.2ms 7.9MB 150ms 0ms rustc 1.64.0
ocaml 1.ml 268ms 4.6ms 17.4MB 253ms 0ms ocaml 4.14.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 719ms 6.5ms 0.7MB 1387ms 0ms rustc 1.64.0
rust 2-im.rs 1078ms 2.5ms 0.7MB 2070ms 0ms rustc 1.64.0
rust 5-m.rs 1233ms 12ms 0.7MB 2380ms 0ms rustc 1.64.0
rust 3-i.rs 1432ms 1.8ms 0.6MB 1420ms 0ms rustc 1.64.0
rust 1-m.rs 1946ms 14ms 0.7MB 3787ms 0ms rustc 1.64.0
rust 2-i.rs 1996ms 0.5ms 0.6MB 1980ms 0ms rustc 1.64.0
rust 1.rs 3862ms 80ms 0.6MB 3850ms 0ms rustc 1.64.0
ocaml 2.ml 3925ms 2.1ms 2.6MB 3910ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 66ms 1.6ms 0.7MB 110ms 0ms rustc 1.64.0
rust 2-im.rs 96ms 0.1ms 0.7MB 160ms 0ms rustc 1.64.0
rust 5-m.rs 112ms 2.9ms 0.7MB 190ms 0ms rustc 1.64.0
rust 3-i.rs 120ms 0.7ms 0.6MB 110ms 0ms rustc 1.64.0
rust 2-i.rs 166ms 0.6ms 0.6MB 160ms 0ms rustc 1.64.0
rust 1-m.rs 173ms 2.7ms 0.7MB 310ms 0ms rustc 1.64.0
rust 1.rs 323ms 1.7ms 0.6MB 310ms 0ms rustc 1.64.0
ocaml 2.ml 328ms 2.0ms 2.6MB 320ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 179ms 0.5ms 1.3MB 320ms 0ms rustc 1.66.0-nightly
rust 5-m.rs 201ms 2.8ms 1.3MB 363ms 0ms rustc 1.64.0
rust 1c.rs 230ms 0.9ms 0.7MB 220ms 0ms rustc 1.66.0-nightly
rust 1.rs 316ms 3.1ms 0.6MB 307ms 0ms rustc 1.64.0
ocaml 6.ml 423ms 0.6ms 24.5MB 410ms 0ms ocaml 4.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 26ms 0.6ms 1.9MB 17ms 0ms rustc 1.66.0-nightly
rust 5c-m.rs 27ms 2.6ms 1.2MB 37ms 0ms rustc 1.66.0-nightly
rust 5-m.rs 30ms 2.3ms 1.3MB 33ms 0ms rustc 1.64.0
rust 1.rs 34ms 0.2ms 0.6MB 23ms 0ms rustc 1.64.0
ocaml 6.ml 49ms 2.6ms 6.0MB 33ms 0ms ocaml 4.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.5ms 0.3ms 2.0MB 0ms 0ms rustc 1.64.0
ocaml 1.ml 2.2ms 0.6ms 2.6MB 0ms 0ms ocaml 4.14.0
rust 1.rs 2.8ms 1.5ms 2.0MB 0ms 0ms rustc 1.66.0-nightly

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 65ms 3.7ms 0.6MB 53ms 0ms rustc 1.64.0
rust 1.rs 72ms 1.4ms 2.2MB 60ms 0ms rustc 1.64.0
ocaml 1.ml 238ms 0.6ms 5.9MB 227ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 213ms 14ms 2.2MB 203ms 0ms rustc 1.64.0
rust 1.rs 304ms 12ms 2.2MB 290ms 0ms rustc 1.64.0
ocaml 1.ml 708ms 0.9ms 5.9MB 697ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 35ms 0.2ms 0.6MB 27ms 0ms rustc 1.64.0
rust 1.rs 47ms 1.5ms 1.8MB 37ms 0ms rustc 1.64.0
ocaml 1.ml 104ms 0.6ms 5.0MB 90ms 0ms ocaml 4.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 895ms 9.9ms 33.8MB 863ms 13ms rustc 1.64.0
ocaml 1.ml 1490ms 8.9ms 62.6MB 1450ms 23ms ocaml 4.14.0
ocaml 2.ml 2549ms 8.8ms 71.5MB 2527ms 7ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 183ms 1.5ms 9.9MB 170ms 0ms rustc 1.64.0
ocaml 1.ml 188ms 0.6ms 18.6MB 173ms 0ms ocaml 4.14.0
ocaml 2.ml 426ms 1.7ms 23.5MB 407ms 7ms ocaml 4.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 252ms 0.3ms 0.6MB 240ms 0ms rustc 1.64.0
rust 7-i.rs 305ms 1.6ms 0.6MB 290ms 0ms rustc 1.64.0
rust 3.rs 338ms 0.5ms 0.7MB 330ms 0ms rustc 1.66.0-nightly
rust 2.rs 343ms 4.2ms 0.6MB 333ms 0ms rustc 1.64.0
rust 1.rs 383ms 0.6ms 0.6MB 370ms 0ms rustc 1.64.0
ocaml 1.ml 469ms 0.4ms 2.6MB 457ms 0ms ocaml 4.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 27ms 0.4ms 0.6MB 20ms 0ms rustc 1.64.0
rust 7-i.rs 33ms 0.3ms 0.6MB 27ms 0ms rustc 1.64.0
rust 3.rs 36ms 0.6ms 0.6MB 27ms 0ms rustc 1.66.0-nightly
rust 2.rs 36ms 0.4ms 0.6MB 30ms 0ms rustc 1.64.0
rust 1.rs 42ms 1.0ms 0.6MB 30ms 0ms rustc 1.64.0
ocaml 1.ml 51ms 3.2ms 2.4MB 40ms 0ms ocaml 4.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 461ms 8.7ms 6.7MB 447ms 0ms rustc 1.64.0
rust 1.rs 633ms 88ms 40.8MB 617ms 3ms rustc 1.64.0
ocaml 1.ml 2004ms 26ms 555.9MB 1887ms 103ms ocaml 4.14.0
ocaml 2.ml 2262ms 1.0ms 20.1MB 2250ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 105ms 0.5ms 3.2MB 97ms 0ms rustc 1.64.0
rust 1.rs 130ms 6.1ms 11.7MB 117ms 0ms rustc 1.64.0
ocaml 1.ml 380ms 3.5ms 142.3MB 347ms 13ms ocaml 4.14.0
ocaml 2.ml 548ms 0.4ms 8.4MB 537ms 0ms ocaml 4.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 568ms 7.5ms 76.9MB 717ms 17ms rustc 1.64.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 62ms 0.6ms 11.6MB 70ms 0ms rustc 1.64.0
ocaml 2.ml 682ms 4.2ms 50.9MB 653ms 13ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 1057ms 1.7ms 2.1MB 2053ms 0ms rustc 1.64.0
rust 8-m.rs 1058ms 1.0ms 2.5MB 2050ms 0ms rustc 1.66.0-nightly
rust 8.rs 2060ms 0.5ms 2.5MB 2050ms 0ms rustc 1.66.0-nightly
rust 7.rs 2061ms 1.5ms 2.2MB 2050ms 0ms rustc 1.64.0
rust 2-m.rs 2124ms 0.5ms 2.1MB 4147ms 0ms rustc 1.64.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0
rust 2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 272ms 0.9ms 0.7MB 507ms 0ms rustc 1.64.0
rust 8-m.rs 274ms 0.6ms 2.2MB 510ms 0ms rustc 1.66.0-nightly
rust 7.rs 517ms 0.3ms 0.6MB 510ms 0ms rustc 1.64.0
rust 8.rs 517ms 0.5ms 2.1MB 507ms 0ms rustc 1.66.0-nightly
rust 2-m.rs 549ms 13ms 2.3MB 1033ms 3ms rustc 1.64.0
ocaml 2.ml 1647ms 1.4ms 3.4MB 1640ms 0ms ocaml 4.14.0
rust 2.rs 1707ms 1.9ms 0.6MB 1697ms 0ms rustc 1.64.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 74ms 1.4ms 0.7MB 123ms 0ms rustc 1.64.0
rust 8-m.rs 75ms 1.4ms 2.2MB 127ms 0ms rustc 1.66.0-nightly
rust 8.rs 131ms 0.2ms 2.2MB 120ms 0ms rustc 1.66.0-nightly
rust 7.rs 132ms 0.8ms 1.9MB 120ms 0ms rustc 1.64.0
rust 2-m.rs 143ms 0.2ms 0.7MB 257ms 0ms rustc 1.64.0
ocaml 2.ml 415ms 0.4ms 3.5MB 403ms 0ms ocaml 4.14.0
rust 2.rs 429ms 0.1ms 0.6MB 420ms 0ms rustc 1.64.0