Programming Language and compiler
Benchmarks

OCaml VS Lua benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 4918ms 27ms 153.4MB 4853ms 47ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 119.5MB 4937ms 47ms lua 5.4.4
lua 1.lua timeout 0.0ms 174.6MB 4930ms 50ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 343ms 1.5ms 22.9MB 327ms 3ms ocaml 5.0.0
lua 1.lua 404ms 4.7ms 25.0MB 383ms 7ms luajit 2.1.0-beta3
lua 1.lua 1057ms 15ms 17.3MB 1043ms 0ms lua 5.4.4

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3975ms 4.3ms 2.8MB 3963ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 330ms 1.2ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 421ms 0.7ms 22.7MB 403ms 0ms ocaml 5.0.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 46ms 0.5ms 4.9MB 33ms 0ms ocaml 5.0.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.9ms 0.4ms 2.3MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 2.1ms 0.8ms 1.5MB 0ms 0ms lua 5.4.4
ocaml 1.ml 2.5ms 0.7ms 2.9MB 0ms 0ms ocaml 5.0.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 259ms 0.2ms 6.8MB 250ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 769ms 4.3ms 6.8MB 757ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 115ms 0.5ms 5.9MB 107ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1528ms 14ms 69.1MB 1497ms 13ms ocaml 5.0.0
ocaml 2.ml 3201ms 10ms 74.3MB 3160ms 27ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 159.2MB 4920ms 60ms lua 5.4.4
lua 1.lua timeout 0.0ms 180.9MB 4913ms 70ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 223ms 0.9ms 25.6MB 207ms 3ms ocaml 5.0.0
ocaml 2.ml 572ms 3.4ms 30.1MB 550ms 3ms ocaml 5.0.0
lua 1.lua 1517ms 29ms 36.2MB 1490ms 13ms luajit 2.1.0-beta3
lua 1.lua 2818ms 14ms 41.6MB 2790ms 10ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 468ms 0.1ms 3.0MB 460ms 0ms ocaml 5.0.0
lua 4.lua 1105ms 6.1ms 1.4MB 1097ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 1.5MB 4990ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 50ms 1.2ms 2.9MB 40ms 0ms ocaml 5.0.0
lua 4.lua 115ms 2.8ms 1.4MB 103ms 0ms luajit 2.1.0-beta3
lua 4.lua 1205ms 19ms 1.5MB 1193ms 0ms lua 5.4.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1942ms 9.7ms 550.6MB 1843ms 83ms ocaml 5.0.0
ocaml 2.ml 2416ms 46ms 19.0MB 2403ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 354ms 17ms 140.4MB 323ms 13ms ocaml 5.0.0
ocaml 2.ml 602ms 21ms 9.1MB 583ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 181.9MB 4913ms 67ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 715ms 2.1ms 52.5MB 687ms 13ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.6MB 4990ms 0ms luajit 2.1.0-beta3
ocaml 2.ml timeout 0.0ms 4.2MB 4990ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1559ms 3.6ms 2.6MB 1550ms 0ms luajit 2.1.0-beta3
ocaml 2.ml 1634ms 0.6ms 3.7MB 1620ms 0ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 2.2MB 4987ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 394ms 0.9ms 1.4MB 380ms 0ms luajit 2.1.0-beta3
ocaml 2.ml 412ms 0.8ms 3.4MB 400ms 0ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 1.4MB 4987ms 0ms lua 5.4.4