Programming Language and compiler
Benchmarks

OCaml VS Lua benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 4948ms 10ms 153.4MB 4887ms 43ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 119.5MB 4953ms 27ms lua 5.4.4
lua 1.lua timeout 0.0ms 209.4MB 4930ms 50ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 341ms 3.5ms 22.9MB 323ms 3ms ocaml 5.0.0
lua 1.lua 416ms 5.6ms 25.2MB 393ms 10ms luajit 2.1.0-beta3
lua 1.lua 1062ms 12ms 17.4MB 1040ms 3ms lua 5.4.4

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3984ms 14ms 2.8MB 3973ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 331ms 1.3ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 425ms 0.3ms 22.7MB 407ms 3ms ocaml 5.0.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 2.4ms 4.9MB 37ms 0ms ocaml 5.0.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.9ms 0.2ms 2.3MB 0ms 0ms luajit 2.1.0-beta3
ocaml 1.ml 2.7ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0
lua 1.lua 3.0ms 2.4ms 1.5MB 0ms 0ms lua 5.4.4

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 264ms 2.8ms 6.7MB 250ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 781ms 8.1ms 6.7MB 767ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 118ms 1.6ms 6.0MB 110ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1524ms 6.3ms 69.4MB 1483ms 23ms ocaml 5.0.0
ocaml 2.ml 3227ms 33ms 74.1MB 3187ms 23ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 159.2MB 4940ms 43ms lua 5.4.4
lua 1.lua timeout 0.0ms 183.3MB 4927ms 53ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 229ms 7.2ms 25.6MB 213ms 3ms ocaml 5.0.0
ocaml 2.ml 576ms 3.7ms 30.2MB 557ms 3ms ocaml 5.0.0
lua 1.lua 1526ms 27ms 36.0MB 1503ms 7ms luajit 2.1.0-beta3
lua 1.lua 2805ms 35ms 41.6MB 2773ms 13ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 470ms 0.5ms 2.9MB 460ms 0ms ocaml 5.0.0
lua 4.lua 1109ms 7.7ms 1.4MB 1097ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 1.4MB 4987ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 50ms 0.6ms 2.9MB 40ms 0ms ocaml 5.0.0
lua 4.lua 118ms 7.0ms 1.4MB 110ms 0ms luajit 2.1.0-beta3
lua 4.lua 1211ms 12ms 1.4MB 1200ms 0ms lua 5.4.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1999ms 32ms 550.5MB 1893ms 87ms ocaml 5.0.0
ocaml 2.ml 2424ms 16ms 19.0MB 2410ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 339ms 11ms 140.3MB 307ms 17ms ocaml 5.0.0
ocaml 2.ml 609ms 28ms 9.1MB 590ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 181.9MB 4927ms 47ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 705ms 2.8ms 52.5MB 683ms 10ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 2.2MB 4990ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.5MB 4990ms 0ms luajit 2.1.0-beta3
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1559ms 1.5ms 2.5MB 1547ms 0ms luajit 2.1.0-beta3
ocaml 2.ml 1639ms 5.6ms 3.7MB 1623ms 0ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 2.2MB 4990ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 393ms 0.7ms 1.4MB 383ms 0ms luajit 2.1.0-beta3
ocaml 2.ml 412ms 0.4ms 3.3MB 400ms 0ms ocaml 5.0.0
lua 1.lua timeout 0.0ms 1.5MB 4987ms 0ms lua 5.4.4