Programming Language and compiler
Benchmarks

Ocaml VS Lua benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 4123ms 259ms 120.7MB 4060ms 43ms ocaml 4.14.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 285ms 2.1ms 17.4MB 267ms 3ms ocaml 4.14.0
lua 1.lua 542ms 22ms 25.2MB 523ms 7ms luajit 2.1.0
lua 1.lua 1204ms 6.2ms 17.3MB 1183ms 3ms lua 5.4.4

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3161ms 11ms 2.6MB 3147ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 262ms 0.5ms 2.5MB 250ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 357ms 26ms 25.6MB 340ms 3ms ocaml 4.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 43ms 0.5ms 4.9MB 30ms 0ms ocaml 4.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.1ms 0.7ms 2.2MB 0ms 0ms luajit 2.1.0
ocaml 1.ml 2.3ms 0.4ms 2.9MB 0ms 0ms ocaml 4.14.0
lua 1.lua 3.1ms 1.1ms 1.1MB 0ms 0ms lua 5.4.4

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 203ms 0.4ms 5.8MB 190ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 627ms 47ms 5.9MB 610ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 91ms 0.4ms 5.1MB 80ms 0ms ocaml 4.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1709ms 12ms 62.6MB 1673ms 17ms ocaml 4.14.0
ocaml 2.ml 2842ms 3.0ms 71.2MB 2803ms 20ms ocaml 4.14.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 205ms 0.5ms 18.6MB 180ms 10ms ocaml 4.14.0
ocaml 2.ml 460ms 5.6ms 25.2MB 440ms 3ms ocaml 4.14.0
lua 1.lua 2331ms 46ms 35.3MB 2293ms 17ms luajit 2.1.0
lua 1.lua 3310ms 64ms 41.5MB 3277ms 20ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 526ms 39ms 2.4MB 513ms 0ms ocaml 4.14.0
lua 4.lua 1120ms 8.4ms 1.1MB 1107ms 0ms luajit 2.1.0
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 59ms 0.6ms 2.6MB 50ms 0ms ocaml 4.14.0
lua 4.lua 116ms 1.0ms 1.0MB 100ms 0ms luajit 2.1.0
lua 4.lua 1449ms 38ms 1.1MB 1433ms 0ms lua 5.4.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2591ms 2.3ms 19.8MB 2577ms 3ms ocaml 4.14.0
ocaml 1.ml 3328ms 22ms 555.2MB 3160ms 150ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 612ms 2.4ms 8.9MB 593ms 0ms ocaml 4.14.0
ocaml 1.ml 678ms 11ms 142.5MB 630ms 30ms ocaml 4.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 667ms 1.2ms 50.3MB 630ms 20ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1344ms 0.8ms 3.4MB 1330ms 0ms ocaml 4.14.0
lua 1.lua 1357ms 86ms 2.4MB 1347ms 0ms luajit 2.1.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 325ms 27ms 2.4MB 313ms 0ms luajit 2.1.0
ocaml 2.ml 385ms 0.1ms 3.1MB 373ms 0ms ocaml 4.14.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4