Nim VS Lua benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 3400ms 65ms 34.4MB 3377ms 7ms nim/clang 1.6.6
nim 2.nim 3513ms 2.5ms 34.5MB 3490ms 7ms nim 1.6.6
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 320ms 4.9ms 5.7MB 310ms 0ms nim/clang 1.6.6
nim 2.nim 332ms 2.4ms 5.4MB 320ms 0ms nim 1.6.6
lua 1.lua 452ms 1.9ms 25.4MB 427ms 7ms luajit 2.1.0
lua 1.lua 1073ms 10ms 17.3MB 1053ms 3ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 520ms 0.3ms 5.0MB 510ms 0ms luajit 2.1.0
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 37ms 0.5ms 2.9MB 23ms 0ms luajit 2.1.0
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 261ms 0.9ms 0.7MB 247ms 0ms nim 1.6.6
nim 2.nim 337ms 0.7ms 0.9MB 320ms 0ms nim/clang 1.6.6
nim 1.nim 771ms 2.8ms 0.7MB 650ms 103ms nim 1.6.6
nim 1.nim 787ms 2.3ms 0.9MB 657ms 110ms nim/clang 1.6.6

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 28ms 0.1ms 0.7MB 20ms 0ms nim 1.6.6
nim 2.nim 36ms 0.1ms 1.0MB 30ms 0ms nim/clang 1.6.6
nim 1.nim 81ms 0.5ms 0.7MB 57ms 7ms nim 1.6.6
nim 1.nim 82ms 0.9ms 1.0MB 63ms 3ms nim/clang 1.6.6

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.7ms 0.5ms 0.7MB 0ms 0ms nim 1.6.6
nim 1.nim 1.8ms 0.5ms 1.0MB 0ms 0ms nim/clang 1.6.6
lua 1.lua 2.2ms 0.7ms 2.2MB 0ms 0ms luajit 2.1.0
lua 1.lua 2.5ms 0.9ms 1.1MB 0ms 0ms lua 5.4.4

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 760ms 4.4ms 94.5MB 327ms 393ms nim 1.6.6
nim 1.nim 767ms 2.5ms 94.7MB 320ms 413ms nim/clang 1.6.6

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 126ms 0.5ms 18.1MB 47ms 63ms nim 1.6.6
nim 1.nim 131ms 0.9ms 18.0MB 50ms 63ms nim/clang 1.6.6

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 147ms 0.8ms 1.0MB 140ms 0ms nim/clang 1.6.6
nim 2.nim 154ms 0.4ms 0.7MB 143ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 436ms 4.3ms 1.0MB 427ms 0ms nim/clang 1.6.6
nim 2.nim 458ms 2.1ms 0.7MB 447ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 64ms 1.0ms 1.0MB 53ms 0ms nim/clang 1.6.6
nim 2.nim 67ms 0.4ms 0.7MB 60ms 0ms nim 1.6.6
nim 1.nim 421ms 0.9ms 1.0MB 410ms 0ms nim/clang 1.6.6
nim 1.nim 466ms 4.2ms 0.7MB 457ms 0ms nim 1.6.6

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 576ms 0.8ms 4.8MB 567ms 0ms nim/clang 1.6.6
nim 1.nim 997ms 0.5ms 4.5MB 990ms 0ms nim 1.6.6

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 26ms 0.2ms 0.9MB 17ms 0ms nim/clang 1.6.6
nim 1.nim 43ms 0.3ms 0.7MB 33ms 0ms nim 1.6.6

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1581ms 0.4ms 35.1MB 1560ms 10ms nim/clang 1.6.6
nim 1.nim 1664ms 0.7ms 35.1MB 1643ms 7ms nim 1.6.6
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 340ms 2.8ms 9.9MB 330ms 0ms nim/clang 1.6.6
nim 1.nim 361ms 4.6ms 9.3MB 347ms 0ms nim 1.6.6
lua 1.lua 1838ms 17ms 35.5MB 1817ms 7ms luajit 2.1.0
lua 1.lua 2924ms 30ms 41.4MB 2900ms 7ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 405ms 0.5ms 1.0MB 390ms 0ms nim/clang 1.6.6
nim 2.nim 429ms 1.0ms 1.0MB 420ms 0ms nim 1.6.6
lua 4.lua 1145ms 21ms 2.4MB 1137ms 0ms luajit 2.1.0
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 43ms 0.1ms 1.0MB 33ms 0ms nim/clang 1.6.6
nim 2.nim 45ms 0.9ms 1.0MB 40ms 0ms nim 1.6.6
lua 4.lua 119ms 0.9ms 2.3MB 110ms 0ms luajit 2.1.0
lua 4.lua 1178ms 9.7ms 1.1MB 1167ms 0ms lua 5.4.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 593ms 2.3ms 6.4MB 583ms 0ms nim/clang 1.6.6
nim 2.nim 668ms 3.2ms 6.1MB 650ms 0ms nim 1.6.6
nim 1.nim 828ms 1.4ms 41.1MB 813ms 0ms nim 1.6.6
nim 1.nim 829ms 24ms 40.9MB 813ms 3ms nim/clang 1.6.6

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 124ms 0.7ms 11.0MB 110ms 0ms nim 1.6.6
nim 1.nim 129ms 2.5ms 11.3MB 117ms 0ms nim/clang 1.6.6
nim 2.nim 140ms 0.3ms 3.3MB 130ms 0ms nim/clang 1.6.6
nim 2.nim 158ms 0.2ms 3.0MB 150ms 0ms nim 1.6.6

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4121ms 0.3ms 1.8MB 4110ms 0ms nim/clang 1.6.6
nim 1.nim 4122ms 1.3ms 1.8MB 4110ms 0ms nim 1.6.6
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1032ms 0.3ms 1.0MB 1020ms 0ms nim 1.6.6
nim 1.nim 1033ms 1.6ms 1.0MB 1020ms 0ms nim/clang 1.6.6
lua 1.lua 1561ms 2.0ms 2.4MB 1550ms 0ms luajit 2.1.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 260ms 0.3ms 1.0MB 250ms 0ms nim 1.6.6
nim 1.nim 260ms 0.3ms 1.0MB 250ms 0ms nim/clang 1.6.6
lua 1.lua 394ms 0.7ms 2.3MB 380ms 0ms luajit 2.1.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4