Programming Language and compiler
Benchmarks

Lua VS Python benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1667ms 61ms 273.7MB 1530ms 110ms pypy 3.8.13
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 128ms 2.2ms 82.9MB 83ms 20ms pypy 3.8.13
lua 1.lua 452ms 1.9ms 25.4MB 427ms 7ms luajit 2.1.0
python 1.py 641ms 4.3ms 12.3MB 610ms 13ms pyston 3.8.12
lua 1.lua 1073ms 10ms 17.3MB 1053ms 3ms lua 5.4.4
python 1.py 1532ms 2.7ms 11.8MB 1517ms 0ms cpython 3.10.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.2ms 0.7ms 2.2MB 0ms 0ms luajit 2.1.0
lua 1.lua 2.5ms 0.9ms 1.1MB 0ms 0ms lua 5.4.4
python 1.py 14ms 1.1ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.6ms 7.5MB 10ms 0ms cpython 3.10.4
python 1.py 34ms 1.1ms 53.6MB 10ms 10ms pypy 3.8.13

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2718ms 66ms 293.9MB 2520ms 183ms pypy 3.8.13
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 387ms 1.3ms 144.6MB 327ms 43ms pypy 3.8.13
lua 1.lua 1838ms 17ms 35.5MB 1817ms 7ms luajit 2.1.0
lua 1.lua 2924ms 30ms 41.4MB 2900ms 7ms lua 5.4.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 1145ms 21ms 2.4MB 1137ms 0ms luajit 2.1.0
python 2.py 2186ms 36ms 79.8MB 2157ms 13ms pypy 3.8.13
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 119ms 0.9ms 2.3MB 110ms 0ms luajit 2.1.0
python 2.py 282ms 2.1ms 79.5MB 257ms 10ms pypy 3.8.13
python 1.py 590ms 2.3ms 79.7MB 563ms 10ms pypy 3.8.13
lua 4.lua 1178ms 9.7ms 1.1MB 1167ms 0ms lua 5.4.4
python 1.py 1463ms 3.4ms 8.6MB 1450ms 0ms pyston 3.8.12
python 2.py 2152ms 28ms 8.5MB 2140ms 0ms pyston 3.8.12
python 1.py 4709ms 32ms 7.3MB 4693ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1561ms 2.0ms 2.4MB 1550ms 0ms luajit 2.1.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 394ms 0.7ms 2.3MB 380ms 0ms luajit 2.1.0
python 8-m.py 3295ms 48ms 110.4MB 5600ms 377ms pypy 3.8.13
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 520ms 0.3ms 5.0MB 510ms 0ms luajit 2.1.0
python 1.py 1216ms 5.5ms 196.8MB 1140ms 60ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 37ms 0.5ms 2.9MB 23ms 0ms luajit 2.1.0
python 1.py 293ms 12ms 95.1MB 257ms 17ms pypy 3.8.13
python 1.py 965ms 4.9ms 17.2MB 947ms 3ms pyston 3.8.12
python 1.py 1003ms 35ms 17.1MB 967ms 0ms cpython 3.10.4