Programming Language and compiler
Benchmarks

Lua VS Python benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1164ms 8.8ms 95.7MB 1100ms 47ms pypy 3.10.14
lua 1.lua 3463ms 70ms 172.8MB 3323ms 123ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 104.9MB 4960ms 27ms lua 5.4.7
python 1.py timeout 0.0ms 40.9MB 4970ms 13ms cpython 3.13.0
python 1.py timeout 0.0ms 40.5MB 4767ms 213ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 93ms 0.7ms 67.9MB 60ms 17ms pypy 3.10.14
lua 1.lua 286ms 1.1ms 15.9MB 263ms 7ms luajit 2.1.0-beta3
python 1.py 474ms 4.5ms 11.9MB 450ms 7ms pyston 3.8.12
python 1.py 716ms 13ms 12.8MB 707ms 0ms cpython 3.13.0
lua 1.lua 810ms 1.8ms 16.9MB 790ms 0ms lua 5.4.7

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.4ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 1.5ms 0.2ms 2.1MB 0ms 0ms lua 5.4.7
python 1.py 11ms 0.9ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 1.1ms 8.5MB 0ms 0ms cpython 3.13.0
python 1.py 29ms 1.0ms 51.0MB 10ms 10ms pypy 3.10.14

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2242ms 21ms 210.2MB 2127ms 100ms pypy 3.10.14
lua 1.lua timeout 0.0ms 107.4MB 4953ms 33ms lua 5.4.7
lua 1.lua timeout 0.0ms 149.3MB 4933ms 47ms luajit 2.1.0-beta3
python 1.py timeout 0.0ms 93.9MB 4953ms 27ms cpython 3.13.0
python 1.py timeout 0.0ms 130.4MB 4943ms 40ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 386ms 1.5ms 103.6MB 317ms 50ms pypy 3.10.14
lua 1.lua 1122ms 32ms 31.0MB 1097ms 10ms luajit 2.1.0-beta3
lua 1.lua 2145ms 2.0ms 28.6MB 2120ms 10ms lua 5.4.7
python 1.py 2958ms 51ms 37.1MB 2937ms 7ms cpython 3.13.0
python 1.py timeout 0.0ms 48.9MB 4943ms 40ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 716ms 7.4ms 2.4MB 707ms 0ms luajit 2.1.0-beta3
python 2.py 1351ms 7.9ms 59.8MB 1323ms 17ms pypy 3.10.14
python 1.py 2634ms 23ms 56.6MB 2610ms 10ms pypy 3.10.14
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7
python 1.py timeout 0.0ms 8.8MB 4987ms 3ms cpython 3.13.0
python 2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.0
python 1.py timeout 0.0ms 8.3MB 4987ms 3ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4987ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 76ms 2.2ms 2.4MB 67ms 0ms luajit 2.1.0-beta3
python 2.py 176ms 1.4ms 57.6MB 147ms 13ms pypy 3.10.14
python 1.py 301ms 4.2ms 56.6MB 273ms 10ms pypy 3.10.14
python 1.py 926ms 8.6ms 8.3MB 910ms 0ms pyston 3.8.12
lua 4.lua 1120ms 22ms 2.3MB 1107ms 0ms lua 5.4.7
python 2.py 1297ms 12ms 8.1MB 1280ms 0ms pyston 3.8.12
python 1.py 3025ms 45ms 8.8MB 3007ms 3ms cpython 3.13.0
python 2.py 3179ms 124ms 8.8MB 3167ms 0ms cpython 3.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 4052ms 6.0ms 2.5MB 4043ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.5MB 4990ms 0ms lua 5.4.7
python 8.py timeout 0.0ms 16.8MB 43ms 10ms cpython 3.13.0
python 8.py timeout 0.0ms 100.4MB 843ms 157ms pypy 3.10.14
python 8.py timeout 0.0ms 18.3MB 67ms 20ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1024ms 0.9ms 2.4MB 1010ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7
python 8.py timeout 0.0ms 16.4MB 110ms 20ms cpython 3.13.0
python 8.py timeout 0.0ms 97.6MB 1480ms 487ms pypy 3.10.14
python 8.py timeout 0.0ms 17.5MB 137ms 43ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 258ms 1.0ms 2.3MB 247ms 0ms luajit 2.1.0-beta3
python 8-m.py 1978ms 11ms 94.6MB 6323ms 333ms pypy 3.10.14
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7
python 8.py timeout 0.0ms 14.1MB 243ms 43ms cpython 3.13.0
python 8.py timeout 0.0ms 17.2MB 390ms 117ms pyston 3.8.12