Programming Language and compiler
Benchmarks

Python VS Lua benchmarks

Current benchmark data was generated on Mon Mar 31 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1210ms 7.0ms 96.2MB 1147ms 47ms pypy 3.10.16
lua 1.lua 3623ms 23ms 173.0MB 3477ms 133ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 104.9MB 4953ms 33ms lua 5.4.7
python 1.py timeout 0.0ms 40.8MB 4963ms 20ms cpython 3.13.2
python 1.py timeout 0.0ms 40.5MB 4747ms 240ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 95ms 1.1ms 68.8MB 67ms 17ms pypy 3.10.16
lua 1.lua 292ms 3.1ms 15.9MB 267ms 10ms luajit 2.1.0-beta3
python 1.py 479ms 4.3ms 11.9MB 453ms 10ms pyston 3.8.12
python 1.py 718ms 7.5ms 12.6MB 703ms 0ms cpython 3.13.2
lua 1.lua 824ms 5.5ms 16.9MB 807ms 0ms lua 5.4.7

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1217ms 27ms 107.0MB 1170ms 30ms pypy 3.10.16
python 1.py 2643ms 6.3ms 25.0MB 2620ms 13ms cpython 3.13.2
python 1.py timeout 0.0ms 17.3MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 224ms 3.9ms 86.3MB 190ms 20ms pypy 3.10.16
python 1.py 228ms 1.1ms 20.2MB 207ms 10ms cpython 3.13.2
python 1.py 685ms 12ms 16.8MB 667ms 7ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 254ms 5.1ms 83.6MB 217ms 20ms pypy 3.10.16
python 1.py 360ms 1.5ms 12.5MB 343ms 3ms cpython 3.13.2
python 1.py 2006ms 5.2ms 9.6MB 1990ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 100ms 1.7ms 63.4MB 73ms 13ms pypy 3.10.16
python 1.py 139ms 55ms 12.0MB 100ms 0ms cpython 3.13.2
python 1.py 350ms 0.8ms 8.8MB 340ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1852ms 1.6ms 88.8MB 1807ms 30ms pypy 3.10.16
python 5-m.py 2282ms 30ms 65.4MB 3493ms 843ms pypy 3.10.16
python 5-m.py 2455ms 13ms 12.5MB 3537ms 1010ms pyston 3.8.12
python 1.py 3017ms 14ms 8.1MB 3007ms 0ms pyston 3.8.12
python 5-m.py 3351ms 11ms 13.5MB 4443ms 913ms cpython 3.13.2
python 1.py 4656ms 26ms 8.8MB 4640ms 0ms cpython 3.13.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 251ms 5.7ms 63.3MB 223ms 13ms pypy 3.10.16
python 5-m.py 311ms 1.4ms 12.4MB 393ms 143ms pyston 3.8.12
python 1.py 318ms 0.3ms 8.1MB 310ms 0ms pyston 3.8.12
python 5-m.py 397ms 5.6ms 13.6MB 480ms 133ms cpython 3.13.2
python 5-m.py 445ms 6.3ms 65.4MB 737ms 310ms pypy 3.10.16
python 1.py 488ms 7.2ms 8.6MB 477ms 0ms cpython 3.13.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.5ms 0.2ms 2.3MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 1.6ms 0.1ms 2.1MB 0ms 0ms lua 5.4.7
python 1.py 11ms 0.5ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.0ms 8.6MB 10ms 0ms cpython 3.13.2
python 1.py 29ms 1.1ms 51.6MB 10ms 10ms pypy 3.10.16

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2132ms 36ms 26.8MB 1117ms 1563ms pyston 3.8.12
python 1.py 2559ms 231ms 27.3MB 1567ms 1620ms cpython 3.13.2
python 1.py 4884ms 99ms 101.8MB 2890ms 1217ms pypy 3.10.16

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1096ms 17ms 21.3MB 240ms 270ms pyston 3.8.12
python 1.py 1100ms 22ms 22.9MB 307ms 290ms cpython 3.13.2
python 1.py 1425ms 69ms 87.3MB 723ms 237ms pypy 3.10.16

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 194ms 6.5ms 38.4MB 163ms 20ms pyston 3.8.12
python 1.py 214ms 1.4ms 38.6MB 187ms 13ms cpython 3.13.2
python 1.py 298ms 2.7ms 89.5MB 260ms 20ms pypy 3.10.16

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1815ms 17ms 220.5MB 1643ms 160ms pyston 3.8.12
python 1.py 1915ms 31ms 222.2MB 1830ms 73ms pypy 3.10.16
python 1.py 1927ms 7.1ms 221.4MB 1830ms 87ms cpython 3.13.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 2435ms 14ms 136.4MB 8277ms 343ms pypy 3.10.16
python 3-m.py 3135ms 60ms 34.3MB 11840ms 123ms pyston 3.8.12
python 3.py timeout 0.0ms 35.6MB 93ms 20ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 389ms 1.1ms 75.7MB 983ms 170ms pypy 3.10.16
python 3-m.py 393ms 4.9ms 14.2MB 1303ms 70ms pyston 3.8.12
python 3-m.py 634ms 4.3ms 15.1MB 2240ms 53ms cpython 3.13.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 144ms 0.5ms 58.3MB 120ms 10ms pypy 3.10.16
python 1.py 179ms 2.6ms 59.4MB 157ms 10ms pypy 3.10.16
python 1.py 719ms 5.8ms 8.9MB 707ms 0ms pyston 3.8.12
python 2.py 833ms 11ms 8.5MB 820ms 0ms pyston 3.8.12
python 1.py 1138ms 4.4ms 9.4MB 1127ms 0ms cpython 3.13.2
python 2.py 1348ms 40ms 9.0MB 1337ms 0ms cpython 3.13.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 338ms 2.7ms 59.3MB 320ms 3ms pypy 3.10.16
python 1.py 380ms 6.1ms 60.3MB 353ms 10ms pypy 3.10.16
python 1.py 2132ms 18ms 8.9MB 2123ms 0ms pyston 3.8.12
python 2.py 2501ms 6.7ms 8.5MB 2490ms 0ms pyston 3.8.12
python 1.py 3370ms 28ms 9.4MB 3357ms 0ms cpython 3.13.2
python 2.py 3950ms 27ms 9.0MB 3937ms 0ms cpython 3.13.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 106ms 5.2ms 57.9MB 83ms 10ms pypy 3.10.16
python 1.py 122ms 1.9ms 58.7MB 100ms 10ms pypy 3.10.16
python 1.py 348ms 6.0ms 8.5MB 333ms 0ms pyston 3.8.12
python 2.py 387ms 2.2ms 8.1MB 373ms 0ms pyston 3.8.12
python 1.py 539ms 4.9ms 9.0MB 523ms 0ms cpython 3.13.2
python 2.py 634ms 5.0ms 8.6MB 623ms 0ms cpython 3.13.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2202ms 10ms 203.1MB 2083ms 107ms pypy 3.10.16
lua 1.lua timeout 0.0ms 107.4MB 4947ms 37ms lua 5.4.7
lua 1.lua timeout 0.0ms 149.4MB 4923ms 63ms luajit 2.1.0-beta3
python 1.py timeout 0.0ms 93.9MB 4950ms 40ms cpython 3.13.2
python 1.py timeout 0.0ms 130.4MB 4940ms 50ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 377ms 5.4ms 105.2MB 323ms 40ms pypy 3.10.16
lua 1.lua 1392ms 85ms 31.1MB 1360ms 13ms luajit 2.1.0-beta3
lua 1.lua 2291ms 16ms 28.6MB 2270ms 10ms lua 5.4.7
python 1.py 3111ms 151ms 37.2MB 3083ms 13ms cpython 3.13.2
python 1.py timeout 0.0ms 48.9MB 4940ms 43ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 713ms 1.8ms 2.3MB 703ms 0ms luajit 2.1.0-beta3
python 2.py 1353ms 7.7ms 60.3MB 1330ms 10ms pypy 3.10.16
python 1.py 2647ms 8.4ms 57.2MB 2623ms 10ms pypy 3.10.16
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7
python 1.py timeout 0.0ms 8.6MB 4990ms 0ms cpython 3.13.2
python 2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 75ms 1.1ms 2.4MB 70ms 0ms luajit 2.1.0-beta3
python 2.py 182ms 1.3ms 58.1MB 160ms 10ms pypy 3.10.16
python 1.py 299ms 2.7ms 57.1MB 280ms 10ms pypy 3.10.16
python 1.py 932ms 16ms 8.3MB 920ms 0ms pyston 3.8.12
lua 4.lua 1112ms 26ms 2.3MB 1103ms 0ms lua 5.4.7
python 2.py 1282ms 11ms 8.3MB 1270ms 0ms pyston 3.8.12
python 1.py 2968ms 4.6ms 8.8MB 2953ms 0ms cpython 3.13.2
python 2.py 3214ms 99ms 8.8MB 3200ms 0ms cpython 3.13.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2527ms 58ms 369.5MB 2457ms 57ms pypy 3.10.16
python 2.py 3022ms 8.2ms 633.0MB 2873ms 137ms pyston 3.8.12
python 1.py 4719ms 120ms 320.4MB 4657ms 50ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4960ms 27ms cpython 3.13.2
python 2.py timeout 0.0ms 633.6MB 4843ms 143ms cpython 3.13.2
python 2.py timeout 0.0ms 959.8MB 4730ms 260ms pypy 3.10.16

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 524ms 3.5ms 135.2MB 490ms 20ms pypy 3.10.16
python 2.py 734ms 1.6ms 164.2MB 697ms 27ms pyston 3.8.12
python 1.py 1045ms 7.6ms 86.0MB 1023ms 10ms pyston 3.8.12
python 2.py 1423ms 16ms 164.8MB 1380ms 30ms cpython 3.13.2
python 2.py 1530ms 19ms 290.2MB 1440ms 77ms pypy 3.10.16
python 1.py 2661ms 20ms 86.8MB 2640ms 10ms cpython 3.13.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1915ms 5.6ms 8.9MB 1873ms 30ms pyston 3.8.12
python 4.py 1945ms 3.8ms 9.4MB 1893ms 40ms cpython 3.13.2
python 4.py 2174ms 1.1ms 89.4MB 2133ms 30ms pypy 3.10.16

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 451ms 0.7ms 8.6MB 440ms 0ms pyston 3.8.12
python 4.py 468ms 3.4ms 9.0MB 457ms 0ms cpython 3.13.2
python 4.py 549ms 3.3ms 83.8MB 513ms 20ms pypy 3.10.16

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2244ms 5.8ms 243.6MB 2190ms 40ms pypy 3.10.16
python 1.py 4741ms 7.8ms 225.5MB 4550ms 173ms pyston 3.8.12
python 1.py timeout 0.0ms 146.4MB 4933ms 57ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 330ms 3.2ms 85.6MB 293ms 20ms pypy 3.10.16
python 1.py 497ms 6.0ms 29.8MB 463ms 17ms pyston 3.8.12
python 1.py 606ms 2.2ms 30.7MB 573ms 20ms cpython 3.13.2

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3178ms 4.3ms 8.3MB 3167ms 0ms pyston 3.8.12
python 1.py 3503ms 25ms 74.3MB 3470ms 20ms pypy 3.10.16
python 1.py 3792ms 25ms 8.6MB 3780ms 0ms cpython 3.13.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 811ms 3.4ms 8.3MB 800ms 0ms pyston 3.8.12
python 1.py 973ms 13ms 8.6MB 963ms 0ms cpython 3.13.2
python 1.py 974ms 6.2ms 67.3MB 940ms 20ms pypy 3.10.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 4068ms 9.8ms 2.5MB 4057ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.4MB 4990ms 0ms lua 5.4.7
python 8.py timeout 0.0ms 14.9MB 40ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 95.4MB 790ms 77ms pypy 3.10.16
python 8.py timeout 0.0ms 14.2MB 37ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1021ms 2.2ms 2.4MB 1010ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7
python 8.py timeout 0.0ms 14.4MB 43ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 96.7MB 1313ms 177ms pypy 3.10.16
python 8.py timeout 0.0ms 13.7MB 53ms 20ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 261ms 2.8ms 2.3MB 250ms 0ms luajit 2.1.0-beta3
python 8-m.py 1974ms 19ms 92.9MB 6383ms 260ms pypy 3.10.16
lua 1.lua timeout 0.0ms 2.0MB 4990ms 0ms lua 5.4.7
python 8.py timeout 0.0ms 14.0MB 90ms 20ms cpython 3.13.2
python 8.py timeout 0.0ms 13.1MB 123ms 37ms pyston 3.8.12