Programming Language and compiler
Benchmarks

Wasm VS Python benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1568ms 90ms 79.1MB 1510ms 40ms pypy 3.10.13
wasm 3.rs 1832ms 18ms 82.0MB 1817ms 23ms node 18.19.0
wasm 5.rs 1873ms 10ms 65.7MB 1860ms 20ms node 18.19.0
wasm 4.rs 1910ms 6.6ms 34.9MB 1893ms 3ms wasmtime 17.0.0
wasm 3.rs 1959ms 30ms 50.9MB 1923ms 20ms wasmtime 17.0.0
wasm 5.rs 2022ms 10ms 34.9MB 1997ms 3ms wasmtime 17.0.0
wasm 4.rs 2156ms 42ms 66.8MB 2137ms 20ms node 18.19.0
python 1.py timeout 0.0ms 41.3MB 4977ms 10ms cpython 3.12.1
python 1.py timeout 0.0ms 40.5MB 4763ms 223ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 116ms 0.7ms 62.6MB 80ms 20ms pypy 3.10.13
wasm 4.rs 184ms 4.7ms 20.9MB 167ms 0ms wasmtime 17.0.0
wasm 3.rs 186ms 4.3ms 22.9MB 167ms 0ms wasmtime 17.0.0
wasm 5.rs 194ms 1.5ms 20.9MB 180ms 0ms wasmtime 17.0.0
wasm 3.rs 208ms 1.9ms 53.2MB 190ms 23ms node 18.19.0
wasm 5.rs 215ms 1.7ms 53.0MB 210ms 7ms node 18.19.0
wasm 4.rs 252ms 15ms 53.0MB 240ms 13ms node 18.19.0
python 1.py 478ms 4.3ms 11.9MB 450ms 13ms pyston 3.8.12
python 1.py 732ms 6.5ms 13.1MB 713ms 0ms cpython 3.12.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 301ms 0.9ms 20.4MB 277ms 7ms cpython 3.12.1
wasm 3.rs 1207ms 4.1ms 55.8MB 1250ms 20ms node 18.19.0
wasm 3.rs 1234ms 9.3ms 21.1MB 1217ms 3ms wasmtime 17.0.0
python 1.py 3056ms 23ms 116.4MB 2993ms 47ms pypy 3.10.13
python 1.py timeout 0.0ms 17.3MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 89ms 3.1ms 19.7MB 77ms 0ms wasmtime 17.0.0
wasm 3.rs 129ms 0.6ms 57.2MB 157ms 23ms node 18.19.0
python 1.py 292ms 2.9ms 82.9MB 243ms 30ms pypy 3.10.13
python 1.py 303ms 0.9ms 20.4MB 280ms 7ms cpython 3.12.1
python 1.py 653ms 8.2ms 16.8MB 637ms 0ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 257ms 4.7ms 63.0MB 223ms 17ms pypy 3.10.13
python 1.py 355ms 7.3ms 13.0MB 333ms 7ms cpython 3.12.1
wasm 1.rs 469ms 42ms 20.3MB 453ms 0ms wasmtime 17.0.0
wasm 1.rs 481ms 2.2ms 58.4MB 543ms 17ms node 18.19.0
python 1.py 1998ms 10ms 9.6MB 1980ms 3ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 105ms 3.0ms 61.5MB 77ms 17ms pypy 3.10.13
wasm 1.rs 120ms 0.3ms 19.6MB 103ms 0ms wasmtime 17.0.0
python 1.py 132ms 49ms 12.0MB 93ms 0ms cpython 3.12.1
wasm 1.rs 176ms 0.9ms 58.2MB 223ms 23ms node 18.19.0
python 1.py 347ms 2.1ms 8.8MB 330ms 0ms pyston 3.8.12

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 4176ms 317ms 18.5MB 4160ms 0ms wasmtime 17.0.0
wasm 1.rs timeout 0.0ms 50.5MB 4983ms 7ms node 18.19.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 341ms 5.0ms 18.5MB 330ms 0ms wasmtime 17.0.0
wasm 1.rs 654ms 3.7ms 50.4MB 640ms 10ms node 18.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 295ms 2.8ms 18.8MB 280ms 0ms wasmtime 17.0.0
wasm 1.rs 317ms 2.4ms 50.0MB 310ms 7ms node 18.19.0
python 1.py 1945ms 8.0ms 62.7MB 1917ms 10ms pypy 3.10.13
python 5-m.py 2465ms 14ms 12.4MB 3553ms 1027ms pyston 3.8.12
python 5-m.py 2926ms 14ms 63.1MB 4217ms 773ms pypy 3.10.13
python 1.py 3002ms 24ms 8.1MB 2987ms 0ms pyston 3.8.12
python 5-m.py 3316ms 15ms 14.3MB 4393ms 993ms cpython 3.12.1
python 1.py 4481ms 71ms 9.3MB 4473ms 0ms cpython 3.12.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 38ms 0.5ms 18.9MB 23ms 0ms wasmtime 17.0.0
wasm 1.rs 67ms 0.8ms 50.5MB 63ms 7ms node 18.19.0
python 1.py 267ms 4.6ms 61.3MB 240ms 7ms pypy 3.10.13
python 5-m.py 314ms 12ms 12.5MB 407ms 147ms pyston 3.8.12
python 1.py 316ms 1.5ms 8.1MB 303ms 3ms pyston 3.8.12
python 5-m.py 401ms 1.6ms 14.3MB 463ms 167ms cpython 3.12.1
python 1.py 469ms 14ms 9.3MB 457ms 0ms cpython 3.12.1
python 5-m.py 657ms 11ms 63.1MB 880ms 367ms pypy 3.10.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 6.8ms 0.2ms 19.0MB 0ms 0ms wasmtime 17.0.0
python 1.py 12ms 0.9ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 9.0MB 0ms 0ms cpython 3.12.1
python 1.py 30ms 1.2ms 48.6MB 8ms 8ms pypy 3.10.13
wasm 1.rs 37ms 0.7ms 48.6MB 24ms 4ms node 18.19.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 118ms 1.0ms 19.0MB 107ms 0ms wasmtime 17.0.0
python 2.py 154ms 4.7ms 56.8MB 123ms 17ms pypy 3.10.13
python 1.py 189ms 6.3ms 59.5MB 160ms 13ms pypy 3.10.13
wasm 1.rs 205ms 1.5ms 53.4MB 207ms 10ms node 18.19.0
python 1.py 729ms 10ms 8.9MB 713ms 0ms pyston 3.8.12
python 2.py 851ms 3.5ms 8.5MB 840ms 0ms pyston 3.8.12
python 1.py 1105ms 12ms 9.9MB 1093ms 0ms cpython 3.12.1
python 2.py 1288ms 22ms 9.5MB 1277ms 0ms cpython 3.12.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 340ms 7.6ms 19.0MB 327ms 0ms wasmtime 17.0.0
python 2.py 349ms 3.5ms 59.9MB 327ms 10ms pypy 3.10.13
python 1.py 395ms 5.9ms 60.9MB 367ms 17ms pypy 3.10.13
wasm 1.rs 534ms 4.6ms 53.3MB 530ms 17ms node 18.19.0
python 1.py 2192ms 83ms 8.9MB 2180ms 0ms pyston 3.8.12
python 2.py 2556ms 13ms 8.5MB 2547ms 0ms pyston 3.8.12
python 1.py 3250ms 26ms 9.9MB 3233ms 0ms cpython 3.12.1
python 2.py 3744ms 9.6ms 9.5MB 3733ms 0ms cpython 3.12.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 62ms 0.6ms 18.8MB 50ms 0ms wasmtime 17.0.0
python 2.py 113ms 4.7ms 56.5MB 87ms 10ms pypy 3.10.13
wasm 1.rs 120ms 1.4ms 52.2MB 110ms 17ms node 18.19.0
python 1.py 122ms 0.4ms 57.5MB 93ms 10ms pypy 3.10.13
python 1.py 349ms 6.2ms 8.5MB 337ms 0ms pyston 3.8.12
python 2.py 391ms 3.9ms 8.1MB 380ms 0ms pyston 3.8.12
python 1.py 528ms 10ms 9.5MB 517ms 0ms cpython 3.12.1
python 2.py 616ms 7.8ms 9.3MB 603ms 0ms cpython 3.12.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 864ms 2.7ms 21.8MB 850ms 0ms wasmtime 17.0.0
wasm 8.rs 1081ms 21ms 54.1MB 1067ms 13ms node 18.19.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 44ms 0.3ms 18.9MB 37ms 3ms wasmtime 17.0.0
wasm 8.rs 85ms 3.1ms 51.0MB 80ms 3ms node 18.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 994ms 15ms 42.9MB 967ms 13ms wasmtime 17.0.0
wasm 1.rs 1049ms 26ms 74.0MB 1027ms 20ms node 18.19.0
python 1.py 2604ms 19ms 201.5MB 2490ms 97ms pypy 3.10.13
python 1.py timeout 0.0ms 81.6MB 4970ms 20ms cpython 3.12.1
python 1.py timeout 0.0ms 130.4MB 4943ms 40ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 222ms 0.8ms 24.9MB 210ms 0ms wasmtime 17.0.0
wasm 1.rs 258ms 2.2ms 55.9MB 243ms 17ms node 18.19.0
python 1.py 487ms 3.0ms 94.2MB 440ms 30ms pypy 3.10.13
python 1.py timeout 0.0ms 34.1MB 4977ms 7ms cpython 3.12.1
python 1.py timeout 0.0ms 41.4MB 4970ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 448ms 1.3ms 18.8MB 430ms 0ms wasmtime 17.0.0
wasm 2.rs 569ms 0.7ms 18.8MB 557ms 0ms wasmtime 17.0.0
wasm 1.rs 787ms 145ms 50.0MB 773ms 7ms node 18.19.0
wasm 2.rs 871ms 3.1ms 51.1MB 860ms 7ms node 18.19.0
python 2.py 1386ms 17ms 60.4MB 1357ms 17ms pypy 3.10.13
python 1.py 2647ms 17ms 54.1MB 2617ms 10ms pypy 3.10.13
python 1.py timeout 0.0ms 9.1MB 4987ms 0ms cpython 3.12.1
python 2.py timeout 0.0ms 9.3MB 4990ms 0ms cpython 3.12.1
python 1.py timeout 0.0ms 8.3MB 4980ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 54ms 1.0ms 18.8MB 40ms 3ms wasmtime 17.0.0
wasm 2.rs 66ms 0.7ms 18.8MB 53ms 0ms wasmtime 17.0.0
wasm 1.rs 104ms 2.6ms 50.1MB 93ms 10ms node 18.19.0
wasm 2.rs 122ms 0.7ms 50.8MB 110ms 7ms node 18.19.0
python 2.py 179ms 0.4ms 55.8MB 153ms 10ms pypy 3.10.13
python 1.py 305ms 5.4ms 54.0MB 283ms 10ms pypy 3.10.13
python 1.py 942ms 43ms 8.3MB 930ms 0ms pyston 3.8.12
python 2.py 1314ms 31ms 8.1MB 1300ms 0ms pyston 3.8.12
python 1.py 2986ms 131ms 9.1MB 2973ms 0ms cpython 3.12.1
python 2.py 3077ms 2.2ms 9.1MB 3063ms 0ms cpython 3.12.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 346ms 3.4ms 23.8MB 337ms 0ms wasmtime 17.0.0
wasm 1.rs 515ms 31ms 57.9MB 500ms 3ms wasmtime 17.0.0
wasm 2.rs 589ms 5.8ms 54.8MB 580ms 3ms node 18.19.0
wasm 1.rs 812ms 6.1ms 89.4MB 797ms 17ms node 18.19.0
python 2.py 3061ms 79ms 632.9MB 2887ms 157ms pyston 3.8.12
python 1.py 3479ms 37ms 366.2MB 3410ms 50ms pypy 3.10.13
python 1.py 4862ms 92ms 320.5MB 4807ms 47ms pyston 3.8.12
python 2.py 4871ms 47ms 634.1MB 4697ms 160ms cpython 3.12.1
python 1.py timeout 0.0ms 321.7MB 4963ms 23ms cpython 3.12.1
python 2.py timeout 0.0ms 956.8MB 4737ms 247ms pypy 3.10.13

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 90ms 1.5ms 20.0MB 70ms 0ms wasmtime 17.0.0
wasm 1.rs 107ms 11ms 28.7MB 90ms 3ms wasmtime 17.0.0
wasm 2.rs 173ms 1.8ms 51.1MB 167ms 0ms node 18.19.0
wasm 1.rs 184ms 0.9ms 59.9MB 160ms 17ms node 18.19.0
python 1.py 698ms 9.1ms 131.7MB 667ms 17ms pypy 3.10.13
python 2.py 735ms 2.3ms 164.3MB 690ms 23ms pyston 3.8.12
python 1.py 1113ms 6.9ms 86.0MB 1087ms 7ms pyston 3.8.12
python 2.py 1213ms 1.8ms 165.4MB 1170ms 30ms cpython 3.12.1
python 1.py 2241ms 84ms 87.3MB 2217ms 10ms cpython 3.12.1
python 2.py 2612ms 31ms 283.0MB 2523ms 77ms pypy 3.10.13

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1897ms 5.0ms 8.9MB 1850ms 30ms pyston 3.8.12
python 4.py 1959ms 2.6ms 9.9MB 1910ms 33ms cpython 3.12.1
wasm 2.rs 2223ms 3.0ms 19.8MB 2210ms 0ms wasmtime 17.0.0
wasm 2.rs 2256ms 1.9ms 56.4MB 2277ms 30ms node 18.19.0
python 4.py 2334ms 11ms 63.4MB 2280ms 37ms pypy 3.10.13

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 450ms 3.6ms 8.8MB 433ms 0ms pyston 3.8.12
python 4.py 466ms 5.6ms 9.6MB 450ms 0ms cpython 3.12.1
wasm 2.rs 526ms 0.4ms 18.9MB 507ms 0ms wasmtime 17.0.0
wasm 2.rs 567ms 0.1ms 56.3MB 590ms 23ms node 18.19.0
python 4.py 569ms 8.0ms 61.9MB 537ms 13ms pypy 3.10.13

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3144ms 7.0ms 8.3MB 3127ms 0ms pyston 3.8.12
wasm 1.rs 3531ms 59ms 58.4MB 3590ms 20ms node 18.19.0
python 1.py 3598ms 18ms 9.1MB 3590ms 0ms cpython 3.12.1
wasm 1.rs 3639ms 5.5ms 18.5MB 3623ms 0ms wasmtime 17.0.0
python 1.py 3760ms 22ms 62.8MB 3723ms 20ms pypy 3.10.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 801ms 9.6ms 8.3MB 790ms 0ms pyston 3.8.12
python 1.py 914ms 2.1ms 9.1MB 900ms 0ms cpython 3.12.1
wasm 1.rs 923ms 5.6ms 19.0MB 907ms 0ms wasmtime 17.0.0
wasm 1.rs 927ms 13ms 58.4MB 977ms 30ms node 18.19.0
python 1.py 1044ms 16ms 61.5MB 1020ms 10ms pypy 3.10.13

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 7.rs 3705ms 9.4ms 49.9MB 3690ms 7ms node 18.19.0
wasm 2.rs 3742ms 13ms 18.3MB 3727ms 0ms wasmtime 17.0.0
wasm 2.rs 3746ms 4.9ms 49.7MB 3730ms 7ms node 18.19.0
wasm 7.rs 4973ms 5.7ms 18.3MB 4957ms 3ms wasmtime 17.0.0
python 8.py timeout 0.0ms 17.2MB 57ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 76.8MB 967ms 133ms pypy 3.10.13
python 8.py timeout 0.0ms 18.1MB 63ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 942ms 1.0ms 18.3MB 930ms 0ms wasmtime 17.0.0
wasm 7.rs 954ms 2.8ms 49.9MB 937ms 10ms node 18.19.0
wasm 2.rs 963ms 1.3ms 49.4MB 953ms 3ms node 18.19.0
wasm 7.rs 1251ms 3.1ms 18.2MB 1237ms 0ms wasmtime 17.0.0
python 8.py timeout 0.0ms 16.8MB 100ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 75.9MB 1767ms 440ms pypy 3.10.13
python 8.py timeout 0.0ms 17.8MB 150ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 245ms 0.7ms 18.7MB 230ms 0ms wasmtime 17.0.0
wasm 7.rs 268ms 1.8ms 49.7MB 253ms 10ms node 18.19.0
wasm 2.rs 271ms 2.4ms 49.3MB 263ms 3ms node 18.19.0
wasm 7.rs 320ms 1.0ms 18.2MB 303ms 0ms wasmtime 17.0.0
python 8-m.py 2161ms 17ms 76.3MB 6830ms 320ms pypy 3.10.13
python 8.py timeout 0.0ms 14.6MB 293ms 40ms cpython 3.12.1
python 8.py timeout 0.0ms 17.2MB 430ms 120ms pyston 3.8.12