Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1164ms | 8.8ms | 95.7MB | 1100ms | 47ms | pypy 3.10.14 |
wasm | 5.rs | 1753ms | 16ms | 34.7MB | 1733ms | 7ms | wasmtime 25.0.3 |
wasm | 4.rs | 1760ms | 6.6ms | 34.7MB | 1740ms | 7ms | wasmtime 25.0.3 |
wasm | 3.rs | 1775ms | 26ms | 50.6MB | 1743ms | 13ms | wasmtime 25.0.3 |
python | 1.py | timeout | 0.0ms | 40.9MB | 4970ms | 13ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 40.5MB | 4767ms | 213ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 93ms | 0.7ms | 67.9MB | 60ms | 17ms | pypy 3.10.14 |
wasm | 5.rs | 167ms | 1.0ms | 20.7MB | 153ms | 3ms | wasmtime 25.0.3 |
wasm | 3.rs | 171ms | 3.2ms | 22.7MB | 153ms | 7ms | wasmtime 25.0.3 |
wasm | 4.rs | 175ms | 4.5ms | 20.7MB | 160ms | 0ms | wasmtime 25.0.3 |
python | 1.py | 474ms | 4.5ms | 11.9MB | 450ms | 7ms | pyston 3.8.12 |
python | 1.py | 716ms | 13ms | 12.8MB | 707ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 3.rs | 1120ms | 8.2ms | 20.8MB | 1107ms | 3ms | wasmtime 25.0.3 |
python | 1.py | 1187ms | 11ms | 103.5MB | 1140ms | 30ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 21.3MB | 4977ms | 10ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 17.4MB | 4980ms | 3ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 3.rs | 81ms | 1.4ms | 21.2MB | 67ms | 3ms | wasmtime 25.0.3 |
python | 1.py | 221ms | 6.2ms | 84.3MB | 170ms | 33ms | pypy 3.10.14 |
python | 1.py | 582ms | 3.3ms | 20.4MB | 557ms | 7ms | cpython 3.13.0 |
python | 1.py | 645ms | 2.4ms | 16.8MB | 623ms | 3ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 251ms | 2.6ms | 82.9MB | 217ms | 17ms | pypy 3.10.14 |
python | 1.py | 358ms | 6.5ms | 12.6MB | 343ms | 0ms | cpython 3.13.0 |
wasm | 1.rs | 415ms | 5.2ms | 20.1MB | 397ms | 0ms | wasmtime 25.0.3 |
python | 1.py | 1992ms | 1.4ms | 9.6MB | 1977ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 99ms | 3.0ms | 62.9MB | 73ms | 17ms | pypy 3.10.14 |
python | 1.py | 109ms | 4.3ms | 11.9MB | 97ms | 0ms | cpython 3.13.0 |
wasm | 1.rs | 114ms | 2.3ms | 21.4MB | 100ms | 3ms | wasmtime 25.0.3 |
python | 1.py | 345ms | 0.2ms | 8.8MB | 330ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 236ms | 1.9ms | 19.0MB | 220ms | 7ms | wasmtime 25.0.3 |
python | 1.py | 1908ms | 7.1ms | 88.3MB | 1867ms | 23ms | pypy 3.10.14 |
python | 5-m.py | 2493ms | 42ms | 12.5MB | 3617ms | 1003ms | pyston 3.8.12 |
python | 5-m.py | 2816ms | 14ms | 64.9MB | 3960ms | 837ms | pypy 3.10.14 |
python | 1.py | 3005ms | 19ms | 8.1MB | 2993ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 3408ms | 32ms | 13.8MB | 4537ms | 1013ms | cpython 3.13.0 |
python | 1.py | 4612ms | 106ms | 8.8MB | 4597ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 32ms | 1.5ms | 18.8MB | 20ms | 0ms | wasmtime 25.0.3 |
python | 1.py | 253ms | 2.4ms | 63.6MB | 230ms | 10ms | pypy 3.10.14 |
python | 1.py | 314ms | 3.5ms | 8.1MB | 303ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 317ms | 4.6ms | 12.4MB | 413ms | 143ms | pyston 3.8.12 |
python | 5-m.py | 406ms | 4.6ms | 13.9MB | 493ms | 137ms | cpython 3.13.0 |
python | 1.py | 472ms | 7.6ms | 8.8MB | 457ms | 0ms | cpython 3.13.0 |
python | 5-m.py | 544ms | 10ms | 64.9MB | 807ms | 310ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 6.6ms | 0.3ms | 19.0MB | 0ms | 0ms | wasmtime 25.0.3 |
python | 1.py | 11ms | 0.9ms | 7.6MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.1ms | 8.5MB | 0ms | 0ms | cpython 3.13.0 |
python | 1.py | 29ms | 1.0ms | 51.0MB | 10ms | 10ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 90ms | 1.4ms | 20.8MB | 73ms | 7ms | wasmtime 25.0.3 |
python | 2.py | 145ms | 2.6ms | 58.0MB | 117ms | 10ms | pypy 3.10.14 |
python | 1.py | 182ms | 3.8ms | 59.6MB | 143ms | 23ms | pypy 3.10.14 |
python | 1.py | 718ms | 9.3ms | 8.9MB | 707ms | 0ms | pyston 3.8.12 |
python | 2.py | 835ms | 13ms | 8.5MB | 817ms | 0ms | pyston 3.8.12 |
python | 1.py | 1128ms | 15ms | 9.4MB | 1110ms | 0ms | cpython 3.13.0 |
python | 2.py | 1311ms | 25ms | 9.1MB | 1300ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 253ms | 1.2ms | 18.7MB | 243ms | 0ms | wasmtime 25.0.3 |
python | 2.py | 341ms | 8.9ms | 58.9MB | 317ms | 10ms | pypy 3.10.14 |
python | 1.py | 373ms | 0.1ms | 60.4MB | 357ms | 0ms | pypy 3.10.14 |
python | 1.py | 2137ms | 24ms | 8.9MB | 2123ms | 0ms | pyston 3.8.12 |
python | 2.py | 2471ms | 28ms | 8.5MB | 2453ms | 3ms | pyston 3.8.12 |
python | 1.py | 3296ms | 12ms | 9.4MB | 3280ms | 0ms | cpython 3.13.0 |
python | 2.py | 3856ms | 36ms | 9.1MB | 3843ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 45ms | 0.9ms | 18.5MB | 30ms | 0ms | wasmtime 25.0.3 |
python | 2.py | 104ms | 1.1ms | 57.8MB | 77ms | 10ms | pypy 3.10.14 |
python | 1.py | 121ms | 3.3ms | 58.5MB | 93ms | 13ms | pypy 3.10.14 |
python | 1.py | 346ms | 5.2ms | 8.5MB | 333ms | 0ms | pyston 3.8.12 |
python | 2.py | 390ms | 6.1ms | 8.1MB | 377ms | 0ms | pyston 3.8.12 |
python | 1.py | 539ms | 9.9ms | 9.1MB | 523ms | 0ms | cpython 3.13.0 |
python | 2.py | 635ms | 25ms | 8.8MB | 623ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 868ms | 31ms | 42.7MB | 843ms | 17ms | wasmtime 25.0.3 |
python | 1.py | 2242ms | 21ms | 210.2MB | 2127ms | 100ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 93.9MB | 4953ms | 27ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 130.4MB | 4943ms | 40ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 197ms | 4.6ms | 24.6MB | 183ms | 0ms | wasmtime 25.0.3 |
python | 1.py | 386ms | 1.5ms | 103.6MB | 317ms | 50ms | pypy 3.10.14 |
python | 1.py | 2958ms | 51ms | 37.1MB | 2937ms | 7ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 48.9MB | 4943ms | 40ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 406ms | 1.1ms | 18.6MB | 390ms | 0ms | wasmtime 25.0.3 |
wasm | 2.rs | 578ms | 1.2ms | 18.6MB | 560ms | 0ms | wasmtime 25.0.3 |
python | 2.py | 1351ms | 7.9ms | 59.8MB | 1323ms | 17ms | pypy 3.10.14 |
python | 1.py | 2634ms | 23ms | 56.6MB | 2610ms | 10ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 8.8MB | 4987ms | 3ms | cpython 3.13.0 |
python | 2.py | timeout | 0.0ms | 8.8MB | 4990ms | 0ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4987ms | 3ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.1MB | 4987ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 1.rs | 49ms | 0.5ms | 18.6MB | 33ms | 0ms | wasmtime 25.0.3 |
wasm | 2.rs | 66ms | 1.1ms | 18.6MB | 50ms | 0ms | wasmtime 25.0.3 |
python | 2.py | 176ms | 1.4ms | 57.6MB | 147ms | 13ms | pypy 3.10.14 |
python | 1.py | 301ms | 4.2ms | 56.6MB | 273ms | 10ms | pypy 3.10.14 |
python | 1.py | 926ms | 8.6ms | 8.3MB | 910ms | 0ms | pyston 3.8.12 |
python | 2.py | 1297ms | 12ms | 8.1MB | 1280ms | 0ms | pyston 3.8.12 |
python | 1.py | 3025ms | 45ms | 8.8MB | 3007ms | 3ms | cpython 3.13.0 |
python | 2.py | 3179ms | 124ms | 8.8MB | 3167ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 2.rs | 370ms | 5.1ms | 25.5MB | 360ms | 0ms | wasmtime 25.0.3 |
wasm | 1.rs | 468ms | 2.9ms | 57.8MB | 450ms | 3ms | wasmtime 25.0.3 |
python | 1.py | 2508ms | 22ms | 369.0MB | 2427ms | 63ms | pypy 3.10.14 |
python | 2.py | 2995ms | 49ms | 632.9MB | 2827ms | 153ms | pyston 3.8.12 |
python | 1.py | 4841ms | 38ms | 320.4MB | 4780ms | 47ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 321.3MB | 4953ms | 27ms | cpython 3.13.0 |
python | 2.py | timeout | 0.0ms | 633.6MB | 4820ms | 160ms | cpython 3.13.0 |
python | 2.py | timeout | 0.0ms | 959.3MB | 4683ms | 300ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 2.rs | 95ms | 2.5ms | 20.0MB | 90ms | 0ms | wasmtime 25.0.3 |
wasm | 1.rs | 95ms | 0.6ms | 28.6MB | 80ms | 3ms | wasmtime 25.0.3 |
python | 1.py | 539ms | 11ms | 134.6MB | 497ms | 27ms | pypy 3.10.14 |
python | 2.py | 720ms | 4.3ms | 164.2MB | 673ms | 30ms | pyston 3.8.12 |
python | 1.py | 1102ms | 6.4ms | 86.0MB | 1077ms | 10ms | pyston 3.8.12 |
python | 2.py | 1394ms | 3.2ms | 164.9MB | 1350ms | 27ms | cpython 3.13.0 |
python | 2.py | 1533ms | 15ms | 289.7MB | 1447ms | 70ms | pypy 3.10.14 |
python | 1.py | 2681ms | 12ms | 86.9MB | 2650ms | 10ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 1902ms | 3.9ms | 9.0MB | 1867ms | 20ms | pyston 3.8.12 |
python | 4.py | 1960ms | 11ms | 9.4MB | 1907ms | 37ms | cpython 3.13.0 |
python | 4.py | 2130ms | 10ms | 89.1MB | 2090ms | 23ms | pypy 3.10.14 |
wasm | 2.rs | 2192ms | 2.4ms | 19.6MB | 2180ms | 3ms | wasmtime 25.0.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 451ms | 6.4ms | 8.6MB | 440ms | 0ms | pyston 3.8.12 |
python | 4.py | 464ms | 1.8ms | 9.1MB | 450ms | 0ms | cpython 3.13.0 |
wasm | 2.rs | 517ms | 0.6ms | 18.9MB | 500ms | 0ms | wasmtime 25.0.3 |
python | 4.py | 546ms | 9.4ms | 83.5MB | 503ms | 30ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 3156ms | 16ms | 8.3MB | 3137ms | 0ms | pyston 3.8.12 |
wasm | 1.rs | 3457ms | 32ms | 18.4MB | 3437ms | 7ms | wasmtime 25.0.3 |
python | 1.py | 3719ms | 8.3ms | 74.6MB | 3673ms | 30ms | pypy 3.10.14 |
python | 1.py | 3812ms | 7.4ms | 8.8MB | 3797ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 803ms | 8.8ms | 8.4MB | 790ms | 0ms | pyston 3.8.12 |
wasm | 1.rs | 869ms | 8.0ms | 18.4MB | 850ms | 0ms | wasmtime 25.0.3 |
python | 1.py | 968ms | 11ms | 8.8MB | 953ms | 0ms | cpython 3.13.0 |
python | 1.py | 1035ms | 6.9ms | 67.5MB | 1010ms | 7ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 2.rs | 3591ms | 4.7ms | 18.4MB | 3577ms | 0ms | wasmtime 25.0.3 |
wasm | 7.rs | 4884ms | 13ms | 20.4MB | 4870ms | 0ms | wasmtime 25.0.3 |
python | 8.py | timeout | 0.0ms | 16.8MB | 43ms | 10ms | cpython 3.13.0 |
python | 8.py | timeout | 0.0ms | 100.4MB | 843ms | 157ms | pypy 3.10.14 |
python | 8.py | timeout | 0.0ms | 18.3MB | 67ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 2.rs | 906ms | 3.5ms | 20.3MB | 887ms | 0ms | wasmtime 25.0.3 |
wasm | 7.rs | 1230ms | 3.1ms | 18.4MB | 1217ms | 0ms | wasmtime 25.0.3 |
python | 8.py | timeout | 0.0ms | 16.4MB | 110ms | 20ms | cpython 3.13.0 |
python | 8.py | timeout | 0.0ms | 97.6MB | 1480ms | 487ms | pypy 3.10.14 |
python | 8.py | timeout | 0.0ms | 17.5MB | 137ms | 43ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
wasm | 2.rs | 233ms | 1.4ms | 20.3MB | 220ms | 0ms | wasmtime 25.0.3 |
wasm | 7.rs | 314ms | 1.8ms | 18.3MB | 300ms | 3ms | wasmtime 25.0.3 |
python | 8-m.py | 1978ms | 11ms | 94.6MB | 6323ms | 333ms | pypy 3.10.14 |
python | 8.py | timeout | 0.0ms | 14.1MB | 243ms | 43ms | cpython 3.13.0 |
python | 8.py | timeout | 0.0ms | 17.2MB | 390ms | 117ms | pyston 3.8.12 |