Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1149ms | 16ms | 95.7MB | 1087ms | 47ms | pypy 3.10.14 |
crystal | 1.cr | 1390ms | 8.4ms | 64.3MB | 1363ms | 7ms | crystal 1.14.0 |
python | 1.py | timeout | 0.0ms | 40.8MB | 4970ms | 17ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 40.6MB | 4743ms | 240ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 94ms | 1.9ms | 68.0MB | 63ms | 20ms | pypy 3.10.14 |
crystal | 1.cr | 108ms | 0.6ms | 11.1MB | 97ms | 0ms | crystal 1.14.0 |
python | 1.py | 491ms | 25ms | 11.9MB | 463ms | 7ms | pyston 3.8.12 |
python | 1.py | 710ms | 4.2ms | 12.8MB | 697ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1178ms | 15ms | 102.5MB | 1133ms | 30ms | pypy 3.10.14 |
crystal | 1.cr | 1318ms | 45ms | 20.1MB | 1233ms | 67ms | crystal 1.14.0 |
python | 1.py | timeout | 0.0ms | 21.1MB | 4977ms | 7ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 17.1MB | 4977ms | 7ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 77ms | 1.0ms | 7.5MB | 50ms | 13ms | crystal 1.14.0 |
python | 1.py | 219ms | 6.3ms | 84.3MB | 183ms | 20ms | pypy 3.10.14 |
python | 1.py | 572ms | 3.4ms | 20.4MB | 543ms | 10ms | cpython 3.13.0 |
python | 1.py | 685ms | 13ms | 16.8MB | 663ms | 7ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 60ms | 2.2ms | 6.6MB | 40ms | 10ms | crystal 1.14.0 |
python | 1.py | 250ms | 4.1ms | 82.8MB | 203ms | 30ms | pypy 3.10.14 |
python | 1.py | 356ms | 1.6ms | 12.6MB | 337ms | 3ms | cpython 3.13.0 |
python | 1.py | 1997ms | 6.3ms | 9.6MB | 1983ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 23ms | 1.1ms | 5.4MB | 10ms | 0ms | crystal 1.14.0 |
python | 1.py | 101ms | 1.8ms | 62.9MB | 70ms | 17ms | pypy 3.10.14 |
python | 1.py | 112ms | 8.0ms | 11.9MB | 97ms | 0ms | cpython 3.13.0 |
python | 1.py | 346ms | 1.7ms | 8.8MB | 330ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 2.cr | 538ms | 2.4ms | 3.4MB | 420ms | 100ms | crystal 1.14.0 |
crystal | 1.cr | 728ms | 1.8ms | 14.6MB | 590ms | 120ms | crystal 1.14.0 |
python | 1.py | 1909ms | 10.0ms | 88.3MB | 1867ms | 23ms | pypy 3.10.14 |
python | 5-m.py | 2472ms | 27ms | 12.5MB | 3610ms | 997ms | pyston 3.8.12 |
python | 5-m.py | 2826ms | 10ms | 64.9MB | 4047ms | 780ms | pypy 3.10.14 |
python | 1.py | 3033ms | 47ms | 8.1MB | 3017ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 3411ms | 65ms | 13.9MB | 4617ms | 930ms | cpython 3.13.0 |
python | 1.py | 4670ms | 96ms | 8.8MB | 4650ms | 3ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 2.cr | 59ms | 0.9ms | 3.4MB | 40ms | 7ms | crystal 1.14.0 |
crystal | 1.cr | 76ms | 0.1ms | 4.5MB | 50ms | 10ms | crystal 1.14.0 |
python | 1.py | 250ms | 0.3ms | 63.8MB | 223ms | 10ms | pypy 3.10.14 |
python | 5-m.py | 312ms | 1.4ms | 12.5MB | 420ms | 123ms | pyston 3.8.12 |
python | 1.py | 312ms | 2.4ms | 8.1MB | 297ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 408ms | 10ms | 13.9MB | 520ms | 120ms | cpython 3.13.0 |
python | 1.py | 478ms | 11ms | 8.8MB | 463ms | 0ms | cpython 3.13.0 |
python | 5-m.py | 555ms | 5.0ms | 65.0MB | 817ms | 313ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 2.1ms | 0.2ms | 3.0MB | 0ms | 0ms | crystal 1.14.0 |
python | 1.py | 12ms | 1.2ms | 7.6MB | 5ms | 5ms | pyston 3.8.12 |
python | 1.py | 15ms | 0.3ms | 8.5MB | 10ms | 0ms | cpython 3.13.0 |
python | 1.py | 29ms | 1.5ms | 51.0MB | 4ms | 12ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 1947ms | 461ms | 187.1MB | 310ms | 500ms | crystal 1.14.0 |
python | 1.py | 2123ms | 18ms | 36.4MB | 1133ms | 1507ms | pyston 3.8.12 |
python | 1.py | 2379ms | 301ms | 33.3MB | 1593ms | 1627ms | cpython 3.13.0 |
python | 1.py | 4814ms | 17ms | 107.0MB | 2870ms | 1220ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1101ms | 27ms | 28.8MB | 217ms | 287ms | pyston 3.8.12 |
crystal | 1.cr | 1158ms | 90ms | 66.3MB | 30ms | 90ms | crystal 1.14.0 |
python | 1.py | 1170ms | 92ms | 28.7MB | 317ms | 273ms | cpython 3.13.0 |
python | 1.py | 1611ms | 66ms | 89.5MB | 723ms | 200ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 0-unsafe.cr | 36ms | 1.4ms | 3.1MB | 20ms | 0ms | crystal 1.14.0 |
crystal | 1.cr | 63ms | 1.1ms | 3.1MB | 50ms | 0ms | crystal 1.14.0 |
python | 2.py | 146ms | 5.0ms | 57.9MB | 120ms | 7ms | pypy 3.10.14 |
python | 1.py | 176ms | 0.5ms | 59.5MB | 150ms | 10ms | pypy 3.10.14 |
python | 1.py | 713ms | 3.1ms | 8.9MB | 703ms | 0ms | pyston 3.8.12 |
python | 2.py | 841ms | 12ms | 8.5MB | 830ms | 0ms | pyston 3.8.12 |
python | 1.py | 1118ms | 25ms | 9.4MB | 1110ms | 0ms | cpython 3.13.0 |
python | 2.py | 1290ms | 15ms | 9.1MB | 1273ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 0-unsafe.cr | 99ms | 0.6ms | 3.1MB | 90ms | 0ms | crystal 1.14.0 |
crystal | 1.cr | 187ms | 1.0ms | 3.3MB | 180ms | 0ms | crystal 1.14.0 |
python | 2.py | 339ms | 1.0ms | 58.9MB | 313ms | 13ms | pypy 3.10.14 |
python | 1.py | 372ms | 2.9ms | 60.4MB | 347ms | 10ms | pypy 3.10.14 |
python | 1.py | 2130ms | 31ms | 8.9MB | 2117ms | 3ms | pyston 3.8.12 |
python | 2.py | 2504ms | 61ms | 8.5MB | 2490ms | 0ms | pyston 3.8.12 |
python | 1.py | 3298ms | 41ms | 9.4MB | 3283ms | 0ms | cpython 3.13.0 |
python | 2.py | 3869ms | 4.9ms | 9.1MB | 3853ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 0-unsafe.cr | 19ms | 1.0ms | 3.0MB | 10ms | 0ms | crystal 1.14.0 |
crystal | 1.cr | 30ms | 0.7ms | 3.0MB | 20ms | 0ms | crystal 1.14.0 |
python | 2.py | 103ms | 0.8ms | 57.8MB | 77ms | 13ms | pypy 3.10.14 |
python | 1.py | 120ms | 2.9ms | 58.5MB | 97ms | 7ms | pypy 3.10.14 |
python | 1.py | 349ms | 5.9ms | 8.5MB | 333ms | 0ms | pyston 3.8.12 |
python | 2.py | 384ms | 5.3ms | 8.1MB | 367ms | 3ms | pyston 3.8.12 |
python | 1.py | 536ms | 14ms | 9.3MB | 520ms | 0ms | cpython 3.13.0 |
python | 2.py | 617ms | 1.4ms | 8.8MB | 607ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 833ms | 8.7ms | 81.7MB | 817ms | 3ms | crystal 1.14.0 |
python | 1.py | 2247ms | 43ms | 210.1MB | 2133ms | 97ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 93.9MB | 4953ms | 30ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 130.3MB | 4930ms | 50ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 162ms | 1.4ms | 22.3MB | 147ms | 0ms | crystal 1.14.0 |
python | 1.py | 378ms | 2.6ms | 103.6MB | 327ms | 33ms | pypy 3.10.14 |
python | 1.py | 3059ms | 119ms | 37.1MB | 3030ms | 17ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 48.9MB | 4953ms | 33ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 2.cr | 343ms | 1.1ms | 3.4MB | 330ms | 0ms | crystal 1.14.0 |
crystal | 1.cr | 344ms | 2.1ms | 3.4MB | 330ms | 0ms | crystal 1.14.0 |
python | 2.py | 1352ms | 14ms | 59.8MB | 1320ms | 17ms | pypy 3.10.14 |
python | 1.py | 2641ms | 30ms | 56.6MB | 2610ms | 13ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 8.8MB | 4987ms | 0ms | cpython 3.13.0 |
python | 2.py | timeout | 0.0ms | 8.8MB | 4983ms | 0ms | cpython 3.13.0 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4990ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.1MB | 4990ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 38ms | 0.8ms | 3.4MB | 30ms | 0ms | crystal 1.14.0 |
crystal | 2.cr | 38ms | 1.0ms | 3.4MB | 27ms | 0ms | crystal 1.14.0 |
python | 2.py | 180ms | 2.7ms | 57.6MB | 153ms | 10ms | pypy 3.10.14 |
python | 1.py | 304ms | 5.3ms | 56.8MB | 277ms | 10ms | pypy 3.10.14 |
python | 1.py | 1078ms | 255ms | 8.3MB | 1063ms | 0ms | pyston 3.8.12 |
python | 2.py | 1319ms | 15ms | 8.1MB | 1303ms | 0ms | pyston 3.8.12 |
python | 1.py | 2912ms | 17ms | 8.8MB | 2900ms | 0ms | cpython 3.13.0 |
python | 2.py | 3132ms | 41ms | 8.8MB | 3123ms | 0ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 2.cr | 349ms | 3.6ms | 8.3MB | 340ms | 0ms | crystal 1.14.0 |
crystal | 1.cr | 386ms | 1.2ms | 43.1MB | 373ms | 0ms | crystal 1.14.0 |
python | 1.py | 2489ms | 28ms | 369.0MB | 2417ms | 57ms | pypy 3.10.14 |
python | 2.py | 2905ms | 8.7ms | 632.9MB | 2723ms | 167ms | pyston 3.8.12 |
python | 1.py | 4843ms | 56ms | 320.4MB | 4783ms | 43ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 321.2MB | 4963ms | 23ms | cpython 3.13.0 |
python | 2.py | timeout | 0.0ms | 633.6MB | 4813ms | 170ms | cpython 3.13.0 |
python | 2.py | timeout | 0.0ms | 959.3MB | 4733ms | 250ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 82ms | 1.2ms | 13.3MB | 70ms | 0ms | crystal 1.14.0 |
crystal | 2.cr | 91ms | 2.2ms | 4.6MB | 80ms | 0ms | crystal 1.14.0 |
python | 1.py | 540ms | 2.4ms | 134.6MB | 500ms | 27ms | pypy 3.10.14 |
python | 2.py | 709ms | 4.9ms | 164.2MB | 657ms | 33ms | pyston 3.8.12 |
python | 1.py | 1118ms | 29ms | 86.0MB | 1090ms | 10ms | pyston 3.8.12 |
python | 2.py | 1383ms | 21ms | 164.9MB | 1333ms | 30ms | cpython 3.13.0 |
python | 2.py | 1531ms | 11ms | 289.6MB | 1443ms | 73ms | pypy 3.10.14 |
python | 1.py | 2652ms | 13ms | 86.9MB | 2623ms | 10ms | cpython 3.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 1907ms | 12ms | 8.9MB | 1853ms | 37ms | pyston 3.8.12 |
python | 4.py | 1961ms | 9.8ms | 9.5MB | 1897ms | 47ms | cpython 3.13.0 |
crystal | 1.cr | 2001ms | 73ms | 6.4MB | 1963ms | 20ms | crystal 1.14.0 |
python | 4.py | 2141ms | 12ms | 89.1MB | 2093ms | 33ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 450ms | 3.5ms | 8.6MB | 437ms | 0ms | pyston 3.8.12 |
crystal | 1.cr | 454ms | 18ms | 5.2MB | 440ms | 0ms | crystal 1.14.0 |
python | 4.py | 484ms | 30ms | 9.1MB | 470ms | 0ms | cpython 3.13.0 |
python | 4.py | 545ms | 13ms | 83.5MB | 503ms | 27ms | pypy 3.10.14 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 3904ms | 21ms | 4.6MB | 3893ms | 0ms | crystal 1.14.0 |
python | 8.py | timeout | 0.0ms | 16.7MB | 53ms | 10ms | cpython 3.13.0 |
python | 8.py | timeout | 0.0ms | 100.0MB | 833ms | 137ms | pypy 3.10.14 |
python | 8.py | timeout | 0.0ms | 18.2MB | 70ms | 13ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 979ms | 2.1ms | 4.3MB | 967ms | 0ms | crystal 1.14.0 |
python | 8.py | timeout | 0.0ms | 16.4MB | 93ms | 30ms | cpython 3.13.0 |
python | 8.py | timeout | 0.0ms | 99.8MB | 1533ms | 517ms | pypy 3.10.14 |
python | 8.py | timeout | 0.0ms | 17.5MB | 140ms | 33ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
crystal | 1.cr | 249ms | 2.4ms | 4.0MB | 240ms | 0ms | crystal 1.14.0 |
python | 8-m.py | 1973ms | 18ms | 95.1MB | 6307ms | 370ms | pypy 3.10.14 |
python | 8.py | timeout | 0.0ms | 16.1MB | 277ms | 40ms | cpython 3.13.0 |
python | 8.py | timeout | 0.0ms | 17.3MB | 397ms | 113ms | pyston 3.8.12 |