Current benchmark data was generated on Thu May 04 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 4.jl | 1253ms | 8.6ms | 241.2MB | 1127ms | 207ms | julia 1.8.5 |
python | 1.py | 1790ms | 46ms | 217.6MB | 1663ms | 110ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 40.9MB | 4960ms | 17ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 40.3MB | 4917ms | 63ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 160ms | 14ms | 74.6MB | 110ms | 23ms | pypy 3.9.16 |
julia | 4.jl | 348ms | 1.7ms | 223.5MB | 280ms | 147ms | julia 1.8.5 |
python | 1.py | 671ms | 2.6ms | 12.0MB | 633ms | 17ms | pyston 3.8.12 |
python | 1.py | 966ms | 14ms | 12.5MB | 947ms | 3ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 7-m.jl | 672ms | 8.8ms | 293.5MB | 887ms | 190ms | julia 1.8.5 |
python | 5-m.py | 3471ms | 17ms | 12.7MB | 4990ms | 1227ms | pyston 3.8.12 |
python | 1.py | 3566ms | 105ms | 85.0MB | 3510ms | 37ms | pypy 3.9.16 |
python | 1.py | 3928ms | 17ms | 8.0MB | 3910ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 4067ms | 23ms | 13.6MB | 5703ms | 1260ms | cpython 3.11.3 |
python | 5-m.py | 4917ms | 70ms | 76.1MB | 5657ms | 1113ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4980ms | 3ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 409ms | 0.7ms | 7.9MB | 393ms | 3ms | pyston 3.8.12 |
python | 1.py | 427ms | 11ms | 73.7MB | 390ms | 20ms | pypy 3.9.16 |
python | 5-m.py | 428ms | 8.5ms | 12.6MB | 557ms | 143ms | pyston 3.8.12 |
julia | 7.jl | 488ms | 5.1ms | 225.3MB | 577ms | 143ms | julia 1.8.5 |
python | 5-m.py | 505ms | 14ms | 13.6MB | 593ms | 207ms | cpython 3.11.3 |
python | 1.py | 604ms | 1.0ms | 8.6MB | 587ms | 0ms | cpython 3.11.3 |
python | 5-m.py | 874ms | 16ms | 76.3MB | 983ms | 463ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 13ms | 0.4ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 15ms | 0.9ms | 8.4MB | 7ms | 3ms | cpython 3.11.3 |
python | 1.py | 40ms | 2.2ms | 52.0MB | 14ms | 10ms | pypy 3.9.16 |
julia | 1.jl | 213ms | 10ms | 163.0MB | 124ms | 94ms | julia/aot 1.8.5 |
julia | 1.jl | 225ms | 1.7ms | 170.9MB | 142ms | 98ms | julia 1.8.5 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 8.jl | 1187ms | 5.4ms | 271.7MB | 1500ms | 200ms | julia 1.8.5 |
python | 3-m.py | 4677ms | 58ms | 209.3MB | 8310ms | 410ms | pypy 3.9.16 |
python | 3.py | timeout | 0.0ms | 35.2MB | 97ms | 13ms | cpython 3.11.3 |
python | 3.py | timeout | 0.0ms | 34.2MB | 73ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 3-m.py | 635ms | 0.8ms | 86.0MB | 947ms | 127ms | pypy 3.9.16 |
python | 3-m.py | 676ms | 6.7ms | 17.7MB | 1183ms | 33ms | pyston 3.8.12 |
julia | 8.jl | 822ms | 3.4ms | 262.5MB | 883ms | 177ms | julia 1.8.5 |
python | 3-m.py | 943ms | 4.1ms | 16.7MB | 1683ms | 53ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 232ms | 1.0ms | 71.0MB | 203ms | 17ms | pypy 3.9.16 |
python | 1.py | 278ms | 6.3ms | 71.9MB | 247ms | 13ms | pypy 3.9.16 |
python | 1.py | 925ms | 7.8ms | 9.0MB | 907ms | 0ms | pyston 3.8.12 |
python | 2.py | 1073ms | 2.7ms | 8.8MB | 1057ms | 0ms | pyston 3.8.12 |
python | 1.py | 1276ms | 27ms | 9.3MB | 1257ms | 0ms | cpython 3.11.3 |
python | 2.py | 1421ms | 16ms | 9.1MB | 1407ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 557ms | 2.9ms | 71.5MB | 527ms | 20ms | pypy 3.9.16 |
python | 1.py | 608ms | 1.1ms | 72.4MB | 587ms | 7ms | pypy 3.9.16 |
python | 1.py | 2726ms | 8.2ms | 9.0MB | 2710ms | 0ms | pyston 3.8.12 |
python | 2.py | 3173ms | 4.4ms | 8.7MB | 3160ms | 0ms | pyston 3.8.12 |
python | 1.py | 3748ms | 29ms | 9.2MB | 3733ms | 0ms | cpython 3.11.3 |
python | 2.py | 4262ms | 61ms | 9.1MB | 4247ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 162ms | 0.5ms | 71.2MB | 130ms | 13ms | pypy 3.9.16 |
python | 1.py | 181ms | 1.1ms | 72.4MB | 140ms | 23ms | pypy 3.9.16 |
python | 1.py | 444ms | 1.3ms | 8.8MB | 430ms | 0ms | pyston 3.8.12 |
python | 2.py | 506ms | 6.4ms | 8.3MB | 490ms | 0ms | pyston 3.8.12 |
python | 1.py | 598ms | 1.3ms | 8.7MB | 583ms | 0ms | cpython 3.11.3 |
python | 2.py | 712ms | 6.9ms | 8.4MB | 697ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 7.jl | 551ms | 4.6ms | 168.3MB | 510ms | 130ms | julia/aot 1.8.5 |
julia | 7.jl | 711ms | 2.6ms | 226.1MB | 657ms | 137ms | julia 1.8.5 |
python | 2.py | 2132ms | 23ms | 71.3MB | 2103ms | 10ms | pypy 3.9.16 |
python | 1.py | 3664ms | 19ms | 70.4MB | 3623ms | 23ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.4MB | 4987ms | 0ms | cpython 3.11.3 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4983ms | 0ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4987ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 7.9MB | 4980ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 7.jl | 272ms | 5.3ms | 169.3MB | 203ms | 133ms | julia/aot 1.8.5 |
python | 2.py | 279ms | 3.4ms | 71.2MB | 253ms | 10ms | pypy 3.9.16 |
python | 1.py | 425ms | 14ms | 70.4MB | 390ms | 17ms | pypy 3.9.16 |
julia | 7.jl | 433ms | 3.5ms | 223.5MB | 377ms | 140ms | julia 1.8.5 |
python | 1.py | 1156ms | 2.0ms | 8.4MB | 1137ms | 3ms | pyston 3.8.12 |
python | 2.py | 1597ms | 31ms | 7.9MB | 1577ms | 3ms | pyston 3.8.12 |
python | 1.py | 3179ms | 60ms | 8.4MB | 3167ms | 3ms | cpython 3.11.3 |
python | 2.py | 3574ms | 7.6ms | 8.6MB | 3557ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 1.jl | 444ms | 1.4ms | 156.3MB | 390ms | 140ms | julia/aot 1.8.5 |
julia | 1.jl | 554ms | 3.9ms | 203.0MB | 497ms | 143ms | julia 1.8.5 |
python | 1.py | timeout | 0.0ms | 321.0MB | 4897ms | 80ms | cpython 3.11.3 |
python | 2.py | timeout | 0.0ms | 633.5MB | 4677ms | 307ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 382.8MB | 4850ms | 133ms | pypy 3.9.16 |
python | 2.py | timeout | 0.0ms | 991.9MB | 4623ms | 360ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 320.4MB | 4903ms | 80ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 633.3MB | 4557ms | 423ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 1.jl | 246ms | 3.6ms | 150.1MB | 173ms | 110ms | julia/aot 1.8.5 |
julia | 1.jl | 361ms | 5.5ms | 195.4MB | 297ms | 143ms | julia 1.8.5 |
python | 1.py | 1331ms | 14ms | 207.2MB | 1257ms | 60ms | pypy 3.9.16 |
python | 2.py | 1563ms | 21ms | 164.4MB | 1463ms | 83ms | pyston 3.8.12 |
python | 2.py | 2088ms | 6.3ms | 164.9MB | 1990ms | 83ms | cpython 3.11.3 |
python | 2.py | 2161ms | 4.7ms | 210.5MB | 2013ms | 133ms | pypy 3.9.16 |
python | 1.py | 3370ms | 74ms | 86.0MB | 3313ms | 37ms | pyston 3.8.12 |
python | 1.py | 4719ms | 66ms | 86.6MB | 4660ms | 40ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 3.jl | 725ms | 6.3ms | 176.4MB | 660ms | 147ms | julia 1.8.5 |
julia | 1.jl | 1659ms | 9.8ms | 262.4MB | 1527ms | 213ms | julia 1.8.5 |
python | 4.py | 2411ms | 1.3ms | 9.1MB | 2383ms | 10ms | pyston 3.8.12 |
python | 4.py | 2548ms | 1.1ms | 9.4MB | 2503ms | 27ms | cpython 3.11.3 |
python | 4.py | 2622ms | 44ms | 125.4MB | 2547ms | 57ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 3.jl | 353ms | 2.1ms | 176.1MB | 300ms | 137ms | julia 1.8.5 |
python | 4.py | 576ms | 0.8ms | 8.8MB | 560ms | 0ms | pyston 3.8.12 |
python | 4.py | 607ms | 0.3ms | 9.1MB | 593ms | 0ms | cpython 3.11.3 |
python | 4.py | 672ms | 6.8ms | 77.0MB | 640ms | 17ms | pypy 3.9.16 |
julia | 1.jl | 952ms | 67ms | 260.2MB | 830ms | 173ms | julia 1.8.5 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 2-m.jl | 1232ms | 2.9ms | 196.0MB | 2077ms | 147ms | julia 1.8.5 |
julia | 3-m.jl | 2183ms | 35ms | 208.2MB | 3857ms | 150ms | julia 1.8.5 |
python | 8.py | timeout | 0.0ms | 16.3MB | 50ms | 10ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 99.0MB | 657ms | 100ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 16.3MB | 70ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 2-m.jl | 579ms | 6.0ms | 194.0MB | 783ms | 147ms | julia 1.8.5 |
julia | 3-m.jl | 845ms | 1.6ms | 209.0MB | 1257ms | 153ms | julia 1.8.5 |
python | 8.py | timeout | 0.0ms | 16.2MB | 97ms | 17ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 102.4MB | 1130ms | 193ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.6MB | 167ms | 27ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
julia | 2.jl | 409ms | 3.9ms | 192.2MB | 463ms | 140ms | julia 1.8.5 |
julia | 3.jl | 523ms | 17ms | 210.6MB | 620ms | 147ms | julia 1.8.5 |
python | 8-m.py | 4105ms | 62ms | 103.1MB | 7120ms | 430ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 15.9MB | 230ms | 23ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 16.7MB | 310ms | 70ms | pyston 3.8.12 |