Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 1082ms | 11ms | 37.1MB | 1063ms | 0ms | v/clang 0.4.0 |
v | 1.v | 1092ms | 6.8ms | 37.0MB | 1070ms | 7ms | v/clang+gc 0.4.0 |
python | 1.py | 1431ms | 7.2ms | 271.9MB | 1300ms | 110ms | pypy 3.10.12 |
python | 1.py | timeout | 0.0ms | 40.9MB | 4970ms | 10ms | cpython 3.11.4 |
python | 1.py | timeout | 0.0ms | 40.3MB | 4903ms | 80ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 90ms | 1.7ms | 5.6MB | 80ms | 0ms | v/clang 0.4.0 |
v | 1.v | 91ms | 1.2ms | 5.6MB | 80ms | 0ms | v/clang+gc 0.4.0 |
python | 1.py | 119ms | 16ms | 80.1MB | 83ms | 13ms | pypy 3.10.12 |
python | 1.py | 610ms | 3.8ms | 12.0MB | 587ms | 7ms | pyston 3.8.12 |
python | 1.py | 994ms | 18ms | 12.5MB | 973ms | 3ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1011ms | 11ms | 189.0MB | 917ms | 77ms | pypy 3.10.12 |
python | 1.py | timeout | 0.0ms | 20.3MB | 4980ms | 3ms | cpython 3.11.4 |
python | 1.py | timeout | 0.0ms | 17.3MB | 4983ms | 0ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 21.1MB | 5210ms | 4150ms | v/clang 0.4.0 |
v | 1.v | timeout | 0.0ms | 16.9MB | 5247ms | 4167ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 265ms | 7.9ms | 94.6MB | 230ms | 17ms | pypy 3.10.12 |
python | 1.py | 811ms | 6.1ms | 20.0MB | 787ms | 3ms | cpython 3.11.4 |
python | 1.py | 930ms | 2.5ms | 16.8MB | 910ms | 3ms | pyston 3.8.12 |
v | 1-m.v | 3611ms | 865ms | 16.6MB | 3743ms | 2970ms | v/clang+gc 0.4.0 |
v | 1-m.v | 4091ms | 389ms | 16.9MB | 4267ms | 3377ms | v/clang 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 278ms | 0.1ms | 88.1MB | 243ms | 17ms | pypy 3.10.12 |
python | 1.py | 1655ms | 1.1ms | 10.1MB | 1640ms | 0ms | cpython 3.11.4 |
python | 1.py | 2783ms | 0.3ms | 9.7MB | 2770ms | 0ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 27.3MB | 4977ms | 3ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 116ms | 1.0ms | 79.0MB | 83ms | 20ms | pypy 3.10.12 |
python | 1.py | 301ms | 0.2ms | 9.3MB | 290ms | 0ms | cpython 3.11.4 |
python | 1.py | 480ms | 1.1ms | 9.0MB | 463ms | 0ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 13.0MB | 4980ms | 0ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 628ms | 0.1ms | 2.0MB | 620ms | 0ms | v/clang 0.4.0 |
v | 1.v | 631ms | 3.5ms | 2.0MB | 620ms | 0ms | v/clang+gc 0.4.0 |
python | 1.py | 2471ms | 36ms | 87.9MB | 2433ms | 20ms | pypy 3.10.12 |
python | 5-m.py | 3926ms | 65ms | 83.2MB | 4250ms | 843ms | pypy 3.10.12 |
python | 5-m.py | 3978ms | 31ms | 12.7MB | 6003ms | 1020ms | pyston 3.8.12 |
python | 5-m.py | 4105ms | 12ms | 13.6MB | 5733ms | 1033ms | cpython 3.11.4 |
python | 1.py | 4108ms | 2.7ms | 7.9MB | 4093ms | 0ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4980ms | 0ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 66ms | 0.7ms | 2.0MB | 60ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 67ms | 2.4ms | 2.0MB | 57ms | 0ms | v/clang 0.4.0 |
python | 1.py | 335ms | 15ms | 78.9MB | 307ms | 17ms | pypy 3.10.12 |
python | 1.py | 428ms | 4.2ms | 8.0MB | 407ms | 3ms | pyston 3.8.12 |
python | 5-m.py | 469ms | 12ms | 12.7MB | 693ms | 123ms | pyston 3.8.12 |
python | 5-m.py | 472ms | 1.7ms | 13.6MB | 607ms | 133ms | cpython 3.11.4 |
python | 1.py | 617ms | 1.4ms | 8.6MB | 603ms | 0ms | cpython 3.11.4 |
python | 5-m.py | 769ms | 8.0ms | 82.7MB | 833ms | 440ms | pypy 3.10.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 2.0ms | 0.4ms | 1.9MB | 0ms | 0ms | v/clang 0.4.0 |
v | 1.v | 2.2ms | 0.3ms | 2.1MB | 0ms | 0ms | v/clang+gc 0.4.0 |
python | 1.py | 13ms | 0.6ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.4ms | 8.5MB | 10ms | 0ms | cpython 3.11.4 |
python | 1.py | 30ms | 0.7ms | 52.1MB | 12ms | 2ms | pypy 3.10.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 844ms | 25ms | 6.7MB | 567ms | 667ms | v/clang+gc 0.4.0 |
python | 1.py | 1502ms | 5.2ms | 35.2MB | 1127ms | 790ms | pyston 3.8.12 |
python | 1.py | 1857ms | 8.4ms | 29.7MB | 1490ms | 803ms | cpython 3.11.4 |
python | 1.py | 4045ms | 60ms | 127.2MB | 3107ms | 783ms | pypy 3.10.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 144ms | 5.0ms | 5.6MB | 83ms | 113ms | v/clang+gc 0.4.0 |
python | 1.py | 350ms | 3.4ms | 27.6MB | 273ms | 127ms | pyston 3.8.12 |
python | 1.py | 381ms | 5.9ms | 25.2MB | 273ms | 163ms | cpython 3.11.4 |
python | 1.py | 1001ms | 16ms | 103.7MB | 777ms | 170ms | pypy 3.10.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 196ms | 0.4ms | 77.2MB | 170ms | 10ms | pypy 3.10.12 |
python | 1.py | 234ms | 0.3ms | 78.0MB | 217ms | 3ms | pypy 3.10.12 |
v | 1.v | 397ms | 1.1ms | 2.2MB | 387ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 425ms | 1.0ms | 2.3MB | 413ms | 0ms | v/clang 0.4.0 |
python | 1.py | 981ms | 0.5ms | 9.0MB | 967ms | 0ms | pyston 3.8.12 |
python | 2.py | 1165ms | 1.0ms | 8.7MB | 1147ms | 3ms | pyston 3.8.12 |
python | 1.py | 1337ms | 3.7ms | 9.3MB | 1323ms | 0ms | cpython 3.11.4 |
python | 2.py | 1548ms | 20ms | 9.1MB | 1533ms | 0ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 459ms | 4.4ms | 77.7MB | 433ms | 10ms | pypy 3.10.12 |
python | 1.py | 507ms | 11ms | 78.6MB | 477ms | 10ms | pypy 3.10.12 |
v | 1.v | 1182ms | 1.4ms | 2.3MB | 1170ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 1268ms | 1.7ms | 2.3MB | 1257ms | 0ms | v/clang 0.4.0 |
python | 1.py | 2937ms | 37ms | 8.9MB | 2920ms | 0ms | pyston 3.8.12 |
python | 2.py | 3476ms | 17ms | 8.7MB | 3467ms | 0ms | pyston 3.8.12 |
python | 1.py | 3949ms | 14ms | 9.4MB | 3937ms | 0ms | cpython 3.11.4 |
python | 2.py | 4639ms | 19ms | 9.1MB | 4620ms | 3ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 132ms | 0.1ms | 2.3MB | 120ms | 0ms | v/clang+gc 0.4.0 |
python | 2.py | 138ms | 1.8ms | 77.3MB | 113ms | 10ms | pypy 3.10.12 |
v | 1.v | 139ms | 1.8ms | 2.2MB | 130ms | 0ms | v/clang 0.4.0 |
python | 1.py | 156ms | 2.2ms | 78.1MB | 127ms | 13ms | pypy 3.10.12 |
python | 1.py | 475ms | 2.7ms | 8.8MB | 460ms | 0ms | pyston 3.8.12 |
python | 2.py | 542ms | 1.7ms | 8.2MB | 530ms | 0ms | pyston 3.8.12 |
python | 1.py | 632ms | 4.6ms | 8.7MB | 613ms | 0ms | cpython 3.11.4 |
python | 2.py | 773ms | 8.4ms | 8.4MB | 757ms | 3ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 874ms | 0.8ms | 2.3MB | 860ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 878ms | 10.0ms | 2.3MB | 863ms | 0ms | v/clang 0.4.0 |
python | 2.py | 1880ms | 4.6ms | 77.3MB | 1853ms | 10ms | pypy 3.10.12 |
python | 1.py | 3370ms | 20ms | 76.1MB | 3337ms | 13ms | pypy 3.10.12 |
python | 1.py | timeout | 0.0ms | 8.4MB | 4983ms | 0ms | cpython 3.11.4 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4983ms | 0ms | cpython 3.11.4 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4980ms | 3ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 7.9MB | 4980ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 90ms | 1.7ms | 2.4MB | 80ms | 0ms | v/clang 0.4.0 |
v | 1.v | 96ms | 10.0ms | 2.2MB | 87ms | 0ms | v/clang+gc 0.4.0 |
python | 2.py | 242ms | 1.9ms | 77.0MB | 217ms | 10ms | pypy 3.10.12 |
python | 1.py | 381ms | 1.2ms | 76.4MB | 360ms | 7ms | pypy 3.10.12 |
python | 1.py | 1202ms | 7.3ms | 8.4MB | 1190ms | 0ms | pyston 3.8.12 |
python | 2.py | 1603ms | 2.5ms | 7.9MB | 1590ms | 0ms | pyston 3.8.12 |
python | 1.py | 3302ms | 19ms | 8.4MB | 3287ms | 0ms | cpython 3.11.4 |
python | 2.py | 3358ms | 33ms | 8.6MB | 3343ms | 0ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 2.v | 507ms | 7.4ms | 10.8MB | 493ms | 0ms | v/clang 0.4.0 |
v | 2.v | 514ms | 7.9ms | 10.6MB | 500ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 546ms | 16ms | 41.2MB | 527ms | 0ms | v/clang 0.4.0 |
v | 1.v | 591ms | 49ms | 41.1MB | 570ms | 0ms | v/clang+gc 0.4.0 |
python | 1.py | 3962ms | 23ms | 388.8MB | 3823ms | 117ms | pypy 3.10.12 |
python | 2.py | 4945ms | 31ms | 633.0MB | 4633ms | 293ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 321.1MB | 4937ms | 50ms | cpython 3.11.4 |
python | 2.py | timeout | 0.0ms | 633.6MB | 4703ms | 277ms | cpython 3.11.4 |
python | 2.py | timeout | 0.0ms | 1013.9MB | 4687ms | 287ms | pypy 3.10.12 |
python | 1.py | timeout | 0.0ms | 320.5MB | 4910ms | 73ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 2.v | 116ms | 0.7ms | 4.0MB | 100ms | 0ms | v/clang+gc 0.4.0 |
v | 2.v | 117ms | 0.6ms | 4.1MB | 107ms | 0ms | v/clang 0.4.0 |
v | 1.v | 124ms | 4.9ms | 20.2MB | 113ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 126ms | 4.9ms | 20.8MB | 110ms | 0ms | v/clang 0.4.0 |
python | 1.py | 883ms | 15ms | 213.0MB | 840ms | 30ms | pypy 3.10.12 |
python | 2.py | 1136ms | 6.5ms | 164.4MB | 1070ms | 50ms | pyston 3.8.12 |
python | 2.py | 1412ms | 11ms | 266.7MB | 1277ms | 117ms | pypy 3.10.12 |
python | 1.py | 1677ms | 20ms | 86.1MB | 1640ms | 23ms | pyston 3.8.12 |
python | 2.py | 1697ms | 29ms | 164.8MB | 1647ms | 37ms | cpython 3.11.4 |
python | 1.py | 2679ms | 11ms | 86.8MB | 2640ms | 20ms | cpython 3.11.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 2543ms | 2.7ms | 117.0MB | 2500ms | 27ms | pypy 3.10.12 |
python | 4.py | 2776ms | 0.4ms | 9.1MB | 2743ms | 17ms | pyston 3.8.12 |
python | 4.py | 2798ms | 0.7ms | 9.4MB | 2747ms | 33ms | cpython 3.11.4 |
v | 1.v | 3883ms | 46ms | 3.0MB | 3857ms | 10ms | v/clang+gc 0.4.0 |
v | 1.v | timeout | 0.0ms | 4.0MB | 4983ms | 0ms | v/clang 0.4.0 |
v | 2.v | timeout | 0.0ms | 3.3MB | 4987ms | 0ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 631ms | 3.2ms | 81.5MB | 603ms | 13ms | pypy 3.10.12 |
python | 4.py | 657ms | 0.1ms | 8.9MB | 647ms | 0ms | pyston 3.8.12 |
python | 4.py | 666ms | 0.5ms | 9.1MB | 653ms | 0ms | cpython 3.11.4 |
v | 1.v | 964ms | 7.4ms | 2.8MB | 950ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 1413ms | 27ms | 2.9MB | 1393ms | 0ms | v/clang 0.4.0 |
v | 2.v | 1802ms | 7.2ms | 3.1MB | 1783ms | 0ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 3325ms | 5.1ms | 258.9MB | 3233ms | 73ms | pypy 3.10.12 |
python | 1.py | timeout | 0.0ms | 107.1MB | 4937ms | 43ms | cpython 3.11.4 |
python | 1.py | timeout | 0.0ms | 107.2MB | 4937ms | 47ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 93.4MB | 4963ms | 17ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 461ms | 0.9ms | 101.7MB | 420ms | 20ms | pypy 3.10.12 |
python | 1.py | 697ms | 1.5ms | 30.5MB | 660ms | 17ms | pyston 3.8.12 |
python | 1.py | 818ms | 2.0ms | 31.7MB | 780ms | 20ms | cpython 3.11.4 |
v | 1.v | 4207ms | 3.5ms | 27.8MB | 4187ms | 3ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 8.py | timeout | 0.0ms | 16.6MB | 53ms | 10ms | cpython 3.11.4 |
python | 8.py | timeout | 0.0ms | 106.2MB | 663ms | 87ms | pypy 3.10.12 |
python | 8.py | timeout | 0.0ms | 18.0MB | 80ms | 13ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 3.1MB | 4990ms | 0ms | v/clang 0.4.0 |
v | 1.v | timeout | 0.0ms | 3.0MB | 4990ms | 0ms | v/clang+gc 0.4.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 1550ms | 0.3ms | 2.8MB | 1537ms | 0ms | v/clang 0.4.0 |
v | 1.v | 1550ms | 0.7ms | 2.8MB | 1540ms | 0ms | v/clang+gc 0.4.0 |
python | 8.py | timeout | 0.0ms | 14.4MB | 127ms | 13ms | cpython 3.11.4 |
python | 8.py | timeout | 0.0ms | 111.5MB | 1110ms | 217ms | pypy 3.10.12 |
python | 8.py | timeout | 0.0ms | 15.6MB | 140ms | 30ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 391ms | 0.7ms | 2.5MB | 380ms | 0ms | v/clang+gc 0.4.0 |
v | 1.v | 392ms | 1.3ms | 2.5MB | 380ms | 0ms | v/clang 0.4.0 |
python | 8-m.py | 3124ms | 25ms | 105.3MB | 5340ms | 337ms | pypy 3.10.12 |
python | 8.py | timeout | 0.0ms | 16.2MB | 263ms | 17ms | cpython 3.11.4 |
python | 8.py | timeout | 0.0ms | 16.7MB | 320ms | 57ms | pyston 3.8.12 |