Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1568ms | 90ms | 79.1MB | 1510ms | 40ms | pypy 3.10.13 |
ruby | 1.rb | 4037ms | 417ms | 123.9MB | 3920ms | 100ms | ruby/yjit 3.3.0 |
python | 1.py | timeout | 0.0ms | 41.3MB | 4977ms | 10ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 40.5MB | 4763ms | 223ms | pyston 3.8.12 |
ruby | 1.rb | timeout | 0.0ms | 85.3MB | 4930ms | 53ms | ruby 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 679.9MB | 9080ms | 607ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 116ms | 0.7ms | 62.6MB | 80ms | 20ms | pypy 3.10.13 |
ruby | 1.rb | 408ms | 6.3ms | 36.4MB | 367ms | 27ms | ruby/yjit 3.3.0 |
python | 1.py | 478ms | 4.3ms | 11.9MB | 450ms | 13ms | pyston 3.8.12 |
python | 1.py | 732ms | 6.5ms | 13.1MB | 713ms | 0ms | cpython 3.12.1 |
ruby | 1.rb | 856ms | 5.9ms | 36.4MB | 813ms | 20ms | ruby 3.3.0 |
ruby | 1-m.rb | 910ms | 25ms | 437.3MB | 2027ms | 183ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 301ms | 0.9ms | 20.4MB | 277ms | 7ms | cpython 3.12.1 |
ruby | 1.rb | 1431ms | 5.5ms | 78.5MB | 1337ms | 77ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 1779ms | 29ms | 78.3MB | 1693ms | 70ms | ruby 3.3.0 |
python | 1.py | 3056ms | 23ms | 116.4MB | 2993ms | 47ms | pypy 3.10.13 |
python | 1.py | timeout | 0.0ms | 17.3MB | 4980ms | 7ms | pyston 3.8.12 |
ruby | 1.rb | timeout | 0.0ms | 717.5MB | 4877ms | 1427ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 1.rb | 169ms | 1.3ms | 40.5MB | 127ms | 27ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 190ms | 2.2ms | 40.3MB | 133ms | 40ms | ruby 3.3.0 |
python | 1.py | 292ms | 2.9ms | 82.9MB | 243ms | 30ms | pypy 3.10.13 |
python | 1.py | 303ms | 0.9ms | 20.4MB | 280ms | 7ms | cpython 3.12.1 |
python | 1.py | 653ms | 8.2ms | 16.8MB | 637ms | 0ms | pyston 3.8.12 |
ruby | 1.rb | timeout | 0.0ms | 730.8MB | 4667ms | 1557ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 6.rb | 1457ms | 11ms | 39.1MB | 1407ms | 33ms | ruby/yjit 3.3.0 |
python | 1.py | 1945ms | 8.0ms | 62.7MB | 1917ms | 10ms | pypy 3.10.13 |
ruby | 6-m.rb | 2178ms | 87ms | 420.2MB | 5517ms | 327ms | truffleruby 23.1.2 |
python | 5-m.py | 2465ms | 14ms | 12.4MB | 3553ms | 1027ms | pyston 3.8.12 |
python | 5-m.py | 2926ms | 14ms | 63.1MB | 4217ms | 773ms | pypy 3.10.13 |
python | 1.py | 3002ms | 24ms | 8.1MB | 2987ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 3316ms | 15ms | 14.3MB | 4393ms | 993ms | cpython 3.12.1 |
ruby | 6.rb | 3794ms | 10ms | 37.6MB | 3760ms | 20ms | ruby 3.3.0 |
python | 1.py | 4481ms | 71ms | 9.3MB | 4473ms | 0ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 6.rb | 223ms | 11ms | 30.4MB | 190ms | 17ms | ruby/yjit 3.3.0 |
python | 1.py | 267ms | 4.6ms | 61.3MB | 240ms | 7ms | pypy 3.10.13 |
python | 5-m.py | 314ms | 12ms | 12.5MB | 407ms | 147ms | pyston 3.8.12 |
python | 1.py | 316ms | 1.5ms | 8.1MB | 303ms | 3ms | pyston 3.8.12 |
python | 5-m.py | 401ms | 1.6ms | 14.3MB | 463ms | 167ms | cpython 3.12.1 |
ruby | 6.rb | 445ms | 0.8ms | 30.0MB | 407ms | 23ms | ruby 3.3.0 |
python | 1.py | 469ms | 14ms | 9.3MB | 457ms | 0ms | cpython 3.12.1 |
python | 5-m.py | 657ms | 11ms | 63.1MB | 880ms | 367ms | pypy 3.10.13 |
ruby | 6-m.rb | 835ms | 23ms | 372.2MB | 2033ms | 187ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 12ms | 0.9ms | 7.6MB | 0ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.3ms | 9.0MB | 0ms | 0ms | cpython 3.12.1 |
python | 1.py | 30ms | 1.2ms | 48.6MB | 8ms | 8ms | pypy 3.10.13 |
ruby | 1.rb | 41ms | 0.2ms | 161.9MB | 8ms | 32ms | truffleruby 23.1.2 |
ruby | 1.rb | 70ms | 2.0ms | 28.3MB | 46ms | 12ms | ruby 3.3.0 |
ruby | 1.rb | 72ms | 1.8ms | 28.4MB | 46ms | 16ms | ruby/yjit 3.3.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 201ms | 6.4ms | 38.4MB | 160ms | 27ms | pyston 3.8.12 |
python | 1.py | 230ms | 2.7ms | 39.0MB | 203ms | 10ms | cpython 3.12.1 |
ruby | 1.rb | 295ms | 2.6ms | 49.8MB | 250ms | 30ms | ruby 3.3.0 |
ruby | 1.rb | 305ms | 2.8ms | 49.0MB | 257ms | 33ms | ruby/yjit 3.3.0 |
python | 1.py | 326ms | 1.1ms | 85.7MB | 280ms | 27ms | pypy 3.10.13 |
ruby | 1-m.rb | 4664ms | 272ms | 508.1MB | 12213ms | 377ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1829ms | 10ms | 220.5MB | 1663ms | 147ms | pyston 3.8.12 |
python | 1.py | 1914ms | 6.7ms | 221.7MB | 1797ms | 100ms | cpython 3.12.1 |
python | 1.py | 1969ms | 28ms | 221.1MB | 1883ms | 70ms | pypy 3.10.13 |
ruby | 1.rb | 2261ms | 6.5ms | 170.4MB | 2133ms | 110ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 2266ms | 17ms | 168.1MB | 2147ms | 103ms | ruby 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 566.0MB | 13103ms | 413ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 154ms | 4.7ms | 56.8MB | 123ms | 17ms | pypy 3.10.13 |
python | 1.py | 189ms | 6.3ms | 59.5MB | 160ms | 13ms | pypy 3.10.13 |
ruby | 1.rb | 335ms | 1.4ms | 28.6MB | 307ms | 13ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 536ms | 12ms | 28.4MB | 503ms | 20ms | ruby 3.3.0 |
ruby | 1-m.rb | 658ms | 38ms | 365.9MB | 1090ms | 147ms | truffleruby 23.1.2 |
python | 1.py | 729ms | 10ms | 8.9MB | 713ms | 0ms | pyston 3.8.12 |
python | 2.py | 851ms | 3.5ms | 8.5MB | 840ms | 0ms | pyston 3.8.12 |
python | 1.py | 1105ms | 12ms | 9.9MB | 1093ms | 0ms | cpython 3.12.1 |
python | 2.py | 1288ms | 22ms | 9.5MB | 1277ms | 0ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 349ms | 3.5ms | 59.9MB | 327ms | 10ms | pypy 3.10.13 |
python | 1.py | 395ms | 5.9ms | 60.9MB | 367ms | 17ms | pypy 3.10.13 |
ruby | 1.rb | 860ms | 11ms | 28.6MB | 823ms | 20ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 1229ms | 22ms | 408.0MB | 1667ms | 170ms | truffleruby 23.1.2 |
ruby | 1.rb | 1440ms | 9.3ms | 28.3MB | 1403ms | 23ms | ruby 3.3.0 |
python | 1.py | 2192ms | 83ms | 8.9MB | 2180ms | 0ms | pyston 3.8.12 |
python | 2.py | 2556ms | 13ms | 8.5MB | 2547ms | 0ms | pyston 3.8.12 |
python | 1.py | 3250ms | 26ms | 9.9MB | 3233ms | 0ms | cpython 3.12.1 |
python | 2.py | 3744ms | 9.6ms | 9.5MB | 3733ms | 0ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 113ms | 4.7ms | 56.5MB | 87ms | 10ms | pypy 3.10.13 |
python | 1.py | 122ms | 0.4ms | 57.5MB | 93ms | 10ms | pypy 3.10.13 |
ruby | 1.rb | 202ms | 0.6ms | 28.6MB | 177ms | 13ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 299ms | 2.9ms | 28.3MB | 270ms | 17ms | ruby 3.3.0 |
python | 1.py | 349ms | 6.2ms | 8.5MB | 337ms | 0ms | pyston 3.8.12 |
python | 2.py | 391ms | 3.9ms | 8.1MB | 380ms | 0ms | pyston 3.8.12 |
ruby | 1-m.rb | 526ms | 34ms | 355.4MB | 967ms | 143ms | truffleruby 23.1.2 |
python | 1.py | 528ms | 10ms | 9.5MB | 517ms | 0ms | cpython 3.12.1 |
python | 2.py | 616ms | 7.8ms | 9.3MB | 603ms | 0ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 2604ms | 19ms | 201.5MB | 2490ms | 97ms | pypy 3.10.13 |
python | 1.py | timeout | 0.0ms | 81.6MB | 4970ms | 20ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 130.4MB | 4943ms | 40ms | pyston 3.8.12 |
ruby | 1.rb | timeout | 0.0ms | 87.8MB | 4917ms | 73ms | ruby 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 88.2MB | 4917ms | 67ms | ruby/yjit 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 575.9MB | 12800ms | 437ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 487ms | 3.0ms | 94.2MB | 440ms | 30ms | pypy 3.10.13 |
ruby | 1-m.rb | 2642ms | 152ms | 618.4MB | 6900ms | 303ms | truffleruby 23.1.2 |
ruby | 1.rb | 3031ms | 1.4ms | 46.8MB | 2987ms | 30ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 4013ms | 75ms | 46.5MB | 3970ms | 23ms | ruby 3.3.0 |
python | 1.py | timeout | 0.0ms | 34.1MB | 4977ms | 7ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 41.4MB | 4970ms | 17ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 2.rb | 953ms | 118ms | 319.9MB | 1190ms | 110ms | truffleruby 23.1.2 |
python | 2.py | 1386ms | 17ms | 60.4MB | 1357ms | 17ms | pypy 3.10.13 |
python | 1.py | 2647ms | 17ms | 54.1MB | 2617ms | 10ms | pypy 3.10.13 |
python | 1.py | timeout | 0.0ms | 9.1MB | 4987ms | 0ms | cpython 3.12.1 |
python | 2.py | timeout | 0.0ms | 9.3MB | 4990ms | 0ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4980ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.1MB | 4983ms | 0ms | pyston 3.8.12 |
ruby | 2.rb | timeout | 0.0ms | 28.1MB | 4967ms | 17ms | ruby 3.3.0 |
ruby | 2.rb | timeout | 0.0ms | 28.5MB | 4963ms | 20ms | ruby/yjit 3.3.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 179ms | 0.4ms | 55.8MB | 153ms | 10ms | pypy 3.10.13 |
python | 1.py | 305ms | 5.4ms | 54.0MB | 283ms | 10ms | pypy 3.10.13 |
ruby | 2-m.rb | 319ms | 5.4ms | 312.4MB | 540ms | 113ms | truffleruby 23.1.2 |
python | 1.py | 942ms | 43ms | 8.3MB | 930ms | 0ms | pyston 3.8.12 |
python | 2.py | 1314ms | 31ms | 8.1MB | 1300ms | 0ms | pyston 3.8.12 |
ruby | 2.rb | 1455ms | 8.4ms | 28.4MB | 1423ms | 17ms | ruby/yjit 3.3.0 |
ruby | 2.rb | 2876ms | 37ms | 28.1MB | 2840ms | 20ms | ruby 3.3.0 |
python | 1.py | 2986ms | 131ms | 9.1MB | 2973ms | 0ms | cpython 3.12.1 |
python | 2.py | 3077ms | 2.2ms | 9.1MB | 3063ms | 0ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 3061ms | 79ms | 632.9MB | 2887ms | 157ms | pyston 3.8.12 |
python | 1.py | 3479ms | 37ms | 366.2MB | 3410ms | 50ms | pypy 3.10.13 |
python | 1.py | 4862ms | 92ms | 320.5MB | 4807ms | 47ms | pyston 3.8.12 |
python | 2.py | 4871ms | 47ms | 634.1MB | 4697ms | 160ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 321.7MB | 4963ms | 23ms | cpython 3.12.1 |
python | 2.py | timeout | 0.0ms | 956.8MB | 4737ms | 247ms | pypy 3.10.13 |
ruby | 1.rb | timeout | 0.0ms | 340.6MB | 4840ms | 150ms | ruby 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 342.0MB | 4843ms | 140ms | ruby/yjit 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 743.0MB | 5043ms | 167ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 698ms | 9.1ms | 131.7MB | 667ms | 17ms | pypy 3.10.13 |
python | 2.py | 735ms | 2.3ms | 164.3MB | 690ms | 23ms | pyston 3.8.12 |
python | 1.py | 1113ms | 6.9ms | 86.0MB | 1087ms | 7ms | pyston 3.8.12 |
python | 2.py | 1213ms | 1.8ms | 165.4MB | 1170ms | 30ms | cpython 3.12.1 |
ruby | 1-m.rb | 1665ms | 20ms | 472.9MB | 2357ms | 177ms | truffleruby 23.1.2 |
python | 1.py | 2241ms | 84ms | 87.3MB | 2217ms | 10ms | cpython 3.12.1 |
python | 2.py | 2612ms | 31ms | 283.0MB | 2523ms | 77ms | pypy 3.10.13 |
ruby | 1.rb | 3530ms | 47ms | 146.6MB | 3423ms | 87ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 4855ms | 12ms | 146.4MB | 4753ms | 83ms | ruby 3.3.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 1897ms | 5.0ms | 8.9MB | 1850ms | 30ms | pyston 3.8.12 |
python | 4.py | 1959ms | 2.6ms | 9.9MB | 1910ms | 33ms | cpython 3.12.1 |
python | 4.py | 2334ms | 11ms | 63.4MB | 2280ms | 37ms | pypy 3.10.13 |
ruby | 1.rb | timeout | 0.0ms | 108.6MB | 4923ms | 63ms | ruby 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 108.8MB | 4913ms | 70ms | ruby/yjit 3.3.0 |
ruby | 1.rb | timeout | 0.0ms | 456.4MB | 13293ms | 427ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 450ms | 3.6ms | 8.8MB | 433ms | 0ms | pyston 3.8.12 |
python | 4.py | 466ms | 5.6ms | 9.6MB | 450ms | 0ms | cpython 3.12.1 |
python | 4.py | 569ms | 8.0ms | 61.9MB | 537ms | 13ms | pypy 3.10.13 |
ruby | 1.rb | 1680ms | 2.7ms | 109.0MB | 1597ms | 67ms | ruby/yjit 3.3.0 |
ruby | 1.rb | 1696ms | 16ms | 108.5MB | 1610ms | 70ms | ruby 3.3.0 |
ruby | 1-m.rb | 1925ms | 70ms | 409.5MB | 5020ms | 253ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 8.py | timeout | 0.0ms | 17.2MB | 57ms | 13ms | cpython 3.12.1 |
python | 8.py | timeout | 0.0ms | 76.8MB | 967ms | 133ms | pypy 3.10.13 |
python | 8.py | timeout | 0.0ms | 18.1MB | 63ms | 10ms | pyston 3.8.12 |
ruby | 4.rb | timeout | 0.0ms | 28.1MB | 4973ms | 10ms | ruby 3.3.0 |
ruby | 4.rb | timeout | 0.0ms | 28.5MB | 4963ms | 17ms | ruby/yjit 3.3.0 |
ruby | 4.rb | timeout | 0.0ms | 527.7MB | 5150ms | 253ms | truffleruby 23.1.2 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 4.rb | 4605ms | 65ms | 509.3MB | 4857ms | 220ms | truffleruby 23.1.2 |
python | 8.py | timeout | 0.0ms | 16.8MB | 100ms | 13ms | cpython 3.12.1 |
python | 8.py | timeout | 0.0ms | 75.9MB | 1767ms | 440ms | pypy 3.10.13 |
python | 8.py | timeout | 0.0ms | 17.8MB | 150ms | 30ms | pyston 3.8.12 |
ruby | 4.rb | timeout | 0.0ms | 28.1MB | 4967ms | 20ms | ruby 3.3.0 |
ruby | 4.rb | timeout | 0.0ms | 28.5MB | 4963ms | 20ms | ruby/yjit 3.3.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 4.rb | 1257ms | 60ms | 358.6MB | 1563ms | 133ms | truffleruby 23.1.2 |
python | 8-m.py | 2161ms | 17ms | 76.3MB | 6830ms | 320ms | pypy 3.10.13 |
python | 8.py | timeout | 0.0ms | 14.6MB | 293ms | 40ms | cpython 3.12.1 |
python | 8.py | timeout | 0.0ms | 17.2MB | 430ms | 120ms | pyston 3.8.12 |
ruby | 4.rb | timeout | 0.0ms | 28.3MB | 4973ms | 10ms | ruby 3.3.0 |
ruby | 4.rb | timeout | 0.0ms | 28.4MB | 4970ms | 13ms | ruby/yjit 3.3.0 |