Programming Language and compiler
Benchmarks

Ruby VS Python benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1568ms 90ms 79.1MB 1510ms 40ms pypy 3.10.13
ruby 1.rb 4037ms 417ms 123.9MB 3920ms 100ms ruby/yjit 3.3.0
python 1.py timeout 0.0ms 41.3MB 4977ms 10ms cpython 3.12.1
python 1.py timeout 0.0ms 40.5MB 4763ms 223ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 85.3MB 4930ms 53ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 679.9MB 9080ms 607ms truffleruby 23.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 116ms 0.7ms 62.6MB 80ms 20ms pypy 3.10.13
ruby 1.rb 408ms 6.3ms 36.4MB 367ms 27ms ruby/yjit 3.3.0
python 1.py 478ms 4.3ms 11.9MB 450ms 13ms pyston 3.8.12
python 1.py 732ms 6.5ms 13.1MB 713ms 0ms cpython 3.12.1
ruby 1.rb 856ms 5.9ms 36.4MB 813ms 20ms ruby 3.3.0
ruby 1-m.rb 910ms 25ms 437.3MB 2027ms 183ms truffleruby 23.1.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 301ms 0.9ms 20.4MB 277ms 7ms cpython 3.12.1
ruby 1.rb 1431ms 5.5ms 78.5MB 1337ms 77ms ruby/yjit 3.3.0
ruby 1.rb 1779ms 29ms 78.3MB 1693ms 70ms ruby 3.3.0
python 1.py 3056ms 23ms 116.4MB 2993ms 47ms pypy 3.10.13
python 1.py timeout 0.0ms 17.3MB 4980ms 7ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 717.5MB 4877ms 1427ms truffleruby 23.1.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 169ms 1.3ms 40.5MB 127ms 27ms ruby/yjit 3.3.0
ruby 1.rb 190ms 2.2ms 40.3MB 133ms 40ms ruby 3.3.0
python 1.py 292ms 2.9ms 82.9MB 243ms 30ms pypy 3.10.13
python 1.py 303ms 0.9ms 20.4MB 280ms 7ms cpython 3.12.1
python 1.py 653ms 8.2ms 16.8MB 637ms 0ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 730.8MB 4667ms 1557ms truffleruby 23.1.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 1457ms 11ms 39.1MB 1407ms 33ms ruby/yjit 3.3.0
python 1.py 1945ms 8.0ms 62.7MB 1917ms 10ms pypy 3.10.13
ruby 6-m.rb 2178ms 87ms 420.2MB 5517ms 327ms truffleruby 23.1.2
python 5-m.py 2465ms 14ms 12.4MB 3553ms 1027ms pyston 3.8.12
python 5-m.py 2926ms 14ms 63.1MB 4217ms 773ms pypy 3.10.13
python 1.py 3002ms 24ms 8.1MB 2987ms 0ms pyston 3.8.12
python 5-m.py 3316ms 15ms 14.3MB 4393ms 993ms cpython 3.12.1
ruby 6.rb 3794ms 10ms 37.6MB 3760ms 20ms ruby 3.3.0
python 1.py 4481ms 71ms 9.3MB 4473ms 0ms cpython 3.12.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 223ms 11ms 30.4MB 190ms 17ms ruby/yjit 3.3.0
python 1.py 267ms 4.6ms 61.3MB 240ms 7ms pypy 3.10.13
python 5-m.py 314ms 12ms 12.5MB 407ms 147ms pyston 3.8.12
python 1.py 316ms 1.5ms 8.1MB 303ms 3ms pyston 3.8.12
python 5-m.py 401ms 1.6ms 14.3MB 463ms 167ms cpython 3.12.1
ruby 6.rb 445ms 0.8ms 30.0MB 407ms 23ms ruby 3.3.0
python 1.py 469ms 14ms 9.3MB 457ms 0ms cpython 3.12.1
python 5-m.py 657ms 11ms 63.1MB 880ms 367ms pypy 3.10.13
ruby 6-m.rb 835ms 23ms 372.2MB 2033ms 187ms truffleruby 23.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 12ms 0.9ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 9.0MB 0ms 0ms cpython 3.12.1
python 1.py 30ms 1.2ms 48.6MB 8ms 8ms pypy 3.10.13
ruby 1.rb 41ms 0.2ms 161.9MB 8ms 32ms truffleruby 23.1.2
ruby 1.rb 70ms 2.0ms 28.3MB 46ms 12ms ruby 3.3.0
ruby 1.rb 72ms 1.8ms 28.4MB 46ms 16ms ruby/yjit 3.3.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 201ms 6.4ms 38.4MB 160ms 27ms pyston 3.8.12
python 1.py 230ms 2.7ms 39.0MB 203ms 10ms cpython 3.12.1
ruby 1.rb 295ms 2.6ms 49.8MB 250ms 30ms ruby 3.3.0
ruby 1.rb 305ms 2.8ms 49.0MB 257ms 33ms ruby/yjit 3.3.0
python 1.py 326ms 1.1ms 85.7MB 280ms 27ms pypy 3.10.13
ruby 1-m.rb 4664ms 272ms 508.1MB 12213ms 377ms truffleruby 23.1.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1829ms 10ms 220.5MB 1663ms 147ms pyston 3.8.12
python 1.py 1914ms 6.7ms 221.7MB 1797ms 100ms cpython 3.12.1
python 1.py 1969ms 28ms 221.1MB 1883ms 70ms pypy 3.10.13
ruby 1.rb 2261ms 6.5ms 170.4MB 2133ms 110ms ruby/yjit 3.3.0
ruby 1.rb 2266ms 17ms 168.1MB 2147ms 103ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 566.0MB 13103ms 413ms truffleruby 23.1.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 154ms 4.7ms 56.8MB 123ms 17ms pypy 3.10.13
python 1.py 189ms 6.3ms 59.5MB 160ms 13ms pypy 3.10.13
ruby 1.rb 335ms 1.4ms 28.6MB 307ms 13ms ruby/yjit 3.3.0
ruby 1.rb 536ms 12ms 28.4MB 503ms 20ms ruby 3.3.0
ruby 1-m.rb 658ms 38ms 365.9MB 1090ms 147ms truffleruby 23.1.2
python 1.py 729ms 10ms 8.9MB 713ms 0ms pyston 3.8.12
python 2.py 851ms 3.5ms 8.5MB 840ms 0ms pyston 3.8.12
python 1.py 1105ms 12ms 9.9MB 1093ms 0ms cpython 3.12.1
python 2.py 1288ms 22ms 9.5MB 1277ms 0ms cpython 3.12.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 349ms 3.5ms 59.9MB 327ms 10ms pypy 3.10.13
python 1.py 395ms 5.9ms 60.9MB 367ms 17ms pypy 3.10.13
ruby 1.rb 860ms 11ms 28.6MB 823ms 20ms ruby/yjit 3.3.0
ruby 1.rb 1229ms 22ms 408.0MB 1667ms 170ms truffleruby 23.1.2
ruby 1.rb 1440ms 9.3ms 28.3MB 1403ms 23ms ruby 3.3.0
python 1.py 2192ms 83ms 8.9MB 2180ms 0ms pyston 3.8.12
python 2.py 2556ms 13ms 8.5MB 2547ms 0ms pyston 3.8.12
python 1.py 3250ms 26ms 9.9MB 3233ms 0ms cpython 3.12.1
python 2.py 3744ms 9.6ms 9.5MB 3733ms 0ms cpython 3.12.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 113ms 4.7ms 56.5MB 87ms 10ms pypy 3.10.13
python 1.py 122ms 0.4ms 57.5MB 93ms 10ms pypy 3.10.13
ruby 1.rb 202ms 0.6ms 28.6MB 177ms 13ms ruby/yjit 3.3.0
ruby 1.rb 299ms 2.9ms 28.3MB 270ms 17ms ruby 3.3.0
python 1.py 349ms 6.2ms 8.5MB 337ms 0ms pyston 3.8.12
python 2.py 391ms 3.9ms 8.1MB 380ms 0ms pyston 3.8.12
ruby 1-m.rb 526ms 34ms 355.4MB 967ms 143ms truffleruby 23.1.2
python 1.py 528ms 10ms 9.5MB 517ms 0ms cpython 3.12.1
python 2.py 616ms 7.8ms 9.3MB 603ms 0ms cpython 3.12.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2604ms 19ms 201.5MB 2490ms 97ms pypy 3.10.13
python 1.py timeout 0.0ms 81.6MB 4970ms 20ms cpython 3.12.1
python 1.py timeout 0.0ms 130.4MB 4943ms 40ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 87.8MB 4917ms 73ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 88.2MB 4917ms 67ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 575.9MB 12800ms 437ms truffleruby 23.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 487ms 3.0ms 94.2MB 440ms 30ms pypy 3.10.13
ruby 1-m.rb 2642ms 152ms 618.4MB 6900ms 303ms truffleruby 23.1.2
ruby 1.rb 3031ms 1.4ms 46.8MB 2987ms 30ms ruby/yjit 3.3.0
ruby 1.rb 4013ms 75ms 46.5MB 3970ms 23ms ruby 3.3.0
python 1.py timeout 0.0ms 34.1MB 4977ms 7ms cpython 3.12.1
python 1.py timeout 0.0ms 41.4MB 4970ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 953ms 118ms 319.9MB 1190ms 110ms truffleruby 23.1.2
python 2.py 1386ms 17ms 60.4MB 1357ms 17ms pypy 3.10.13
python 1.py 2647ms 17ms 54.1MB 2617ms 10ms pypy 3.10.13
python 1.py timeout 0.0ms 9.1MB 4987ms 0ms cpython 3.12.1
python 2.py timeout 0.0ms 9.3MB 4990ms 0ms cpython 3.12.1
python 1.py timeout 0.0ms 8.3MB 4980ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12
ruby 2.rb timeout 0.0ms 28.1MB 4967ms 17ms ruby 3.3.0
ruby 2.rb timeout 0.0ms 28.5MB 4963ms 20ms ruby/yjit 3.3.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 179ms 0.4ms 55.8MB 153ms 10ms pypy 3.10.13
python 1.py 305ms 5.4ms 54.0MB 283ms 10ms pypy 3.10.13
ruby 2-m.rb 319ms 5.4ms 312.4MB 540ms 113ms truffleruby 23.1.2
python 1.py 942ms 43ms 8.3MB 930ms 0ms pyston 3.8.12
python 2.py 1314ms 31ms 8.1MB 1300ms 0ms pyston 3.8.12
ruby 2.rb 1455ms 8.4ms 28.4MB 1423ms 17ms ruby/yjit 3.3.0
ruby 2.rb 2876ms 37ms 28.1MB 2840ms 20ms ruby 3.3.0
python 1.py 2986ms 131ms 9.1MB 2973ms 0ms cpython 3.12.1
python 2.py 3077ms 2.2ms 9.1MB 3063ms 0ms cpython 3.12.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 3061ms 79ms 632.9MB 2887ms 157ms pyston 3.8.12
python 1.py 3479ms 37ms 366.2MB 3410ms 50ms pypy 3.10.13
python 1.py 4862ms 92ms 320.5MB 4807ms 47ms pyston 3.8.12
python 2.py 4871ms 47ms 634.1MB 4697ms 160ms cpython 3.12.1
python 1.py timeout 0.0ms 321.7MB 4963ms 23ms cpython 3.12.1
python 2.py timeout 0.0ms 956.8MB 4737ms 247ms pypy 3.10.13
ruby 1.rb timeout 0.0ms 340.6MB 4840ms 150ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 342.0MB 4843ms 140ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 743.0MB 5043ms 167ms truffleruby 23.1.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 698ms 9.1ms 131.7MB 667ms 17ms pypy 3.10.13
python 2.py 735ms 2.3ms 164.3MB 690ms 23ms pyston 3.8.12
python 1.py 1113ms 6.9ms 86.0MB 1087ms 7ms pyston 3.8.12
python 2.py 1213ms 1.8ms 165.4MB 1170ms 30ms cpython 3.12.1
ruby 1-m.rb 1665ms 20ms 472.9MB 2357ms 177ms truffleruby 23.1.2
python 1.py 2241ms 84ms 87.3MB 2217ms 10ms cpython 3.12.1
python 2.py 2612ms 31ms 283.0MB 2523ms 77ms pypy 3.10.13
ruby 1.rb 3530ms 47ms 146.6MB 3423ms 87ms ruby/yjit 3.3.0
ruby 1.rb 4855ms 12ms 146.4MB 4753ms 83ms ruby 3.3.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1897ms 5.0ms 8.9MB 1850ms 30ms pyston 3.8.12
python 4.py 1959ms 2.6ms 9.9MB 1910ms 33ms cpython 3.12.1
python 4.py 2334ms 11ms 63.4MB 2280ms 37ms pypy 3.10.13
ruby 1.rb timeout 0.0ms 108.6MB 4923ms 63ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 108.8MB 4913ms 70ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 456.4MB 13293ms 427ms truffleruby 23.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 450ms 3.6ms 8.8MB 433ms 0ms pyston 3.8.12
python 4.py 466ms 5.6ms 9.6MB 450ms 0ms cpython 3.12.1
python 4.py 569ms 8.0ms 61.9MB 537ms 13ms pypy 3.10.13
ruby 1.rb 1680ms 2.7ms 109.0MB 1597ms 67ms ruby/yjit 3.3.0
ruby 1.rb 1696ms 16ms 108.5MB 1610ms 70ms ruby 3.3.0
ruby 1-m.rb 1925ms 70ms 409.5MB 5020ms 253ms truffleruby 23.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 17.2MB 57ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 76.8MB 967ms 133ms pypy 3.10.13
python 8.py timeout 0.0ms 18.1MB 63ms 10ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 28.1MB 4973ms 10ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.5MB 4963ms 17ms ruby/yjit 3.3.0
ruby 4.rb timeout 0.0ms 527.7MB 5150ms 253ms truffleruby 23.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4605ms 65ms 509.3MB 4857ms 220ms truffleruby 23.1.2
python 8.py timeout 0.0ms 16.8MB 100ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 75.9MB 1767ms 440ms pypy 3.10.13
python 8.py timeout 0.0ms 17.8MB 150ms 30ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 28.1MB 4967ms 20ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.5MB 4963ms 20ms ruby/yjit 3.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1257ms 60ms 358.6MB 1563ms 133ms truffleruby 23.1.2
python 8-m.py 2161ms 17ms 76.3MB 6830ms 320ms pypy 3.10.13
python 8.py timeout 0.0ms 14.6MB 293ms 40ms cpython 3.12.1
python 8.py timeout 0.0ms 17.2MB 430ms 120ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 28.3MB 4973ms 10ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.4MB 4970ms 13ms ruby/yjit 3.3.0