Programming Language and compiler
Benchmarks

Python VS Ruby benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1431ms 7.2ms 271.9MB 1300ms 110ms pypy 3.10.12
python 1.py timeout 0.0ms 40.9MB 4970ms 10ms cpython 3.11.4
python 1.py timeout 0.0ms 40.3MB 4903ms 80ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 72.7MB 4953ms 33ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 115.5MB 4917ms 63ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 769.5MB 7713ms 377ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 119ms 16ms 80.1MB 83ms 13ms pypy 3.10.12
ruby 1.rb 533ms 1.9ms 40.7MB 503ms 13ms ruby/yjit 3.2.2
python 1.py 610ms 3.8ms 12.0MB 587ms 7ms pyston 3.8.12
ruby 1.rb 969ms 5.3ms 40.2MB 943ms 10ms ruby 3.2.2
ruby 1-m.rb 984ms 52ms 414.6MB 1597ms 140ms truffleruby 22.3.1
python 1.py 994ms 18ms 12.5MB 973ms 3ms cpython 3.11.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1011ms 11ms 189.0MB 917ms 77ms pypy 3.10.12
ruby 1.rb 3206ms 100ms 82.7MB 3143ms 47ms ruby/yjit 3.2.2
ruby 1.rb 3619ms 125ms 82.2MB 3550ms 53ms ruby 3.2.2
python 1.py timeout 0.0ms 20.3MB 4980ms 3ms cpython 3.11.4
python 1.py timeout 0.0ms 17.3MB 4983ms 0ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 1163.0MB 4197ms 1267ms truffleruby 22.3.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 224ms 4.0ms 44.8MB 180ms 27ms ruby/yjit 3.2.2
ruby 1.rb 233ms 1.7ms 44.4MB 207ms 10ms ruby 3.2.2
python 1.py 265ms 7.9ms 94.6MB 230ms 17ms pypy 3.10.12
python 1.py 811ms 6.1ms 20.0MB 787ms 3ms cpython 3.11.4
python 1.py 930ms 2.5ms 16.8MB 910ms 3ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 1158.9MB 4150ms 1270ms truffleruby 22.3.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 278ms 0.1ms 88.1MB 243ms 17ms pypy 3.10.12
python 1.py 1655ms 1.1ms 10.1MB 1640ms 0ms cpython 3.11.4
python 1.py 2783ms 0.3ms 9.7MB 2770ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 116ms 1.0ms 79.0MB 83ms 20ms pypy 3.10.12
python 1.py 301ms 0.2ms 9.3MB 290ms 0ms cpython 3.11.4
python 1.py 480ms 1.1ms 9.0MB 463ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2359ms 7.6ms 43.6MB 2317ms 23ms ruby/yjit 3.2.2
python 1.py 2471ms 36ms 87.9MB 2433ms 20ms pypy 3.10.12
ruby 6-m.rb 2525ms 40ms 381.9MB 4587ms 233ms truffleruby 22.3.1
python 5-m.py 3926ms 65ms 83.2MB 4250ms 843ms pypy 3.10.12
python 5-m.py 3978ms 31ms 12.7MB 6003ms 1020ms pyston 3.8.12
python 5-m.py 4105ms 12ms 13.6MB 5733ms 1033ms cpython 3.11.4
python 1.py 4108ms 2.7ms 7.9MB 4093ms 0ms pyston 3.8.12
ruby 6.rb 4204ms 50ms 43.0MB 4180ms 13ms ruby 3.2.2
python 1.py timeout 0.0ms 8.6MB 4980ms 0ms cpython 3.11.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 307ms 0.5ms 35.0MB 280ms 10ms ruby/yjit 3.2.2
python 1.py 335ms 15ms 78.9MB 307ms 17ms pypy 3.10.12
python 1.py 428ms 4.2ms 8.0MB 407ms 3ms pyston 3.8.12
python 5-m.py 469ms 12ms 12.7MB 693ms 123ms pyston 3.8.12
python 5-m.py 472ms 1.7ms 13.6MB 607ms 133ms cpython 3.11.4
ruby 6.rb 494ms 8.7ms 34.5MB 467ms 13ms ruby 3.2.2
python 1.py 617ms 1.4ms 8.6MB 603ms 0ms cpython 3.11.4
python 5-m.py 769ms 8.0ms 82.7MB 833ms 440ms pypy 3.10.12
ruby 6-m.rb 806ms 12ms 314.0MB 1380ms 100ms truffleruby 22.3.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 13ms 0.6ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 1.4ms 8.5MB 10ms 0ms cpython 3.11.4
python 1.py 30ms 0.7ms 52.1MB 12ms 2ms pypy 3.10.12
ruby 1.rb 43ms 2.1ms 157.2MB 16ms 26ms truffleruby 22.3.1
ruby 1.rb 71ms 1.0ms 32.2MB 48ms 10ms ruby/yjit 3.2.2
ruby 1.rb 71ms 0.6ms 32.0MB 50ms 8ms ruby 3.2.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1502ms 5.2ms 35.2MB 1127ms 790ms pyston 3.8.12
python 1.py 1857ms 8.4ms 29.7MB 1490ms 803ms cpython 3.11.4
python 1.py 4045ms 60ms 127.2MB 3107ms 783ms pypy 3.10.12

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 350ms 3.4ms 27.6MB 273ms 127ms pyston 3.8.12
python 1.py 381ms 5.9ms 25.2MB 273ms 163ms cpython 3.11.4
python 1.py 1001ms 16ms 103.7MB 777ms 170ms pypy 3.10.12

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 249ms 0.4ms 38.4MB 213ms 20ms pyston 3.8.12
python 1.py 256ms 1.4ms 41.1MB 233ms 7ms cpython 3.11.4
python 1.py 399ms 1.9ms 106.6MB 367ms 17ms pypy 3.10.12
ruby 1.rb 433ms 0.1ms 51.6MB 410ms 7ms ruby/yjit 3.2.2
ruby 1.rb 436ms 1.6ms 48.8MB 397ms 27ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 453.7MB 9193ms 197ms truffleruby 22.3.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2322ms 2.4ms 223.1MB 2223ms 80ms cpython 3.11.4
python 1.py 2332ms 3.8ms 220.6MB 2177ms 137ms pyston 3.8.12
python 1.py 2468ms 3.1ms 245.1MB 2380ms 70ms pypy 3.10.12
ruby 1.rb 3991ms 0.7ms 175.2MB 3900ms 77ms ruby 3.2.2
ruby 1.rb 4015ms 44ms 174.0MB 3923ms 73ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 426.7MB 9293ms 180ms truffleruby 22.3.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 3506ms 21ms 213.7MB 6197ms 340ms pypy 3.10.12
python 3-m.py 4859ms 118ms 34.3MB 9207ms 73ms pyston 3.8.12
python 3.py timeout 0.0ms 35.2MB 90ms 13ms cpython 3.11.4

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 513ms 7.5ms 94.1MB 743ms 107ms pypy 3.10.12
python 3-m.py 562ms 2.8ms 17.9MB 987ms 30ms pyston 3.8.12
python 3-m.py 793ms 2.1ms 16.9MB 1430ms 30ms cpython 3.11.4

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 196ms 0.4ms 77.2MB 170ms 10ms pypy 3.10.12
python 1.py 234ms 0.3ms 78.0MB 217ms 3ms pypy 3.10.12
ruby 1.rb 442ms 0.6ms 32.9MB 417ms 10ms ruby/yjit 3.2.2
ruby 1.rb 589ms 3.1ms 32.4MB 563ms 13ms ruby 3.2.2
ruby 1-m.rb 771ms 15ms 330.4MB 1130ms 100ms truffleruby 22.3.1
python 1.py 981ms 0.5ms 9.0MB 967ms 0ms pyston 3.8.12
python 2.py 1165ms 1.0ms 8.7MB 1147ms 3ms pyston 3.8.12
python 1.py 1337ms 3.7ms 9.3MB 1323ms 0ms cpython 3.11.4
python 2.py 1548ms 20ms 9.1MB 1533ms 0ms cpython 3.11.4

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 459ms 4.4ms 77.7MB 433ms 10ms pypy 3.10.12
python 1.py 507ms 11ms 78.6MB 477ms 10ms pypy 3.10.12
ruby 1.rb 1177ms 4.0ms 32.9MB 1150ms 13ms ruby/yjit 3.2.2
ruby 1.rb 1410ms 33ms 359.6MB 1697ms 150ms truffleruby 22.3.1
ruby 1.rb 1639ms 13ms 32.4MB 1613ms 10ms ruby 3.2.2
python 1.py 2937ms 37ms 8.9MB 2920ms 0ms pyston 3.8.12
python 2.py 3476ms 17ms 8.7MB 3467ms 0ms pyston 3.8.12
python 1.py 3949ms 14ms 9.4MB 3937ms 0ms cpython 3.11.4
python 2.py 4639ms 19ms 9.1MB 4620ms 3ms cpython 3.11.4

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 138ms 1.8ms 77.3MB 113ms 10ms pypy 3.10.12
python 1.py 156ms 2.2ms 78.1MB 127ms 13ms pypy 3.10.12
ruby 1.rb 255ms 0.9ms 32.8MB 227ms 13ms ruby/yjit 3.2.2
ruby 1.rb 329ms 2.7ms 32.3MB 307ms 10ms ruby 3.2.2
python 1.py 475ms 2.7ms 8.8MB 460ms 0ms pyston 3.8.12
python 2.py 542ms 1.7ms 8.2MB 530ms 0ms pyston 3.8.12
ruby 1-m.rb 556ms 34ms 309.0MB 833ms 97ms truffleruby 22.3.1
python 1.py 632ms 4.6ms 8.7MB 613ms 0ms cpython 3.11.4
python 2.py 773ms 8.4ms 8.4MB 757ms 3ms cpython 3.11.4

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2210ms 33ms 292.6MB 2010ms 183ms pypy 3.10.12
python 1.py timeout 0.0ms 93.2MB 4963ms 20ms cpython 3.11.4
python 1.py timeout 0.0ms 130.2MB 4930ms 47ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 96.5MB 4927ms 60ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 97.0MB 4930ms 50ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 572.5MB 9213ms 233ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 310ms 2.7ms 137.0MB 247ms 53ms pypy 3.10.12
ruby 1-m.rb 3266ms 25ms 595.8MB 5983ms 230ms truffleruby 22.3.1
ruby 1.rb 4134ms 16ms 53.6MB 4087ms 30ms ruby/yjit 3.2.2
python 1.py 4349ms 24ms 37.3MB 4320ms 10ms cpython 3.11.4
ruby 1.rb 4915ms 13ms 52.8MB 4870ms 30ms ruby 3.2.2
python 1.py timeout 0.0ms 48.8MB 4947ms 33ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 1022ms 5.5ms 306.4MB 1213ms 87ms truffleruby 22.3.1
python 2.py 1880ms 4.6ms 77.3MB 1853ms 10ms pypy 3.10.12
python 1.py 3370ms 20ms 76.1MB 3337ms 13ms pypy 3.10.12
python 1.py timeout 0.0ms 8.4MB 4983ms 0ms cpython 3.11.4
python 2.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.11.4
python 1.py timeout 0.0ms 8.3MB 4980ms 3ms pyston 3.8.12
python 2.py timeout 0.0ms 7.9MB 4980ms 0ms pyston 3.8.12
ruby 2.rb timeout 0.0ms 32.2MB 4967ms 17ms ruby 3.2.2
ruby 2.rb timeout 0.0ms 32.9MB 4977ms 3ms ruby/yjit 3.2.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 242ms 1.9ms 77.0MB 217ms 10ms pypy 3.10.12
python 1.py 381ms 1.2ms 76.4MB 360ms 7ms pypy 3.10.12
ruby 2-m.rb 387ms 13ms 323.0MB 587ms 87ms truffleruby 22.3.1
python 1.py 1202ms 7.3ms 8.4MB 1190ms 0ms pyston 3.8.12
python 2.py 1603ms 2.5ms 7.9MB 1590ms 0ms pyston 3.8.12
ruby 2.rb 2106ms 0.9ms 32.9MB 2080ms 10ms ruby/yjit 3.2.2
ruby 2.rb 3217ms 21ms 32.3MB 3187ms 10ms ruby 3.2.2
python 1.py 3302ms 19ms 8.4MB 3287ms 0ms cpython 3.11.4
python 2.py 3358ms 33ms 8.6MB 3343ms 0ms cpython 3.11.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3962ms 23ms 388.8MB 3823ms 117ms pypy 3.10.12
python 2.py 4945ms 31ms 633.0MB 4633ms 293ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4937ms 50ms cpython 3.11.4
python 2.py timeout 0.0ms 633.6MB 4703ms 277ms cpython 3.11.4
python 2.py timeout 0.0ms 1013.9MB 4687ms 287ms pypy 3.10.12
python 1.py timeout 0.0ms 320.5MB 4910ms 73ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 344.6MB 4853ms 123ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 345.2MB 4850ms 127ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 683.4MB 5050ms 130ms truffleruby 22.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 883ms 15ms 213.0MB 840ms 30ms pypy 3.10.12
python 2.py 1136ms 6.5ms 164.4MB 1070ms 50ms pyston 3.8.12
python 2.py 1412ms 11ms 266.7MB 1277ms 117ms pypy 3.10.12
python 1.py 1677ms 20ms 86.1MB 1640ms 23ms pyston 3.8.12
python 2.py 1697ms 29ms 164.8MB 1647ms 37ms cpython 3.11.4
python 1.py 2679ms 11ms 86.8MB 2640ms 20ms cpython 3.11.4
ruby 1.rb 2793ms 82ms 427.2MB 3267ms 127ms truffleruby 22.3.1
ruby 1.rb timeout 0.0ms 151.0MB 4927ms 50ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 151.4MB 4923ms 60ms ruby/yjit 3.2.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2543ms 2.7ms 117.0MB 2500ms 27ms pypy 3.10.12
python 4.py 2776ms 0.4ms 9.1MB 2743ms 17ms pyston 3.8.12
python 4.py 2798ms 0.7ms 9.4MB 2747ms 33ms cpython 3.11.4
ruby 1.rb timeout 0.0ms 159.2MB 4917ms 60ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 159.8MB 4930ms 57ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 416.1MB 9323ms 203ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 631ms 3.2ms 81.5MB 603ms 13ms pypy 3.10.12
python 4.py 657ms 0.1ms 8.9MB 647ms 0ms pyston 3.8.12
python 4.py 666ms 0.5ms 9.1MB 653ms 0ms cpython 3.11.4
ruby 1-m.rb 1948ms 37ms 408.1MB 3603ms 127ms truffleruby 22.3.1
ruby 1.rb 2372ms 5.3ms 159.8MB 2293ms 67ms ruby/yjit 3.2.2
ruby 1.rb 2392ms 10.0ms 159.3MB 2323ms 53ms ruby 3.2.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3325ms 5.1ms 258.9MB 3233ms 73ms pypy 3.10.12
python 1.py timeout 0.0ms 107.1MB 4937ms 43ms cpython 3.11.4
python 1.py timeout 0.0ms 107.2MB 4937ms 47ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 461ms 0.9ms 101.7MB 420ms 20ms pypy 3.10.12
python 1.py 697ms 1.5ms 30.5MB 660ms 17ms pyston 3.8.12
python 1.py 818ms 2.0ms 31.7MB 780ms 20ms cpython 3.11.4

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 4452ms 3.7ms 8.4MB 4433ms 0ms pyston 3.8.12
python 1.py 4692ms 27ms 8.5MB 4677ms 0ms cpython 3.11.4
python 1.py 4720ms 4.9ms 84.7MB 4693ms 13ms pypy 3.10.12

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1126ms 1.3ms 8.5MB 1113ms 0ms pyston 3.8.12
python 1.py 1182ms 6.4ms 8.4MB 1170ms 0ms cpython 3.11.4
python 1.py 1308ms 2.3ms 81.7MB 1270ms 23ms pypy 3.10.12

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 16.6MB 53ms 10ms cpython 3.11.4
python 8.py timeout 0.0ms 106.2MB 663ms 87ms pypy 3.10.12
python 8.py timeout 0.0ms 18.0MB 80ms 13ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 32.1MB 4973ms 7ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.7MB 4973ms 10ms ruby/yjit 3.2.2
ruby 4.rb timeout 0.0ms 533.5MB 5240ms 213ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 14.4MB 127ms 13ms cpython 3.11.4
python 8.py timeout 0.0ms 111.5MB 1110ms 217ms pypy 3.10.12
python 8.py timeout 0.0ms 15.6MB 140ms 30ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 32.2MB 4977ms 3ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.7MB 4973ms 7ms ruby/yjit 3.2.2
ruby 4.rb timeout 0.0ms 591.7MB 5390ms 237ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 2469ms 3.3ms 477.2MB 2927ms 177ms truffleruby 22.3.1
python 8-m.py 3124ms 25ms 105.3MB 5340ms 337ms pypy 3.10.12
python 8.py timeout 0.0ms 16.2MB 263ms 17ms cpython 3.11.4
python 8.py timeout 0.0ms 16.7MB 320ms 57ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 32.4MB 4973ms 7ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.2