Programming Language and compiler
Benchmarks

Python VS Ruby benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1472ms 22ms 274.2MB 1347ms 113ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 126ms 20ms 83.2MB 90ms 13ms pypy 3.8.13
python 1.py 607ms 2.1ms 11.9MB 577ms 7ms pyston 3.8.12
ruby 1-m.rb 895ms 44ms 398.0MB 1443ms 123ms truffleruby 22.2.0
ruby 1.rb 905ms 6.4ms 292.0MB 750ms 140ms ruby/yjit 3.1.2
ruby 1.rb 973ms 7.5ms 35.5MB 940ms 13ms ruby 3.1.2
python 1.py 1507ms 5.3ms 11.9MB 1493ms 0ms cpython 3.10.7

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1089ms 26ms 197.1MB 1007ms 63ms pypy 3.8.13
ruby 1.rb 3004ms 31ms 336.7MB 2820ms 170ms ruby/yjit 3.1.2
ruby 1.rb 3497ms 38ms 80.1MB 3437ms 47ms ruby 3.1.2
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 238ms 2.6ms 42.3MB 213ms 10ms ruby 3.1.2
python 1.py 276ms 9.7ms 95.5MB 233ms 20ms pypy 3.8.13
ruby 1.rb 385ms 0.9ms 298.8MB 220ms 147ms ruby/yjit 3.1.2
python 1.py 936ms 4.7ms 16.9MB 913ms 3ms pyston 3.8.12
python 1.py 989ms 23ms 17.1MB 967ms 0ms cpython 3.10.7
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 825ms 3.2ms 88.0MB 797ms 10ms pypy 3.8.13
python 1.py 1668ms 0.6ms 9.3MB 1650ms 3ms cpython 3.10.7
python 1.py 2780ms 0.6ms 9.6MB 2763ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 212ms 0.7ms 81.9MB 187ms 10ms pypy 3.8.13
python 1.py 307ms 0.8ms 8.5MB 293ms 0ms cpython 3.10.7
python 1.py 479ms 0.5ms 8.9MB 463ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2517ms 15ms 91.2MB 2477ms 23ms pypy 3.8.13
ruby 6.rb 2830ms 20ms 294.2MB 2673ms 143ms ruby/yjit 3.1.2
python 5-m.py 3868ms 429ms 12.7MB 5843ms 990ms pyston 3.8.12
python 5-m.py 3977ms 29ms 85.3MB 5397ms 1067ms pypy 3.8.13
python 1.py 4077ms 6.7ms 7.9MB 4053ms 7ms pyston 3.8.12
ruby 6.rb 4361ms 42ms 39.5MB 4333ms 13ms ruby 3.1.2
python 5-m.py 4457ms 38ms 12.1MB 6397ms 1020ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
ruby 6.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 332ms 0.7ms 81.8MB 303ms 13ms pypy 3.8.13
python 1.py 425ms 3.2ms 7.9MB 410ms 0ms pyston 3.8.12
python 5-m.py 425ms 34ms 12.6MB 587ms 123ms pyston 3.8.12
ruby 6.rb 505ms 0.8ms 287.7MB 347ms 140ms ruby/yjit 3.1.2
ruby 6.rb 507ms 3.5ms 31.1MB 483ms 10ms ruby 3.1.2
python 5-m.py 535ms 34ms 12.0MB 680ms 137ms cpython 3.10.7
python 1.py 708ms 1.9ms 7.7MB 693ms 0ms cpython 3.10.7
python 5-m.py 815ms 3.9ms 85.3MB 753ms 367ms pypy 3.8.13
ruby 6-m.rb 1309ms 25ms 359.3MB 2303ms 120ms truffleruby 22.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 14ms 0.8ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 0.6ms 7.6MB 10ms 0ms cpython 3.10.7
python 1.py 32ms 0.6ms 54.9MB 16ms 2ms pypy 3.8.13
ruby 1.rb 42ms 2.5ms 148.7MB 18ms 22ms truffleruby 22.2.0
ruby 1.rb 70ms 0.2ms 30.0MB 48ms 6ms ruby 3.1.2
ruby 1.rb 238ms 0.3ms 286.6MB 94ms 134ms ruby/yjit 3.1.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1542ms 2.9ms 29.3MB 1303ms 873ms pyston 3.8.12
python 1.py 2184ms 12ms 27.3MB 1953ms 963ms cpython 3.10.7
python 1.py 4220ms 24ms 132.1MB 3360ms 767ms pypy 3.8.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 355ms 1.7ms 23.9MB 267ms 177ms pyston 3.8.12
python 1.py 439ms 7.6ms 21.8MB 373ms 170ms cpython 3.10.7
python 1.py 1070ms 30ms 106.7MB 870ms 163ms pypy 3.8.13

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 255ms 3.8ms 38.3MB 217ms 20ms pyston 3.8.12
python 1.py 262ms 1.6ms 39.5MB 233ms 10ms cpython 3.10.7
python 1.py 424ms 4.9ms 109.1MB 377ms 27ms pypy 3.8.13
ruby 1.rb 437ms 10.0ms 49.4MB 397ms 20ms ruby 3.1.2
ruby 1.rb 601ms 0.7ms 306.3MB 437ms 143ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2348ms 9.0ms 219.6MB 2217ms 110ms cpython 3.10.7
python 1.py 2350ms 3.3ms 220.6MB 2197ms 133ms pyston 3.8.12
python 1.py 2611ms 53ms 248.9MB 2500ms 70ms pypy 3.8.13
ruby 1.rb 3871ms 3.8ms 163.2MB 3773ms 80ms ruby 3.1.2
ruby 1.rb 4038ms 3.0ms 419.5MB 3827ms 193ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 3515ms 48ms 205.0MB 6187ms 313ms pypy 3.8.13
python 3-m.py 4985ms 4.6ms 34.1MB 9550ms 67ms pyston 3.8.12
python 3.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 522ms 2.5ms 97.2MB 740ms 113ms pypy 3.8.13
python 3-m.py 586ms 4.7ms 15.4MB 1037ms 23ms pyston 3.8.12
python 3-m.py 834ms 4.3ms 15.3MB 1523ms 13ms cpython 3.10.7

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 206ms 8.8ms 80.0MB 177ms 13ms pypy 3.8.13
python 1.py 239ms 0.8ms 81.1MB 213ms 13ms pypy 3.8.13
ruby 1.rb 615ms 14ms 30.1MB 593ms 10ms ruby 3.1.2
ruby 1.rb 628ms 4.4ms 286.7MB 473ms 137ms ruby/yjit 3.1.2
ruby 1-m.rb 773ms 57ms 312.0MB 1127ms 97ms truffleruby 22.2.0
python 1.py 980ms 3.6ms 9.0MB 963ms 0ms pyston 3.8.12
python 2.py 1155ms 3.7ms 8.7MB 1140ms 0ms pyston 3.8.12
python 1.py 1854ms 29ms 8.4MB 1843ms 0ms cpython 3.10.7
python 2.py 2594ms 29ms 8.3MB 2583ms 0ms cpython 3.10.7

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 469ms 1.8ms 80.3MB 437ms 13ms pypy 3.8.13
python 1.py 509ms 5.6ms 81.5MB 490ms 7ms pypy 3.8.13
ruby 1.rb 1391ms 9.5ms 286.8MB 1243ms 130ms ruby/yjit 3.1.2
ruby 1.rb 1431ms 73ms 353.1MB 1917ms 123ms truffleruby 22.2.0
ruby 1.rb 1660ms 16ms 30.2MB 1640ms 7ms ruby 3.1.2
python 1.py 2897ms 7.1ms 9.0MB 2880ms 0ms pyston 3.8.12
python 2.py 3450ms 16ms 8.7MB 3437ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 147ms 2.5ms 80.0MB 120ms 10ms pypy 3.8.13
python 1.py 162ms 1.0ms 81.0MB 130ms 20ms pypy 3.8.13
ruby 1.rb 337ms 2.5ms 29.9MB 317ms 7ms ruby 3.1.2
ruby 1.rb 433ms 1.4ms 286.6MB 270ms 140ms ruby/yjit 3.1.2
python 1.py 477ms 4.2ms 8.7MB 457ms 0ms pyston 3.8.12
python 2.py 540ms 4.5ms 8.2MB 527ms 0ms pyston 3.8.12
ruby 1-m.rb 568ms 48ms 298.6MB 857ms 90ms truffleruby 22.2.0
python 1.py 869ms 9.9ms 7.9MB 857ms 0ms cpython 3.10.7
python 2.py 1253ms 11ms 7.3MB 1237ms 0ms cpython 3.10.7

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2242ms 17ms 293.8MB 2047ms 177ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 333ms 6.8ms 145.2MB 270ms 43ms pypy 3.8.13
ruby 1-m.rb 3172ms 18ms 560.6MB 5827ms 207ms truffleruby 22.2.0
ruby 1.rb 3949ms 15ms 300.8MB 3790ms 140ms ruby/yjit 3.1.2
ruby 1.rb 4772ms 16ms 44.3MB 4743ms 13ms ruby 3.1.2
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 1111ms 6.0ms 308.1MB 1390ms 97ms truffleruby 22.2.0
python 2.py 1898ms 18ms 79.9MB 1873ms 10ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 249ms 3.9ms 79.8MB 220ms 10ms pypy 3.8.13
ruby 2-m.rb 423ms 4.0ms 302.6MB 670ms 80ms truffleruby 22.2.0
python 1.py 560ms 16ms 79.4MB 523ms 13ms pypy 3.8.13
python 1.py 1195ms 5.3ms 8.3MB 1180ms 0ms pyston 3.8.12
python 2.py 1583ms 1.2ms 8.2MB 1570ms 0ms pyston 3.8.12
ruby 2.rb 2352ms 4.8ms 286.8MB 2207ms 127ms ruby/yjit 3.1.2
ruby 2.rb 3223ms 7.6ms 29.9MB 3193ms 10ms ruby 3.1.2
python 1.py 4606ms 4.4ms 7.2MB 4597ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3979ms 12ms 391.6MB 3850ms 110ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 985ms 51ms 215.7MB 930ms 37ms pypy 3.8.13
python 1.py 1795ms 29ms 86.0MB 1750ms 27ms pyston 3.8.12
ruby 1.rb 3126ms 96ms 474.9MB 3563ms 120ms truffleruby 22.2.0
python 1.py 4178ms 13ms 85.9MB 4140ms 23ms cpython 3.10.7
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2593ms 5.4ms 119.3MB 2537ms 43ms pypy 3.8.13
python 4.py 2770ms 1.9ms 8.6MB 2733ms 20ms cpython 3.10.7
python 4.py 2779ms 1.2ms 9.0MB 2740ms 20ms pyston 3.8.12
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 652ms 5.0ms 84.5MB 630ms 10ms pypy 3.8.13
python 4.py 657ms 1.0ms 8.6MB 640ms 0ms pyston 3.8.12
python 4.py 661ms 1.8ms 8.3MB 650ms 0ms cpython 3.10.7
ruby 1-m.rb 1926ms 9.5ms 380.4MB 3533ms 143ms truffleruby 22.2.0
ruby 1.rb 2511ms 13ms 162.8MB 2427ms 63ms ruby 3.1.2
ruby 1.rb 2672ms 16ms 420.8MB 2457ms 203ms ruby/yjit 3.1.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3319ms 6.1ms 264.1MB 3210ms 90ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 462ms 1.0ms 102.6MB 423ms 27ms pypy 3.8.13
python 1.py 696ms 3.9ms 30.3MB 670ms 10ms pyston 3.8.12
python 1.py 848ms 1.7ms 30.6MB 813ms 17ms cpython 3.10.7

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 4469ms 28ms 8.4MB 4457ms 0ms pyston 3.8.12
python 1.py 4785ms 6.9ms 87.1MB 4753ms 10ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1127ms 3.9ms 8.4MB 1113ms 0ms pyston 3.8.12
python 1.py 1348ms 2.4ms 84.4MB 1323ms 10ms pypy 3.8.13
python 1.py 1480ms 1.3ms 7.3MB 1463ms 0ms cpython 3.10.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 2469ms 15ms 445.3MB 3007ms 143ms truffleruby 22.2.0
python 8-m.py 3224ms 95ms 109.9MB 5487ms 373ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2