Ruby VS Wasm benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1991ms 14ms 51.1MB 1967ms 7ms wasmedgec 0.11.0
wasm 3.rs 2042ms 6.2ms 37.8MB 2010ms 17ms wasmer/llvm 2.3.0
wasm 5.rs 2143ms 150ms 35.0MB 2123ms 0ms wasmedgec 0.11.0
wasm 4.rs 2223ms 3.6ms 34.4MB 2203ms 7ms wasmedgec 0.11.0
wasm 4.rs 2416ms 8.0ms 21.7MB 2390ms 7ms wasmer/llvm 2.3.0
wasm 3.rs 2477ms 19ms 42.5MB 2457ms 0ms wasmtime 1.0.0
wasm 5.rs 2565ms 1.4ms 21.9MB 2547ms 10ms wasmer/llvm 2.3.0
wasm 5.rs 2651ms 56ms 59.5MB 2637ms 17ms node 16.17.0
wasm 4.rs 2771ms 42ms 58.6MB 2777ms 13ms node 16.17.0
wasm 3.rs 2796ms 31ms 78.0MB 2793ms 20ms node 16.17.0
wasm 5.rs 2916ms 20ms 26.6MB 2893ms 7ms wasmtime 1.0.0
wasm 4.rs 3153ms 28ms 26.5MB 3130ms 7ms wasmtime 1.0.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 192ms 0.5ms 9.8MB 173ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 194ms 7.6ms 23.0MB 180ms 0ms wasmedgec 0.11.0
wasm 5.rs 211ms 19ms 21.0MB 197ms 0ms wasmedgec 0.11.0
wasm 4.rs 222ms 11ms 20.8MB 210ms 0ms wasmedgec 0.11.0
wasm 4.rs 227ms 0.3ms 8.0MB 217ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 234ms 1.5ms 14.5MB 220ms 0ms wasmtime 1.0.0
wasm 5.rs 244ms 0.1ms 7.9MB 230ms 0ms wasmer/llvm 2.3.0
wasm 5.rs 280ms 8.4ms 12.6MB 263ms 0ms wasmtime 1.0.0
wasm 4.rs 301ms 4.3ms 12.6MB 283ms 3ms wasmtime 1.0.0
wasm 3.rs 332ms 5.2ms 46.4MB 340ms 3ms node 16.17.0
wasm 4.rs 339ms 8.9ms 44.0MB 353ms 7ms node 16.17.0
wasm 5.rs 369ms 16ms 45.6MB 347ms 10ms node 16.17.0
ruby 1-m.rb 893ms 4.8ms 400.8MB 1437ms 140ms truffleruby 22.2.0
ruby 1.rb 909ms 3.9ms 292.0MB 757ms 133ms ruby/yjit 3.1.2
ruby 1.rb 973ms 6.2ms 35.5MB 940ms 17ms ruby 3.1.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1268ms 0.5ms 8.0MB 1257ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 1530ms 20ms 48.2MB 1570ms 20ms node 16.17.0
wasm 3.rs 1588ms 41ms 12.6MB 1573ms 0ms wasmtime 1.0.0
wasm 3.rs 1938ms 4.0ms 22.6MB 1920ms 3ms wasmedgec 0.11.0
ruby 1.rb 3096ms 14ms 336.6MB 2900ms 177ms ruby/yjit 3.1.2
ruby 1.rb 3554ms 6.1ms 80.2MB 3490ms 50ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 84ms 0.8ms 7.0MB 70ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 105ms 3.6ms 11.2MB 93ms 0ms wasmtime 1.0.0
wasm 3.rs 134ms 0.6ms 19.8MB 123ms 0ms wasmedgec 0.11.0
wasm 3.rs 216ms 4.3ms 48.2MB 267ms 7ms node 16.17.0
ruby 1.rb 240ms 4.4ms 42.2MB 200ms 20ms ruby 3.1.2
ruby 1.rb 382ms 1.7ms 298.8MB 227ms 143ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 347ms 0.2ms 6.1MB 333ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 350ms 2.0ms 9.5MB 337ms 0ms wasmtime 1.0.0
wasm 1.rs 359ms 0.2ms 18.9MB 340ms 0ms wasmedgec 0.11.0
wasm 1.rs 465ms 1.2ms 43.7MB 480ms 3ms node 16.17.0
ruby 6.rb 2845ms 14ms 296.0MB 2673ms 153ms ruby/yjit 3.1.2
ruby 6.rb 4360ms 38ms 39.4MB 4327ms 20ms ruby 3.1.2
ruby 6.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 38ms 0.2ms 6.1MB 30ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 42ms 0.6ms 9.2MB 30ms 0ms wasmtime 1.0.0
wasm 1.rs 44ms 0.5ms 18.5MB 37ms 0ms wasmedgec 0.11.0
wasm 1.rs 126ms 2.2ms 47.5MB 143ms 3ms node 16.17.0
ruby 6.rb 504ms 2.6ms 287.6MB 353ms 137ms ruby/yjit 3.1.2
ruby 6.rb 505ms 3.9ms 31.1MB 477ms 13ms ruby 3.1.2
ruby 6-m.rb 1331ms 21ms 387.2MB 2350ms 107ms truffleruby 22.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 2.7ms 0.5ms 4.9MB 0ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 6.0ms 0.9ms 9.2MB 0ms 0ms wasmtime 1.0.0
wasm 1.rs 8.5ms 2.6ms 18.4MB 0ms 0ms wasmedgec 0.11.0
ruby 1.rb 41ms 1.1ms 145.7MB 22ms 16ms truffleruby 22.2.0
ruby 1.rb 70ms 0.9ms 29.9MB 48ms 10ms ruby 3.1.2
wasm 1.rs 83ms 1.1ms 43.5MB 94ms 6ms node 16.17.0
ruby 1.rb 240ms 1.6ms 286.6MB 100ms 124ms ruby/yjit 3.1.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 430ms 1.4ms 49.3MB 397ms 23ms ruby 3.1.2
ruby 1.rb 600ms 1.7ms 305.1MB 437ms 143ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3872ms 2.8ms 160.1MB 3780ms 73ms ruby 3.1.2
ruby 1.rb 4140ms 173ms 418.9MB 3917ms 207ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 126ms 1.6ms 6.3MB 113ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 137ms 0.8ms 18.6MB 127ms 0ms wasmedgec 0.11.0
wasm 1.rs 149ms 1.7ms 10.9MB 140ms 0ms wasmtime 1.0.0
wasm 1.rs 227ms 4.3ms 44.6MB 243ms 7ms node 16.17.0
ruby 1.rb 609ms 6.2ms 30.2MB 580ms 10ms ruby 3.1.2
ruby 1.rb 627ms 4.1ms 286.6MB 487ms 127ms ruby/yjit 3.1.2
ruby 1-m.rb 746ms 6.4ms 314.0MB 1080ms 93ms truffleruby 22.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 368ms 1.6ms 6.3MB 360ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 401ms 6.7ms 19.2MB 387ms 0ms wasmedgec 0.11.0
wasm 1.rs 434ms 5.4ms 10.9MB 423ms 0ms wasmtime 1.0.0
wasm 1.rs 505ms 4.3ms 44.6MB 520ms 10ms node 16.17.0
ruby 1.rb 1388ms 18ms 286.8MB 1247ms 127ms ruby/yjit 3.1.2
ruby 1.rb 1391ms 3.8ms 339.8MB 1920ms 120ms truffleruby 22.2.0
ruby 1.rb 1675ms 30ms 30.2MB 1650ms 13ms ruby 3.1.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 62ms 1.3ms 4.9MB 50ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 71ms 0.5ms 18.6MB 60ms 0ms wasmedgec 0.11.0
wasm 1.rs 76ms 0.7ms 11.3MB 63ms 3ms wasmtime 1.0.0
wasm 1.rs 158ms 1.7ms 44.6MB 173ms 7ms node 16.17.0
ruby 1.rb 347ms 5.8ms 29.9MB 327ms 7ms ruby 3.1.2
ruby 1.rb 433ms 1.2ms 286.7MB 290ms 127ms ruby/yjit 3.1.2
ruby 1-m.rb 538ms 7.6ms 297.4MB 823ms 73ms truffleruby 22.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1079ms 4.2ms 42.4MB 1055ms 10ms wasmedgec 0.11.0
wasm 1.rs 1246ms 3.1ms 29.8MB 1213ms 17ms wasmer/llvm 2.3.0
wasm 1.rs 1372ms 11ms 67.5MB 1373ms 17ms node 16.17.0
wasm 1.rs 1434ms 9.1ms 34.5MB 1407ms 7ms wasmtime 1.0.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 235ms 1.5ms 24.4MB 217ms 3ms wasmedgec 0.11.0
wasm 1.rs 267ms 1.0ms 11.7MB 257ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 308ms 0.9ms 16.7MB 297ms 0ms wasmtime 1.0.0
wasm 1.rs 355ms 5.1ms 49.2MB 363ms 7ms node 16.17.0
ruby 1-m.rb 3161ms 37ms 580.5MB 5767ms 237ms truffleruby 22.2.0
ruby 1.rb 3960ms 18ms 300.9MB 3797ms 143ms ruby/yjit 3.1.2
ruby 1.rb 4792ms 15ms 44.4MB 4750ms 30ms ruby 3.1.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 469ms 1.1ms 4.9MB 457ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 497ms 0.9ms 9.6MB 487ms 0ms wasmtime 1.0.0
wasm 1.rs 501ms 1.0ms 18.5MB 483ms 0ms wasmedgec 0.11.0
wasm 1.rs 571ms 3.9ms 48.3MB 593ms 7ms node 16.17.0
wasm 2.rs 678ms 0.6ms 18.9MB 667ms 0ms wasmedgec 0.11.0
wasm 2.rs 679ms 1.0ms 9.7MB 663ms 0ms wasmtime 1.0.0
wasm 2.rs 688ms 0.2ms 4.9MB 677ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 758ms 12ms 48.3MB 783ms 10ms node 16.17.0
ruby 2.rb 1108ms 5.4ms 317.8MB 1390ms 100ms truffleruby 22.2.0
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 51ms 0.6ms 4.8MB 40ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 57ms 0.8ms 11.5MB 47ms 0ms wasmtime 1.0.0
wasm 1.rs 59ms 0.3ms 18.9MB 47ms 0ms wasmedgec 0.11.0
wasm 2.rs 72ms 0.5ms 4.8MB 60ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 75ms 0.2ms 11.4MB 60ms 0ms wasmtime 1.0.0
wasm 2.rs 78ms 3.4ms 18.7MB 63ms 0ms wasmedgec 0.11.0
wasm 1.rs 150ms 5.2ms 48.3MB 177ms 7ms node 16.17.0
wasm 2.rs 171ms 3.2ms 47.7MB 193ms 7ms node 16.17.0
ruby 2-m.rb 421ms 1.4ms 300.5MB 650ms 100ms truffleruby 22.2.0
ruby 2.rb 2353ms 2.0ms 286.7MB 2207ms 123ms ruby/yjit 3.1.2
ruby 2.rb 3241ms 15ms 29.9MB 3217ms 10ms ruby 3.1.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 510ms 2.9ms 10.8MB 493ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 560ms 2.5ms 23.3MB 543ms 3ms wasmedgec 0.11.0
wasm 2.rs 698ms 2.2ms 15.5MB 683ms 0ms wasmtime 1.0.0
wasm 2.rs 721ms 8.6ms 48.3MB 733ms 7ms node 16.17.0
wasm 1.rs 858ms 1.8ms 44.9MB 823ms 23ms wasmer/llvm 2.3.0
wasm 1.rs 871ms 40ms 57.0MB 850ms 10ms wasmedgec 0.11.0
wasm 1.rs 1014ms 62ms 83.3MB 1027ms 10ms node 16.17.0
wasm 1.rs 1338ms 34ms 49.7MB 1320ms 3ms wasmtime 1.0.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 119ms 0.7ms 7.3MB 107ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 139ms 1.1ms 20.1MB 123ms 0ms wasmedgec 0.11.0
wasm 1.rs 147ms 2.1ms 15.7MB 127ms 3ms wasmer/llvm 2.3.0
wasm 1.rs 151ms 0.2ms 29.6MB 140ms 0ms wasmedgec 0.11.0
wasm 2.rs 168ms 0.0ms 12.0MB 157ms 0ms wasmtime 1.0.0
wasm 1.rs 223ms 2.2ms 20.3MB 210ms 0ms wasmtime 1.0.0
wasm 1.rs 233ms 3.5ms 59.3MB 240ms 7ms node 16.17.0
wasm 2.rs 235ms 0.8ms 44.3MB 250ms 0ms node 16.17.0
ruby 1.rb 3198ms 35ms 463.2MB 3600ms 157ms truffleruby 22.2.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3010ms 8.2ms 7.0MB 2990ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 3124ms 6.9ms 18.9MB 3107ms 0ms wasmedgec 0.11.0
wasm 2.rs 3380ms 1.0ms 11.3MB 3370ms 0ms wasmtime 1.0.0
wasm 2.rs 3675ms 39ms 48.1MB 3717ms 10ms node 16.17.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 709ms 3.6ms 6.3MB 697ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 745ms 5.2ms 19.6MB 727ms 0ms wasmedgec 0.11.0
wasm 2.rs 802ms 0.3ms 10.9MB 790ms 0ms wasmtime 1.0.0
wasm 2.rs 961ms 7.8ms 48.7MB 1007ms 10ms node 16.17.0
ruby 1-m.rb 1925ms 1.4ms 383.9MB 3523ms 147ms truffleruby 22.2.0
ruby 1.rb 2499ms 1.8ms 161.8MB 2413ms 67ms ruby 3.1.2
ruby 1.rb 2661ms 4.8ms 420.8MB 2450ms 193ms ruby/yjit 3.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 4126ms 1.0ms 19.2MB 4113ms 0ms wasmedgec 0.11.0
wasm 7.rs 4194ms 1.2ms 6.0MB 4180ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 4266ms 0.6ms 18.7MB 4257ms 0ms wasmedgec 0.11.0
wasm 2.rs 4298ms 5.4ms 48.2MB 4320ms 10ms node 16.17.0
wasm 2.rs 4396ms 1.1ms 6.1MB 4380ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 4506ms 11ms 52.0MB 4527ms 7ms node 16.17.0
wasm 2.rs 4534ms 12ms 11.0MB 4520ms 0ms wasmtime 1.0.0
wasm 7.rs 4610ms 2.4ms 10.9MB 4600ms 0ms wasmtime 1.0.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 1039ms 0.6ms 19.2MB 1027ms 0ms wasmedgec 0.11.0
wasm 7.rs 1052ms 1.1ms 6.0MB 1040ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 1074ms 1.0ms 18.6MB 1063ms 0ms wasmedgec 0.11.0
wasm 2.rs 1102ms 1.1ms 6.2MB 1090ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 1143ms 3.4ms 48.7MB 1177ms 3ms node 16.17.0
wasm 2.rs 1146ms 1.0ms 12.9MB 1133ms 0ms wasmtime 1.0.0
wasm 7.rs 1160ms 0.2ms 11.5MB 1147ms 0ms wasmtime 1.0.0
wasm 7.rs 1207ms 2.4ms 48.3MB 1230ms 10ms node 16.17.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 7.rs 266ms 0.6ms 4.9MB 253ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 267ms 0.4ms 18.5MB 253ms 0ms wasmedgec 0.11.0
wasm 7.rs 277ms 2.1ms 19.1MB 263ms 0ms wasmedgec 0.11.0
wasm 2.rs 279ms 0.3ms 4.9MB 263ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 293ms 0.3ms 9.7MB 280ms 0ms wasmtime 1.0.0
wasm 7.rs 296ms 0.3ms 9.4MB 283ms 0ms wasmtime 1.0.0
wasm 2.rs 366ms 5.1ms 48.3MB 397ms 0ms node 16.17.0
wasm 7.rs 379ms 1.5ms 48.6MB 397ms 13ms node 16.17.0
ruby 4.rb 2456ms 33ms 462.5MB 2987ms 150ms truffleruby 22.2.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2