Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 1.cpp | 2.4ms | 0.7ms | 1.3MB | 0ms | 0ms | g++ 12.2.0 |
cpp | 1.cpp | 2.4ms | 0.7ms | 1.4MB | 0ms | 0ms | clang++ 14.0.0 |
ruby | 1.rb | 54ms | 1.8ms | 153.4MB | 30ms | 28ms | truffleruby 22.3.1 |
ruby | 1.rb | 87ms | 1.1ms | 32.1MB | 52ms | 18ms | ruby 3.2.0 |
ruby | 1.rb | 91ms | 4.1ms | 32.3MB | 64ms | 14ms | ruby/yjit 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ruby | 1.rb | 547ms | 7.6ms | 33.0MB | 513ms | 20ms | ruby/yjit 3.2.0 |
ruby | 1.rb | 783ms | 2.8ms | 32.4MB | 753ms | 13ms | ruby 3.2.0 |
ruby | 1-m.rb | 991ms | 25ms | 326.0MB | 1430ms | 137ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 0-i.cpp | 218ms | 1.5ms | 1.4MB | 203ms | 0ms | g++ 12.2.0 |
cpp | 0-i.cpp | 253ms | 4.3ms | 1.4MB | 243ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 413ms | 9.0ms | 1.4MB | 400ms | 0ms | g++ 12.2.0 |
cpp | 1.cpp | 417ms | 9.1ms | 1.5MB | 407ms | 0ms | clang++ 14.0.0 |
ruby | 2.rb | 1435ms | 12ms | 298.5MB | 1713ms | 100ms | truffleruby 22.3.1 |
ruby | 2.rb | timeout | 0.0ms | 32.2MB | 4970ms | 13ms | ruby 3.2.0 |
ruby | 2.rb | timeout | 0.0ms | 33.0MB | 4963ms | 13ms | ruby/yjit 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 0-i.cpp | 25ms | 0.3ms | 1.3MB | 13ms | 0ms | g++ 12.2.0 |
cpp | 0-i.cpp | 28ms | 0.2ms | 1.4MB | 20ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 45ms | 0.3ms | 1.4MB | 40ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 46ms | 1.9ms | 1.3MB | 40ms | 0ms | g++ 12.2.0 |
ruby | 2-m.rb | 513ms | 25ms | 309.9MB | 770ms | 127ms | truffleruby 22.3.1 |
ruby | 2.rb | 2528ms | 32ms | 33.1MB | 2487ms | 23ms | ruby/yjit 3.2.0 |
ruby | 2.rb | 4072ms | 73ms | 32.2MB | 4043ms | 13ms | ruby 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 1.cpp | 769ms | 8.0ms | 7.4MB | 750ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 769ms | 17ms | 7.7MB | 753ms | 0ms | g++ 12.2.0 |
ruby | 1.rb | timeout | 0.0ms | 344.6MB | 4780ms | 197ms | ruby 3.2.0 |
ruby | 1.rb | timeout | 0.0ms | 344.9MB | 4787ms | 190ms | ruby/yjit 3.2.0 |
ruby | 1.rb | timeout | 0.0ms | 682.1MB | 5030ms | 217ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 1.cpp | 177ms | 1.4ms | 4.0MB | 167ms | 0ms | g++ 12.2.0 |
cpp | 1.cpp | 185ms | 4.4ms | 3.9MB | 173ms | 0ms | clang++ 14.0.0 |
ruby | 1.rb | 3780ms | 6.1ms | 431.4MB | 4390ms | 167ms | truffleruby 22.3.1 |
ruby | 1.rb | timeout | 0.0ms | 151.0MB | 4900ms | 77ms | ruby 3.2.0 |
ruby | 1.rb | timeout | 0.0ms | 151.5MB | 4893ms | 90ms | ruby/yjit 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 8-m.cpp | 1061ms | 4.5ms | 3.7MB | 2067ms | 3ms | clang++ 14.0.0 |
cpp | 7-m.cpp | 1065ms | 5.3ms | 3.3MB | 2080ms | 0ms | clang++ 14.0.0 |
cpp | 8-m.cpp | 1071ms | 5.9ms | 1.3MB | 2087ms | 0ms | g++ 12.2.0 |
cpp | 7-m.cpp | 1071ms | 11ms | 1.4MB | 2073ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 2187ms | 29ms | 1.3MB | 4277ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 2209ms | 24ms | 3.4MB | 4327ms | 3ms | clang++ 14.0.0 |
ruby | 4.rb | timeout | 0.0ms | 32.2MB | 4967ms | 10ms | ruby 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.9MB | 4973ms | 13ms | ruby/yjit 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 404.5MB | 5227ms | 213ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 7-m.cpp | 271ms | 2.1ms | 1.3MB | 510ms | 0ms | g++ 12.2.0 |
cpp | 7-m.cpp | 278ms | 3.3ms | 3.3MB | 517ms | 0ms | clang++ 14.0.0 |
cpp | 8-m.cpp | 281ms | 2.7ms | 1.3MB | 523ms | 0ms | g++ 12.2.0 |
cpp | 8-m.cpp | 283ms | 8.5ms | 3.5MB | 527ms | 0ms | clang++ 14.0.0 |
cpp | 6-im.cpp | 546ms | 13ms | 1.3MB | 1053ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 560ms | 0.6ms | 3.3MB | 1077ms | 3ms | clang++ 14.0.0 |
ruby | 4.rb | timeout | 0.0ms | 32.2MB | 4970ms | 17ms | ruby 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.8MB | 4957ms | 20ms | ruby/yjit 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 460.5MB | 5583ms | 183ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 7-m.cpp | 73ms | 1.9ms | 1.4MB | 120ms | 0ms | g++ 12.2.0 |
cpp | 8-m.cpp | 77ms | 0.2ms | 3.3MB | 130ms | 0ms | clang++ 14.0.0 |
cpp | 8-m.cpp | 78ms | 1.5ms | 1.3MB | 130ms | 0ms | g++ 12.2.0 |
cpp | 7-m.cpp | 79ms | 2.5ms | 3.5MB | 130ms | 0ms | clang++ 14.0.0 |
cpp | 6-im.cpp | 151ms | 0.9ms | 1.3MB | 273ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 152ms | 0.4ms | 3.7MB | 273ms | 0ms | clang++ 14.0.0 |
ruby | 4.rb | 3275ms | 18ms | 360.5MB | 3963ms | 167ms | truffleruby 22.3.1 |
ruby | 4.rb | timeout | 0.0ms | 32.0MB | 4960ms | 23ms | ruby 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.9MB | 4967ms | 10ms | ruby/yjit 3.2.0 |