Current benchmark data was generated on Sun Jan 29 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 1.cpp | 1.7ms | 0.4ms | 1.3MB | 0ms | 0ms | g++ 12.2.0 |
cpp | 1.cpp | 1.9ms | 0.6ms | 1.4MB | 0ms | 0ms | clang++ 14.0.0 |
ruby | 1.rb | 41ms | 2.6ms | 156.3MB | 16ms | 26ms | truffleruby 22.3.1 |
ruby | 1.rb | 72ms | 0.3ms | 32.5MB | 46ms | 14ms | ruby/yjit 3.2.0 |
ruby | 1.rb | 72ms | 0.5ms | 32.1MB | 48ms | 12ms | ruby 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 0-i.cpp | 225ms | 0.6ms | 1.3MB | 210ms | 0ms | g++ 12.2.0 |
cpp | 0-i.cpp | 253ms | 0.3ms | 1.4MB | 240ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 327ms | 1.4ms | 1.4MB | 313ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 341ms | 0.6ms | 1.3MB | 330ms | 0ms | g++ 12.2.0 |
ruby | 2.rb | 1013ms | 1.8ms | 306.6MB | 1220ms | 67ms | truffleruby 22.3.1 |
ruby | 2.rb | timeout | 0.0ms | 32.2MB | 4973ms | 10ms | ruby 3.2.0 |
ruby | 2.rb | timeout | 0.0ms | 33.0MB | 4967ms | 17ms | ruby/yjit 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 0-i.cpp | 25ms | 0.7ms | 1.3MB | 13ms | 0ms | g++ 12.2.0 |
cpp | 0-i.cpp | 28ms | 0.5ms | 1.4MB | 20ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 35ms | 0.3ms | 1.4MB | 23ms | 0ms | clang++ 14.0.0 |
cpp | 1.cpp | 38ms | 2.9ms | 1.3MB | 30ms | 0ms | g++ 12.2.0 |
ruby | 2-m.rb | 380ms | 2.8ms | 305.0MB | 580ms | 73ms | truffleruby 22.3.1 |
ruby | 2.rb | 2169ms | 0.8ms | 33.0MB | 2140ms | 10ms | ruby/yjit 3.2.0 |
ruby | 2.rb | 3369ms | 22ms | 32.2MB | 3340ms | 13ms | ruby 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 1.cpp | 641ms | 0.7ms | 7.6MB | 627ms | 0ms | g++ 12.2.0 |
cpp | 1.cpp | 707ms | 2.2ms | 7.5MB | 697ms | 0ms | clang++ 14.0.0 |
ruby | 1.rb | timeout | 0.0ms | 344.6MB | 4850ms | 123ms | ruby 3.2.0 |
ruby | 1.rb | timeout | 0.0ms | 345.1MB | 4833ms | 143ms | ruby/yjit 3.2.0 |
ruby | 1.rb | timeout | 0.0ms | 689.3MB | 5030ms | 153ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 1.cpp | 153ms | 0.2ms | 3.9MB | 140ms | 0ms | g++ 12.2.0 |
cpp | 1.cpp | 170ms | 1.3ms | 3.9MB | 160ms | 0ms | clang++ 14.0.0 |
ruby | 1.rb | 2733ms | 12ms | 428.6MB | 3227ms | 123ms | truffleruby 22.3.1 |
ruby | 1.rb | timeout | 0.0ms | 151.1MB | 4910ms | 70ms | ruby 3.2.0 |
ruby | 1.rb | timeout | 0.0ms | 151.5MB | 4910ms | 70ms | ruby/yjit 3.2.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 8-m.cpp | 1059ms | 1.1ms | 3.3MB | 2070ms | 3ms | clang++ 14.0.0 |
cpp | 7-m.cpp | 1063ms | 0.2ms | 3.4MB | 2077ms | 0ms | clang++ 14.0.0 |
cpp | 7-m.cpp | 1064ms | 4.4ms | 1.4MB | 2083ms | 0ms | g++ 12.2.0 |
cpp | 8-m.cpp | 1066ms | 1.8ms | 1.3MB | 2083ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 2222ms | 12ms | 3.3MB | 4360ms | 3ms | clang++ 14.0.0 |
cpp | 6-im.cpp | 2236ms | 14ms | 1.3MB | 4390ms | 3ms | g++ 12.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.2MB | 4977ms | 7ms | ruby 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.8MB | 4973ms | 10ms | ruby/yjit 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 585.6MB | 5217ms | 223ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 8-m.cpp | 275ms | 0.8ms | 1.3MB | 520ms | 0ms | g++ 12.2.0 |
cpp | 8-m.cpp | 275ms | 1.2ms | 3.3MB | 517ms | 0ms | clang++ 14.0.0 |
cpp | 7-m.cpp | 276ms | 1.6ms | 3.3MB | 520ms | 0ms | clang++ 14.0.0 |
cpp | 7-m.cpp | 276ms | 1.2ms | 1.4MB | 520ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 565ms | 2.3ms | 1.3MB | 1087ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 574ms | 22ms | 3.3MB | 1100ms | 0ms | clang++ 14.0.0 |
ruby | 4.rb | timeout | 0.0ms | 32.1MB | 4970ms | 10ms | ruby 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.8MB | 4973ms | 10ms | ruby/yjit 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 580.5MB | 5417ms | 200ms | truffleruby 22.3.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
cpp | 7-m.cpp | 76ms | 1.3ms | 3.3MB | 130ms | 0ms | clang++ 14.0.0 |
cpp | 7-m.cpp | 77ms | 1.8ms | 1.4MB | 130ms | 0ms | g++ 12.2.0 |
cpp | 8-m.cpp | 77ms | 1.6ms | 3.3MB | 130ms | 0ms | clang++ 14.0.0 |
cpp | 8-m.cpp | 79ms | 2.0ms | 1.4MB | 130ms | 0ms | g++ 12.2.0 |
cpp | 6-im.cpp | 150ms | 2.7ms | 3.4MB | 273ms | 0ms | clang++ 14.0.0 |
cpp | 6-im.cpp | 150ms | 1.0ms | 1.3MB | 273ms | 0ms | g++ 12.2.0 |
ruby | 4.rb | 2454ms | 2.0ms | 479.2MB | 2940ms | 143ms | truffleruby 22.3.1 |
ruby | 4.rb | timeout | 0.0ms | 32.4MB | 4970ms | 7ms | ruby 3.2.0 |
ruby | 4.rb | timeout | 0.0ms | 32.8MB | 4967ms | 13ms | ruby/yjit 3.2.0 |