C++ VS Ruby benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 383ms 1.6ms 4.7MB 1463ms 0ms g++ 11.4.0
cpp 1-im.cpp 396ms 27ms 8.0MB 1473ms 3ms clang++ 14.0.0-1ubuntu1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 40ms 0.7ms 7.9MB 120ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1-im.cpp 40ms 0.7ms 4.5MB 133ms 0ms g++ 11.4.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.0ms 0.1ms 1.4MB 0ms 0ms g++ 11.4.0
cpp 1.cpp 1.8ms 1.0ms 2.1MB 0ms 0ms clang++ 14.0.0-1ubuntu1.1
ruby 1.rb 38ms 1.4ms 162.3MB 16ms 26ms truffleruby 24.1.1
ruby 1.rb 48ms 1.5ms 12.9MB 34ms 2ms ruby 3.4.1
ruby 1.rb 50ms 1.0ms 13.1MB 36ms 4ms ruby/yjit 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 158ms 1.3ms 1.5MB 150ms 0ms g++ 11.4.0
cpp 0-i.cpp 168ms 2.5ms 2.3MB 160ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 294ms 0.7ms 1.8MB 280ms 0ms g++ 11.4.0
cpp 1.cpp 298ms 3.2ms 2.3MB 287ms 0ms clang++ 14.0.0-1ubuntu1.1
ruby 2.rb 801ms 6.0ms 328.7MB 1027ms 110ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 17ms 0.2ms 1.5MB 10ms 0ms g++ 11.4.0
cpp 0-i.cpp 18ms 0.1ms 2.3MB 10ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 32ms 0.4ms 1.8MB 20ms 0ms g++ 11.4.0
cpp 1.cpp 33ms 0.7ms 2.3MB 23ms 0ms clang++ 14.0.0-1ubuntu1.1
ruby 2-m.rb 305ms 2.6ms 328.7MB 530ms 113ms truffleruby 24.1.1
ruby 2.rb 999ms 5.7ms 13.6MB 980ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2623ms 37ms 12.9MB 2607ms 3ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 463ms 15ms 7.3MB 447ms 0ms g++ 11.4.0
cpp 1.cpp 499ms 2.6ms 7.7MB 487ms 0ms clang++ 14.0.0-1ubuntu1.1
ruby 1.rb timeout 0.0ms 325.3MB 4843ms 140ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.1MB 4863ms 123ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 785.4MB 5060ms 150ms truffleruby 24.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 113ms 2.5ms 3.6MB 100ms 0ms g++ 11.4.0
cpp 1.cpp 125ms 0.9ms 4.0MB 113ms 0ms clang++ 14.0.0-1ubuntu1.1
ruby 1-m.rb 1601ms 15ms 491.7MB 2290ms 177ms truffleruby 24.1.1
ruby 1.rb 3191ms 32ms 131.9MB 3100ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4269ms 40ms 131.1MB 4180ms 73ms ruby 3.4.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 458ms 3.4ms 4.2MB 1780ms 0ms g++ 11.4.0
cpp 8-m.cpp 459ms 22ms 7.3MB 1757ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 876ms 7.8ms 7.4MB 3420ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 885ms 20ms 4.2MB 3437ms 3ms g++ 11.4.0
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4983ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 452.3MB 5147ms 223ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 118ms 1.8ms 7.4MB 433ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 126ms 5.2ms 4.1MB 463ms 0ms g++ 11.4.0
cpp 6-im.cpp 225ms 2.6ms 7.4MB 847ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 226ms 2.7ms 4.1MB 857ms 0ms g++ 11.4.0
ruby 4.rb 4148ms 29ms 427.7MB 4383ms 190ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 37ms 0.9ms 4.0MB 117ms 0ms g++ 11.4.0
cpp 8-m.cpp 42ms 11ms 7.4MB 117ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 64ms 1.6ms 7.3MB 210ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 64ms 0.1ms 4.0MB 227ms 0ms g++ 11.4.0
ruby 4.rb 1193ms 53ms 393.2MB 1497ms 130ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4977ms 3ms ruby/yjit 3.4.1