Lua VS C# benchmarks

Current benchmark data was generated on Wed Sep 28 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1331ms 9.4ms 391.1MB 1237ms 157ms dotnet 6.0.401
csharp 1.cs 2177ms 35ms 102.7MB 2453ms 197ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 151ms 2.5ms 44.6MB 130ms 7ms mono 6.12.0
csharp 1.cs 184ms 6.7ms 90.9MB 140ms 23ms dotnet 6.0.401
lua 1.lua 426ms 22ms 25.1MB 410ms 0ms luajit 2.1.0-beta3
lua 1.lua 1044ms 6.9ms 17.3MB 1023ms 0ms lua 5.4.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.7ms 0.6ms 2.2MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 2.8ms 0.5ms 1.1MB 0ms 0ms lua 5.4.4
csharp 1.cs 18ms 1.2ms 24.3MB 10ms 0ms mono 6.12.0
csharp 1.cs 51ms 1.8ms 29.1MB 20ms 2ms dotnet 6.0.401

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 921ms 4.2ms 391.9MB 793ms 163ms dotnet 6.0.401
csharp 2.cs 927ms 18ms 378.4MB 787ms 173ms dotnet 6.0.401
csharp 1.cs 1675ms 7.1ms 148.6MB 2093ms 110ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 252ms 2.7ms 94.2MB 203ms 30ms dotnet 6.0.401
csharp 1.cs 291ms 3.1ms 185.8MB 197ms 73ms dotnet 6.0.401
csharp 1.cs 306ms 5.3ms 72.7MB 277ms 27ms mono 6.12.0
lua 1.lua 1528ms 19ms 35.4MB 1510ms 3ms luajit 2.1.0-beta3
lua 1.lua 2788ms 47ms 41.5MB 2760ms 13ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 404ms 2.6ms 29.3MB 377ms 3ms dotnet 6.0.401
csharp 8.cs 532ms 4.1ms 25.4MB 503ms 3ms dotnet 6.0.401
lua 4.lua 1094ms 2.2ms 2.4MB 1083ms 0ms luajit 2.1.0-beta3
csharp 8.cs 1107ms 0.7ms 25.1MB 1090ms 0ms mono 6.12.0
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 91ms 6.8ms 29.4MB 63ms 3ms dotnet 6.0.401
csharp 8.cs 103ms 0.3ms 27.3MB 73ms 0ms dotnet 6.0.401
lua 4.lua 115ms 1.3ms 1.0MB 110ms 0ms luajit 2.1.0-beta3
csharp 8.cs 135ms 5.0ms 25.3MB 123ms 0ms mono 6.12.0
lua 4.lua 1177ms 5.5ms 1.1MB 1163ms 0ms lua 5.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2677ms 2.3ms 32.6MB 5163ms 10ms dotnet 6.0.401
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0-beta3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 714ms 1.1ms 30.3MB 1290ms 13ms dotnet 6.0.401
lua 1.lua 1550ms 1.3ms 2.4MB 1540ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 3179ms 76ms 27.6MB 6040ms 7ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 229ms 2.9ms 29.9MB 347ms 10ms dotnet 6.0.401
lua 1.lua 390ms 0.9ms 1.1MB 380ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 800ms 2.0ms 28.0MB 1520ms 3ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 560ms 3.0ms 5.0MB 547ms 0ms luajit 2.1.0-beta3
csharp 1-m.cs 4095ms 60ms 104.8MB 6900ms 57ms dotnet 6.0.401

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 39ms 1.7ms 2.9MB 30ms 0ms luajit 2.1.0-beta3
csharp 1-m.cs 414ms 34ms 88.5MB 643ms 33ms dotnet 6.0.401