Lua VS C# benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1595ms 35ms 305.1MB 1500ms 147ms dotnet 6.0.300
csharp 1.cs 2472ms 34ms 107.8MB 2887ms 257ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 164ms 1.0ms 44.7MB 137ms 13ms mono 6.12.0
csharp 1.cs 193ms 1.5ms 77.6MB 143ms 23ms dotnet 6.0.300
lua 1.lua 542ms 22ms 25.2MB 523ms 7ms luajit 2.1.0
lua 1.lua 1204ms 6.2ms 17.3MB 1183ms 3ms lua 5.4.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.1ms 0.7ms 2.2MB 0ms 0ms luajit 2.1.0
lua 1.lua 3.1ms 1.1ms 1.1MB 0ms 0ms lua 5.4.4
csharp 1.cs 22ms 0.9ms 25.8MB 10ms 0ms mono 6.12.0
csharp 1.cs 52ms 6.4ms 29.0MB 20ms 4ms dotnet 6.0.300

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1061ms 2.4ms 388.0MB 937ms 167ms dotnet 6.0.300
csharp 1.cs 1098ms 27ms 305.2MB 957ms 170ms dotnet 6.0.300
csharp 1.cs 1920ms 11ms 147.1MB 2480ms 123ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 308ms 5.3ms 135.0MB 213ms 70ms dotnet 6.0.300
csharp 1.cs 323ms 1.1ms 164.5MB 227ms 80ms dotnet 6.0.300
csharp 1.cs 346ms 0.7ms 74.4MB 317ms 47ms mono 6.12.0
lua 1.lua 2331ms 46ms 35.3MB 2293ms 17ms luajit 2.1.0
lua 1.lua 3310ms 64ms 41.5MB 3277ms 20ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 443ms 4.3ms 31.2MB 410ms 3ms dotnet 6.0.300
csharp 8.cs 618ms 8.4ms 27.2MB 583ms 7ms dotnet 6.0.300
lua 4.lua 1120ms 8.4ms 1.1MB 1107ms 0ms luajit 2.1.0
csharp 8.cs 1298ms 29ms 25.0MB 1280ms 0ms mono 6.12.0
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 96ms 3.5ms 27.2MB 60ms 0ms dotnet 6.0.300
csharp 8.cs 112ms 7.1ms 29.1MB 83ms 0ms dotnet 6.0.300
lua 4.lua 116ms 1.0ms 1.0MB 100ms 0ms luajit 2.1.0
csharp 8.cs 147ms 9.2ms 25.0MB 133ms 0ms mono 6.12.0
lua 4.lua 1449ms 38ms 1.1MB 1433ms 0ms lua 5.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2478ms 3.8ms 29.7MB 4743ms 17ms dotnet 6.0.300
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 686ms 0.7ms 30.1MB 1230ms 10ms dotnet 6.0.300
lua 1.lua 1357ms 86ms 2.4MB 1347ms 0ms luajit 2.1.0
csharp 3-m.cs 2554ms 15ms 27.7MB 4747ms 3ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 227ms 5.2ms 27.3MB 337ms 7ms dotnet 6.0.300
lua 1.lua 325ms 27ms 2.4MB 313ms 0ms luajit 2.1.0
csharp 3-m.cs 662ms 0.1ms 29.7MB 1207ms 0ms mono 6.12.0
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 579ms 3.1ms 5.0MB 567ms 0ms luajit 2.1.0
csharp 1-m.cs 4737ms 96ms 89.8MB 8880ms 67ms dotnet 6.0.300

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 38ms 2.0ms 3.0MB 27ms 0ms luajit 2.1.0
csharp 1-m.cs 429ms 21ms 78.6MB 657ms 47ms dotnet 6.0.300