Programming Language and compiler
Benchmarks

Lua VS C# benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1213ms 21ms 132.8MB 1443ms 180ms dotnet/aot 8.0.101
csharp 1.cs 1714ms 70ms 109.8MB 1903ms 220ms mono 6.12.0
csharp 1.cs 1868ms 70ms 2126.1MB 710ms 1117ms dotnet 8.0.101
lua 1.lua 3568ms 87ms 172.9MB 3433ms 120ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 105.0MB 4950ms 40ms lua 5.4.6

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 92ms 2.7ms 29.1MB 93ms 13ms dotnet/aot 8.0.101
csharp 1.cs 142ms 1.4ms 44.9MB 117ms 13ms mono 6.12.0
csharp 1.cs 283ms 5.7ms 229.7MB 130ms 113ms dotnet 8.0.101
lua 1.lua 290ms 1.7ms 15.6MB 270ms 7ms luajit 2.1.0-beta3
lua 1.lua 855ms 12ms 17.0MB 840ms 3ms lua 5.4.6

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.5ms 0.1ms 2.1MB 0ms 0ms lua 5.4.6
lua 1.lua 1.5ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 520ms 2.4ms 155.2MB 587ms 87ms dotnet/aot 8.0.101
csharp 1.cs 601ms 10ms 107.3MB 693ms 97ms dotnet/aot 8.0.101
csharp 2.cs 1201ms 5.0ms 1295.1MB 493ms 673ms dotnet 8.0.101
csharp 1.cs 1308ms 29ms 144.8MB 1517ms 157ms mono 6.12.0
csharp 1.cs 1565ms 4.3ms 1869.6MB 580ms 943ms dotnet 8.0.101
lua 1.lua timeout 0.0ms 107.4MB 4950ms 40ms lua 5.4.6
lua 1.lua timeout 0.0ms 149.3MB 4937ms 53ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 110ms 2.0ms 38.0MB 113ms 17ms dotnet/aot 8.0.101
csharp 1.cs 123ms 1.1ms 48.4MB 130ms 23ms dotnet/aot 8.0.101
csharp 1.cs 262ms 7.9ms 73.9MB 237ms 33ms mono 6.12.0
csharp 2.cs 371ms 4.9ms 305.1MB 183ms 157ms dotnet 8.0.101
csharp 1.cs 441ms 8.6ms 428.5MB 170ms 237ms dotnet 8.0.101
lua 1.lua 1196ms 6.5ms 31.3MB 1160ms 20ms luajit 2.1.0-beta3
lua 1.lua 2323ms 26ms 28.8MB 2303ms 3ms lua 5.4.6

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
lua 4.lua 707ms 1.1ms 2.4MB 697ms 0ms luajit 2.1.0-beta3
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.6

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
lua 4.lua 76ms 2.8ms 2.4MB 63ms 0ms luajit 2.1.0-beta3
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0
lua 4.lua 1138ms 22ms 2.3MB 1127ms 0ms lua 5.4.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1868ms 28ms 18.9MB 7187ms 17ms dotnet/aot 8.0.101
csharp 3-m.cs 2016ms 168ms 39.0MB 7077ms 27ms dotnet 8.0.101
lua 1.lua 4049ms 5.8ms 2.5MB 4037ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 4685ms 117ms 29.1MB 17887ms 20ms mono 6.12.0
lua 1.lua timeout 0.0ms 2.4MB 4990ms 0ms lua 5.4.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 477ms 2.0ms 18.7MB 1807ms 10ms dotnet/aot 8.0.101
csharp 3-m.cs 536ms 3.2ms 36.9MB 1843ms 17ms dotnet 8.0.101
lua 1.lua 1015ms 1.6ms 2.4MB 1003ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 1178ms 36ms 29.3MB 4430ms 7ms mono 6.12.0
lua 1.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.6

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 132ms 0.4ms 18.9MB 453ms 3ms dotnet/aot 8.0.101
csharp 3-m.cs 191ms 6.2ms 35.6MB 490ms 10ms dotnet 8.0.101
lua 1.lua 259ms 2.7ms 2.3MB 250ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 344ms 4.8ms 33.1MB 1147ms 17ms mono 6.12.0
lua 1.lua timeout 0.0ms 2.0MB 4993ms 0ms lua 5.4.6