Programming Language and compiler
Benchmarks

Lua VS C# benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 942ms 23ms 178.5MB 930ms 140ms dotnet/aot 9.0.100
csharp 1.cs 1121ms 32ms 206.4MB 1067ms 147ms dotnet 9.0.100
csharp 1.cs 1708ms 66ms 101.6MB 1907ms 207ms mono 6.12.0
lua 1.lua 3463ms 70ms 172.8MB 3323ms 123ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 104.9MB 4960ms 27ms lua 5.4.7

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 122ms 3.4ms 41.6MB 83ms 27ms dotnet/aot 9.0.100
csharp 1.cs 143ms 1.2ms 46.1MB 117ms 17ms mono 6.12.0
csharp 1.cs 196ms 4.9ms 59.9MB 153ms 33ms dotnet 9.0.100
lua 1.lua 286ms 1.1ms 15.9MB 263ms 7ms luajit 2.1.0-beta3
lua 1.lua 810ms 1.8ms 16.9MB 790ms 0ms lua 5.4.7

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.4ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 1.5ms 0.2ms 2.1MB 0ms 0ms lua 5.4.7
csharp 1.cs 9.1ms 5.6ms 15.6MB 0ms 0ms dotnet/aot 9.0.100
csharp 1.cs 31ms 0.9ms 23.4MB 20ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.6ms 32.3MB 20ms 6ms dotnet 9.0.100

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 543ms 7.0ms 124.9MB 480ms 93ms dotnet/aot 9.0.100
csharp 1.cs 598ms 27ms 152.8MB 520ms 123ms dotnet/aot 9.0.100
csharp 2.cs 679ms 13ms 140.7MB 630ms 100ms dotnet 9.0.100
csharp 1.cs 754ms 16ms 173.0MB 683ms 140ms dotnet 9.0.100
csharp 1.cs 1318ms 93ms 142.6MB 1553ms 177ms mono 6.12.0
lua 1.lua timeout 0.0ms 107.4MB 4953ms 33ms lua 5.4.7
lua 1.lua timeout 0.0ms 149.3MB 4933ms 47ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 135ms 1.1ms 66.2MB 107ms 30ms dotnet/aot 9.0.100
csharp 1.cs 149ms 4.0ms 80.6MB 110ms 47ms dotnet/aot 9.0.100
csharp 2.cs 256ms 2.6ms 84.5MB 213ms 53ms dotnet 9.0.100
csharp 1.cs 264ms 7.8ms 69.4MB 230ms 40ms mono 6.12.0
csharp 1.cs 274ms 1.4ms 99.3MB 243ms 57ms dotnet 9.0.100
lua 1.lua 1122ms 32ms 31.0MB 1097ms 10ms luajit 2.1.0-beta3
lua 1.lua 2145ms 2.0ms 28.6MB 2120ms 10ms lua 5.4.7

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 358ms 1.2ms 34.0MB 347ms 0ms dotnet 9.0.100
csharp 8.cs 371ms 1.4ms 15.8MB 360ms 0ms dotnet/aot 9.0.100
csharp 8.cs 424ms 8.4ms 33.8MB 397ms 10ms dotnet 9.0.100
lua 4.lua 716ms 7.4ms 2.4MB 707ms 0ms luajit 2.1.0-beta3
csharp 8.cs 1247ms 5.7ms 24.3MB 1230ms 7ms mono 6.12.0
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 45ms 1.6ms 15.8MB 30ms 0ms dotnet/aot 9.0.100
lua 4.lua 76ms 2.2ms 2.4MB 67ms 0ms luajit 2.1.0-beta3
csharp 9.cs 93ms 1.7ms 33.7MB 77ms 7ms dotnet 9.0.100
csharp 8.cs 94ms 0.7ms 33.7MB 73ms 10ms dotnet 9.0.100
csharp 8.cs 165ms 1.7ms 24.4MB 150ms 0ms mono 6.12.0
lua 4.lua 1120ms 22ms 2.3MB 1107ms 0ms lua 5.4.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1872ms 21ms 18.3MB 7233ms 7ms dotnet/aot 9.0.100
csharp 3-m.cs 1919ms 8.5ms 39.9MB 7290ms 23ms dotnet 9.0.100
lua 1.lua 4052ms 6.0ms 2.5MB 4043ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 4604ms 45ms 26.8MB 17770ms 10ms mono 6.12.0
lua 1.lua timeout 0.0ms 2.5MB 4990ms 0ms lua 5.4.7

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 497ms 35ms 18.3MB 1783ms 3ms dotnet/aot 9.0.100
csharp 3-m.cs 530ms 1.5ms 37.9MB 1857ms 20ms dotnet 9.0.100
lua 1.lua 1024ms 0.9ms 2.4MB 1010ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 1290ms 128ms 25.6MB 4493ms 13ms mono 6.12.0
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 130ms 0.9ms 18.3MB 437ms 0ms dotnet/aot 9.0.100
csharp 3-m.cs 178ms 2.3ms 36.4MB 500ms 7ms dotnet 9.0.100
lua 1.lua 258ms 1.0ms 2.3MB 247ms 0ms luajit 2.1.0-beta3
csharp 3-m.cs 346ms 0.2ms 28.4MB 1153ms 13ms mono 6.12.0
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7