Programming Language and compiler
Benchmarks

Codon VS C# benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.5ms 0.8ms 7.2MB 0ms 0ms codon 0.16.3
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0
codon 1.py 1295ms 1.9ms 7.7MB 1287ms 0ms codon 0.16.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
codon 1.py 140ms 2.4ms 5.8MB 127ms 0ms codon 0.16.3
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 346ms 5.2ms 101.3MB 303ms 10ms dotnet 8.0.101
csharp 1.cs 353ms 5.9ms 55.6MB 340ms 3ms dotnet/aot 8.0.101
codon 1.py 406ms 0.9ms 46.5MB 390ms 0ms codon 0.16.3
csharp 2.cs 427ms 2.0ms 21.2MB 423ms 3ms dotnet/aot 8.0.101
csharp 2.cs 441ms 0.4ms 41.7MB 397ms 13ms dotnet 8.0.101
codon 2.py 482ms 8.3ms 107.0MB 463ms 13ms codon 0.16.3
csharp 1.cs 544ms 3.3ms 86.6MB 520ms 13ms mono 6.12.0
csharp 2.cs 1861ms 11ms 29.9MB 1843ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 81ms 2.0ms 17.2MB 70ms 0ms codon 0.16.3
csharp 1.cs 81ms 1.1ms 23.9MB 70ms 7ms dotnet/aot 8.0.101
codon 2.py 110ms 3.4ms 26.0MB 97ms 3ms codon 0.16.3
csharp 2.cs 111ms 0.4ms 18.2MB 110ms 0ms dotnet/aot 8.0.101
csharp 1.cs 114ms 3.7ms 49.8MB 77ms 7ms dotnet 8.0.101
csharp 1.cs 144ms 0.9ms 40.8MB 127ms 7ms mono 6.12.0
csharp 2.cs 153ms 1.7ms 35.4MB 117ms 7ms dotnet 8.0.101
csharp 2.cs 482ms 4.0ms 25.5MB 467ms 0ms mono 6.12.0