Programming Language and compiler
Benchmarks

Python VS C# benchmarks

Current benchmark data was generated on Thu May 04 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1474ms 36ms 309.1MB 1380ms 177ms dotnet/aot 7.0.203
csharp 1.cs 1652ms 19ms 357.4MB 1500ms 220ms dotnet 7.0.203
python 1.py 1790ms 46ms 217.6MB 1663ms 110ms pypy 3.9.16
csharp 1.cs 2381ms 20ms 104.3MB 2803ms 233ms mono 6.12.0
python 1.py timeout 0.0ms 40.9MB 4960ms 17ms cpython 3.11.3
python 1.py timeout 0.0ms 40.3MB 4917ms 63ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 145ms 3.3ms 61.4MB 117ms 23ms dotnet/aot 7.0.203
python 1.py 160ms 14ms 74.6MB 110ms 23ms pypy 3.9.16
csharp 1.cs 163ms 0.5ms 46.1MB 147ms 7ms mono 6.12.0
csharp 1.cs 253ms 4.2ms 83.2MB 197ms 33ms dotnet 7.0.203
python 1.py 671ms 2.6ms 12.0MB 633ms 17ms pyston 3.8.12
python 1.py 966ms 14ms 12.5MB 947ms 3ms cpython 3.11.3

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1514ms 44ms 220.9MB 1403ms 93ms pypy 3.9.16
csharp 1.cs timeout 0.0ms 87.6MB 9253ms 70ms dotnet 7.0.203
csharp 1.cs timeout 0.0ms 66.2MB 9297ms 57ms dotnet/aot 7.0.203
python 1.py timeout 0.0ms 20.2MB 4977ms 7ms cpython 3.11.3
python 1.py timeout 0.0ms 17.3MB 4980ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 308ms 11ms 88.1MB 263ms 27ms pypy 3.9.16
csharp 1-m.cs 372ms 1.9ms 56.6MB 620ms 23ms dotnet/aot 7.0.203
csharp 1.cs 519ms 28ms 75.9MB 540ms 53ms dotnet 7.0.203
python 1.py 799ms 10ms 19.9MB 773ms 3ms cpython 3.11.3
python 1.py 868ms 8.8ms 16.8MB 840ms 7ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 605ms 2.5ms 78.3MB 567ms 20ms pypy 3.9.16
python 1.py 1404ms 0.9ms 10.1MB 1387ms 0ms cpython 3.11.3
python 1.py 2300ms 2.5ms 9.7MB 2280ms 3ms pyston 3.8.12
csharp 1.cs timeout 0.0ms 37.1MB 4947ms 10ms dotnet 7.0.203
csharp 1.cs timeout 0.0ms 22.6MB 4980ms 7ms dotnet/aot 7.0.203

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 172ms 1.4ms 73.2MB 137ms 20ms pypy 3.9.16
python 1.py 263ms 2.3ms 9.3MB 247ms 0ms cpython 3.11.3
python 1.py 405ms 1.5ms 9.0MB 390ms 0ms pyston 3.8.12
csharp 1.cs 850ms 1.1ms 19.2MB 837ms 7ms dotnet/aot 7.0.203
csharp 1.cs 936ms 4.8ms 37.1MB 897ms 13ms dotnet 7.0.203

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 324ms 25ms 58.5MB 493ms 113ms dotnet/aot 7.0.203
csharp 5-m.cs 443ms 11ms 69.5MB 673ms 113ms dotnet 7.0.203
csharp 5-m.cs 525ms 16ms 65.9MB 870ms 117ms mono 6.12.0
python 5-m.py 3471ms 17ms 12.7MB 4990ms 1227ms pyston 3.8.12
python 1.py 3566ms 105ms 85.0MB 3510ms 37ms pypy 3.9.16
python 1.py 3928ms 17ms 8.0MB 3910ms 0ms pyston 3.8.12
python 5-m.py 4067ms 23ms 13.6MB 5703ms 1260ms cpython 3.11.3
python 5-m.py 4917ms 70ms 76.1MB 5657ms 1113ms pypy 3.9.16
python 1.py timeout 0.0ms 8.6MB 4980ms 3ms cpython 3.11.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 60ms 9.9ms 22.3MB 63ms 23ms dotnet/aot 7.0.203
csharp 5-m.cs 103ms 13ms 37.5MB 130ms 27ms mono 6.12.0
csharp 5.cs 112ms 1.5ms 41.2MB 107ms 20ms dotnet 7.0.203
python 1.py 409ms 0.7ms 7.9MB 393ms 3ms pyston 3.8.12
python 1.py 427ms 11ms 73.7MB 390ms 20ms pypy 3.9.16
python 5-m.py 428ms 8.5ms 12.6MB 557ms 143ms pyston 3.8.12
python 5-m.py 505ms 14ms 13.6MB 593ms 207ms cpython 3.11.3
python 1.py 604ms 1.0ms 8.6MB 587ms 0ms cpython 3.11.3
python 5-m.py 874ms 16ms 76.3MB 983ms 463ms pypy 3.9.16

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 6.7ms 1.3ms 10.0MB 0ms 0ms dotnet/aot 7.0.203
python 1.py 13ms 0.4ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.9ms 8.4MB 7ms 3ms cpython 3.11.3
csharp 1.cs 22ms 0.8ms 26.1MB 8ms 2ms mono 6.12.0
python 1.py 40ms 2.2ms 52.0MB 14ms 10ms pypy 3.9.16
csharp 1.cs 58ms 4.5ms 28.7MB 28ms 4ms dotnet 7.0.203

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 924ms 8.1ms 124.6MB 970ms 130ms dotnet 7.0.203
csharp 2.cs 1029ms 48ms 171.4MB 873ms 547ms dotnet 7.0.203
csharp 1.cs 1100ms 8.5ms 178.1MB 1070ms 507ms dotnet 7.0.203
csharp 2-http3.cs 1190ms 20ms 198.7MB 1327ms 237ms dotnet 7.0.203
python 1.py 1759ms 12ms 33.8MB 1307ms 933ms pyston 3.8.12
python 1.py 2124ms 28ms 29.8MB 1697ms 923ms cpython 3.11.3
python 1.py 4614ms 20ms 126.8MB 3537ms 890ms pypy 3.9.16

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 402ms 6.0ms 30.2MB 293ms 170ms pyston 3.8.12
python 1.py 439ms 8.1ms 24.9MB 333ms 170ms cpython 3.11.3
csharp 1.cs 562ms 1.0ms 97.4MB 543ms 153ms dotnet 7.0.203
csharp 2.cs 617ms 17ms 85.8MB 407ms 140ms dotnet 7.0.203
csharp 2-http2.cs 800ms 5.4ms 92.1MB 773ms 83ms dotnet 7.0.203
csharp 2-http3.cs 886ms 10.0ms 103.3MB 857ms 120ms dotnet 7.0.203
python 1.py 1170ms 6.1ms 96.5MB 913ms 207ms pypy 3.9.16

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 276ms 1.7ms 38.4MB 247ms 13ms pyston 3.8.12
python 1.py 285ms 7.2ms 41.2MB 253ms 10ms cpython 3.11.3
csharp 2.cs 398ms 8.4ms 74.6MB 343ms 37ms dotnet 7.0.203
python 1.py 416ms 1.0ms 98.6MB 373ms 27ms pypy 3.9.16
csharp 1.cs 696ms 2.5ms 146.4MB 667ms 90ms dotnet 7.0.203

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1892ms 51ms 288.9MB 2047ms 137ms dotnet 7.0.203
python 1.py 2584ms 4.8ms 223.0MB 2433ms 133ms cpython 3.11.3
python 1.py 2598ms 22ms 220.7MB 2400ms 177ms pyston 3.8.12
python 1.py 2650ms 20ms 239.6MB 2537ms 97ms pypy 3.9.16
csharp 1.cs 3074ms 98ms 793.6MB 2947ms 413ms dotnet 7.0.203

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 1003ms 15ms 51.6MB 1493ms 23ms dotnet/aot 7.0.203
csharp 6-m.cs 1816ms 6.3ms 71.7MB 2960ms 37ms mono 6.12.0
python 3-m.py 4677ms 58ms 209.3MB 8310ms 410ms pypy 3.9.16
csharp 6-m.cs 4763ms 179ms 71.4MB 9113ms 43ms dotnet 7.0.203
python 3.py timeout 0.0ms 35.2MB 97ms 13ms cpython 3.11.3
python 3.py timeout 0.0ms 34.2MB 73ms 20ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 164ms 5.7ms 42.1MB 190ms 17ms dotnet/aot 7.0.203
csharp 6.cs 266ms 0.8ms 52.3MB 360ms 17ms mono 6.12.0
csharp 6-m.cs 485ms 3.4ms 60.4MB 733ms 27ms dotnet 7.0.203
python 3-m.py 635ms 0.8ms 86.0MB 947ms 127ms pypy 3.9.16
python 3-m.py 676ms 6.7ms 17.7MB 1183ms 33ms pyston 3.8.12
python 3-m.py 943ms 4.1ms 16.7MB 1683ms 53ms cpython 3.11.3

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 134ms 1.5ms 10.1MB 123ms 0ms dotnet/aot 7.0.203
csharp 2.cs 195ms 1.2ms 24.0MB 180ms 0ms mono 6.12.0
csharp 2.cs 204ms 0.8ms 31.4MB 170ms 7ms dotnet 7.0.203
python 2.py 232ms 1.0ms 71.0MB 203ms 17ms pypy 3.9.16
python 1.py 278ms 6.3ms 71.9MB 247ms 13ms pypy 3.9.16
python 1.py 925ms 7.8ms 9.0MB 907ms 0ms pyston 3.8.12
python 2.py 1073ms 2.7ms 8.8MB 1057ms 0ms pyston 3.8.12
python 1.py 1276ms 27ms 9.3MB 1257ms 0ms cpython 3.11.3
python 2.py 1421ms 16ms 9.1MB 1407ms 0ms cpython 3.11.3
csharp 1.cs 1510ms 9.5ms 58.2MB 1487ms 20ms dotnet/aot 7.0.203
csharp 1.cs 1765ms 44ms 75.2MB 1700ms 27ms dotnet 7.0.203
csharp 1.cs 3357ms 2.0ms 47.6MB 3290ms 57ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 382ms 1.5ms 10.1MB 380ms 0ms dotnet/aot 7.0.203
csharp 2.cs 428ms 1.5ms 27.4MB 400ms 7ms dotnet 7.0.203
csharp 2.cs 525ms 1.5ms 25.3MB 513ms 0ms mono 6.12.0
python 2.py 557ms 2.9ms 71.5MB 527ms 20ms pypy 3.9.16
python 1.py 608ms 1.1ms 72.4MB 587ms 7ms pypy 3.9.16
python 1.py 2726ms 8.2ms 9.0MB 2710ms 0ms pyston 3.8.12
python 2.py 3173ms 4.4ms 8.7MB 3160ms 0ms pyston 3.8.12
python 1.py 3748ms 29ms 9.2MB 3733ms 0ms cpython 3.11.3
python 2.py 4262ms 61ms 9.1MB 4247ms 0ms cpython 3.11.3
csharp 1.cs 4474ms 9.6ms 58.6MB 4450ms 17ms dotnet/aot 7.0.203
csharp 1.cs 4907ms 65ms 75.6MB 4857ms 37ms dotnet 7.0.203
csharp 1.cs timeout 0.0ms 47.6MB 4927ms 67ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 71ms 2.5ms 8.1MB 67ms 0ms dotnet/aot 7.0.203
csharp 2.cs 112ms 0.5ms 25.1MB 93ms 0ms mono 6.12.0
csharp 2.cs 139ms 5.6ms 29.6MB 100ms 3ms dotnet 7.0.203
python 2.py 162ms 0.5ms 71.2MB 130ms 13ms pypy 3.9.16
python 1.py 181ms 1.1ms 72.4MB 140ms 23ms pypy 3.9.16
python 1.py 444ms 1.3ms 8.8MB 430ms 0ms pyston 3.8.12
python 2.py 506ms 6.4ms 8.3MB 490ms 0ms pyston 3.8.12
python 1.py 598ms 1.3ms 8.7MB 583ms 0ms cpython 3.11.3
python 2.py 712ms 6.9ms 8.4MB 697ms 0ms cpython 3.11.3
csharp 1.cs 4338ms 3.6ms 53.4MB 4313ms 17ms dotnet/aot 7.0.203
csharp 1.cs 4517ms 5.1ms 73.2MB 4470ms 30ms dotnet 7.0.203
csharp 1.cs 4606ms 11ms 33.5MB 4583ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 925ms 3.9ms 383.7MB 813ms 170ms dotnet/aot 7.0.203
csharp 1.cs 993ms 12ms 304.5MB 880ms 157ms dotnet/aot 7.0.203
csharp 2.cs 1143ms 4.4ms 431.9MB 940ms 213ms dotnet 7.0.203
csharp 1.cs 1202ms 3.5ms 431.8MB 1030ms 210ms dotnet 7.0.203
csharp 1.cs 1920ms 100ms 149.9MB 2397ms 177ms mono 6.12.0
python 1.py 2892ms 160ms 230.4MB 2713ms 160ms pypy 3.9.16
python 1.py timeout 0.0ms 92.9MB 4940ms 40ms cpython 3.11.3
python 1.py timeout 0.0ms 130.3MB 4920ms 53ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 215ms 3.9ms 137.7MB 153ms 60ms dotnet/aot 7.0.203
csharp 1.cs 265ms 6.2ms 195.1MB 183ms 77ms dotnet/aot 7.0.203
csharp 1.cs 341ms 2.9ms 72.3MB 330ms 30ms mono 6.12.0
csharp 2.cs 371ms 33ms 133.6MB 277ms 73ms dotnet 7.0.203
csharp 1.cs 375ms 3.2ms 174.9MB 270ms 90ms dotnet 7.0.203
python 1.py 423ms 11ms 149.9MB 360ms 47ms pypy 3.9.16
python 1.py timeout 0.0ms 37.1MB 4977ms 7ms cpython 3.11.3
python 1.py timeout 0.0ms 41.4MB 4960ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 420ms 10ms 29.2MB 387ms 3ms dotnet 7.0.203
csharp 8.cs 583ms 2.6ms 8.2MB 577ms 0ms dotnet/aot 7.0.203
csharp 8.cs 603ms 6.5ms 29.6MB 570ms 3ms dotnet 7.0.203
csharp 8.cs 1298ms 32ms 24.9MB 1277ms 3ms mono 6.12.0
python 2.py 2132ms 23ms 71.3MB 2103ms 10ms pypy 3.9.16
python 1.py 3664ms 19ms 70.4MB 3623ms 23ms pypy 3.9.16
python 1.py timeout 0.0ms 8.4MB 4987ms 0ms cpython 3.11.3
python 2.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.11.3
python 1.py timeout 0.0ms 8.3MB 4987ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 7.9MB 4980ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 68ms 1.9ms 11.9MB 63ms 0ms dotnet/aot 7.0.203
csharp 9.cs 109ms 2.4ms 27.8MB 67ms 13ms dotnet 7.0.203
csharp 8.cs 116ms 3.3ms 29.5MB 87ms 3ms dotnet 7.0.203
csharp 8.cs 153ms 3.2ms 24.9MB 140ms 0ms mono 6.12.0
python 2.py 279ms 3.4ms 71.2MB 253ms 10ms pypy 3.9.16
python 1.py 425ms 14ms 70.4MB 390ms 17ms pypy 3.9.16
python 1.py 1156ms 2.0ms 8.4MB 1137ms 3ms pyston 3.8.12
python 2.py 1597ms 31ms 7.9MB 1577ms 3ms pyston 3.8.12
python 1.py 3179ms 60ms 8.4MB 3167ms 3ms cpython 3.11.3
python 2.py 3574ms 7.6ms 8.6MB 3557ms 0ms cpython 3.11.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 610ms 4.2ms 19.7MB 593ms 7ms dotnet/aot 7.0.203
csharp 2.cs 760ms 4.5ms 38.6MB 727ms 3ms dotnet 7.0.203
csharp 1.cs 1135ms 7.9ms 73.7MB 1107ms 20ms dotnet/aot 7.0.203
csharp 1.cs 1358ms 41ms 88.5MB 1320ms 23ms mono 6.12.0
csharp 1.cs 1941ms 86ms 88.5MB 1890ms 20ms dotnet 7.0.203
csharp 2.cs 2787ms 19ms 34.0MB 2770ms 3ms mono 6.12.0
python 1.py timeout 0.0ms 321.0MB 4897ms 80ms cpython 3.11.3
python 2.py timeout 0.0ms 633.5MB 4677ms 307ms cpython 3.11.3
python 1.py timeout 0.0ms 382.8MB 4850ms 133ms pypy 3.9.16
python 2.py timeout 0.0ms 991.9MB 4623ms 360ms pypy 3.9.16
python 1.py timeout 0.0ms 320.4MB 4903ms 80ms pyston 3.8.12
python 2.py timeout 0.0ms 633.3MB 4557ms 423ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 142ms 1.4ms 30.0MB 127ms 7ms dotnet/aot 7.0.203
csharp 2.cs 146ms 3.9ms 15.3MB 140ms 0ms dotnet/aot 7.0.203
csharp 1.cs 202ms 3.3ms 40.7MB 183ms 3ms mono 6.12.0
csharp 2.cs 221ms 2.7ms 30.1MB 187ms 3ms dotnet 7.0.203
csharp 1.cs 334ms 10ms 42.2MB 307ms 3ms dotnet 7.0.203
csharp 2.cs 675ms 0.5ms 26.2MB 660ms 0ms mono 6.12.0
python 1.py 1331ms 14ms 207.2MB 1257ms 60ms pypy 3.9.16
python 2.py 1563ms 21ms 164.4MB 1463ms 83ms pyston 3.8.12
python 2.py 2088ms 6.3ms 164.9MB 1990ms 83ms cpython 3.11.3
python 2.py 2161ms 4.7ms 210.5MB 2013ms 133ms pypy 3.9.16
python 1.py 3370ms 74ms 86.0MB 3313ms 37ms pyston 3.8.12
python 1.py 4719ms 66ms 86.6MB 4660ms 40ms cpython 3.11.3

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2411ms 1.3ms 9.1MB 2383ms 10ms pyston 3.8.12
python 4.py 2548ms 1.1ms 9.4MB 2503ms 27ms cpython 3.11.3
python 4.py 2622ms 44ms 125.4MB 2547ms 57ms pypy 3.9.16
csharp 1.cs 4813ms 5.6ms 59.0MB 4793ms 33ms dotnet/aot 7.0.203
csharp 1.cs 4990ms 2.1ms 84.8MB 4910ms 130ms dotnet 7.0.203

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 576ms 0.8ms 8.8MB 560ms 0ms pyston 3.8.12
python 4.py 607ms 0.3ms 9.1MB 593ms 0ms cpython 3.11.3
python 4.py 672ms 6.8ms 77.0MB 640ms 17ms pypy 3.9.16
csharp 1.cs 1148ms 1.4ms 60.4MB 1117ms 23ms dotnet/aot 7.0.203
csharp 1.cs 1204ms 55ms 80.5MB 1187ms 47ms dotnet 7.0.203

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 3185ms 5.9ms 525.3MB 3177ms 203ms dotnet 7.0.203
python 1.py 3388ms 38ms 273.2MB 3253ms 117ms pypy 3.9.16
csharp 6.cs 3534ms 9.6ms 459.5MB 3380ms 200ms dotnet/aot 7.0.203
csharp 6.cs 3658ms 65ms 521.2MB 3520ms 203ms dotnet 7.0.203
csharp 5.cs timeout 0.0ms 184.6MB 4953ms 103ms dotnet/aot 7.0.203
python 1.py timeout 0.0ms 108.2MB 4930ms 57ms cpython 3.11.3
python 1.py timeout 0.0ms 107.6MB 4930ms 53ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 373ms 3.1ms 72.5MB 350ms 23ms dotnet/aot 7.0.203
csharp 5.cs 468ms 3.5ms 94.9MB 410ms 43ms dotnet 7.0.203
python 1.py 475ms 3.2ms 94.3MB 430ms 27ms pypy 3.9.16
csharp 6.cs 531ms 9.0ms 92.7MB 460ms 53ms dotnet 7.0.203
csharp 5.cs 713ms 1.8ms 70.3MB 683ms 23ms dotnet/aot 7.0.203
python 1.py 774ms 1.5ms 30.6MB 743ms 13ms pyston 3.8.12
python 1.py 821ms 4.6ms 31.9MB 783ms 23ms cpython 3.11.3

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4246ms 5.7ms 58.1MB 4217ms 27ms dotnet/aot 7.0.203
csharp 1.cs 4331ms 23ms 76.4MB 4333ms 47ms dotnet 7.0.203
python 1.py 4417ms 4.1ms 8.5MB 4400ms 0ms pyston 3.8.12
python 1.py 4746ms 16ms 8.4MB 4730ms 0ms cpython 3.11.3
python 1.py timeout 0.0ms 78.0MB 4953ms 23ms pypy 3.9.16

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1095ms 13ms 52.7MB 1057ms 27ms dotnet/aot 7.0.203
python 1.py 1117ms 0.5ms 8.4MB 1103ms 0ms pyston 3.8.12
python 1.py 1201ms 7.0ms 8.5MB 1187ms 0ms cpython 3.11.3
csharp 1.cs 1204ms 4.3ms 72.3MB 1213ms 30ms dotnet 7.0.203
python 1.py 1610ms 16ms 75.2MB 1573ms 23ms pypy 3.9.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2098ms 11ms 13.7MB 4057ms 10ms dotnet/aot 7.0.203
csharp 3-m.cs 4123ms 363ms 30.5MB 7190ms 27ms dotnet 7.0.203
csharp 3.cs timeout 0.0ms 30.2MB 9583ms 10ms mono 6.12.0
python 8.py timeout 0.0ms 16.3MB 50ms 10ms cpython 3.11.3
python 8.py timeout 0.0ms 99.0MB 657ms 100ms pypy 3.9.16
python 8.py timeout 0.0ms 16.3MB 70ms 20ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 544ms 5.0ms 11.9MB 1020ms 10ms dotnet/aot 7.0.203
csharp 3-m.cs 1106ms 15ms 31.9MB 2037ms 17ms dotnet 7.0.203
csharp 3-m.cs 2596ms 3.1ms 27.5MB 5030ms 13ms mono 6.12.0
python 8.py timeout 0.0ms 16.2MB 97ms 17ms cpython 3.11.3
python 8.py timeout 0.0ms 102.4MB 1130ms 193ms pypy 3.9.16
python 8.py timeout 0.0ms 17.6MB 167ms 27ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 155ms 4.8ms 12.3MB 267ms 3ms dotnet/aot 7.0.203
csharp 3-m.cs 364ms 39ms 31.6MB 533ms 13ms dotnet 7.0.203
csharp 3-m.cs 707ms 52ms 29.8MB 1280ms 0ms mono 6.12.0
python 8-m.py 4105ms 62ms 103.1MB 7120ms 430ms pypy 3.9.16
python 8.py timeout 0.0ms 15.9MB 230ms 23ms cpython 3.11.3
python 8.py timeout 0.0ms 16.7MB 310ms 70ms pyston 3.8.12