Programming Language and compiler
Benchmarks

Lua VS C benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 119.6MB 4927ms 57ms lua 5.4.4
lua 1.lua timeout 0.0ms 176.2MB 4913ms 67ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 478ms 3.0ms 24.7MB 453ms 7ms luajit 2.1.0-beta3
lua 1.lua 1214ms 12ms 17.3MB 1197ms 0ms lua 5.4.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.5ms 0.4ms 1.5MB 0ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 1.c 2.0ms 0.6ms 1.3MB 0ms 0ms gcc 12.2.0
lua 1.lua 2.0ms 0.4ms 2.5MB 0ms 0ms luajit 2.1.0-beta3
c 1.c 2.2ms 0.6ms 1.4MB 0ms 0ms clang 14.0.0
lua 1.lua 2.3ms 0.7ms 1.4MB 0ms 0ms lua 5.4.4

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 159.1MB 4917ms 63ms lua 5.4.4
lua 1.lua timeout 0.0ms 180.9MB 4890ms 90ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1836ms 89ms 36.3MB 1813ms 3ms luajit 2.1.0-beta3
lua 1.lua 3056ms 30ms 41.6MB 3020ms 17ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 271ms 2.7ms 1.2MB 260ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 8-i.c 331ms 1.3ms 1.3MB 320ms 0ms gcc 12.2.0
c 5.c 335ms 0.5ms 1.3MB 327ms 0ms gcc 12.2.0
c 8-i.c 350ms 0.9ms 1.4MB 340ms 0ms clang 14.0.0
c 5.c 357ms 1.0ms 1.4MB 340ms 0ms clang 14.0.0
c 5.c 357ms 1.9ms 0.9MB 340ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 2.c 362ms 3.2ms 1.2MB 350ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 2.c 389ms 0.2ms 1.4MB 377ms 0ms clang 14.0.0
c 2.c 489ms 8.2ms 1.3MB 473ms 0ms gcc 12.2.0
lua 4.lua 1110ms 1.0ms 1.4MB 1100ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 1.4MB 4987ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 30ms 0.3ms 1.2MB 20ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 8-i.c 36ms 0.2ms 1.3MB 30ms 0ms gcc 12.2.0
c 5.c 36ms 0.2ms 1.3MB 30ms 0ms gcc 12.2.0
c 5.c 38ms 0.7ms 1.0MB 30ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 5.c 38ms 0.3ms 1.4MB 30ms 0ms clang 14.0.0
c 8-i.c 38ms 0.3ms 1.4MB 30ms 0ms clang 14.0.0
c 2.c 39ms 0.8ms 1.2MB 30ms 0ms zigcc 0.11.0-dev.1577+11cc1c16f
c 2.c 42ms 0.5ms 1.4MB 30ms 0ms clang 14.0.0
c 2.c 52ms 0.3ms 1.3MB 40ms 0ms gcc 12.2.0
lua 4.lua 117ms 2.1ms 1.4MB 103ms 0ms luajit 2.1.0-beta3
lua 4.lua 1567ms 89ms 1.5MB 1557ms 0ms lua 5.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1280ms 2.8ms 1.3MB 2503ms 0ms gcc 12.2.0
c 4-m.c 1595ms 21ms 3.2MB 3123ms 0ms clang 14.0.0
c 5-im.c 1605ms 1.3ms 1.3MB 3137ms 3ms gcc 12.2.0
c 6-im.c 1644ms 8.7ms 1.3MB 3200ms 0ms gcc 12.2.0
c 6-im.c 1667ms 15ms 3.2MB 3257ms 0ms clang 14.0.0
c 3-m.c 1868ms 4.6ms 3.2MB 3673ms 0ms clang 14.0.0
c 3-m.c 1894ms 21ms 1.3MB 3697ms 0ms gcc 12.2.0
c 5-im.c 2042ms 13ms 3.2MB 3997ms 3ms clang 14.0.0
lua 1.lua timeout 0.0ms 2.2MB 4990ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.6MB 4987ms 0ms luajit 2.1.0-beta3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 333ms 2.4ms 1.3MB 630ms 0ms gcc 12.2.0
c 4-m.c 408ms 1.5ms 3.1MB 777ms 0ms clang 14.0.0
c 5-im.c 416ms 2.7ms 1.3MB 790ms 0ms gcc 12.2.0
c 6-im.c 421ms 2.9ms 2.4MB 800ms 0ms gcc 12.2.0
c 6-im.c 426ms 1.8ms 3.3MB 810ms 0ms clang 14.0.0
c 3-m.c 484ms 1.9ms 1.3MB 933ms 0ms gcc 12.2.0
c 3-m.c 490ms 17ms 3.2MB 930ms 0ms clang 14.0.0
c 5-im.c 524ms 0.6ms 3.2MB 1007ms 0ms clang 14.0.0
lua 1.lua 1405ms 0.1ms 2.5MB 1390ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.2MB 4983ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 93ms 3.3ms 1.3MB 157ms 0ms gcc 12.2.0
c 4-m.c 111ms 0.6ms 3.1MB 190ms 0ms clang 14.0.0
c 5-im.c 114ms 0.7ms 1.3MB 200ms 0ms gcc 12.2.0
c 6-im.c 114ms 2.8ms 1.3MB 200ms 0ms gcc 12.2.0
c 6-im.c 117ms 3.2ms 3.3MB 203ms 0ms clang 14.0.0
c 3-m.c 130ms 1.2ms 3.1MB 230ms 0ms clang 14.0.0
c 3-m.c 131ms 0.9ms 1.3MB 237ms 0ms gcc 12.2.0
c 5-im.c 142ms 1.3ms 3.1MB 253ms 0ms clang 14.0.0
lua 1.lua 360ms 6.5ms 1.4MB 347ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 1.4MB 4980ms 0ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 579ms 2.4ms 5.1MB 563ms 0ms luajit 2.1.0-beta3

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 36ms 1.0ms 3.1MB 30ms 0ms luajit 2.1.0-beta3