Programming Language and compiler
Benchmarks

Crystal VS Java benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 766ms 12ms 414.2MB 733ms 123ms openjdk 20
java 2.java 785ms 6.1ms 409.0MB 753ms 127ms openjdk 19
java 2.java 804ms 24ms 683.4MB 853ms 203ms graal/jvm 17.0.4
java 2.java 1479ms 49ms 1081.8MB 1013ms 687ms openjdk/zgc 19
crystal 1.cr 1947ms 17ms 66.1MB 2307ms 23ms crystal 1.5.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 142ms 1.2ms 11.0MB 143ms 0ms crystal 1.5.1
java 2.java 179ms 6.1ms 109.2MB 173ms 30ms openjdk 19
java 2.java 185ms 15ms 110.9MB 183ms 27ms openjdk 20
java 2.java 210ms 21ms 165.1MB 253ms 43ms graal/jvm 17.0.4
java 2.java 345ms 11ms 240.4MB 183ms 193ms openjdk/zgc 19

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2179ms 23ms 20.2MB 2120ms 43ms crystal 1.5.1
java 1-m.java 3298ms 52ms 201.3MB 6173ms 120ms openjdk 19
java 1-m.java 4199ms 57ms 944.9MB 7373ms 620ms openjdk/zgc 19
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 127ms 2.5ms 9.6MB 107ms 3ms crystal 1.5.1
java 1-m.java 715ms 68ms 112.9MB 1240ms 53ms openjdk 19
java 1-m.java 816ms 116ms 107.2MB 1427ms 53ms openjdk 20
java 1-m.java 977ms 78ms 302.2MB 1567ms 190ms openjdk/zgc 19

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 79ms 0.4ms 8.5MB 57ms 7ms crystal 1.5.1
java 1-m.java 817ms 50ms 281.2MB 1387ms 120ms graal/jvm 17.0.4
java 1-m.java 822ms 47ms 207.2MB 1430ms 70ms openjdk 19
java 1-m.java 823ms 67ms 221.6MB 1443ms 67ms openjdk 20
java 1-m.java 1036ms 18ms 422.0MB 1453ms 337ms openjdk/zgc 19

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 30ms 0.7ms 7.3MB 20ms 0ms crystal 1.5.1
java 1-m.java 420ms 13ms 189.2MB 647ms 90ms graal/jvm 17.0.4
java 1-m.java 445ms 7.5ms 116.4MB 717ms 50ms openjdk 19
java 1-m.java 451ms 8.9ms 119.1MB 730ms 53ms openjdk 20
java 1-m.java 565ms 25ms 208.9MB 750ms 180ms openjdk/zgc 19

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 1418ms 8.8ms 91.7MB 2653ms 37ms graal/jvm 17.0.4
java 1-m.java 1579ms 40ms 42.2MB 2890ms 80ms openjdk/zgc 19
java 1-m.java 1582ms 75ms 42.1MB 3000ms 13ms openjdk 19
java 1-m.java 1585ms 94ms 44.3MB 3030ms 20ms openjdk 20
crystal 1.cr 3718ms 2.7ms 3.0MB 3703ms 0ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 263ms 5.7ms 42.2MB 420ms 10ms openjdk 19
java 1-m.java 264ms 8.7ms 44.1MB 410ms 23ms openjdk 20
java 1-m.java 292ms 38ms 100.0MB 440ms 37ms graal/jvm 17.0.4
crystal 1.cr 301ms 0.9ms 5.0MB 290ms 0ms crystal 1.5.1
java 1-m.java 317ms 7.1ms 44.0MB 403ms 77ms openjdk/zgc 19

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 4.java 466ms 12ms 41.7MB 540ms 17ms openjdk 19
java 4.java 470ms 6.4ms 43.9MB 547ms 13ms openjdk 20
java 4.java 526ms 14ms 43.5MB 547ms 70ms openjdk/zgc 19
java 4-m.java 549ms 6.3ms 118.4MB 850ms 47ms graal/jvm 17.0.4
crystal 2.cr 764ms 1.8ms 3.6MB 660ms 93ms crystal 1.5.1
crystal 1.cr 1006ms 0.6ms 16.7MB 890ms 100ms crystal 1.5.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 82ms 0.5ms 5.5MB 60ms 7ms crystal 1.5.1
crystal 1.cr 105ms 0.7ms 4.6MB 87ms 3ms crystal 1.5.1
java 4.java 142ms 2.0ms 41.3MB 160ms 10ms openjdk 19
java 4.java 142ms 1.7ms 42.9MB 157ms 20ms openjdk 20
java 4.java 156ms 7.9ms 82.9MB 173ms 37ms graal/jvm 17.0.4
java 4.java 201ms 3.0ms 41.3MB 170ms 63ms openjdk/zgc 19

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 4.3ms 1.4ms 2.8MB 0ms 0ms crystal 1.5.1
java 1.java 77ms 2.0ms 58.0MB 70ms 14ms graal/jvm 17.0.4
java 1.java 83ms 3.5ms 40.6MB 80ms 10ms openjdk 20
java 1.java 89ms 4.9ms 40.5MB 78ms 10ms openjdk 19
java 1.java 136ms 2.5ms 39.9MB 80ms 68ms openjdk/zgc 19

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3539ms 58ms 135.7MB 377ms 317ms crystal 1.5.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1311ms 6.7ms 31.3MB 40ms 57ms crystal 1.5.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 62ms 1.0ms 3.0MB 50ms 0ms crystal 1.5.1
crystal 1.cr 111ms 1.3ms 3.1MB 100ms 0ms crystal 1.5.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 177ms 0.1ms 3.1MB 170ms 0ms crystal 1.5.1
crystal 1.cr 320ms 1.7ms 3.1MB 307ms 0ms crystal 1.5.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 30ms 0.4ms 2.9MB 20ms 0ms crystal 1.5.1
crystal 1.cr 56ms 0.8ms 3.1MB 50ms 0ms crystal 1.5.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 883ms 0.8ms 9.9MB 870ms 0ms crystal 1.5.1
java 1b.java 1497ms 25ms 48.4MB 1597ms 13ms openjdk 19
java 1b.java 1521ms 27ms 50.8MB 1620ms 10ms openjdk 20
java 1b.java 1562ms 7.1ms 49.0MB 1590ms 70ms openjdk/zgc 19
java 1b.java 1590ms 16ms 122.6MB 1760ms 43ms graal/jvm 17.0.4
java 1a.java 1801ms 9.1ms 50.4MB 1880ms 23ms openjdk 20
java 1a.java 1818ms 33ms 48.6MB 1910ms 27ms openjdk 19
java 1a.java 1870ms 9.2ms 114.0MB 1970ms 33ms graal/jvm 17.0.4
java 1a.java 1875ms 16ms 49.8MB 1897ms 77ms openjdk/zgc 19
java 1.java 2059ms 4.7ms 121.0MB 2150ms 50ms graal/jvm 17.0.4
java 1.java 2148ms 6.1ms 198.9MB 2167ms 73ms openjdk 19
java 1.java 2169ms 15ms 192.9MB 2217ms 57ms openjdk 20
java 1.java 2585ms 4.9ms 567.8MB 2297ms 397ms openjdk/zgc 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 44ms 3.6ms 4.9MB 30ms 0ms crystal 1.5.1
java 1b.java 222ms 14ms 45.6MB 287ms 20ms openjdk 19
java 1b.java 222ms 4.0ms 44.2MB 310ms 13ms openjdk 20
java 1a.java 233ms 11ms 48.5MB 303ms 20ms openjdk 19
java 1.java 234ms 4.7ms 95.2MB 290ms 27ms openjdk 19
java 1.java 234ms 2.5ms 97.8MB 277ms 20ms openjdk 20
java 1a.java 247ms 7.5ms 101.0MB 317ms 40ms graal/jvm 17.0.4
java 1a.java 248ms 25ms 46.5MB 330ms 20ms openjdk 20
java 1.java 258ms 1.4ms 107.1MB 327ms 40ms graal/jvm 17.0.4
java 1b.java 279ms 12ms 45.9MB 300ms 67ms openjdk/zgc 19
java 1a.java 282ms 13ms 44.8MB 277ms 70ms openjdk/zgc 19
java 1b-m.java 292ms 28ms 119.1MB 423ms 37ms graal/jvm 17.0.4
java 1.java 316ms 3.9ms 111.4MB 273ms 110ms openjdk/zgc 19
java 2.java 876ms 31ms 571.2MB 1007ms 177ms openjdk 20
java 2.java 932ms 20ms 552.5MB 1033ms 197ms openjdk 19
java 2.java 1669ms 55ms 1124.2MB 1150ms 790ms openjdk/zgc 19

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 575ms 8.1ms 294.1MB 597ms 87ms openjdk 20
java 1.java 600ms 16ms 365.9MB 607ms 97ms openjdk 19
java 1.java 681ms 58ms 366.4MB 847ms 120ms graal/jvm 17.0.4
java 1.java 1088ms 1.8ms 733.5MB 740ms 500ms openjdk/zgc 19
crystal 1.cr 1445ms 5.3ms 64.4MB 1670ms 37ms crystal 1.5.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 245ms 3.0ms 174.2MB 243ms 63ms openjdk 19
java 1.java 246ms 3.9ms 173.9MB 263ms 43ms openjdk 20
crystal 1.cr 246ms 3.1ms 17.5MB 267ms 10ms crystal 1.5.1
java 1-m.java 301ms 4.0ms 244.5MB 420ms 77ms graal/jvm 17.0.4
java 1.java 465ms 8.9ms 325.2MB 287ms 230ms openjdk/zgc 19

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 586ms 6.5ms 87.4MB 627ms 30ms graal/jvm 17.0.4
crystal 1.cr 594ms 1.5ms 4.8MB 577ms 0ms crystal 1.5.1
crystal 2.cr 623ms 0.7ms 3.0MB 610ms 0ms crystal 1.5.1
java 1.java 638ms 5.0ms 44.2MB 647ms 20ms openjdk 19
java 1.java 643ms 3.3ms 42.4MB 650ms 23ms openjdk 20
java 1.java 705ms 4.7ms 42.0MB 663ms 73ms openjdk/zgc 19
java 2.java 2299ms 9.1ms 534.4MB 2290ms 163ms openjdk 20
java 2.java 2309ms 29ms 487.1MB 2310ms 157ms openjdk 19
java 2.java 3386ms 50ms 1654.7MB 2387ms 1197ms openjdk/zgc 19

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 65ms 2.6ms 4.9MB 50ms 0ms crystal 1.5.1
crystal 2.cr 67ms 1.7ms 3.0MB 57ms 0ms crystal 1.5.1
java 1.java 157ms 3.9ms 42.3MB 170ms 10ms openjdk 19
java 1.java 157ms 4.7ms 42.7MB 170ms 20ms openjdk 20
java 1.java 157ms 3.0ms 87.9MB 203ms 23ms graal/jvm 17.0.4
java 1.java 214ms 4.5ms 43.5MB 183ms 63ms openjdk/zgc 19
java 2.java 480ms 11ms 354.0MB 527ms 93ms openjdk 20
java 2.java 482ms 9.4ms 345.0MB 523ms 103ms openjdk 19
java 2.java 802ms 2.3ms 484.3MB 590ms 367ms openjdk/zgc 19

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 428ms 1.0ms 9.9MB 417ms 0ms crystal 1.5.1
java 2.java 1037ms 6.0ms 53.9MB 1073ms 20ms openjdk 20
java 2.java 1075ms 26ms 54.2MB 1107ms 23ms openjdk 19
java 2.java 1123ms 1.7ms 51.0MB 1100ms 70ms openjdk/zgc 19
java 1.java 1127ms 18ms 86.7MB 1147ms 33ms openjdk 20
java 1.java 1140ms 16ms 84.6MB 1163ms 30ms openjdk 19
crystal 1.cr 1267ms 39ms 44.0MB 1243ms 7ms crystal 1.5.1
java 1.java 1405ms 18ms 110.5MB 1353ms 103ms openjdk/zgc 19
java 1.java 1613ms 33ms 164.5MB 2260ms 73ms graal/jvm 17.0.4
java 2-m.java 2068ms 15ms 130.4MB 3833ms 50ms graal/jvm 17.0.4

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 95ms 1.1ms 4.3MB 80ms 0ms crystal 1.5.1
crystal 1.cr 159ms 2.7ms 14.8MB 147ms 0ms crystal 1.5.1
java 1.java 248ms 2.6ms 60.4MB 283ms 17ms openjdk 20
java 1.java 250ms 2.8ms 62.3MB 283ms 17ms openjdk 19
java 1.java 313ms 4.1ms 59.2MB 283ms 73ms openjdk/zgc 19
java 2.java 329ms 2.4ms 48.7MB 363ms 20ms openjdk 19
java 2.java 330ms 3.1ms 46.8MB 360ms 20ms openjdk 20
java 1-m.java 351ms 14ms 135.8MB 467ms 67ms graal/jvm 17.0.4
java 2.java 388ms 3.1ms 46.1MB 357ms 77ms openjdk/zgc 19
java 2-m.java 669ms 8.9ms 127.2MB 1167ms 67ms graal/jvm 17.0.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2816ms 90ms 8.7MB 3030ms 323ms crystal 1.5.1
java 1.java timeout 0.0ms 0.0MB 0ms 0ms graal/jvm 17.0.4
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 654ms 9.8ms 5.4MB 687ms 73ms crystal 1.5.1
java 1.java 1515ms 17ms 317.7MB 1813ms 113ms openjdk 19
java 1.java 1529ms 15ms 309.2MB 1803ms 107ms openjdk 20
java 1.java 1564ms 6.5ms 384.4MB 1910ms 120ms graal/jvm 17.0.4
java 1.java 2102ms 48ms 967.5MB 1730ms 713ms openjdk/zgc 19

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2398ms 4.1ms 194.4MB 2297ms 87ms crystal 1.5.1
java 3.java timeout 0.0ms 0.0MB 0ms 0ms graal/jvm 17.0.4
java 3.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 3.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 3.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 243ms 1.6ms 24.6MB 223ms 3ms crystal 1.5.1
java 3.java 1005ms 4.4ms 109.9MB 1327ms 43ms openjdk 19
java 3.java 1009ms 12ms 113.9MB 1327ms 47ms openjdk 20
java 3.java 1023ms 47ms 189.9MB 1433ms 70ms graal/jvm 17.0.4
java 3.java 1145ms 36ms 159.8MB 1283ms 163ms openjdk/zgc 19

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 4360ms 25ms 107.0MB 8363ms 43ms graal/jvm 17.0.4
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 1256ms 53ms 103.4MB 2277ms 47ms graal/jvm 17.0.4
crystal 1.cr 1425ms 3.3ms 4.1MB 1410ms 0ms crystal 1.5.1
java 2-m.java 1633ms 55ms 42.8MB 3080ms 23ms openjdk 20
java 2-m.java 1736ms 112ms 45.0MB 3293ms 10ms openjdk 19
java 2-m.java 1749ms 139ms 42.7MB 3200ms 77ms openjdk/zgc 19

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 361ms 0.6ms 5.5MB 350ms 0ms crystal 1.5.1
java 2-m.java 436ms 26ms 100.2MB 727ms 37ms graal/jvm 17.0.4
java 2-m.java 577ms 28ms 44.3MB 1013ms 20ms openjdk 20
java 2-m.java 583ms 8.5ms 43.6MB 1033ms 7ms openjdk 19
java 2-m.java 632ms 24ms 44.2MB 1010ms 77ms openjdk/zgc 19