Benchmark Comparison Results

ColorBenchmarkConfigurations
IgniteSqlQueryBenchmark 1.7.1-5be40d3f-sql-query-1-backup
HazelcastSqlQueryBenchmark 3.7-1302600-sql-query-1-backup

ThroughputLatencyProbe

Avg Min Max SD
74,447.48 66,336.00 79,559.00 2,533.85
58,605.58 56,536.00 60,156.00 639.30
Avg Min Max SD
859,910.10 803,693.22 963,568.87 29,249.64
1,091,359.24 1,063,084.82 1,131,406.32 11,913.50

DStatProbe

Avg Min Max SD
1,298,865.49 1,140,736.00 1,461,248.00 92,606.97
446,681.73 416,768.00 475,136.00 16,356.71
Avg Min Max SD
14,464.00 14,233.60 14,745.60 145.81
32,332.20 32,051.20 32,563.20 148.31
Avg Min Max SD
161,884.16 160,768.00 162,816.00 599.76
438,299.22 437,248.00 439,296.00 805.84
Avg Min Max SD
13,925,089.28 13,736,345.60 14,050,918.40 97,780.22
14,470,348.80 14,470,348.80 14,470,348.80 0.00
Avg Min Max SD
20.75 17.00 25.00 1.45
5.29 3.00 8.00 0.89
Avg Min Max SD
9.93 8.00 12.00 0.86
2.91 2.00 5.00 0.50
Avg Min Max SD
65.95 62.00 71.00 1.51
90.96 86.00 94.00 1.44
Avg Min Max SD
0.00 0.00 0.00 0.00
0.00 0.00 0.00 0.00
Avg Min Max SD
0.00 0.00 0.00 0.00
0.00 0.00 0.00 0.00
Avg Min Max SD
3.38 2.00 5.00 0.59
0.70 0.00 5.00 1.31
Avg Min Max SD
0.00 0.00 0.00 0.00
0.00 0.00 0.00 0.00
Avg Min Max SD
25,313.28 0.00 319,488.00 56,372.08
38,183.97 0.00 376,832.00 77,864.86
Avg Min Max SD
20,230,526.29 17,825,792.00 20,971,520.00 575,884.63
12,575,944.72 11,534,336.00 12,582,912.00 85,330.96
Avg Min Max SD
57,343,126.19 51,380,224.00 60,817,408.00 1,565,595.63
10,457,778.60 10,020,864.00 10,485,760.00 92,487.06
Avg Min Max SD
0.00 0.00 0.00 0.00
0.00 0.00 0.00 0.00
Avg Min Max SD
0.00 0.00 0.00 0.00
0.00 0.00 0.00 0.00
Avg Min Max SD
143,534.08 136,192.00 147,456.00 1,999.77
177,267.67 168,960.00 182,272.00 2,003.27
Avg Min Max SD
233,127.25 223,232.00 238,592.00 2,697.57
202,840.45 195,584.00 207,872.00 2,133.06

PercentileProbe