Benchmark Comparison Results
Color
Benchmark
Configurations
IgnitePutAllTxBenchmark
1.7.1-5be40d3f-tx-putAll-bs-6-1-backup
HazelcastSetAllTxBenchmark
3.7-1302600-tx-setAll-bs-6-1-backup
ThroughputLatencyProbe
Avg
Min
Max
SD
11,623.60
9,516.00
12,392.00
289.65
9,064.38
8,809.00
9,294.00
85.07
Avg
Min
Max
SD
11,623.60
9,516.00
12,392.00
289.65
9,064.38
8,809.00
9,294.00
85.07
Avg
Min
Max
SD
5,509,136.33
5,159,296.59
6,729,743.29
145,343.62
7,061,115.89
6,888,624.07
7,335,460.11
67,514.18
Avg
Min
Max
SD
5,509,136.33
5,159,296.59
6,729,743.29
145,343.62
7,061,115.89
6,888,624.07
7,335,460.11
67,514.18
DStatProbe
Avg
Min
Max
SD
1,258,328.75
822,272.00
1,693,696.00
253,049.82
407,026.35
396,288.00
415,744.00
5,171.78
Avg
Min
Max
SD
1,258,328.75
822,272.00
1,693,696.00
253,049.82
407,026.35
396,288.00
415,744.00
5,171.78
Avg
Min
Max
SD
18,138.45
17,920.00
18,432.00
144.41
35,966.29
35,737.60
36,249.60
143.07
Avg
Min
Max
SD
18,138.45
17,920.00
18,432.00
144.41
35,966.29
35,737.60
36,249.60
143.07
Avg
Min
Max
SD
171,837.44
171,008.00
173,056.00
481.72
457,482.24
455,680.00
458,752.00
769.21
Avg
Min
Max
SD
171,837.44
171,008.00
173,056.00
481.72
457,482.24
455,680.00
458,752.00
769.21
Avg
Min
Max
SD
13,952,352.26
13,526,630.40
14,365,491.20
256,483.71
14,470,348.80
14,470,348.80
14,470,348.80
0.00
Avg
Min
Max
SD
13,952,352.26
13,526,630.40
14,365,491.20
256,483.71
14,470,348.80
14,470,348.80
14,470,348.80
0.00
Avg
Min
Max
SD
4.95
3.00
7.00
0.97
2.16
1.00
3.00
0.53
Avg
Min
Max
SD
4.95
3.00
7.00
0.97
2.16
1.00
3.00
0.53
Avg
Min
Max
SD
1.78
1.00
3.00
0.59
4.42
3.00
6.00
0.67
Avg
Min
Max
SD
1.78
1.00
3.00
0.59
4.42
3.00
6.00
0.67
Avg
Min
Max
SD
92.29
90.00
95.00
1.31
89.18
87.00
92.00
0.82
Avg
Min
Max
SD
92.29
90.00
95.00
1.31
89.18
87.00
92.00
0.82
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.89
0.00
2.00
0.37
4.21
2.00
5.00
0.52
Avg
Min
Max
SD
0.89
0.00
2.00
0.37
4.21
2.00
5.00
0.52
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
23,620.27
0.00
409,600.00
57,547.01
36,563.63
0.00
385,024.00
82,044.01
Avg
Min
Max
SD
23,620.27
0.00
409,600.00
57,547.01
36,563.63
0.00
385,024.00
82,044.01
Avg
Min
Max
SD
14,728,997.55
12,582,912.00
15,728,640.00
350,179.35
5,532,689.07
5,399,552.00
5,665,792.00
50,015.27
Avg
Min
Max
SD
14,728,997.55
12,582,912.00
15,728,640.00
350,179.35
5,532,689.07
5,399,552.00
5,665,792.00
50,015.27
Avg
Min
Max
SD
28,926,716.59
24,117,248.00
30,408,704.00
754,353.61
10,483,121.49
10,219,520.00
10,485,760.00
26,297.25
Avg
Min
Max
SD
28,926,716.59
24,117,248.00
30,408,704.00
754,353.61
10,483,121.49
10,219,520.00
10,485,760.00
26,297.25
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
Avg
Min
Max
SD
184,982.19
173,056.00
194,560.00
2,973.12
250,763.95
243,712.00
258,048.00
3,256.61
Avg
Min
Max
SD
184,982.19
173,056.00
194,560.00
2,973.12
250,763.95
243,712.00
258,048.00
3,256.61
Avg
Min
Max
SD
215,934.29
197,632.00
226,304.00
3,526.01
258,300.59
247,808.00
268,288.00
4,203.22
Avg
Min
Max
SD
215,934.29
197,632.00
226,304.00
3,526.01
258,300.59
247,808.00
268,288.00
4,203.22
PercentileProbe