1. Results of measuring performance of Mesos Marathon

Abstract:This document includes performance test results for Mesos as a container platform for Docker with Marathon. All tests have been performed regarding Measuring performance of container cluster systems

1.1. Environment description

1.1.1. Cluster description

• 3 master nodes with Mesos, Marathon and Zookeeper
• 189 mesos slaves nodes

1.1.2. Software versions

• Mesos - 0.27.0
• Marathon - 0.15.2
• Zookeeper - 3.4.5
• Docker - 1.10.2

1.1.3. Running options

• Marathon extra options are “-Xmx2048m –max_tasks_per_offer 20”

1.1.4. Hardware configuration of each server

Description of servers hardware

server	vendor,model	HP,DL380 Gen9
	operating_system	3.13.0-76-generic Ubuntu-trusty x86_64
CPU	vendor,model	Intel,E5-2680 v3
	processor_count	2
	core_count	12
	frequency_MHz	2500
RAM	vendor,model	HP,752369-081
	amount_MB	262144
NETWORK	interface_name	p1p1
	vendor,model	Intel,X710 Dual Port
	bandwidth	10G
STORAGE	dev_name	/dev/sda
	vendor,model	raid10 - HP P840 12 disks EH0600JEDHE
	SSD/HDD	HDD
	size	3,6TB

1.1.5. Network scheme and part of configuration of hardware network switches

Network scheme of the environment:

Here is the part of switch configuration for each switch port which connected to p1p1.603 interface of a server:

switchport mode trunk
switchport trunk native vlan 600
switchport trunk allowed vlan 600-602,630-649
spanning-tree port type edge trunk
spanning-tree bpduguard enable
no snmp trap link-status

1.2. Results

1.2.1. Test create

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	50	6.15	6.15	6.15	6.15
1	100	6.09	6.09	6.09	6.09
1	500	14.18	14.18	14.18	14.18
2	50	6.08	6.1	6.09	6.09
2	100	6.09	6.12	6.11	6.105
2	500	20.3	22.27	21.29	21.285
4	50	6.15	16.2	11.66	12.155
4	100	6.24	16.19	10.24	9.26
4	500	28.39	38.42	33.13	32.86
8	50	8.11	12.24	10.16	10.16
8	100	6.46	16.25	12.08	13.185
8	500	29.12	83.03	58.19	58.06
16	50	8.12	20.36	12.88	13.22
16	100	9.02	26.39	19.3	20.28
16	500	130.43	453.85	296.59	320.07

Graph for test create, concurrency 1

Graph for test create, concurrency 2

Graph for test create, concurrency 4

Graph for test create, concurrency 8

Graph for test create, concurrency 16

1.2.2. Test delete

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	50	0.01	0.01	0.01	0.01
1	100	0.01	0.01	0.01	0.01
1	500	0.01	0.01	0.01	0.01
2	50	0.01	0.02	0.01	0.01
2	100	0.02	0.02	0.02	0.02
2	500	0.01	0.02	0.01	0.01
4	50	0.02	0.03	0.03	0.03
4	100	0.02	0.03	0.03	0.03
4	500	0.02	0.04	0.03	0.04
8	50	0.04	0.05	0.04	0.04
8	100	0.04	0.05	0.05	0.05
8	500	0.05	0.07	0.06	0.07
16	50	0.12	0.13	0.12	0.12
16	100	0.09	0.11	0.1	0.1
16	500	0.13	0.15	0.14	0.14

Graph for test delete, concurrency 1

Graph for test delete, concurrency 2

Graph for test delete, concurrency 4

Graph for test delete, concurrency 8

Graph for test delete, concurrency 16

1.2.3. Test restart

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	500	28.63	28.63	28.63	28.63
2	50	8.51	8.53	8.52	8.52
2	100	14.47	16.59	15.53	15.53
2	500	28.81	30.83	29.82	29.82
4	50	10.56	12.53	11.07	10.59
4	100	12.74	28.65	18.19	15.69
4	500	63.31	75.2	68.69	68.12
8	50	12.75	22.68	17.18	16.64
8	100	26.73	38.87	31.54	30.755
8	500	433.62	441.69	439.17	439.505
16	50	19.36	30.86	23.32	22.73
16	100	45.8	63.07	51.96	51.35
16	500	605.63	1204.02	709.46	646.73

Graph for test restart, concurrency 2

Graph for test restart, concurrency 4

Graph for test restart, concurrency 8

Graph for test restart, concurrency 16

1.2.4. Test update_cpu

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	50	12.51	12.51	12.51	12.51
1	100	12.56	12.56	12.56	12.56
1	500	22.63	22.63	22.63	22.63
2	50	6.51	8.49	7.5	7.5
2	100	14.53	16.58	15.55	15.555
2	500	20.73	26.72	23.73	23.725
4	50	8.52	14.56	11.52	11.5
4	100	14.6	71.14	30.77	18.67
4	500	47.03	55.09	50.56	50.06
8	50	8.56	26.71	16.61	16.59
8	100	18.65	32.73	24.67	24.655
8	500	219.0	249.28	239.4	243.815
16	50	16.63	32.78	22.68	22.68
16	100	37.56	44.87	41.58	40.95
16	500	610.82	1205.25	883.32	736.29

Graph for test update_cpu, concurrency 1

Graph for test update_cpu, concurrency 2

Graph for test update_cpu, concurrency 4

Graph for test update_cpu, concurrency 8

Graph for test update_cpu, concurrency 16

1.2.5. Test update_disk

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	50	10.48	10.48	10.48	10.48
1	100	16.59	16.59	16.59	16.59
1	500	26.65	26.65	26.65	26.65
2	50	8.52	12.56	10.54	10.54
2	100	14.56	26.61	20.59	20.585
2	500	26.67	28.68	27.68	27.675
4	50	10.56	20.55	14.05	12.555
4	100	12.59	20.63	17.6	18.59
4	500	53.01	55.1	53.58	53.1
8	50	10.67	26.75	19.66	19.635
8	100	15.18	20.68	17.99	17.705
8	500	395.82	441.34	415.5	402.97
16	50	15.0	32.79	24.62	24.705
16	100	44.19	50.94	47.14	46.995
16	500	426.87	1204.53	731.92	610.83

Graph for test update_disk, concurrency 1

Graph for test update_disk, concurrency 2

Graph for test update_disk, concurrency 4

Graph for test update_disk, concurrency 8

Graph for test update_disk, concurrency 16

1.2.6. Test update_instances

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	50	600.05	600.05	600.05	600.05
1	100	16.17	16.17	16.17	16.17
1	500	600.31	600.31	600.31	600.31
2	50	10.12	600.11	305.12	305.115
2	100	14.16	600.19	307.18	307.175
2	500	600.72	601.09	600.9	600.905
4	50	10.13	600.17	452.65	600.155
4	100	14.18	600.36	308.75	310.225
4	500	39.4	602.01	461.02	601.33
8	50	20.24	600.4	323.46	336.595
8	100	18.23	600.79	169.8	28.68
8	500	150.94	603.91	546.72	603.255
16	50	14.25	600.72	276.17	32.375
16	100	24.24	601.53	351.71	601.0
16	500	603.1	1206.38	1016.9	1203.81

Graph for test update_instances, concurrency 1

Graph for test update_instances, concurrency 2

Graph for test update_instances, concurrency 4

Graph for test update_instances, concurrency 8

Graph for test update_instances, concurrency 16

1.2.7. Test update_mem

CONCURRENCY	NODES_NUMBER_PER_APPLICATION	APPLICATION_OPERATION (sec)
		minimum	maximum	average	median
1	50	8.58	8.58	8.58	8.58
1	100	10.55	10.55	10.55	10.55
1	500	22.68	22.68	22.68	22.68
2	50	10.46	10.48	10.47	10.47
2	100	10.54	14.5	12.52	12.52
2	500	26.6	26.76	26.68	26.68
4	50	10.51	10.55	10.54	10.54
4	100	10.57	18.65	16.59	18.575
4	500	56.96	69.29	63.66	64.2
8	50	18.61	22.74	21.16	20.695
8	100	15.1	26.77	21.26	20.7
8	500	294.84	304.16	300.42	300.86
16	50	13.92	24.67	19.78	21.645
16	100	39.57	49.03	41.95	41.24
16	500	498.57	1204.44	666.49	624.195

Graph for test update_mem, concurrency 1

Graph for test update_mem, concurrency 2

Graph for test update_mem, concurrency 4

Graph for test update_mem, concurrency 8

Graph for test update_mem, concurrency 16

1.2.8. Test health check

CONTAINERS_COUNT	HEALTH_CHECK_INTERVAL_DEVIATION (sec)
	minimum	maximum	average	95%
2500	0.00	0.12	0.02	0.04