maDeepLabCut Extended Performance Data

	A	B	C	D	E	F	G	H	I	J	K	L	M	N	O	P
1	Welcome to the extended results from our network parameter sweep for the development of DLC-nets
2	Please note this was developed on 95/5 splits, whereas the offical maDLC benchmark is 70/15 val /15 non-public test
3							Graph sizes:
4	name	backbone	stride	pafwidth	pairwise_loss_weight	assembly method	11	17	23	29	35	41	47	53	59	66
5	multifusion-3M-DLC_stride2_fc_p20	DLCRNet	2	20	0.1	calibrated	0.9635	0.9734	0.9777	0.9746	0.9759	0.9853	0.9870	0.9865	0.9882	0.9879
6	multistage3-3M-DLC_stride4_fc_p16	DLCRNet	4	16	0.1	calibrated	0.9815	0.9839	0.9839	0.9903	0.9901	0.9875	0.9878	0.9879	0.9839	0.9864
7	DLC-ResNet50_fullyconnected_stride4	resnet50	4	20	0.1	calibrated	0.99	0.9908	0.9913	0.9863	0.9870	0.9852	0.9882	0.9844	0.9866	0.9863
8	multifusion-3M-DLC_stride2_fc_p16	DLCRNet	2	16	0.1	calibrated	0.9515	0.9575	0.9621	0.9742	0.9789	0.9853	0.9842	0.9851	0.9862	0.9859
9	multistage3-3M-DLC_stride4_fc_p20	DLCRNet	4	20	0.1	calibrated	0.9706	0.9792	0.9860	0.9862	0.9861	0.9850	0.9880	0.9857	0.9857	0.9856
10	multifusion-3M-DLC_stride4_fc_p16	DLCRNet	4	16	0.1	calibrated	0.9847	0.9850	0.9860	0.9856	0.9826	0.9840	0.9835	0.9853	0.9855	0.9851
11	multifusion-3M-DLC_stride4_fc_p8	DLCRNet	4	8	0.1	calibrated	0.9865	0.9892	0.9890	0.9880	0.9910	0.9844	0.9833	0.9834	0.9853	0.9851
12	multistage3-3M-DLC_stride8_fc_p16	DLCRNet	8	16	0.1	calibrated	0.9767	0.9765	0.9789	0.9772	0.9742	0.9839	0.9838	0.9835	0.9821	0.9835
13	multifusion-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	calibrated	0.9821	0.9816	0.9812	0.9839	0.9846	0.9880	0.9835	0.9815	0.9833	0.9830
14	multifusion-3M-DLC_stride4_fc_p20	DLCRNet	4	20	0.1	calibrated	0.9804	0.9751	0.9799	0.9838	0.9834	0.9826	0.9836	0.9833	0.9834	0.9829
15	multistage5_single-shortcut-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	calibrated	0.9834	0.9835	0.9834	0.9828	0.9826	0.9819	0.9844	0.9843	0.9832	0.9822
16	multistage5-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	calibrated	0.9563	0.9809	0.9842	0.9840	0.9807	0.9850	0.9808	0.9807	0.9816	0.9802
17	multifusion-3M-DLC_stride8_fc_p16	DLCRNet	8	16	0.1	calibrated	0.9713	0.9721	0.9709	0.9715	0.9774	0.9786	0.9791	0.9783	0.9777	0.9800
18	DLC-ResNet50_fullyconnected8	resnet50	8	20	0.1	calibrated	0.96	0.9790	0.9791	0.9823	0.9811	0.9814	0.9841	0.9837	0.9779	0.9786
19	DLC-ResNet50_fullyconnected	resnet50	8	12	0.1	calibrated	0.96	0.9717	0.9755	0.9736	0.9757	0.9703	0.9798	0.9810	0.9836	0.9760
20	multifusion-3M-DLC_stride8_fc_p20	DLCRNet	8	20	0.1	calibrated	0.9753	0.9754	0.9750	0.9698	0.9678	0.9744	0.9761	0.9752	0.9773	0.9758
21	multistage3-3M-DLC_stride4_fc_p8	DLCRNet	4	8	0.1	calibrated	0.9684	0.9880	0.9865	0.9884	0.9821	0.9781	0.9797	0.9797	0.9762	0.9746
22	multifusion-3M-DLC_stride2_fc_p12	DLCRNet	2	12	0.1	calibrated	0.9413	0.9495	0.9654	0.9718	0.9574	0.9791	0.9743	0.9743	0.9739	0.9729
23	multistage3-3M-DLC_stride8_fc_p20	DLCRNet	8	20	0.1	calibrated	0.9742	0.9750	0.9757	0.9698	0.9718	0.9715	0.9674	0.9742	0.9727	0.9725
24	multistage3-3M-DLC_stride8_fc_p8	DLCRNet	8	8	0.1	calibrated	0.9688	0.9779	0.9695	0.9695	0.9739	0.9725	0.9746	0.9756	0.9766	0.9724
25	multistage3-3M-DLC_stride8_fc_p12	DLCRNet	8	12	0.1	calibrated	0.9697	0.9779	0.9773	0.9795	0.9788	0.9737	0.9753	0.9730	0.9719	0.9718
26	DLC-ResNet50_fullyconnected16	resnet50	8	20	0.1	calibrated	0.97	0.9761	0.9714	0.9735	0.9752	0.9786	0.9725	0.9733	0.9715	0.9704
27	Associative embedding (MMPose)	HRNet	4			AE	0.97	0.97	0.97	0.97	0.97	0.97	0.97	0.97	0.97	0.97
28	multifusion-3M-DLC_stride2_fc_p8	DLCRNet	2	8	0.1	calibrated	0.9352	0.9739	0.9698	0.9758	0.9817	0.9803	0.9803	0.9753	0.9746	0.9698
29	multifusion-3M-DLC_stride8_fc_p8	DLCRNet	8	8	0.1	calibrated	0.9788	0.9711	0.9720	0.9733	0.9749	0.9752	0.9746	0.9707	0.9696	0.9696
30	DLC-Efficientnet-b7_fullyconnected	effnetb7	8	20	1	calibrated	0.9733	0.9702	0.9731	0.9757	0.9743	0.9727	0.9688	0.9708	0.9697	0.9695
31	multistage3-3M-DLC_stride2_fc_p16	DLCRNet	2	16	0.1	calibrated	0.9366	0.9760	0.9743	0.9756	0.9723	0.9690	0.9680	0.9734	0.9699	0.9694
32	DLC-Efficientnet-b0_fullyconnected	effnetb0	8	20	1	calibrated	0.9675	0.9711	0.9717	0.9736	0.9753	0.9757	0.9695	0.9687	0.9680	0.9694
33	multistage3-3M-DLC_stride2_fc_p12	DLCRNet	2	12	0.1	calibrated	0.9437	0.9654	0.9768	0.9872	0.9752	0.9675	0.9646	0.9683	0.9687	0.9694
34	DLC-Efficientnet-b0_fullyconnected	effnetb0	4	20	1	calibrated	0.9722	0.9768	0.9776	0.9706	0.9616	0.9646	0.9634	0.9658	0.9638	0.9689
35	DLC-ResNet50_fullyconnected	resnet50	8	20	0.1	calibrated	0.98	0.9770	0.9773	0.9773	0.9776	0.9799	0.9832	0.9807	0.9806	0.9687
36	multifusion-3M-DLC_stride8_fc_p12	DLCRNet	8	12	0.1	calibrated	0.9318	0.9661	0.9702	0.9727	0.9762	0.9795	0.9741	0.9742	0.9719	0.9637
37	DLC-Efficientnet-b7_fullyconnected	effnetb7	4	20	1	calibrated	0.9369	0.9472	0.9558	0.9742	0.9578	0.9602	0.9674	0.9669	0.9607	0.9616
38	DLC-Efficientnet-b7_fullyconnected	effnetb7	4	20	0.1	calibrated	0.9667	0.9690	0.9730	0.9730	0.9792	0.9761	0.9784	0.9704	0.9685	0.9615
39	multistage3-3M-DLC_stride2_fc_p20	DLCRNet	2	20	0.1	calibrated	0.9490	0.9714	0.9688	0.9876	0.9874	0.9780	0.9836	0.9900	0.9601	0.9610
40	multistage3-3M-DLC_stride4_fc_p20	DLCRNet	4	20	0.1	baseline	0.9721	0.9015	0.9370	0.9018	0.9074	0.9447	0.9611	0.9562	0.9570	0.9593
41	multistage3-3M-DLC_stride4_fc_p20	DLCRNet	4	20	0.1	data-driven	0.9715	0.9781	0.9819	0.9771	0.9783	0.9793	0.9791	0.9722	0.9673	0.9582
42	DLC-Efficientnet-b7_fullyconnected	effnetb7	8	20	0.1	calibrated	0.9702	0.9663	0.9632	0.9652	0.9676	0.9655	0.9596	0.9622	0.9600	0.9559
43	DLC-Efficientnet-b0_fullyconnected	effnetb0	8	20	0.1	calibrated	0.9392	0.9434	0.9477	0.9537	0.9576	0.9602	0.9687	0.9584	0.9583	0.9555
44	multistage5_single-shortcut-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	data-driven	0.9828	0.9825	0.9776	0.9806	0.9723	0.9703	0.9719	0.9662	0.9628	0.9541
45	multistage5_single-shortcut-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	baseline	0.9592	0.9212	0.9282	0.9427	0.9463	0.9517	0.9543	0.9522	0.9500	0.9528
46	multifusion-3M-DLC_stride4_fc_p16	DLCRNet	4	16	0.1	baseline	0.9562	0.8937	0.9173	0.9206	0.9202	0.9224	0.9442	0.9527	0.9530	0.9525
47	multifusion-3M-DLC_stride4_fc_p16	DLCRNet	4	16	0.1	data-driven	0.9859	0.9855	0.9787	0.9802	0.9785	0.9711	0.9716	0.9701	0.9675	0.9525
48	multistage3-3M-DLC_stride2_fc_p8	DLCRNet	2	8	0.1	calibrated	0.9491	0.9667	0.9692	0.9724	0.9727	0.9701	0.9641	0.9729	0.9508	0.9488
49	multistage3-3M-DLC_stride4_fc_p8	DLCRNet	4	8	0.1	baseline	0.9669	0.9082	0.9136	0.9091	0.9271	0.9368	0.9473	0.9461	0.9512	0.9486
50	DLC-ResNet50_fullyconnected_stride4	resnet50	4	20	0.1	data-driven	0.99	0.9868	0.9850	0.9819	0.9771	0.9675	0.9696	0.9635	0.9626	0.9475
51	multistage3-3M-DLC_stride4_fc_p8	DLCRNet	4	8	0.1	data-driven	0.9679	0.9676	0.9707	0.9705	0.9593	0.9561	0.9624	0.9598	0.9586	0.9469
52	DLC-ResNet50_fullyconnected	resnet50	8	12	0.1	data-driven	0.96	0.9619	0.9636	0.9594	0.9580	0.9560	0.9617	0.9594	0.9578	0.9463
53	DLC-ResNet50_fullyconnected_stride4	resnet50	4	20	0.1	baseline	0.94	0.9274	0.9372	0.9364	0.9436	0.9580	0.9582	0.9449	0.9436	0.9457
54	DLC-ResNet50_fullyconnected	resnet50	8	12	0.1	baseline	0.96	0.8677	0.8618	0.8922	0.8969	0.9124	0.9118	0.9189	0.9299	0.9431
55	multifusion-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	data-driven	0.9772	0.9803	0.9771	0.9732	0.9671	0.9692	0.9673	0.9589	0.9592	0.9421
56	multistage3-3M-DLC_stride4_fc_p16	DLCRNet	4	16	0.1	baseline	0.9655	0.9020	0.9111	0.9097	0.9232	0.9407	0.9472	0.9442	0.9455	0.9417
57	multifusion-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	baseline	0.9221	0.8700	0.8818	0.8908	0.9003	0.9228	0.9437	0.9398	0.9423	0.9410
58	multistage3-3M-DLC_stride4_fc_p16	DLCRNet	4	16	0.1	data-driven	0.9796	0.9778	0.9717	0.9715	0.9682	0.9657	0.9573	0.9602	0.9550	0.9408
59	DLC-ResNet50_fullyconnected8	resnet50	8	20	0.1	data-driven	0.95	0.9698	0.9623	0.9445	0.9512	0.9408	0.9639	0.9547	0.9510	0.9336
60	DLC-ResNet50_fullyconnected8	resnet50	8	20	0.1	baseline	0.95	0.8897	0.8662	0.8692	0.8850	0.9018	0.9113	0.9075	0.9230	0.9331
61	DLC-Efficientnet-b7_fullyconnected	effnetb7	8	20	1	baseline	0.9415	0.8515	0.8554	0.8968	0.9230	0.9182	0.9313	0.9349	0.9306	0.9326
62	DLC-Efficientnet-b7_fullyconnected	effnetb7	8	20	1	data-driven	0.9670	0.9739	0.9751	0.9649	0.9672	0.9627	0.9547	0.9500	0.9512	0.9323
63	multifusion-3M-DLC_stride8_fc_p20	DLCRNet	8	20	0.1	baseline	0.9340	0.8948	0.8510	0.8866	0.9004	0.9171	0.9270	0.9389	0.9370	0.9313
64	multifusion-3M-DLC_stride8_fc_p20	DLCRNet	8	20	0.1	data-driven	0.9755	0.9758	0.9755	0.9685	0.9697	0.9687	0.9643	0.9467	0.9456	0.9312
65	Associative embedding (MMPose)	resnet50	4			AE	0.93	0.93	0.93	0.93	0.93	0.93	0.93	0.93	0.93	0.93
66	multifusion-3M-DLC_stride8_fc_p16	DLCRNet	8	16	0.1	data-driven	0.9729	0.9699	0.9713	0.9546	0.9433	0.9251	0.9204	0.9400	0.9464	0.9205
67	multifusion-3M-DLC_stride4_fc_p20	DLCRNet	4	20	0.1	baseline	0.9068	0.8810	0.8949	0.8941	0.8988	0.9184	0.9293	0.9288	0.9331	0.9192
68	multifusion-3M-DLC_stride2_fc_p16	DLCRNet	2	16	0.1	baseline	0.8764	0.8080	0.8481	0.8458	0.8710	0.8733	0.8950	0.8760	0.9176	0.9192
69	multifusion-3M-DLC_stride2_fc_p16	DLCRNet	2	16	0.1	data-driven	0.9467	0.9374	0.9498	0.9443	0.9505	0.9387	0.9426	0.9410	0.9281	0.9180
70	multifusion-3M-DLC_stride4_fc_p20	DLCRNet	4	20	0.1	data-driven	0.9817	0.9732	0.9690	0.9711	0.9586	0.9707	0.9665	0.9409	0.9373	0.9178
71	multifusion-3M-DLC_stride2_fc_p20	DLCRNet	2	20	0.1	data-driven	0.9588	0.9587	0.9495	0.9511	0.9405	0.9468	0.9343	0.9303	0.9354	0.9156
72	multistage3-3M-DLC_stride8_fc_p20	DLCRNet	8	20	0.1	baseline	0.9343	0.8579	0.8684	0.8864	0.9040	0.8981	0.8822	0.8941	0.9096	0.9140
73	multifusion-3M-DLC_stride2_fc_p20	DLCRNet	2	20	0.1	baseline	0.8963	0.7951	0.8447	0.8483	0.8567	0.8535	0.8789	0.9158	0.9154	0.9139
74	multifusion-3M-DLC_stride2_fc_p12	DLCRNet	2	12	0.1	data-driven	0.9391	0.9312	0.9364	0.9358	0.9135	0.9413	0.9273	0.9249	0.9295	0.9134
75	DLC-ResNet50_fullyconnected16	resnet50	8	20	0.1	data-driven	0.98	0.9773	0.9774	0.9694	0.9643	0.9609	0.9441	0.9107	0.9307	0.9131
76	multistage3-3M-DLC_stride8_fc_p20	DLCRNet	8	20	0.1	data-driven	0.9709	0.9705	0.9704	0.9621	0.9592	0.9571	0.9504	0.9450	0.9448	0.9128
77	DLC-ResNet50_fullyconnected16	resnet50	8	20	0.1	baseline	0.96	0.8628	0.8650	0.8825	0.8980	0.9112	0.9124	0.9091	0.9129	0.9116
78	multistage3-3M-DLC_stride8_fc_p12	DLCRNet	8	12	0.1	data-driven	0.9790	0.9682	0.9686	0.9710	0.9628	0.9593	0.9564	0.9556	0.9485	0.9102
79	multistage5-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	baseline	0.9656	0.9316	0.9262	0.9231	0.9298	0.9355	0.9158	0.9148	0.9086	0.9098
80	DLC-Efficientnet-b0_fullyconnected	effnetb0	8	20	1	baseline	0.9400	0.8919	0.9081	0.9247	0.9244	0.9264	0.9009	0.8935	0.9038	0.9095
81	multistage5-3M-DLC_stride4_fc_p12	DLCRNet	4	12	0.1	data-driven	0.9630	0.9772	0.9729	0.9704	0.9294	0.9465	0.9526	0.9358	0.9410	0.9084
82	multifusion-3M-DLC_stride8_fc_p16	DLCRNet	8	16	0.1	baseline	0.9348	0.8775	0.8584	0.8775	0.8792	0.8980	0.8864	0.8834	0.8987	0.9075
83	multifusion-3M-DLC_stride4_fc_p8	DLCRNet	4	8	0.1	data-driven	0.9779	0.9748	0.9743	0.9723	0.9547	0.9409	0.9445	0.9236	0.9192	0.9073
84	multifusion-3M-DLC_stride2_fc_p12	DLCRNet	2	12	0.1	baseline	0.8901	0.8489	0.8618	0.8422	0.8931	0.8975	0.9022	0.8977	0.9109	0.9072
85	multistage3-3M-DLC_stride8_fc_p12	DLCRNet	8	12	0.1	baseline	0.9227	0.8812	0.8659	0.8872	0.8836	0.8940	0.8987	0.8909	0.9053	0.9063
86	DLC-Efficientnet-b0_fullyconnected	effnetb0	4	20	1	baseline	0.9312	0.8859	0.8760	0.8889	0.8972	0.9084	0.8954	0.9047	0.8982	0.9054
87	DLC-ResNet50_fullyconnected	resnet50	8	20	0.1	baseline	0.92	0.8975	0.9040	0.8933	0.8964	0.8969	0.9168	0.9208	0.9117	0.9053
88	DLC-Efficientnet-b0_fullyconnected	effnetb0	4	20	1	data-driven	0.9683	0.9712	0.9667	0.9554	0.9477	0.9493	0.9415	0.9364	0.9166	0.9035
89	DLC-Efficientnet-b7_fullyconnected	effnetb7	4	20	0.1	baseline	0.9246	0.8327	0.8294	0.8721	0.8838	0.9023	0.9073	0.8986	0.8969	0.9031
90	DLC-ResNet50_fullyconnected	resnet50	8	20	0.1	data-driven	0.98	0.9717	0.9634	0.9653	0.9660	0.9627	0.9650	0.9535	0.9283	0.9027
91	DLC-Efficientnet-b7_fullyconnected	effnetb7	4	20	0.1	data-driven	0.9662	0.9561	0.9527	0.9403	0.9460	0.9413	0.9403	0.9355	0.9145	0.9026
92	multifusion-3M-DLC_stride4_fc_p8	DLCRNet	4	8	0.1	baseline	0.9344	0.8426	0.8616	0.8592	0.8642	0.8897	0.8970	0.8863	0.9027	0.9015
93	multifusion-3M-DLC_stride8_fc_p8	DLCRNet	8	8	0.1	data-driven	0.9785	0.9675	0.9641	0.9667	0.9626	0.9619	0.9642	0.9579	0.9406	0.9012
94	multifusion-3M-DLC_stride8_fc_p8	DLCRNet	8	8	0.1	baseline	0.9539	0.8415	0.8331	0.8528	0.8557	0.8745	0.8805	0.8810	0.9002	0.8987
95	DLC-Efficientnet-b0_fullyconnected	effnetb0	8	20	1	data-driven	0.9668	0.9669	0.9671	0.9398	0.9382	0.9152	0.9145	0.9206	0.9162	0.8957
96	multistage3-3M-DLC_stride8_fc_p16	DLCRNet	8	16	0.1	baseline	0.9216	0.8649	0.8644	0.8841	0.8769	0.8951	0.8955	0.8936	0.8966	0.8955
97	multifusion-3M-DLC_stride2_fc_p8	DLCRNet	2	8	0.1	data-driven	0.9306	0.9275	0.9264	0.9296	0.9307	0.9269	0.9311	0.9236	0.9198	0.8939
98	multistage3-3M-DLC_stride8_fc_p16	DLCRNet	8	16	0.1	data-driven	0.9755	0.9760	0.9749	0.9632	0.9498	0.9582	0.9562	0.9553	0.9342	0.8939
99	multifusion-3M-DLC_stride8_fc_p12	DLCRNet	8	12	0.1	baseline	0.9332	0.8688	0.8694	0.8667	0.8673	0.8823	0.8994	0.8947	0.9034	0.8916
100	multifusion-3M-DLC_stride8_fc_p12	DLCRNet	8	12	0.1	data-driven	0.9423	0.9676	0.9634	0.9560	0.9608	0.9596	0.9597	0.9553	0.9389	0.8894