(0,1,2,3,4,5,6,7,8,9)--con(3*3)*n—49*n*30*10
將mnist的圖片用間隔取點的辦法處理成9*9，用3*3的卷積核，卷積核的數量從1個到57個，收斂標準是1e-4,每個收斂標準收斂199次取平均值，比較卷積核數量的最優值是多少。
得到的表格
|
f2[0] |
f2[1] |
f2[2] |
f2[3] |
f2[4] |
f2[5] |
f2[6] |
f2[7] |
f2[8] |
f2[9] |
迭代次數n |
平均準確率p-ave |
δ |
耗時ms/次 |
耗時ms/199次 |
耗時 min/199 |
最大值p-max |
|
|
3層無核 |
0.03018 |
3.75E-05 |
0.221124 |
0.0101 |
0.015106 |
0.467342 |
0.0151 |
0.241225 |
3.71E-05 |
3.24E-05 |
1689378 |
0.927924 |
1.00E-04 |
28948.91 |
5760833 |
96.01388 |
0.93572 |
|
1 |
0.145746 |
2.19E-05 |
0.492465 |
0.125672 |
0.065336 |
0.050283 |
0.030176 |
0.090478 |
3.02E-05 |
1.93E-05 |
1990817 |
0.909972 |
1.00E-04 |
107722 |
21436683 |
357.2781 |
0.92138 |
|
2 |
0.145755 |
2.03E-05 |
0.47236 |
0.050298 |
0.055293 |
0.065354 |
0.050276 |
0.160823 |
2.77E-05 |
2.25E-05 |
933442.8 |
0.923857 |
1.00E-04 |
94093.7 |
18724673 |
312.0779 |
0.933915 |
|
3 |
0.115611 |
0.005053 |
0.467338 |
0.010103 |
0.030173 |
0.0553 |
0.135697 |
0.175895 |
0.005056 |
2.65E-05 |
726211.9 |
0.931374 |
1.00E-04 |
105439.1 |
20982392 |
349.7065 |
0.941536 |
|
4 |
0.130689 |
0.005055 |
0.52763 |
0.005073 |
0.050271 |
0.040225 |
0.135702 |
0.105548 |
3.68E-05 |
2.61E-05 |
618438.8 |
0.935437 |
1.00E-04 |
124103.7 |
2.47E+07 |
411.6105 |
0.943041 |
|
5 |
0.145763 |
0.010083 |
0.457287 |
0.010091 |
0.055295 |
0.040228 |
0.160822 |
0.120625 |
3.47E-05 |
2.67E-05 |
566818.9 |
0.937962 |
1.00E-04 |
138056 |
2.75E+07 |
457.8857 |
0.946149 |
|
6 |
0.170888 |
0.010082 |
0.417093 |
4.68E-05 |
0.06032 |
0.030179 |
0.145754 |
0.160824 |
0.005054 |
2.88E-05 |
536011.3 |
0.940188 |
1.00E-04 |
159576.3 |
3.18E+07 |
529.2614 |
0.947052 |
|
7 |
0.090493 |
0.025163 |
0.427142 |
0.015118 |
0.105542 |
0.045249 |
0.130674 |
0.160822 |
3.83E-05 |
2.83E-05 |
509640.6 |
0.940918 |
1.00E-04 |
177534.1 |
3.53E+07 |
588.8213 |
0.949458 |
|
8 |
0.145764 |
0.015114 |
0.407045 |
0.005069 |
0.060324 |
0.020126 |
0.155799 |
0.180915 |
0.010085 |
3.05E-05 |
513235.8 |
0.942645 |
1.00E-04 |
202541.2 |
40305709 |
671.7618 |
0.949559 |
|
9 |
0.140737 |
0.04024 |
0.38192 |
0.020143 |
0.040221 |
0.070378 |
0.165848 |
0.135698 |
0.005059 |
3.32E-05 |
502784.7 |
0.943339 |
1.00E-04 |
226370.5 |
4.50E+07 |
750.7956 |
0.950461 |
|
10 |
0.085475 |
0.025163 |
0.412065 |
4.29E-05 |
0.025152 |
0.065354 |
0.241218 |
0.145739 |
3.62E-05 |
2.84E-05 |
504104.1 |
0.943965 |
1.00E-04 |
259250 |
51590768 |
859.8461 |
0.949659 |
|
11 |
0.110591 |
0.025163 |
0.472363 |
4.90E-05 |
0.025149 |
0.045249 |
0.150774 |
0.155791 |
0.015118 |
2.63E-05 |
513026.2 |
0.944301 |
1.00E-04 |
280405.5 |
5.58E+07 |
930.0117 |
0.951464 |
|
12 |
0.120644 |
0.035213 |
0.45729 |
0.010097 |
0.030175 |
0.025151 |
0.165851 |
0.150769 |
0.005064 |
2.63E-05 |
510466.6 |
0.944593 |
1.00E-04 |
307725.6 |
6.12E+07 |
1020.623 |
0.953369 |
|
13 |
0.105568 |
0.030192 |
0.452263 |
0.00507 |
0.040224 |
0.040228 |
0.180919 |
0.120621 |
0.025161 |
2.75E-05 |
520095 |
0.945371 |
1.00E-04 |
329515.8 |
6.56E+07 |
1092.894 |
0.953771 |
|
14 |
0.085466 |
0.040242 |
0.412071 |
0.015121 |
0.055302 |
0.055301 |
0.195994 |
0.135695 |
0.005065 |
3.02E-05 |
512976.8 |
0.945288 |
1.00E-04 |
357932 |
7.12E+07 |
1187.141 |
0.952667 |
|
15 |
0.115616 |
0.025168 |
0.3769 |
0.010091 |
0.085448 |
0.025154 |
0.145747 |
0.190967 |
0.025155 |
3.67E-05 |
500753.4 |
0.94602 |
1.00E-04 |
368507.9 |
7.33E+07 |
1222.218 |
0.953771 |
|
16 |
0.080443 |
0.035216 |
0.432164 |
0.005072 |
0.050275 |
0.035198 |
0.165845 |
0.185943 |
0.010084 |
3.60E-05 |
504062.4 |
0.946325 |
1.00E-04 |
402002.3 |
8.00E+07 |
1333.308 |
0.952266 |
|
17 |
0.105571 |
0.04024 |
0.412068 |
4.35E-05 |
0.025151 |
0.035201 |
0.226144 |
0.140719 |
0.015113 |
2.81E-05 |
506346.1 |
0.9465 |
1.00E-04 |
425022.5 |
8.46E+07 |
1409.658 |
0.952467 |
|
18 |
0.100535 |
0.07039 |
0.407043 |
0.025171 |
0.050272 |
0.035201 |
0.100524 |
0.201022 |
0.010088 |
3.65E-05 |
512183.6 |
0.946328 |
1.00E-04 |
451628.7 |
8.99E+07 |
1497.902 |
0.954071 |
|
19 |
0.105567 |
0.055313 |
0.417092 |
0.005071 |
0.045251 |
0.040227 |
0.180923 |
0.145745 |
0.005062 |
3.16E-05 |
527430.3 |
0.946778 |
1.00E-04 |
487771.7 |
9.71E+07 |
1617.776 |
0.952667 |
|
20 |
0.125661 |
0.065361 |
0.442215 |
0.020146 |
0.040225 |
0.050272 |
0.125653 |
0.125651 |
0.005061 |
3.22E-05 |
523399.3 |
0.946712 |
1.00E-04 |
504626.9 |
1.00E+08 |
1673.679 |
0.953369 |
|
21 |
0.090493 |
0.065365 |
0.447237 |
0.015122 |
0.025153 |
0.055296 |
0.145747 |
0.145746 |
0.010088 |
2.98E-05 |
524106.1 |
0.947292 |
1.00E-04 |
542822.5 |
1.08E+08 |
1800.361 |
0.954473 |
|
22 |
0.115617 |
0.01512 |
0.412064 |
0.005071 |
0.025151 |
0.070375 |
0.165848 |
0.185939 |
0.005063 |
3.20E-05 |
532478.9 |
0.94718 |
1.00E-04 |
577178.9 |
1.15E+08 |
1914.31 |
0.954673 |
|
23 |
0.13571 |
0.055316 |
0.457288 |
4.62E-05 |
0.045252 |
0.025151 |
0.130675 |
0.135701 |
0.015115 |
3.43E-05 |
528054.6 |
0.947536 |
1.00E-04 |
603914.4 |
1.20E+08 |
2002.983 |
0.95367 |
|
24 |
0.100541 |
0.05029 |
0.467339 |
0.01512 |
0.050274 |
0.070369 |
0.105549 |
0.12565 |
0.015115 |
3.06E-05 |
529138 |
0.947381 |
1.00E-04 |
615613.9 |
1.23E+08 |
2041.786 |
0.954272 |
|
25 |
0.130688 |
0.050295 |
0.44724 |
4.60E-05 |
0.0352 |
0.030177 |
0.125654 |
0.170869 |
0.010084 |
3.17E-05 |
546074.9 |
0.947314 |
1.00E-04 |
665942 |
1.33E+08 |
2208.708 |
0.954071 |
|
26 |
0.05532 |
0.050294 |
0.412067 |
0.005074 |
0.035204 |
0.065346 |
0.15077 |
0.180919 |
0.045261 |
3.54E-05 |
539120.5 |
0.947706 |
1.00E-04 |
701803.6 |
1.40E+08 |
2327.649 |
0.956077 |
|
27 |
0.110587 |
0.065366 |
0.396991 |
4.40E-05 |
0.025157 |
0.060325 |
0.140724 |
0.19097 |
0.010087 |
3.38E-05 |
528761.1 |
0.947495 |
1.00E-04 |
699371.5 |
1.39E+08 |
2319.582 |
0.955174 |
|
28 |
0.070391 |
0.065369 |
0.432163 |
0.005071 |
0.040225 |
0.055296 |
0.1156 |
0.201018 |
0.015115 |
3.33E-05 |
533398 |
0.947871 |
1.00E-04 |
757388.8 |
1.51E+08 |
2512.006 |
0.954773 |
|
29 |
0.075415 |
0.070392 |
0.427138 |
4.86E-05 |
0.050277 |
0.030177 |
0.150771 |
0.185942 |
0.010086 |
3.39E-05 |
541848.7 |
0.947554 |
1.00E-04 |
807377.7 |
1.61E+08 |
2677.803 |
0.957581 |
|
30 |
0.095516 |
0.060343 |
0.407042 |
0.010091 |
0.035205 |
0.055297 |
0.170874 |
0.160823 |
0.005065 |
3.25E-05 |
544324.9 |
0.947917 |
1.00E-04 |
822086.7 |
1.64E+08 |
2726.588 |
0.955275 |
|
31 |
0.115612 |
0.060342 |
0.447241 |
0.005072 |
0.025148 |
0.070371 |
0.080429 |
0.19097 |
0.005063 |
3.17E-05 |
534737.7 |
0.948017 |
1.00E-04 |
813579.5 |
1.62E+08 |
2698.372 |
0.954773 |
|
32 |
0.03522 |
0.040246 |
0.457289 |
0.005076 |
0.030177 |
0.06032 |
0.135694 |
0.216089 |
0.020137 |
3.22E-05 |
532392.2 |
0.947611 |
1.00E-04 |
854092.9 |
1.70E+08 |
2832.742 |
0.954673 |
|
33 |
0.060346 |
0.040247 |
0.472355 |
0.015122 |
0.035202 |
0.060321 |
0.165847 |
0.140721 |
0.010091 |
3.35E-05 |
552430.2 |
0.948273 |
1.00E-04 |
903742.2 |
1.80E+08 |
2997.412 |
0.954673 |
|
34 |
0.080436 |
0.045271 |
0.417091 |
0.020143 |
0.030179 |
0.055298 |
0.165846 |
0.155794 |
0.030188 |
3.04E-05 |
551996.2 |
0.947777 |
1.00E-04 |
930373 |
1.85E+08 |
3085.737 |
0.953971 |
|
35 |
0.065366 |
0.035221 |
0.497483 |
0.005075 |
0.030177 |
0.050272 |
0.1357 |
0.160821 |
0.020137 |
3.31E-05 |
550661.4 |
0.948086 |
1.00E-04 |
959975.9 |
1.91E+08 |
3183.92 |
0.954874 |
|
36 |
0.105563 |
0.070392 |
0.44221 |
0.015118 |
0.02515 |
0.045251 |
0.135695 |
0.16082 |
4.26E-05 |
3.18E-05 |
554639.1 |
0.948436 |
1.00E-04 |
1005877 |
2.00E+08 |
3336.16 |
0.955576 |
|
37 |
0.095512 |
0.055321 |
0.396993 |
4.82E-05 |
0.045256 |
0.030176 |
0.160823 |
0.19097 |
0.025159 |
3.44E-05 |
550949.5 |
0.948139 |
1.00E-04 |
1012059 |
2.01E+08 |
3356.661 |
0.955375 |
|
38 |
0.115609 |
0.030192 |
0.457286 |
0.005071 |
0.050273 |
0.060319 |
0.090479 |
0.165845 |
0.025164 |
3.28E-05 |
563623.2 |
0.948436 |
1.00E-04 |
1385627 |
2.76E+08 |
4595.663 |
0.954473 |
|
39 |
0.060343 |
0.060346 |
0.447238 |
4.92E-05 |
0.060322 |
0.100519 |
0.095503 |
0.170871 |
0.005068 |
3.19E-05 |
557487.6 |
0.947838 |
1.00E-04 |
1398310 |
2.78E+08 |
4637.73 |
0.955375 |
|
40 |
0.07039 |
0.050296 |
0.467333 |
0.005073 |
0.015104 |
0.045248 |
0.100521 |
0.241213 |
0.005064 |
3.26E-05 |
566256.8 |
0.947848 |
1.00E-04 |
1467852 |
2.92E+08 |
4868.377 |
0.953971 |
|
41 |
0.075415 |
0.075414 |
0.447238 |
0.015121 |
0.060322 |
0.050275 |
0.120626 |
0.14575 |
0.010088 |
2.98E-05 |
564198.8 |
0.948148 |
1.00E-04 |
1478772 |
2.94E+08 |
4904.595 |
0.955174 |
|
42 |
0.105561 |
0.065364 |
0.427138 |
0.005071 |
0.0352 |
0.085447 |
0.125651 |
0.145747 |
0.005064 |
3.53E-05 |
552787.5 |
0.948351 |
1.00E-04 |
1490932 |
2.97E+08 |
4944.926 |
0.955475 |
|
43 |
0.080442 |
0.050296 |
0.447234 |
0.010094 |
0.0352 |
0.095495 |
0.100529 |
0.175892 |
0.005064 |
3.36E-05 |
565870.1 |
0.948116 |
1.00E-04 |
1569244 |
3.12E+08 |
5204.659 |
0.955275 |
|
44 |
0.09049 |
0.07039 |
0.366843 |
0.005068 |
0.030178 |
0.060326 |
0.145745 |
0.211066 |
0.020136 |
3.37E-05 |
566309.8 |
0.948049 |
1.00E-04 |
1616391 |
3.22E+08 |
5361.029 |
0.955275 |
|
45 |
0.085466 |
0.060342 |
0.47236 |
5.08E-05 |
0.040225 |
0.045248 |
0.100527 |
0.185946 |
0.010085 |
3.12E-05 |
562188.4 |
0.948042 |
1.00E-04 |
1642851 |
3.27E+08 |
5448.788 |
0.954773 |
|
46 |
0.055314 |
0.075417 |
0.402015 |
0.005072 |
0.025156 |
0.080422 |
0.125648 |
0.221115 |
0.010087 |
3.41E-05 |
572334 |
0.948496 |
1.00E-04 |
1717233 |
3.42E+08 |
5695.488 |
0.955174 |
|
47 |
0.060339 |
0.085464 |
0.482406 |
4.91E-05 |
0.010079 |
0.065346 |
0.085451 |
0.195994 |
0.005064 |
0.010082 |
578191.8 |
0.94894 |
1.00E-04 |
1770200 |
3.52E+08 |
5871.163 |
0.956578 |
|
48 |
0.095515 |
0.06034 |
0.442211 |
0.010095 |
0.035204 |
0.0352 |
0.100528 |
0.201019 |
0.010088 |
0.010081 |
579663.2 |
0.948068 |
1.00E-04 |
1799978 |
3.58E+08 |
5969.928 |
0.955174 |
|
49 |
0.085464 |
0.045266 |
0.437187 |
0.010091 |
0.020129 |
0.065347 |
0.135699 |
0.195994 |
0.005064 |
3.67E-05 |
583931.7 |
0.947682 |
1.00E-04 |
1855855 |
3.69E+08 |
6155.252 |
0.954573 |
|
50 |
0.065368 |
0.040246 |
0.45226 |
0.010096 |
0.020128 |
0.085448 |
0.10555 |
0.201018 |
0.020136 |
3.38E-05 |
561001 |
0.948082 |
1.00E-04 |
1826165 |
3.63E+08 |
6056.78 |
0.954272 |
|
51 |
0.085465 |
0.05029 |
0.437186 |
4.86E-05 |
0.040231 |
0.075399 |
0.120624 |
0.165847 |
0.025166 |
3.41E-05 |
583785.6 |
0.948031 |
1.00E-04 |
1912474 |
3.81E+08 |
6343.038 |
0.955676 |
|
52 |
0.080437 |
0.045269 |
0.507531 |
0.010098 |
0.030179 |
0.050274 |
0.1357 |
0.140721 |
4.11E-05 |
3.10E-05 |
570127.3 |
0.948323 |
1.00E-04 |
1929319 |
3.84E+08 |
6398.908 |
0.954071 |
|
53 |
0.105558 |
0.05029 |
0.467334 |
0.005075 |
0.050272 |
0.050273 |
0.065358 |
0.180919 |
0.020137 |
0.005057 |
595435.6 |
0.94851 |
1.00E-04 |
2030153 |
4.04E+08 |
6733.341 |
0.955375 |
|
54 |
0.115609 |
0.055316 |
0.452267 |
4.56E-05 |
0.030181 |
0.060323 |
0.140725 |
0.140724 |
0.005067 |
3.14E-05 |
579110.6 |
0.948439 |
1.00E-04 |
2037337 |
4.05E+08 |
6757.167 |
0.955275 |
|
55 |
0.120636 |
0.030194 |
0.402018 |
0.020146 |
0.015102 |
0.040228 |
0.135699 |
0.226141 |
0.010085 |
3.40E-05 |
596657.2 |
0.948081 |
1.00E-04 |
2129191 |
4.24E+08 |
7061.817 |
0.954071 |
|
56 |
0.055318 |
0.070393 |
0.442214 |
0.0101 |
0.020129 |
0.060321 |
0.10555 |
0.216092 |
0.020137 |
3.41E-05 |
592937.8 |
0.948166 |
1.00E-04 |
2166024 |
4.31E+08 |
7183.979 |
0.956077 |
|
57 |
0.060342 |
0.060346 |
0.412065 |
5.21E-05 |
0.020131 |
0.09047 |
0.115599 |
0.221115 |
0.015111 |
0.00506 |
607269.6 |
0.948324 |
1.00E-04 |
2247650 |
4.47E+08 |
7454.704 |
0.956278 |
這個實驗累計持續了超過18萬分鍾，一共收斂了58*199次，將平均準確率畫成圖
這張圖是10個核到57個核的pave數據，可以觀察到con<=47時網絡性能隨着卷積核數量的增加而上升，當con=47時pave取得最大值0.94894。
這張圖是con=20到con=57，這張圖可以更加清楚的看到con=47時形成的pave峯，
雖然並不排除當卷積核數量大於57個以後可能會出現更大的pave，但這個網絡當卷積核數量大於36個時已經變得不穩定，再實驗更大的卷積核數量實用性並不強。
是否可能用簡單的三層網絡減小收斂標準的辦法實現多卷積核網路的性能？
|
f2[0] |
f2[1] |
f2[2] |
f2[3] |
f2[4] |
f2[5] |
f2[6] |
f2[7] |
f2[8] |
f2[9] |
迭代次數n |
平均準確率p-ave |
δ |
耗時ms/次 |
耗時ms/199次 |
耗時 min/199 |
最大值p-max |
|
0.03018 |
3.75E-05 |
0.221124 |
0.0101 |
0.015106 |
0.467342 |
0.0151 |
0.241225 |
3.71E-05 |
3.24E-05 |
1689378 |
0.927924 |
1.00E-04 |
28948.91 |
5760833 |
96.01388 |
0.93572 |
|
0.025153 |
3.38E-05 |
0.326647 |
0.010101 |
0.035195 |
0.376899 |
2.57E-05 |
0.226146 |
3.20E-05 |
2.44E-05 |
1943678 |
0.928104 |
9.00E-05 |
32832.36 |
6533641 |
108.894 |
0.934316 |
|
0.015099 |
3.06E-05 |
0.301523 |
0.01512 |
0.030172 |
0.452264 |
0.005049 |
0.18092 |
3.22E-05 |
2.23E-05 |
2085566 |
0.928547 |
8.00E-05 |
35165.06 |
6997849 |
116.6308 |
0.934015 |
|
0.035197 |
2.90E-05 |
0.311569 |
0.010086 |
0.015094 |
0.437193 |
0.020122 |
0.17087 |
2.40E-05 |
2.24E-05 |
2525136 |
0.929116 |
7.00E-05 |
42976.27 |
8552289 |
142.5382 |
0.934316 |
|
0.025142 |
2.07E-05 |
0.321618 |
3.20E-05 |
0.020117 |
0.38192 |
0.005042 |
0.246242 |
2.21E-05 |
1.78E-05 |
2890698 |
0.929858 |
6.00E-05 |
48981.99 |
9747438 |
162.4573 |
0.934617 |
|
0.030165 |
1.96E-05 |
0.291466 |
0.010074 |
0.020114 |
0.452263 |
0.005039 |
0.190965 |
1.93E-05 |
1.42E-05 |
3459593 |
0.930397 |
5.00E-05 |
58262.53 |
11594249 |
193.2375 |
0.936923 |
|
0.005036 |
1.60E-05 |
0.271365 |
0.005046 |
0.020112 |
0.452265 |
0.010061 |
0.236186 |
1.40E-05 |
1.18E-05 |
4164640 |
0.930715 |
4.00E-05 |
70300.02 |
13989711 |
233.1619 |
0.935519 |
|
0.005033 |
1.17E-05 |
0.236187 |
0.010065 |
0.035182 |
0.447239 |
0.005034 |
0.261312 |
1.08E-05 |
1.00E-05 |
7064859 |
0.931386 |
3.00E-05 |
120923.6 |
24063811 |
401.0635 |
0.938026 |
|
0.00503 |
7.82E-06 |
0.296486 |
1.04E-05 |
0.025131 |
0.396988 |
0.025131 |
0.251259 |
7.56E-06 |
5.63E-06 |
1.40E+07 |
0.931936 |
2.00E-05 |
237084 |
47179720 |
786.3287 |
0.936823 |
實驗表明用81*30*10的網絡10分類mnist的0-9當收斂標準等於1e-5的時候就幾乎無法收斂。用簡單的三層網絡只能達到約4個核的性能。因此對於二分類或者三分類的網絡纔可能通過減小收斂標準的辦法用簡單的3層網絡來快速的實現多核網絡的性能，但對於多分類的網絡卷積核是有巨大的性能優勢。
再比較前面的實驗數據用3*3的卷積核二分類0和2的卷積核最優值是4個，而10分類是47個，可以大致估算每增加一個分類對象需要多加5個卷積核。