1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
|
=============================================================================
This file contains data to test the learning functions
=============================================================================
Network-Files: letseq_untrained.net
==============
Pattern-Files: letseq_train.pat
==============
Description: - load network letseq_untrained.net
============ - load patterns letseq_train.pat
- do NOT press init button
- set cycles to 50
- set shuffle off
- for each test set:
- set learing function given in test set.
- set learning parameters given in test set.
- set update function given in test set.
- set update parameters given in test set.
- press the all button
- compare the results with the given results
- reload network letseq_untrained.net
Test set 1)
===========
learning function : JE_BP 0.2 0.0 0.0 0.0 0.0
update function : JE_Order 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 2443.41919 0.81829 407.23654
45: 1967.71216 0.65898 327.95203
40: 1945.15869 0.65143 324.19312
35: 1932.37512 0.64715 322.06253
30: 1927.02405 0.64535 321.17068
25: 1924.20728 0.64441 320.70120
20: 1922.32935 0.64378 320.38821
15: 1920.95422 0.64332 320.15903
10: 1919.92957 0.64298 319.98825
5: 1919.18176 0.64273 319.86362
1: 1918.72192 0.64257 319.78699
Test set 2)
===========
learning function : JE_BP_Momentum 0.2 0.5 0.0 0.0 0.0
update function : JE_Order 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 2299.23633 0.77001 383.20605
45: 1940.69067 0.64993 323.44846
40: 1928.97119 0.64601 321.49521
35: 1924.74207 0.64459 320.79034
30: 1922.88293 0.64397 320.48050
25: 1921.99377 0.64367 320.33231
20: 1921.47021 0.64349 320.24503
15: 1921.12415 0.64338 320.18735
10: 1920.87244 0.64329 320.14542
5: 1920.67578 0.64323 320.11264
1: 1920.54810 0.64318 320.09134
Test set 3)
===========
learning function : JE_Quickprop 0.3 2.0 0.0001 0.0 0.0
update function : JE_Order 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 5434.64062 1.82004 905.77344
45: 7522.88721 2.51939 1253.81458
40: 6292.01709 2.10717 1048.66956
35: 5435.19775 1.82023 905.86627
30: 6004.00586 2.01072 1000.66766
25: 7073.52441 2.36890 1178.92078
20: 5555.14258 1.86040 925.85712
15: 7609.96484 2.54855 1268.32751
10: 5322.99658 1.78265 887.16608
5: 6655.99365 2.22907 1109.33228
1: 5883.22119 1.97027 980.53687
Test set 4)
===========
learning function : JE_Rprop 0.1 50.0 0.0 0.0 0.0
update function : JE_Order 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 5434.64062 1.82004 905.77344
45: 3022.28174 1.01215 503.71362
40: 2336.67163 0.78254 389.44528
35: 2055.28149 0.68831 342.54691
30: 1929.24146 0.64610 321.54025
25: 1903.56677 0.63750 317.26114
20: 1892.60681 0.63383 315.43448
15: 1890.64722 0.63317 315.10788
10: 1890.46191 0.63311 315.07700
5: 1890.36511 0.63308 315.06085
1: 1890.33557 0.63307 315.05594
Test set 5)
===========
learning function : JE_BP 0.2 0.0 0.0 0.0 0.0
update function : JE_Special 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 2443.41943 0.81829 407.23657
45: 1967.71216 0.65898 327.95203
40: 1945.15820 0.65143 324.19302
35: 1932.37439 0.64714 322.06241
30: 1927.02344 0.64535 321.17056
25: 1924.20728 0.64441 320.70120
20: 1922.32910 0.64378 320.38818
15: 1920.95435 0.64332 320.15906
10: 1919.92944 0.64298 319.98825
5: 1919.18188 0.64273 319.86365
1: 1918.72217 0.64257 319.78702
Test set 6)
===========
learning function : JE_BP_Momentum 0.2 0.5 0.0 0.0 0.0
update function : JE_Special 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 2299.23633 0.77001 383.20605
45: 1940.69067 0.64993 323.44846
40: 1928.97119 0.64601 321.49521
35: 1924.74207 0.64459 320.79034
30: 1922.88293 0.64397 320.48050
25: 1921.99377 0.64367 320.33231
20: 1921.47021 0.64349 320.24503
15: 1921.12415 0.64338 320.18735
10: 1920.87244 0.64329 320.14542
5: 1920.67578 0.64323 320.11264
1: 1920.54810 0.64318 320.09134
Test set 7)
===========
learning function : JE_Quickprop 0.3 2.0 0.0001 0.0 0.0
update function : JE_Special 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 5434.64062 1.82004 905.77344
45: 7522.88721 2.51939 1253.81458
40: 6292.01709 2.10717 1048.66956
35: 5435.19775 1.82023 905.86627
30: 6004.00586 2.01072 1000.66766
25: 7073.52441 2.36890 1178.92078
20: 5555.14258 1.86040 925.85712
15: 7609.96484 2.54855 1268.32751
10: 5322.99658 1.78265 887.16608
5: 6655.99365 2.22907 1109.33228
1: 5883.22119 1.97027 980.53687
Test set 8)
===========
learning function : JE_Rprop 0.1 50.0 0.0 0.0 0.0
update function : JE_Special 0.0 0.0 0.0 0.0 0.0
epoch: SSE MSE SSE/o-units
50: 5434.64062 1.82004 905.77344
45: 2778.15088 0.93039 463.02515
40: 2425.45947 0.81228 404.24326
35: 2154.22510 0.72144 359.03751
30: 1978.34998 0.66254 329.72501
25: 1915.36108 0.64145 319.22684
20: 1899.89709 0.63627 316.64951
15: 1893.70703 0.63420 315.61783
10: 1891.51941 0.63346 315.25323
5: 1890.86426 0.63324 315.14404
1: 1890.64331 0.63317 315.10721
|
