Bias Regularisation

title	Bias Regularisation
class	class vsoc.training.RegularisationTraining$
learningRate	1.0E-04
trainingData	playerpos_x A 500000
batchSizeTrainingDataRelative	0.10
testData	playerpos_x B 1000
iterations	200
optAlgo	STOCHASTIC_GRADIENT_DESCENT
numHiddenNodes	50, 100, 200
regularisation	Some(Regularisation(0.0,0.0,2.0,2.0)), Some(Regularisation(0.0,0.0,1.0,1.0)), Some(Regularisation(0.0,0.0,0.001,0.001)), Some(Regularisation(0.0,0.0,1.0E-5,1.0E-5)), Some(Regularisation(0.0,0.0,0.0,0.0))
seed	3915220284829678

Conclusion

Expected that bias regularisation could fix the wrong bias for nets with more than 100 intermediate nodes, but there was no effect.
Taking 100 intermediate nodes leads so far to the best results.

Further Work

Find a way to learn the correct bias.