This week has been all about AI logic, it has been a slow week with not much progress.
Testing of the AI agent showing two patterns.
- Stuck at repeated detection. Q-Learning values stop fluctuating and becomes stable, seems to stop learning.
- Instantly changing nodes. Never exploiting the nodes.
Started by looking at the connections inside the neural network, the weights of the connections are incomprehensible.
Went over to activation function values. Noticed that I was using an activation function in FANN that can’t be used when training the neural network. Also looked into the activation cost of nodes. Found a post on stackoverflow; depending on the type of ANN you have to normalize input values. This will be compared, scaled vs non-scaled, during the weekend over a longer time period.