Wrong assignment to Q inside the `HistoryEmbedded`?

[marimeireles]

For the following configuration:

The result of self.Q is 2.

Why is the length of observations equals 2? Shouldn't it be 4?

[marimeireles]

It doesn't seem like self.Q is being used anywhere else in the HistoryEmbedded code nor in the agent classes that work with it.

[marimeireles]

Fix and add a test.