Questions tagged [discrete-state-spaces]

In my understanding, DQN is useful because it utilises a neural network as a q-value function approximator, which, after the training, can generalise to unseen states. I understand how that would work when the input is a vector of continuous values,…

I've recently read much about feature engineering in continuous (uncountable) feature spaces. Now I am interested what methods exist in the setting of large discrete state spaces. For example consider a board game with grid as a basic layout. Each…

So I'm planning on clustering a bunch of observation data using k-medoids. There are seven attributes for each instance and the data is numerical and discrete. I'm a little uncertain of how to evaluate the model to find the correct number of…

This question come to mind when i was planing to do a benchmark of RL algorithms to my Environment. In fact, Q-Learning, SARSA actually only handles with discrete state spaces because they are tabular methods, but Deep RL algorithms like PPO, DDPG…