For questions related to the concept of time-step, for instance, in Markov decision processes or reinforcement learning.
Questions tagged [time-step]
2 questions
7
votes
2 answers
What is a time-step in a Markov Decision Process?
The "discounted sum of future rewards" (or return) using discount factor $\gamma$ is
$$\gamma^1 r_1 +\gamma^2 r_2 + \gamma^3 r_2 + \dots \tag{1}\label{1}$$
where $r_i$ is the reward received at the $i$th time-step.
I am confused as to what…
Abhishek Bhatia
- 447
- 2
- 5
- 16
0
votes
0 answers
Python - adding more timesteps makes my model "fail"
Hi! I have just made my first model in stable-baselines3 using pygame in Python.
The game is about a ball reaching the highest platform out of three placed in the sky.
Now - after a few days of trying I managed to make the model learn how to get…
Skorejen
- 101
- 1