I'm working out of Shankar's principles of quantum mechanics book. And overall, I think I get the gist of how to solve problems with Schrodinger's Equation. I recall in my Modern Physics course, we only worked in the x-space it seems. Basically we limited our Schrodinger Equation to $$ \frac{d^{2} \psi}{dx^{2}} + \frac{2m}{\hbar^{2}} (E-V)\psi = 0 .$$ However, in Shankar he's introduced Bra-Ket notation and in familiarizing myself with it, I've run into trouble making sense of the exact path to go to solve a general problem.
For example, working with the free particle where $\hat{H} = \frac{\hat{P}^2}{2m}$. I follow so far, since $\hat{H} = T+V$ and $V=0$. I understand that the Schrodinger Equation becomes: $$i\hbar |\dot{\psi} \rangle= \hat{H}|\psi \rangle = \frac{\hat{P}^2}{2m}|\psi \rangle.$$
I still follow that the normal modes are solutions of the form $|\psi\rangle = |E\rangle e^{-\frac{iEt}{\hbar}}$ from the fact that when $\hat{H}$ acts on $|\psi \rangle$ it outputs an eigenstate $|E \rangle$ and we multiply that by the propgator which he derived for any arbitrary solution of Schrodinger's equation in the previous section (provided V has no time dependence). Once we put this back into the time-dependent Schrodinger Equation, which I've verified myself we get $$\hat{H}|E \rangle = \frac{\hat{P}^2}{2m}|E\rangle = E |E \rangle $$ The time-independent schrodinger equation. However, here is where he starts losing me. On the very next line he says the problem can be solved without going to any basis. And that any eigenstate of $\hat{P}$ is also an eigenstate of $\hat{P}^2$. Which I understand. What I don't understand is that the next like he trades out the $|E \rangle$ for $|p\rangle $ which to me, I think I need a little more justification for. I understand that when an operator acts on a state, it outputs an eigenstate. However, why are we in the $p$-space now if we don't need to go to any space to solve the problem?
He gets the allowed values for $p$, which depend on $E$. And then constructs the propagator for this problem.
I think my confusion comes from trying to make the leap from what I know to what this book is trying to show me. In Modern Physics, and in my undergrad quantum course, we were concerned with finding the wave function almost entirely. Once we found the wave function, and the allowed energies, we were done. What is the actual goal here? Constructing an orthonormal basis for Energy? Constructing the propogator? I apologize if my questions don't make much sense, I don't follow some of his work. And I have found some lecture notes online that illuminate it for me, but I think I still need clarification.
Also, in his particle in a box solution, he says he's solving it in the X basis and says its the only viable choice. Why is the P basis not a viable choice? In the well, in the p-basis, wouldn't the solution be simple like it is for the free-particle? I understand it complicates when there is a potential, because $\hat{H}$ doesn't only depend on $\hat{P}$ but I think I'm missing steps here as well.
I guess to break down my questions they are as follows:
In Shankar's free particle solution, what is the justification for going from a state that is in the E-space to the p-space?
What is the goal of solving the problem if not to get the wave function? We use some test state, $|E \rangle U(t)$ and then put it into the Schrodinger equation to get a solution for accepted values of p/E. Then solve for the propogator, somehow? I don't follow his steps.
How do you know which basis to work in for an arbitrary problem? Intuition? For the particle in the box he says the x-basis is the only viable one, but doesn't explain why. Should I try to work it out in the p-basis to justify his choice?