Assuming IL is positive when you turn your high side switch on (Minimum inductor current >0), VSW will start at about -0.7V due to low side diode conduction during the dead time.
Because of this, the current you put into VSW will initially have a return path through ground, since it has to conduct at least ILmin amount of current before the low side diode can turn on and allow VSW to start slewing high.
Edit:
Think of Coss as a capacitor between VSW and IN. Right before you turn on your high side switch, this capacitor has V(IN) plus a diode across it. When you turn on your high side switch, you are discharging this capacitor. The current loop is local; it's just from the top of the capacitor, through the switch, then back into the bottom of the capacitor. This does not go to OUT.