Speed is always considered relative to something. It wouldn’t be too far fetched to consider ghosts to maintain speed relative to the remains of the body of their late life.