Rockets work by throwing matter out of the back. That burning gas is what provides thrust to the rocket.
It's crude and grossly inefficient, but it's the only technology we have for propulsion in space. I'm still waiting for humanity to come up with some revolutionary, star-wars type...