I'd argue physics is one of the core gameplay elements, along with game logic itself. You'll base your entire game on these.