When you close a presentation, Keynote still remains open.
Click the red close button in the top-left corner of the Keynote window, or press Command-W.
To quit Keynote, choose Keynote > Quit Keynote (from the Keynote menu at the top of your screen).