Quit KAlarm by selecting File->Quit, or Quit in the system tray icon context menu. Alternatively, if the system tray icon is not visible, close all KAlarm's windows.