You've got to click on it again to delete it. It's kinda like the "Are you sure you want to do this?" of Windows