It is not possible to delete a category if it contains labelled content. If it does, you will first need to remove the labels so that the category (and it's sub-categories) is completely empty.

Once this has been done, simply select the category and click the 'Delete' button.