Click on the 9-square icon in the top left then click on People.
Select (click on) the contact you want to delete, then click the contact's delete button.
Having said that, it sounds like your Outlook is a different version. The instructions above are for Outlook.com