Deleting a contact will not delete the conversations you had with this contact, it will simply be hidden from your Inbox, if the contact sends you a new message, it will be displayed in your Inbox again.
To delete a contact from your contact list simply go to your contact list and click on the delete button on the right side of the contact you want to delete.
