Delete the labels. Deleting labels won't delete contacts or messages tagged to these labels.
To get rid of duplicate contacts merge them.
From Google Contacts Help:
If you have duplicate listings for the same person in Google Contacts, you can merge them.
You can't merge contacts that are saved in different Google Accounts.
Go to Google ...