How could you politely end a conversation with a person who is annoying?

[rehaM]

I find it difficult to end conversations with someone as I don't want to be disrespectful, but I'll usually say that I have somewhere to be