How could you politely end a conversation with a person who is so annoying?

There’s no polite way for Me because when I’m annoyed I just hang up or walk away from the person