One you wish would go
I believe the answer is:
pest
(Other definitions for pest that I've seen before include "Plague" , "Annoying person" , "Disease with a high death rate" , "Troublesome man or animal" , "Destructive creature" .)