Have nothing to do with hermit-style holiday? (5,5)
I believe the answer is:
Here is my best explanation:
'have nothing to do with' is the definition.
I cannot understand how the rest of the clue works.
(Other definitions for leave alone that I've seen before include "Do not disturb", "Abandon" and "Keep away from".)