In Ancapistan you would be able to sue for damages as soon as the drone impacts your use of your property, including nuisance noise or visual.
I’m not sure at what point you would be okay taking the drone down. It might be a “use your judgement, but THEY might sue YOU for damages and win, so better be worth it” scenario. Or it might be more clear cut. I haven’t thought it out enough.