Likewise, when I claim that the farming on your land is creating edge effects which destroy the biodiversity on my land...
So in other words, you have some use of your land that requires the use of my land? You have no right to that anymore than I have the right to build my grain silo on your land. Unless I'm directly damaging your land through some sort of border crossing, you've got no justification to tell me what I can and cannot do with my land.
You don't seem to understand the difference between magically declaring that someone has "no right" to do something and implementation difficulties of actually being able to stop them from doing it.