If the guardian farmer is always just in front of you, you just need to set off 30 seconds earlier everytime you go somewhere. Happy to help.
...just be aggressive and hold your nerve.