I'd say very early spring or autumn. Just try to mind their nests and you'll be good to go. Some bird don't even fly South anymore because of global warming so there's a good chance that you'll need to pay attention even in the colder months. Then again, I don't know where you're from so they might as well be gone during autumn/winter That's a good time I'd say!