You can always go out with a can of WD40 and a lighter as well. That will provide protection for anything outside the hole. That's how I handle wasp and bee nests that are attached to my house.
"Nests should be located during the day, so you can see the workers entering and exiting all day. Mark the entry points. Treat at night only when it is dark.
Any treatments should be done at night, because they are all in the nest. They don't see well at night and your chances of being stung are greatly reduced."