That is a key piece of information that would have been handy to initially post when you started the thread....
Wasp killer spray, then. You might not get them all in one shot but find where the bulk of them are and go after them. When you find more, go after them as well. After multiple applications you should be able to eliminate the entire hive.