Sounds more like hornets then bees. Hornets love to go into hot places. Go to a commercial HVAC or electrical supply house and get some stuff there. We use Hornet spray at work made by CRC, works great!
If they're honey bees, I'd say leave them alone. They've had a rough year with some sort of plague that has wiped about half of them out, they're very much needed!
People told me I need help with my drinking problem. So I hired a bartender.