If it's your house on your property, and you have already paid for the work going on, quality work, then you have a right to complain. Now if it were a lunch time with one beer maybe, I could understand. Document every time it happens so you can go back and sue for faulty workmanship if that is the case. I don't like sue happy people, but you deserve what you pay for. Make this known to the contractor and tell him that is the way it will be.
I work as a plumber on big jobs and alcohol and power tools do not mix. Residential construction is a different world, but accidents still happen, no need to throw alcohol into the mix.