Neighbor problems, any ideas?

We live in a VERY small town. Our house is right next door to a building that is both the Mason's Hall, and the Historical Society for the town. We've lived here for five years, and the building was used only twice a year, for their annual meetings. We got a puppy this winter, and admittedly used the back lawn of that building as extension of our lawn. I was diligent about cleaning up poop, but there were times that the poop occurred at night, and I couldn't see it until the next morning. Early in the summer, I apologized to the person mowing the lawn next door about the poop I hadn't gotten to that day. He said "Hey, don't worry about it....we live in the country, and it's fertilizer." On the other side of the Historical Society is the busiest restaurant in town. Their back lawn is adjacent to the parking lot for the restaurant. Often dogs are walked on the lawn, and I've always cleaned up their poop too. The Historical Society recently elected a new president, who nicely asked my husband one day, to please not allow our dog to poop on the lawn. My husband ured him that we would no longer allow her over there, and we haven't. I've still done poop patrol over there though, because I knew that we would be blamed for it. A month ago, I was walking the dog, leashed, in our back yard. The new president was mowing, and was quite rude to me about the two poops he had to pick up that morning. I calmly explained to him that our dog hadn't been on that lawn in weeks, and that I've picked up my share of poop from the patrons of the restaurant. Since that day, he's made a point of mowing, weed-whacking, wood-chipping, chain sawing, etc. at the crack of dawn almost every morning. My husband works nights, and him being woken up at 5:30am every morning was driving me nuts. Last week I went to talk to him about it, and he was extremely rude. Pointed his finger at me in anger, threatened to "take care" of my dog, told me he could make noise any time he damn well pleased. After about 15 min., I just went back inside. In the last week, both the Masons and the Historical Society have had their annual meetings, and I'd bet that 80% of the population of the town are members in one of those. Both of those evenings, there were cars parked all over my lawn, even partially blocking my driveway, and completely blocking my walkway. This has never occurred before. So....do I make a stink, and look like a bad neighbor to most of the town? Do I just suck it up, and lay low? He is now there every day, and I don't even want to go outside until he leaves. (Called our town clerk, there are no noise restrictions in our town.) Man, it felt better just to vent!