One relevant comment, and one experience.
Usually when people are concerned about drones it is because they fear something. Perhaps in this case the daughter feared something, and the neighbor was protecting the interests of his daughter. Typical fears are around privacy (including snooping), having physical harm from a drone out of control, the irritation of noise (compared to what, a lawn mower or chainsaw?). So if not in this case, you might want to find a way to address any concerns.
While engaging law enforcement when there is an extreme response may be prudent, I had a different experience with law enforcement. I was doing a practice run for taking pictures, and standing on the pedestrian portion of a bridge. It was a weekday morning, and there were not people around. While the aircraft was near the end of my practice run, a sheriff deputy stopped his patrol car and came out of it shouting at me. He came up very close to me (less than 6 inches) and shouted at me that I should look at him when he was talking with me. I told him I was unable, but if he would standby, I could talk with him and answer any questions after I recovered the aircraft. This wasn't good enough for him, and I was unable to figure out why he was so agitated. His shouting continued, and he ordered me to look at him, which I did momentarily. Now I was getting aggravated. Again I told him give me just a couple of minutes and the aircraft will land. At that point he put his hands on my left arm. I wanted to continue to fly the aircraft, but I also didn't want to be considered as resisting arrest. I asked him if he was arresting me, and what the charge was. He said he wanted me to stop flying and look at him. I said I could not and that if he continued without good cause he was violating 14 CFR 91, by interfering with crew of an aircraft. He let go, walked 50 feet away and made a cellphone call.
I landed the aircraft, and shut down my equipment, and walked over to him as he was finishing his phone call. His tone was a little different, and he started in on my being disrespectful. I tried to explain that I needed to pay attention to what I was doing, and if it wasn't an emergency, and he could wait two minutes, the flight would have been over. We parted after he told me that he didn't want to see me there again, and if he did there would be consequences.
When he left, I started charging the batteries, and made a call to the zone station and talked with the commanding officer on duty. Turns out that he was somewhat familiar with drone operation, and he later revealed that he was studying for a 107 certificate. He was familiar with the deputy who talked with me, and said that he would be addressing this "internally" which almost sounded official.
I have avoided that location, and in the two years since then have not had any such similar encounter. I have been unable to determine the deputy's concern.