I am new to all of this and while I understand the sentiment of not ruining things for others, additional laws/regulations are not the answer either. Where does it ever end with laws and someone else telling you how to live your life and what you can and can't do. As with anything (cars, guns, drugs, how to raise kids, etc, etc) there doesn't need to be more laws, but people do need to be held responsible for any and all instances in which they are at fault for damages, including the potential loss of life. There are many more statistical means to hurt, maim, and potentially kill people and/or damage property than flying a quad. Forcing limits, especially when there isn't a law about it seems a bit over the top for me.
With that being said, I am not the guy who has to push the envelope of everything. 500 meters is more than enough for my personal use, but I have no negative opinions about those who want to fly over that height. I only have a negative opinion about those who act irresponsibly based on the circumstances. Every situation is different.