Personally, I think if you have something someone wants in those neighborhoods, I don't think the fact that you are a neighbor would stop them from trying to get it. I have no doubt there are good people or people that are potentially good, but I also have no doubt there are people who are up to no good.
My issue with buying property in a place like Detroit is that even if you bought it, the city and others would probably not let you tear anything down or do anything useful with the property.