I did a rough estimate a while back and found that a 5 mile radius around every airport covers roughly 47% of the entire land mass of the US. And most of the areas not covered are generally wilderness... which makes sense, airports are more likely going to be in populated areas.
So while some people (not necessarily here) will preach that you should follow the rules to the T, it's more likely than not that everyone flies within the 5 mile zone on occasion, if not often. There's going to have to be a reevaluation of these rules at some point, as more people start flying these and try to do the right thing, it'll become obvious how ridiculous the rules are. And airports are just not equipped to handle all the calls they'll end up getting.
It should be noted the rules technically state that if you're within 5 miles, you simply need to alert the airport of your plan NOT get their permission, so basically all they can say is "ummm, ok, just stay under 400 feet". Unless you're directly off the runway, you won't be getting in an airplane's way... or at least one that itself is following the rules. I believe minimum altitudes for airplanes is 800 feet, and you're not below that much beyond 1/4 mile from the end of the runway.
It's all a bit of a mess, made worse by the sensationalization in the media and the knee-jerk reaction from the government it compelled. And of course by the idiots flying drones into buildings/stadiums/people/air traffic/etc.