Have you talked to her and just explained what you are doing, and that you have 0 interest in her or her house?
I had a neighbor come out once (never met him before) claiming I'm spying on him and his house. He was pretty irate and seemed to be a conspiracy type lol. I assured him my Solo was just staring off at the horizon above the hills and trees, filming the sunset. I was up at 400 feet. I invited him to come over and take a look at my view on the tablet of what I was seeing and he came over and peered over my shoulder. I then pointed the camera down and he could see about a 15 block area and all of the houses were very tiny. I just said I didn't even know which house was his and I didn't care either. I was just flying getting an aerial view. He actually started thinking it was pretty cool once he started watching me. I asked if he wanted to fly it for a minute (400 feet up...not really gonna get in trouble...) and he did and he got the biggest damn smile on his face, just like we all did our first time flying Solo. I kinda made a friend. Now if he hears my Solo out and about he just comes over to watch.
Long and short of it is there are a lot of uninformed people out there. They only hear of the reports in the news which are always reporting someone doing something bad, not good, and assume anyone with a drone is doing the same types of stupid things. A little education, and given in a teaching manner as opposed to a "you're wrong dumbass, I know the law" can go a long way. I'm not saying you did that, just sayin' in general... I've probably had the above scenario happen 3 times in the 5 months that I've had my Solo with someone not happy. Not exactly the same, but someone with a stereotype that I was able to dissuade with compassion and understanding of their fear/worry, and educating them. They ARE coming from a place of fear.