Buying a rental next to a shoddy house in nice neighborhood?

[Amanda Studebaker]

I visited a house today that looks great on paper. The neighborhood is in a good location and the other houses on the street are well taken care of - except for the house next door, which has holes in the roof and a backyard that looks like it hasn't been touched in five years. I think the reason the house is selling below market rates is because people are worried about the house next door.

Does anyone have experience with this? Is the neighboring house going to create a nightmare for me when trying to attract renters?