Many indexed feeds are private homes or businesses that are accidentally exposed due to poor security.
robots.txt is a polite request, not a security boundary. It will stop Google from indexing it, but it will not stop a determined attacker. inurl view index shtml best
Within these index.shtml pages, there are often hyperlinks to raw log files. If the server is misconfigured, clicking a link like Current Log (weblogs/current.log) could allow you to download the server’s raw access log, which contains IP addresses, user agents, and request paths. Many indexed feeds are private homes or businesses