Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Hey, how do you identify them? Is there a service to recognize which of these companies scrapped you?


Every few weeks I run my nginx access logs through a script that uses the same textual ASN database to tally them up and spit out a summary report. There are many different sources for periodic textual ASN databases you can parse with UNIXy tools.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: