Get the latest tech news

So you want to scrape like the big boys (2021)


What it really takes to scrape without getting detected.

When normal people are out drinking beers in the pub on Friday night, these individuals invent increasingly bizarre ways to fingerprint browsers and detect bots ;) In the event that an IPv4 address is blocked or blacklisted as a source of spam, the impact on a CGN would be greater, potentially affecting an entire subscriber base. One problem with the setup described above is that I will need to spoof those pesky deviceorientation and devicemotion JavaScript events on a kernel level, because no real device is laying on the ground without rotation/movement all day long.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Big Boys

Big Boys