Get the latest tech news
Show HN: Web Scraping with Your Web Browser: Why Not?
find plenty of tutorials on the Internet about the art of web scraping (for example, here and here) and the first things you will learn about are Python and Beautiful Soup. There is no tutorial on web scraping with Javascript in a web browser though you will find browser extensions that claim to do it all without any need for coding (this only works for simplistic and unprotected websites).
It doesn't seem to be, judging from the prevailing advice being generously handed out to questioners on Internet forums like Reddit, not to mention the countless YouTube videos. The remote server is fine for simple use cases (like Rumble) but it quickly hits a barrier such as that posed by YouTube which blocks data center IP addresses. The trick involves letting the browser solve the bot challenge and then using the proxy to capture the cookie (it may or may not be feasible to completely automate the task).
Or read this on Hacker News