Get the latest tech news
Show HN: HackerNews-new-jobs – insights into fresh and recurring job ads
Insights into HackerNews "Who's Hiring" thread. Contribute to nemanjam/hn-new-jobs development by creating an account on GitHub.
It uses Axios for fetching html but soon I discovered that their server has very strict rate limiting and such scrapper was getting a lot of unpredictable ETIMEDOUT and ECONNRESET connection abrupt terminations. After careful research I discovered that crond daemon must run as root user or it will produce setpgid: Operation not permitted error, see this Github issue. This requires exposing scripts as API endpoints and running crond daemon in a separate Docker image, which is unpractical and greatly complicates deployment.
Or read this on Hacker News
