Habr Parser
A command-line Habr scraper for selected hubs that saves articles to JSON, with a filter by year and keywords.
01 / 01
About the project
- Stack
- Node.jsAxiosCheeriosocks-proxy-agentJavaScript
A command-line scraper for Habr articles. It pages through the feeds of the selected hubs and parses the article cards, saving the title, link, description, hub list, reading time, and publication date.
The result goes into JSON, one file per hub, so the dump can be refreshed piece by piece. Requests run through an optional SOCKS5 proxy.
A separate sorter script walks the collected files, picks articles by publication year and a keyword list, and writes the narrowed selection into sortedArticles.