Search results
1032 packages found
Crawler (spider) of site web pages by domain name
CrawleeOne is a framework built on top of Crawlee and Apify for writing robust and highly configurable web scrapers
A simple email extractor for obfuscated emails.
- email-address
- extractor
- obfuscated
- obfuscated-email
- obfuscated-emails
- parse
- regex
- obfuscator
- obfuscation
- harvester
- scraper
- crawler
- View more
xvideos.com api implementation.
A robust GitHub API crawler that walks a queue of GitHub entities retrieving and storing their contents.
An `URL` parser for crawling purpose.
- crawler-url-parser
- url-parser
- extract-url
- url-parse
- is-parent-url
- is-child-url
- url
- parser
- parse
- crawler
- extract
- extractor
- absolute
- relative
- View more
Web scraper that extracts magnetic links from Google or from the informed URL
A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.
A package for detecting keywords on the Internet Computer
A JavaScript library that allows for the quick transformation of DOM documents into useful formats.
Yet another node torrent scraper based on x-ray. (Support iptorrents, torrentleech, torrent9, Yyggtorrent, ThePiratebay, torrentz2, 1337x, KickassTorrent, Rarbg, TorrentProject, Yts, Limetorrents, Eztv)
- torrent
- scraper
- crawler
- node
- api
- yggtorrent
- torrentz2
- torrentleech
- iptorrents
- 1337x
- thepiratebay
- tpb
- kickasstorrents
- rarbg
- View more
Find an element that matches a particular CSS selector on a website
nodejs lightweight scraper/crawler
Simple WAF to integrate with Node.js web systems
- waf
- nodejs
- firewall
- blocker
- filtering
- bot
- spider
- robot
- crawler
- useragent
- user-agent
- detector
- detect
- detection
- View more
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Crawl 100% JS single page apps with phantomjs and node.
A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
A node library to crawler imdb and parse to json