Search results
1745 packages found
crawler
exact matchCrawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
Search for anything on web.
Stealth mode: Applies various techniques to make detection of headless puppeteer harder.
- puppeteer
- puppeteer-extra
- puppeteer-extra-plugin
- stealth
- stealth-mode
- detection-evasion
- crawler
- chrome
- headless
- pupeteer
A library for efficiently walking a directory recursively
This library provides support for traversing objects and their values while providing information on the traversal state, pathing to target values, and the ability to manipulate said pathing to easily move to related values.
A snazzy light Node.js image crawler laced with TypeScript goodness! 🕵️🦾
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
protect your content from scraping
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
Pure javascript cross-platform module to extract text from PDFs.
- pdf-parse
- pdf-crawler
- xpdf
- pdf.js
- pdfreader
- pdf-extractor
- pdf2json
- j-pdfjson
- pdf-parser
- pdf-extract
- pdf-to-text
- pdf-text-extract
- pdfjs
- server side PDF parsing
[](https://nodei.co/npm/botium-crawler/)
xvideos.com api implementation.
An attestate crawler strategy to download and transform Ethereum block event logs
🤖/👨🦰 Recognise bots/crawlers/spiders using the user agent string.
Lightweight async scraper for Google News
a web crawler based on crawlee, use file to cache result. Easy to maintain as Singleton Service.
Pure javascript cross-platform module to extract text from PDFs.
- pdf-parse
- pdf-crawler
- xpdf
- pdf.js
- pdfreader
- pdf-extractor
- pdf2json
- j-pdfjson
- pdf-parser
- pdf-extract
- pdf-to-text
- pdf-text-extract
- pdfjs
- server side PDF parsing
A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS
Pure javascript cross-platform module to extract text from PDFs.
- pdf-parse
- pdf-crawler
- xpdf
- pdf.js
- pdfreader
- pdf-extractor
- pdf2json
- j-pdfjson
- pdf-parser
- pdf-extract
- pdf-to-text
- pdf-text-extract
- pdfjs
- server side PDF parsing
crawl youtube without api key (search videos channels or get all channel/playlist's videos)
- youtube
- crawler
- scraper
- api
- no
- key
- simple
- javascript
- youtube api
- youtube search
- youtube api no key
- youtube crawler
- youtube scrapper
- youtube open api
- View more