Overview pjscrape is a framework for anyone who's ever wanted a command-line tool for web scraping using Javascript and jQuery. Built to run with PhantomJS, it allows you to scrape pages in a fully rendered, Javascript-enabled context from the command line, no browser required. Features Client-side, Javascript-based scraping environment with full access to jQuery functions Easy, flexible syntax for setting up one or more scrapers Recursive/crawl scraping Delay scrape until a "ready" condition occurs Load your own scripts on the page before scraping Modular architecture for logging and writing/formatting scraped items Client-side utilities for common tasks Growing set of unit tests Download pjscrape-v0.1.4.zip pjscrape-v0.1.4.tar.gz Fork on github Dependencies PhantomJS v.1.3 License MIT License Documentation Javascript API Documentation In its most concise syntax, pjscrape makes scraping a webpage as easy as this:

声明:本站所有文章,如无特殊说明或标注,均为本站原创发布。任何个人或组织,在未征得本站同意时,禁止复制、盗用、采集、发布本站内容到任何网站、书籍等各类媒体平台。如若本站内容侵犯了原著者的合法权益,可联系我们进行处理。