bis_fetcher.fetcher.base

bis_fetcher.fetcher.base#

Base Fetcher

Functions

crawl_links(start_url, parse_page_func, ...)

Crawl links for article links with the given keyword.

scrape_article_text(links, parse_article_func)

Scrape the article text from the given links.

Classes

BaseFetcher(*[, article_filename, base_url, ...])

Base Fetcher

By()

Set of supported locator strategies.

Response(*[, text, status_code])