Repositories list

• shub-workflow

  Public

  scrapinghub/shub-workflow’s past year of commit activity
  Python

  •

  Apache License 2.0

  •1616 forks in scrapinghub/shub-workflow•1414 stars in scrapinghub/shub-workflow•22 issues in scrapinghub/shub-workflow•22 pull requests in scrapinghub/shub-workflow•Updated Oct 28, 2026Oct 28, 2026

• dateparser

  Public

  scrapinghub/dateparser’s past year of commit activity
  python parser for human readable dates

  hacktoberfest

  hacktoberfest

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •530530 forks in scrapinghub/dateparser•2.9k2.9k stars in scrapinghub/dateparser•125125 issues in scrapinghub/dateparser•109109 pull requests in scrapinghub/dateparser•Updated Oct 27, 2026Oct 27, 2026

• scrapy-poet

  Public

  scrapinghub/scrapy-poet’s past year of commit activity
  Page Object pattern for Scrapy

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2929 forks in scrapinghub/scrapy-poet•129129 stars in scrapinghub/scrapy-poet•44 issues in scrapinghub/scrapy-poet•77 pull requests in scrapinghub/scrapy-poet•Updated Oct 27, 2026Oct 27, 2026

• shub

  Public

  scrapinghub/shub’s past year of commit activity
  Scrapinghub Command Line Client

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •8383 forks in scrapinghub/shub•129129 stars in scrapinghub/shub•1818 issues in scrapinghub/shub•1414 pull requests in scrapinghub/shub•Updated Oct 27, 2026Oct 27, 2026

• python-scrapinghub

  Public

  scrapinghub/python-scrapinghub’s past year of commit activity
  A client interface for Scrapinghub's API

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •6262 forks in scrapinghub/python-scrapinghub•204204 stars in scrapinghub/python-scrapinghub•2020 issues in scrapinghub/python-scrapinghub•2020 pull requests in scrapinghub/python-scrapinghub•Updated Oct 27, 2026Oct 27, 2026

• web-poet

  Public

  scrapinghub/web-poet’s past year of commit activity
  Web scraping Page Objects core library

  pythonweb-scrapinghacktoberfest+ 1

  pythonweb-scrapinghacktoberfestpage-objects

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1919 forks in scrapinghub/web-poet•107107 stars in scrapinghub/web-poet•1010 issues in scrapinghub/web-poet•1616 pull requests in scrapinghub/web-poet•Updated Oct 26, 2026Oct 26, 2026

• scrapinghub-stack-scrapy

  Public
  Software stack with latest Scrapy and updated deps

  Dockerfile

  •

  BSD 3-Clause "New" or "Revised" License

  •1919 forks in scrapinghub/scrapinghub-stack-scrapy•6565 stars in scrapinghub/scrapinghub-stack-scrapy•11 issue in scrapinghub/scrapinghub-stack-scrapy•33 pull requests in scrapinghub/scrapinghub-stack-scrapy•Updated Oct 26, 2026Oct 26, 2026

• python-crfsuite

  Public
  A python binding for crfsuite

  data-sciencecrfcrfsuite

  data-sciencecrfcrfsuite

  Python

  •

  MIT License

  •223223 forks in scrapinghub/python-crfsuite•774774 stars in scrapinghub/python-crfsuite•2020 issues in scrapinghub/python-crfsuite•44 pull requests in scrapinghub/python-crfsuite•Updated Oct 22, 2026Oct 22, 2026

• spidermon

  Public
  Scrapy Extension for monitoring spiders execution.

  testingmonitoringscraping+ 5

  testingmonitoringscrapingcrawlingspidershacktoberfestmonitoring-toolscrapinghub

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •101101 forks in scrapinghub/spidermon•562562 stars in scrapinghub/spidermon•77 issues in scrapinghub/spidermon•99 pull requests in scrapinghub/spidermon•Updated Oct 20, 2026Oct 20, 2026

• extruct

  Public

  scrapinghub/extruct’s past year of commit activity
  Extract embedded metadata from HTML markup

  microformatssemantic-webrdfa+ 4

  microformatssemantic-webrdfajson-ldmicrodataopengraphhacktoberfest

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •127127 forks in scrapinghub/extruct•978978 stars in scrapinghub/extruct•2626 issues in scrapinghub/extruct•2929 pull requests in scrapinghub/extruct•Updated Oct 15, 2026Oct 15, 2026

• scrapyrt

  Public
  HTTP API for Scrapy spiders

  pythoncrawlerscraper+ 7

  pythoncrawlerscrapercrawlingtwistedscrapywebcrawlerhacktoberfestwebcrawlinghacktoberfest2021

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •161161 forks in scrapinghub/scrapyrt•885885 stars in scrapinghub/scrapyrt•2323 issues in scrapinghub/scrapyrt•77 pull requests in scrapinghub/scrapyrt•Updated Oct 13, 2026Oct 13, 2026

• scrapinghub-entrypoint-scrapy

  Public
  Scrapy entrypoint for Scrapinghub job runner

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1616 forks in scrapinghub/scrapinghub-entrypoint-scrapy•2525 stars in scrapinghub/scrapinghub-entrypoint-scrapy•55 issues in scrapinghub/scrapinghub-entrypoint-scrapy•77 pull requests in scrapinghub/scrapinghub-entrypoint-scrapy•Updated Oct 9, 2026Oct 9, 2026

• price-parser

  Public
  Extract price amount and currency symbol from a raw text string

  hacktoberfest

  hacktoberfest

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •6666 forks in scrapinghub/price-parser•348348 stars in scrapinghub/price-parser•1414 issues in scrapinghub/price-parser•2626 pull requests in scrapinghub/price-parser•Updated Oct 6, 2026Oct 6, 2026

• number-parser

  Public
  Parse numbers written in natural language

  hacktoberfest

  hacktoberfest

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2828 forks in scrapinghub/number-parser•131131 stars in scrapinghub/number-parser•1111 issues in scrapinghub/number-parser•1616 pull requests in scrapinghub/number-parser•Updated Oct 3, 2026Oct 3, 2026

• andi

  Public
  Library for annotation-based dependency injection

  Python

  •

  Apache License 2.0

  •77 forks in scrapinghub/andi•2424 stars in scrapinghub/andi•22 issues in scrapinghub/andi•11 pull request in scrapinghub/andi•Updated Oct 1, 2026Oct 1, 2026

• scrapy-frontera

  Public
  More flexible and featured Frontera scheduler for Scrapy

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •55 forks in scrapinghub/scrapy-frontera•3838 stars in scrapinghub/scrapy-frontera•22 issues in scrapinghub/scrapy-frontera•11 pull request in scrapinghub/scrapy-frontera•Updated Sep 17, 2026Sep 17, 2026

• article-extraction-benchmark

  Public archive
  Article extraction benchmark: dataset and evaluation scripts

  Python

  •

  MIT License

  •3737 forks in scrapinghub/article-extraction-benchmark•378378 stars in scrapinghub/article-extraction-benchmark•11 issue in scrapinghub/article-extraction-benchmark•55 pull requests in scrapinghub/article-extraction-benchmark•Updated May 29, 2026May 29, 2026

• scrapy-autoextract

  Public archive
  Zyte Automatic Extraction integration for Scrapy

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1616 forks in scrapinghub/scrapy-autoextract•5858 stars in scrapinghub/scrapy-autoextract•44 issues in scrapinghub/scrapy-autoextract•33 pull requests in scrapinghub/scrapy-autoextract•Updated Apr 13, 2026Apr 13, 2026

• autoextract-examples

  Public archive
  Jupyter Notebook

  •11 fork in scrapinghub/autoextract-examples•44 stars in scrapinghub/autoextract-examples•00 issues in scrapinghub/autoextract-examples•11 pull request in scrapinghub/autoextract-examples•Updated Apr 10, 2026Apr 10, 2026

• product-extraction-benchmark

  Public archive
  Jupyter Notebook

  •

  MIT License

  •11 fork in scrapinghub/product-extraction-benchmark•1616 stars in scrapinghub/product-extraction-benchmark•00 issues in scrapinghub/product-extraction-benchmark•11 pull request in scrapinghub/product-extraction-benchmark•Updated Apr 10, 2026Apr 10, 2026

• marathon-apps-collectd-plugin

  Public archive
  marathon-apps-collectd-plugin

  Python

  •

  GNU General Public License v2.0

  •9898 forks in scrapinghub/marathon-apps-collectd-plugin•22 stars in scrapinghub/marathon-apps-collectd-plugin•00 issues in scrapinghub/marathon-apps-collectd-plugin•11 pull request in scrapinghub/marathon-apps-collectd-plugin•Updated Nov 27, 2025Nov 27, 2025

• hcf-backend

  Public
  Crawl Frontier HCF backend

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •66 forks in scrapinghub/hcf-backend•99 stars in scrapinghub/hcf-backend•22 issues in scrapinghub/hcf-backend•00 pull requests in scrapinghub/hcf-backend•Updated Oct 31, 2025Oct 31, 2025

• docker-images

  Public
  Dockerfile

  •88 forks in scrapinghub/docker-images•3333 stars in scrapinghub/docker-images•00 issues in scrapinghub/docker-images•55 pull requests in scrapinghub/docker-images•Updated Oct 20, 2025Oct 20, 2025

• Formasaurus

  Public
  Formasaurus tells you the type of an HTML form and its fields using machine learning

  HTML

  •4444 forks in scrapinghub/Formasaurus•88 stars in scrapinghub/Formasaurus•11 issue in scrapinghub/Formasaurus•11 pull request in scrapinghub/Formasaurus•Updated Sep 4, 2025Sep 4, 2025

• sklearn-crfsuite

  Public
  scikit-learn inspired API for CRFsuite

  Python

  •204204 forks in scrapinghub/sklearn-crfsuite•11 star in scrapinghub/sklearn-crfsuite•00 issues in scrapinghub/sklearn-crfsuite•11 pull request in scrapinghub/sklearn-crfsuite•Updated Sep 4, 2025Sep 4, 2025

• frontera

  Public
  A scalable frontier for web crawlers

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •211211 forks in scrapinghub/frontera•1.3k1.3k stars in scrapinghub/frontera•5959 issues in scrapinghub/frontera•1414 pull requests in scrapinghub/frontera•Updated Jun 6, 2025Jun 6, 2025

• social-app-django

  Public archive
  Python Social Auth - Application - Django

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •393393 forks in scrapinghub/social-app-django•22 stars in scrapinghub/social-app-django•00 issues in scrapinghub/social-app-django•11 pull request in scrapinghub/social-app-django•Updated Nov 18, 2024Nov 18, 2024

• streamparse

  Public archive
  streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.

  Python

  •

  Apache License 2.0

  •220220 forks in scrapinghub/streamparse•22 stars in scrapinghub/streamparse•00 issues in scrapinghub/streamparse•11 pull request in scrapinghub/streamparse•Updated Sep 20, 2024Sep 20, 2024

• splash

  Public
  Lightweight, scriptable browser as a service with an HTTP API

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •511511 forks in scrapinghub/splash•4.2k4.2k stars in scrapinghub/splash•373373 issues in scrapinghub/splash•2626 pull requests in scrapinghub/splash•Updated Aug 2, 2024Aug 2, 2024

• pgcontents

  Public archive
  A Postgres-backed ContentsManager implementation for IPython

  Python

  •

  Apache License 2.0

  •8585 forks in scrapinghub/pgcontents•22 stars in scrapinghub/pgcontents•00 issues in scrapinghub/pgcontents•11 pull request in scrapinghub/pgcontents•Updated Jul 18, 2024Jul 18, 2024