« Projects

Scrapy

  • Q: I'd like to participate. How do I begin?

  • Q: Other than writing code, how can I contribute?

    • [X]

      • Tip:

        Discuss documentation, testing, webmastering, and/or publicity.

        Include URLs if relevant (we'll automatically linkify them).

      • Example:

        We need people to download version 0.4.5 and make sure the frobulator still frobulates correctly.

  • Q: What's a good bug for a newcomer to tackle?

    • [X]

      • Tip:

        Many projects have good small tasks that can teach newcomers how the project works. Now's your chance to share one of them!

        Include URLs if relevant (we'll automatically linkify them).

      • Example:

        Someone could improve the photo upload dialog box so that it lets you resize the photo before sending it to the web.

  • Q: What is a bug or issue with Scrapy that you've been putting off, neglecting, or just plain avoiding?

    • 0
      Revamping Scrapyd

      Scrapyd, the open source spider running, needs some love. You can find more info in its project page: https://github.com/scrapy/scrapyd


         — Pablo Hoffman (pablohoffman) · 2 years ago
    • [X]

      • Examples:

        I don't know how to get started with internationalizing my app.

        Bug 392 about printing was filed five years ago, and I don't even know if printing still works.

        I want help from a C coder writing a Maildir patch for Alpine.

      • Note:

        If this issue was formally filed on the web, be sure to include the URL.

What else do you want to talk about?

About Scrapy

(logo)

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

from the profile of Daniel Graña (dangra)

The code is mostly written in Python.

People who want to help (11)

The following people are interested in helping. Send them an email! (tips)

You can use this page to track who has been contacted if you log in. There will be a checkbox next to their name. When you check it, the page will publish today's date and your username.

Volunteer opportunities, etc.

Volunteer opportunities matching Scrapy (647)

No one on OpenHatch has signed up as a mentor for Scrapy. Can you? Add the tag.

There are 327 people who can mentor in Python, Scrapy's primary language.

You can embed the "I want to help" button on your website. (More about this.)