Package: scrapy-processors
Scrapy ProcessorsScrapy Processors is a collection of Processor classes meant to work with
theitemloaderspackage, commonly used with thescrapywebscraping framework.These processors are meant to extend / replace the provided processors in theitemloaderspackage.Additionally the provided Processor and ProcessorCollection classes can be extended to create custom processors.InstallationTo install Scrapy Processors, simply use pip:$pipinstallscrapy-processorsBuilt-in ProcessorsCharWhitespacePaddingCoalesceDateDateTimeDateTimeExtrordinaireDemojizeEmailsExtractDigitsFlattenJoinNormalizeNumericStringNormalizeWhitespacePhoneNumbersPriceParserRemoveEmojisRemoveHTMLTagsSelectJmesSocialsStripQuotesTakeAllTakeAllTruthyTakeFirstTakeFirstTruthyTimeToFloatUnicodeEscapeBuilt-in Processor CollectionsComposeMapComposeTable of ContentsWhat's a Processor?What's Context?Subclassing Processor and ProcessorCollectionBuilt-in ProcessorCollection SubclassesBuilt-in value-by-value processorsBuilt-in iterable processorsOpening an IssueIf you encounter a problem with the project or have a feature request, you can open an issue to let us know.To open an issue, please follow these steps:Go to theIssuestab on the github repository page.Click on the "New Issue" button.Provide a descriptive title for the issue.In the issue description, provide detailed information about the problem you are experiencing or the feature you are requesting.If applicable, include steps to reproduce the problem or any relevant code examples.Add appropriate labels to categorize the issue (e.g., bug, enhancement, documentation).Click on the "Submit new issue" button to create the issue.Once you have opened an issue, our team will review it and provide assistance or discuss the requested feature.Note: Before opening a new issue, please search the existing issues to see if a similar issue has already been reported. This helps avoid duplicates and allows us to focus on resolving existing problems.ContributingThank you for considering contributing to this project! We welcome your contributions to help make this project better.To contribute to this project, please follow these steps:Fork the repository by clicking on the "Fork" button at the top of the repository page. This will create a copy of the repository in your GitHub account.Clone the forked repository to your local machine using Git:$ git clone https://github.com/your-username/scrapy-processors.gitCreate a new branch for your changes:$ git checkout -b featureMake your desired changes to the codebase.Commit your changes with descriptive commit messages:$ git commit -m "Add new feature"Push your changes to your forked repository:$ git push origin featureOpen a pull request (PR) from your forked repository to the original repository'smasterbranch.Provide a clear and descriptive title for your PR and explain the changes you have made.Wait for the project maintainers to review your PR. You may need to make additional changes based on their feedback.Once your PR is approved, it will be merged into the main codebase. Congratulations on your contribution!If you have any questions or need further assistance, feel free to open an issue or reach out to the project maintainers.Happy contributing!LicenseThis project is licensed under the MIT License. See the LICENSE file for more details.