Position: Short Term Contractor- Scraper of a Tax website-Scrape Experience Preferred -Some UX requested
Company: Mentally
Category: Python
Experience required: 5y
English level: fluent

This is a project position, we are looking for a top developer with extensive crawler development experience to build in 1-4 months a crawler. The contract should also be able to contract for maintenance. Contract will be paid at milestones delivered not just hours. We need full time contractor.

We are looking for a python developer capable of building minimal UX to manage the back end application and development of a scraper.

The italian Tax agency maintains a digital Database of B2B, B2C, B2G Invoices as well as B2C receipts.

However, they allow access only via a manual web interface and they offer no API service. To download these files you have to have a scraper.


Scope of  the work

Build a robust back end multithreaded RPA -robotic process automation server microservice capable of massively downloading items from the Website.

• Essential  requirements
1. High throughout: many documents per minutes for users in parallel sessions.
2. Dependability
3. Error tolerance: manage crash or errors and automatically restart the batch processes
4. Horizontal and vertical  scalability
5. Users credential management database GDPR compatible
6. User inputs credential UX and Utilities to remind the user of password change each 90 days.
7. Lowest cost of operation possible
8. Designed to support potential variations in the login system on the webportal

DETAILED REQUIREMENTS:
shorturl.at/ghuAC




• The professional should have

1. Experience with the design of high throughput high reliable web services for critical infrastructures ( that cannot go down)
2. Previous experiences in Web Scraping project with Login Application
3. Previous experiences in Analysis and Use of Private organizations Rest Api
4. Ability to examine requirements and translate them into architecture design
5. Good knowledge of cloud architecture scale methods: containers vs compute nodes (Azure preferred)
6. Ability to interact with both product manager and customers to carefully assess the business rules.
7. Ability to predict and identify gaps in the product manager requirements if any
8. Experience with documenting the application carefully and professionally and follow the  hand over to developers in residence.
9. Superb communication skills with both technical and non technical people


Our estimates from our engineers indicate about 6 weeks of full time work, you should send us an estimate for a 2 months full time involvement and a clear description of your expertises designing RPA and scraping applications.

INFORMATION TO PROVIDE WHEN APPLYING

1-Estimate for the crawler
2- Estimate for parsing and synching the data into our infrastructure
3- Estimate for the API to synch and extract data if we want to use it as a service
4-the entire user interface to handle customers and the expiration of their pin code
5- The estimate for UX to handle the parser, se the analytics select and restart blocked jobs or to restart
6- the estimate for the supportability plan, e.g. change in ux, bugs, change in access..
7- What is the committed SLA and penalty do you pay if you do not respect it? what happens if the website changes?
8- Is the QA for the crawlers, the parser, the UX for customers t, the UX for the crawler handled accounted correctly?
9-an analysis if the peak demand can be meet and if IP throttling will be necessary
10- An estimate of Operation costs of cloud per year