Ramping up the integration // Week 9

A sweet and salty peek into my week working for The Scrapy Project in Google Summer of Code 2019.

Week #9 17/07 to 23/07

Well, integration isn’t working, and I am not giving up.

What did you do this week?

Well, another week another PR merged. Do those PR’s count that you merge yourself – https://github.com/vipulgupta2048/spidermon/pull/4, Translator has now been officially completed. 

Over to integration, the ride has been quite bumpy. As Cerberus is not being detected by the pipeline, no worries. We have settled on a methodology to solve this problem. We will first check if CerberusValidator works in the ItemValidationPipeline if it does then Spidermon works. And then we will start worrying why it doesn’t work in other places. 

Oh and I found a bug – https://github.com/scrapinghub/spidermon/issues/192

What is coming up next? 

For now, if you like to know. We will be completing the ItemValidationPipeline, then moving onto integration which rounds this project up successfully. 

Did you get stuck anywhere?

Don’t even ask, I somehow wasn’t able to install Scrapy in my first go (didn’t read the docs) and couldn’t implement the JSONSchemaValidator (didn’t read the docs enough times, with a magnifying glass). So yeah, bumpy.

A worthy bucket to drop in your thoughts, feedback or rant.

This site uses Akismet to reduce spam. Learn how your comment data is processed.