scrapy meta

How To Pass Meta Data Inside Scrapy

Not so long ago, I was building a spider which queried product ids from a database before actually scraping the site. The task was to assign specific product ids to scraped products. In the database table I had two columns: product_id and URL. Each URL…