Explore ways to properly loop scrapy crawlers with twisted callbacks.