Do you sometimes run programs in Python which take a while? And do you constantly keep looking whether the program has finished? Receive notifications while doing other things or when you are away from your computer with the three simple Python scripts below.
You can choose to get notified by a playing a sound, sending a text message or email. That depends on your preferences or the runtime of your program.
Continue reading Get notifications when your Python program has finished
Thanks to the excellent tutorial of Geek Gurl, I managed to make my first timelapse video. In her tutorial she explains how to set up the camera and gives some simple commands for XTerminal on your Raspberry Pi.
Continue reading Timelapse Video with a Raspberry Pi 2
When looking into other Python programmers’ code you’ve most likely come across the __name__ variable. Below you see an example code snippet:
if __name__ == '__main__':
Learn more on how you can make use of this variable to create modules in Python.
Continue reading What’s in a (Python’s) __name__?
When you make many requests in a short period of time, you risk being banned by the server. In this final post of the web scraper series, I’ll show you some tricks to avoid IP banning.
Continue reading Avoiding IP Banning with the Scrapy Framework
In the post about Pipelines, we already saw how we store the scraping results in a SQLite database. In this post of the web scraper series, I will show you how you can send the scraping results via email. This way you get a nice overview of the top rated films for the coming week in your mailbox.
Continue reading Using Extensions in Scrapy
In this post we’ll be looking at the core of Scrapy, the Spider. This is where the heavy-lifting of your web scraper will be done. I’ll show you step-by-step how we create the Spider.
Continue reading Creating a Spider with Scrapy
In this post I will talk about Item Pipelines in the Scrapy framework. In short, Pipelines can be used to process an Item. With processing I mean: using the contents of an item or even removing it.
We’ll continue the Top Films Web Scraper which I introduced in the previous post on Items in Scrapy. For our project, we’ll use Pipelines to store the Items in an SQLite database.
Continue reading Using Pipelines in Scrapy