A while ago I read an interesting blog post on the website of the Dutch organisation Vlinderstichting. Every year they organise a count of butterflies. Volunteers help determining the different butterfly species in their garden. The Vlinderstichting gathers and analyses the results.
As the determination of the butterfly species is done by the volunteers, inevitably this process is prone to errors. As a result the Vlinderstichting has too much work because they have to manually check whether the submissions are correct.
Specifically, there are three butterflies for which the Vlinderstichting receives many wrong determinations. These are
As I am learning more about convolutional neural networks, classifying butterfly images seemed an interesting subject to work on. So let’s do this!
Continue reading “Downloading images with the Flickr API and Python”
Do you sometimes run programs in Python which take a while? And do you constantly keep looking whether the program has finished? Receive notifications while doing other things or when you are away from your computer with the three simple Python scripts below.
You can choose to get notified by a playing a sound, sending a text message or email. That depends on your preferences or the runtime of your program.
Continue reading “Get notifications when your Python program has finished”
Thanks to the excellent tutorial of Geek Gurl, I made my first timelapse video. In her tutorial she explains how to set up the camera. Additionally, she provides some simple commands for XTerminal on your Raspberry Pi.
Continue reading “Timelapse Video with a Raspberry Pi 2”
When looking into other Python programmers’ code you’ve most likely come across the __name__ variable. Below you see an example code snippet:
if __name__ == '__main__':
Learn more on how you can make use of this variable to create modules in Python.
Continue reading “What’s in a (Python’s) __name__?”
When you make many requests in a short period of time, you risk being banned by the server. In this final post of the web scraper series, I’ll show you some tricks to avoid IP banning.
Continue reading “Avoiding IP Banning with the Scrapy Framework”
In the post about Pipelines, we already saw how we store the scraping results in a SQLite database. In this post of the web scraper series, I will show you how you can send the scraping results via email. This way you get a nice overview of the top rated films for the coming week in your mailbox.
Continue reading “Using Extensions in Scrapy”
In this post we’ll be looking at the core of Scrapy, the Spider. This is where the heavy-lifting of your web scraper will be done. I’ll show you step-by-step how we create the Spider.
Continue reading “Creating a Spider with Scrapy”