Python Code Review: Unplugged – Episode 3

By Dan Bader — Get free updates of new posts here.

In this third episode of my video code review series I take a look at a reader’s web scraping project and start adding some unit tests to it.

This is a Python code review I did for Sunny’s web scraping project on GitHub. Sunny reached out to me after watching one of my previous code review videos, asking me if I could give him some feedback on his web scraping pet project.

In this episode you’ll see Flake8 and Python code linting tools make a comeback. Also I’m doing an intro to adding Pytest unit tests to an existing Python code base in the second half of the video.

By the way, I love how eager Sunny was to get feedback on his Python code:

As a pet project I wanted to learn all the best practice as much as I could about python, trying to code as pythonic as I can, checking pep8 and autopep8 (didn’t knew about flake8!!) Eventually I re-factored using classes and methods. If you’ll see that it originally did everything in one monolithic function in the 2.x pull request on github. I still have a few things that I want to implement, so I welcome all kinds of feedback about it!

This is exactly the right mindset that turns people into productive and successful software engineers. Even tiny – but constant – improvements add up and compound over time.

I’ve seen this in friends and colleagues alike. Those developers who seek out constant small improvements eventually go on and do amazing things.

Enjoy the video! And be sure to check out my other Python screencasts if you liked this code review 😊

Links & Resources:

» Click here to watch my other Python Code Review: Unplugged videos

This article was filed under: code-review, craftsmanship, programming, python, and video.

Related Articles:

Python Code Review: Unplugged – Episode 2 – This is the second episode of my video code review series where I record myself giving feedback and refactoring a reader’s Python code.
Watch me do a “live” Python code review for a reader – This is a bit of an experiment – but you might find it interesting!
A Python refactoring gone wrong – Ever witnessed a colleague make a refactoring to “clean up” some Python code only to make it worse and harder to understand?
How code linting will make you awesome at Python – In Python code reviews I’ve seen over and over that it can be tough for developers to format their Python code in a consistent way: extra whitespace, irregular indentation, and other “sloppiness” then often leads to actual bugs in the program.
Generate and host your API documentation for free with open-source tools – How to generate documentation for a RESTful API as part of your continuous integration build and then automatically deploy it to a website. Includes a full example project on GitHub.

Latest Articles:

Interfacing Python and C: The CFFI Module – How to use Python’s built-in CFFI module for interfacing Python with native libraries as an alternative to the “ctypes” approach.
Write More Pythonic Code by Applying the Things You Already Know – There’s a mistake I frequently make when I learn new things about Python… Here’s how you can avoid this pitfall and learn something about Python’s “enumerate()” function at the same time.
Working With File I/O in Python – Learn the basics of working with files in Python. How to read from files, how to write data to them, what file seeks are, and why files should be closed.
How to Reverse a String in Python – An overview of the three main ways to reverse a Python string: “slicing”, reverse iteration, and the classic in-place reversal algorithm. Also includes performance benchmarks.
Mastering Click: Writing Advanced Python Command-Line Apps – How to improve your existing Click Python CLIs with advanced features like sub-commands, user input, parameter types, contexts, and more.
Working with Random Numbers in Python – An overview for working with randomness in Python, using only functionality built into the standard library and CPython itself.

← Browse All Articles

🐍 Python Tricks 💌