Django blog tutorial - the next generation - part 1
Published by Matthew Daly at 28th December 2013 3:00 pm
My series of Django tutorials for building a blogging engine are by far the most popular posts I've ever written on here. I've had a lot of people contact me with questions or just to express their thanks, for which I'm very grateful!
However, these tutorials haven't really aged well. I've since had the opportunity to use Django in a professional capacity, which has significantly improved my understanding of the framework and the whole Python ecosystem, and there's a lot of best practices that I didn't follow and now wish I had. There's also been a few gotchas that have hindered a few people in the past that I'd like to have the opportunity to correct.
So, I'm therefore creating a brand new series of tutorials to remedy this situation. This series will cover exactly the same basic idea of using Django to build a blogging engine, but will expand on what the original series did in many ways. We will cover such additional topics as:
- Using Twitter Bootstrap to make your blog look good without too much hassle
- Using Virtualenv to sandbox your blog application
- Using South to effectively manage changes to your database structure
- Writing some simple unit tests
- Deploying the finished application to Heroku
Ready? Let's get started!
Getting everything set up
Now, first of all, I'm going to assume you're using some variant of Unix, such as Linux or Mac OS X. I'm not saying you can't follow this tutorial with Windows, but you'll have a harder time, because Windows just isn't as developer-friendly as Unix in general. A modern Linux distro like Ubuntu is generally pretty easy to use, and you can easily run it in Virtualbox, so if you use Windows I would recommend you use that to make things easier.
You should also have at least a basic grasp of the command line, such as how to create and navigate directories. You don't have to be a wizard with it, though.
You also need a proper programmer's text editor. I use Vim, but I freely admit that Vim has a very steep learning curve and you may have trouble picking it up at the same time as following this tutorial. Emacs is also a very powerful text editor, and if you like it, feel free to use it. If you haven't yet found a programmer's text editor you like, I suggest you check out Sublime Text, which is easy to get started with, but also very powerful, and can be used without purchasing a license. Don't worry too much about your text editor - it's not vitally import that you use what I use, just find one that works for you. That said, I will say one thing - DON'T use an IDE. IDE's hide too many details from new users and make it harder to figure out what's going on.
You will also need to ensure you have the following installed:
- Python. I recommend installing Python 2.7, because you may have issues with Python 2.6, and Python 3 isn't universally supported yet so you might have some issues with that
- Virtualenv
- Pip
- Git
On most Linux distros, you can find packages for all of these items easily enough using your package manager. On Mac OS X, I recommend using Homebrew to install them, though if you have another package manager installed you can use that too. If you have issues with installing any of these, a quick Google search should be sufficient to resolve the issue.
Beginning work
With all that done, we're ready to get started. Create a folder in a suitable place on your file system and switch into it. I generally keep a dedicated folder in my home directory called Projects
to use for all of my projects, and give each project a folder within it - in this case the project is called django_tutorial_blog_ng
.
Now, we'll use Git to keep track of our source code. If you prefer Mercurial, feel free to use that, but this tutorial will assume use of Git, so you'll want to adapt the commands used accordingly. Start tracking your project with the following command from the shell, when you're in the project directory:
$ git init
If you haven't used Git before, you'll also want to configure it.
Next, we set up our virtualenv. Run the following command:
$ virtualenv venv --distribute
Followed by:
$ source venv/bin/activate
Every time you come back to work on this project, you'll need to run the previous command to make sure you're running the version of Python installed under venv/ rather than your system Python. You can tell it's using this because your shell prompt will be prefixed with (venv)
.
Why do this? Well, it means you can install whatever version of a Python module you like, without having root access, and means the Python install you're using will only have those modules you explicitly install, rather than all of those ones available with your operating system. For instance, you could have multiple projects using different versions of Django, rather than having to update a global installation of Django and potentially break existing applications.
Now that our virtualenv is set up, we'll install Django, as well as several other useful Python modules. Run the following command:
$ pip install django-toolbelt South
A little explanation is called for here. The package django-toolbelt
includes a number of packages we'll be using, including Django, as well as Gunicorn (a simple web server we'll use when the time comes to deploy the app to Heroku). South is a migration tool that is commonly used with Django - basically, if you make changes to existing models, Django doesn't natively have the capacity to apply those changes (yet - native migrations are planned at some point in the future), so South can be used to apply those changes for you without having to either manually change the database structure or dump the database and rebuild it.
Please note that one of the packages, psycopg2
, may fail if you don't have PostgreSQL installed, but don't worry about installing it. We'll be using SQLite for developing the application locally, and we'll be deploying the finished product to Heroku, which does have it installed.
Once the installation is complete, run the following command to record the new modules installed:
$ pip freeze > requirements.txt
The file requirements.txt
will be created, which stores the packages and versions you have installed so that they can be easily recreated. If you had issues installing psycopg2
, then here's what your requirements.txt
should look like - feel free to edit it manually to look like this, as when we deploy it to Heroku, it will need to be correct to ensure that our application can be deployed successfully:
1Django==1.6.12South==0.8.43dj-database-url==0.2.24dj-static==0.0.55django-toolbelt==0.0.16gunicorn==18.07psycopg2==2.5.18static==0.49wsgiref==0.1.2
Next, we'll commit these changes with Git:
1$ git add requirements.txt2$ git commit -m 'Committed requirements'
Next we'll add a .gitignore
file to ignore our virtualenv - we want to keep this out of version control because it's something specific to that install. We have all we need to recreate it so we don't want to store it. In addition, we also want to ignore any compiled Python files (identifiable by the .pyc suffix):
1venv/2*.pyc
Let's commit that too:
1$ git add .gitignore2$ git commit -m 'Added a gitignore file'
Now, let's generate our project's basic skeleton:
$ django-admin.py startproject django_tutorial_blog_ng .
This application skeleton includes a basic configuration which will be sufficient for now, but you will also want to add the SQLite database file to your .gitignore
:
1env/2*.pyc3db.sqlite3
Let's commit what we've done:
1$ git add .gitignore django_tutorial_blog_ng/ manage.py2$ git commit -m 'Created project skeleton'
Now, before we create our database, we need to ensure we are using South. Go into django_tutorial_blog_ng/settings.py
and find INSTALLED_APPS
. Edit it to look like this:
1INSTALLED_APPS = (2 'django.contrib.admin',3 'django.contrib.auth',4 'django.contrib.contenttypes',5 'django.contrib.sessions',6 'django.contrib.messages',7 'django.contrib.staticfiles',8 'south',9)
Now, you can create your database. Run the following command:
$ python manage.py syncdb
You'll be prompted to create a superuser - go ahead and fill in the details. Now, run the following command:
$ python manage.py runserver
This will run Django's built-in web server on port 8000, and if you click here, you should see a page congratulating you on your first Django-powered page. Once you're finished with it, you can stop the web server with Ctrl-C.
Don't forget to commit your changes:
1$ git add django_tutorial_blog_ng/settings.py2$ git commit -m 'Added South to installed apps'
Your first app
Django distinguishes between the concepts of projects and apps. A project is a specific project that may consist of one or more apps, such as a web app, whereas an app is a set of functionality within a project. For instance, one website might include some flat pages, an admin interface, and a blogging engine, and these could easily be different apps. By encouraging you to separate different types of functionality into different apps, Django makes it easier for you to reuse existing content elsewhere.
We're going to create our first app, which is the blogging engine. Run the following command to create a basic skeleton for this app:
$ python manage.py startapp blogengine
Next, we need to amend our settings to install this app:
1INSTALLED_APPS = (2 'django.contrib.admin',3 'django.contrib.auth',4 'django.contrib.contenttypes',5 'django.contrib.sessions',6 'django.contrib.messages',7 'django.contrib.staticfiles',8 'south',9 'blogengine',10)
Now, before we can use this app, we want to let South know about it so that changes to your database structure will be managed right from the start by South. Run the following command to create your initial migration:
$ python manage.py schemamigration --initial blogengine
That creates the file for your first migration,but doesn't run it. To migrate your database structure to the latest version, run the following:
$ python manage.py migrate
This won't actually make any changes, but it will ensure that all future changes to your models for the blogengine
app are handled by South. Let's commit our app skeleton:
1$ git add django_tutorial_blog_ng/settings.py blogengine/2$ git commit -m 'Added blogengine app skeleton'
So, we now have our first app set up, but it doesn't do anything much.
Remember that I mentioned how Django differentiates between projects and apps? Well, Django actually ships with a number of useful apps, and one of those is the admin interface. I consider the Django admin to be one of the framework's killer features because it's easy to use and customise, and saves you a lot of grief.
In the past, the admin interface needed a little work to get it working, but in Django 1.6 it's configured to work out of the box, so if you click here, you should see the login screen for it. You should be able to sign in using the username and password you set when you ran syncdb
.
Next, we'll set up our first model.
An introduction to MVC
MVC is a common pattern used in web development. Many web development frameworks can be loosely described as MVC, including Django, Rails, CodeIgniter, Laravel and Symfony, as well as some client-side frameworks like Backbone.js. The basic concept is that a web app is divided into three basic components:
- Models - the data managed with the application
- Views - the presentation of the data
- Controllers - an intermediary between the models and the views
Now, Django's interpretation of MVC is slightly different to many other frameworks. While in most frameworks the views are HTML templates for rendering the data, in Django this role is taken by the templates, and the views are functions or objects that render data from the models using a template. Effectively, you can think of Django's views as being like controllers in other frameworks, and Django templates as being views.
In Django, you create your models as Python classes that represent your data, and you use the Django ORM to query the database. As a result, it's rare to have to directly query your database using SQL, making it more portable between different databases.
Now, our first model is going to be of a blog post. At least initially, each post will have the following attributes:
- A title
- A publication date and time
- Some text
Now, we could just jump straight into creating our first model, but we're going to make a point of following the practices of test-driven development here. The basic concept of TDD is that you write a failing test before writing any code, then you write the code to pass that test afterwards. It does make things a bit slower, but it's all too easy to neglect writing tests at all if you leave it till later.
If you take a look in the blogengine
folder you'll notice there's a file called tests.py
. Open it up and you should see the following:
1from django.test import TestCase23# Create your tests here.
It's worth taking a little time to plan out what we want to test from our post model. Each post object will have the attributes I mentioned above, and what we want to be able to do is test that we can:
- Set the title
- Set the publication date and time
- Set the text
- Save it successfully
- Retrieve it successfully
So, let's create a test for our post model. We'll go through the relevant sections of the test bit by bit:
1from django.test import TestCase2from django.utils import timezone3from blogengine.models import Post4
Here we're importing the required functionality. TestCase
is provided by Django, and is an object all of your tests should inherit from. timezone
is a utility for handling dates and times correctly. Finally, Post
is our model, which we have yet to implement.
1# Create your tests here.2class PostTest(TestCase):3 def test_create_post(self):4 # Create the post5 post = Post()
Here we create the PostTest class, which represents a test for your Post
model. So far it only has one method, but you can add additional ones if required.
12 # Set the attributes3 post.title = 'My first post'4 post.text = 'This is my first blog post'5 post.pub_date = timezone.now()
Here we set the post's attributes.
12 # Save it3 post.save()
Now we save it. At this point it has been added to the database, and the rest of the test involves us ensuring it has been saved correctly and can be retrieved.
12 # Check we can find it3 all_posts = Post.objects.all()4 self.assertEquals(len(all_posts), 1)5 only_post = all_posts[0]6 self.assertEquals(only_post, post)
Here we use the Django database API to fetch all of the Post objects, assert that there is only 1 post object, retrieve that post object, and assert that it is the same object as the post object we just saved.
If unit testing is new to you, assertions may be new to you. Essentially you're saying to the Python interpreter, "I assert that X is true, so please raise an error if this is not true". Here we assert that the length of the variable all_posts
is 1, and that that post is the same object as the previously saved object, so that the test will fail if that is not the case.
12 # Check attributes3 self.assertEquals(only_post.title, 'My first post')4 self.assertEquals(only_post.text, 'This is my first blog post')5 self.assertEquals(only_post.pub_date.day, post.pub_date.day)6 self.assertEquals(only_post.pub_date.month, post.pub_date.month)7 self.assertEquals(only_post.pub_date.year, post.pub_date.year)8 self.assertEquals(only_post.pub_date.hour, post.pub_date.hour)9 self.assertEquals(only_post.pub_date.minute, post.pub_date.minute)10 self.assertEquals(only_post.pub_date.second, post.pub_date.second)
Finally, we assert that the values of each of the post's attributes as stored in the database match up with those in the post object we set. For the title
and text
fields, these are easy to validate as we can just check the values against those we set. For the pub_date
field, things are a bit more complex, since this will be an object in its own right, so you need to check the day, month, year, hour, minute and second attributes separately.
The whole thing should look like this:
1from django.test import TestCase2from django.utils import timezone3from blogengine.models import Post45# Create your tests here.6class PostTest(TestCase):7 def test_create_post(self):8 # Create the post9 post = Post()1011 # Set the attributes12 post.title = 'My first post'13 post.text = 'This is my first blog post'14 post.pub_date = timezone.now()1516 # Save it17 post.save()1819 # Check we can find it20 all_posts = Post.objects.all()21 self.assertEquals(len(all_posts), 1)22 only_post = all_posts[0]23 self.assertEquals(only_post, post)2425 # Check attributes26 self.assertEquals(only_post.title, 'My first post')27 self.assertEquals(only_post.text, 'This is my first blog post')28 self.assertEquals(only_post.pub_date.day, post.pub_date.day)29 self.assertEquals(only_post.pub_date.month, post.pub_date.month)30 self.assertEquals(only_post.pub_date.year, post.pub_date.year)31 self.assertEquals(only_post.pub_date.hour, post.pub_date.hour)32 self.assertEquals(only_post.pub_date.minute, post.pub_date.minute)33 self.assertEquals(only_post.pub_date.second, post.pub_date.second)
With that in place, the time has come to run our test with the following command:
$ python manage.py test
You should see something like this:
1(venv)Smith:django_tutorial_blog_ng matthewdaly$ python manage.py test2Creating test database for alias 'default'...3E4======================================================================5ERROR: blogengine.tests (unittest.loader.ModuleImportFailure)6----------------------------------------------------------------------7ImportError: Failed to import test module: blogengine.tests8Traceback (most recent call last):9 File "/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/loader.py", line 254, in _find_tests10 module = self._get_module_from_name(name)11 File "/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/loader.py", line 232, in _get_module_from_name12 __import__(name)13 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/blogengine/tests.py", line 3, in <module>14 from blogengine.models import Post15ImportError: cannot import name Post161718----------------------------------------------------------------------19Ran 1 test in 0.000s2021FAILED (errors=1)22Destroying test database for alias 'default'...
Don't worry about the error - this is exactly what we expect to see because we haven't implemented our Post model yet. Now that we have a failing test in place, we can implement our model to make the test pass. Open up blogengine/models.py
and enter the following:
1from django.db import models23# Create your models here.4class Post(models.Model):5 title = models.CharField(max_length=200)6 pub_date = models.DateTimeField()7 text = models.TextField()
Save the file and run the test again:
1(venv)Smith:django_tutorial_blog_ng matthewdaly$ python manage.py test2Creating test database for alias 'default'...3E4======================================================================5ERROR: test_create_post (blogengine.tests.PostTest)6----------------------------------------------------------------------7Traceback (most recent call last):8 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/blogengine/tests.py", line 17, in test_create_post9 post.save()10 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/base.py", line 545, in save11 force_update=force_update, update_fields=update_fields)12 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/base.py", line 573, in save_base13 updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields)14 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/base.py", line 654, in _save_table15 result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)16 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/base.py", line 687, in _do_insert17 using=using, raw=raw)18 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/manager.py", line 232, in _insert19 return insert_query(self.model, objs, fields, **kwargs)20 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/query.py", line 1511, in insert_query21 return query.get_compiler(using=using).execute_sql(return_id)22 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 898, in execute_sql23 cursor.execute(sql, params)24 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/backends/util.py", line 53, in execute25 return self.cursor.execute(sql, params)26 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/utils.py", line 99, in __exit__27 six.reraise(dj_exc_type, dj_exc_value, traceback)28 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/backends/util.py", line 53, in execute29 return self.cursor.execute(sql, params)30 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/venv/lib/python2.7/site-packages/django/db/backends/sqlite3/base.py", line 450, in execute31 return Database.Cursor.execute(self, query, params)32OperationalError: no such table: blogengine_post3334----------------------------------------------------------------------35Ran 1 test in 0.059s3637FAILED (errors=1)38Destroying test database for alias 'default'...
Our test still fails, but if we take a look at this error message, we can see why - there is no database table for the posts (called blogengine_post
). Using South, we can easily remedy that by creating a new migration to create this table:
$ python manage.py schemamigration --auto blogengine
That creates the new migration. Now let's run it:
$ python manage.py migrate
Now, let's run our tests to check it's working as expected:
1(venv)Smith:django_tutorial_blog_ng matthewdaly$ python manage.py test2Creating test database for alias 'default'...3.4----------------------------------------------------------------------5Ran 1 test in 0.001s67OK8Destroying test database for alias 'default'...
Success! We now have a model in place that passes our test. Let's commit our changes:
1$ git add blogengine/2$ git commit -m 'Added post model with passing test'
Now, Django's ORM is basically a layer on top of SQL that abstracts away differences between different relational databases, but the underlying queries are still being run. You can view the SQL created to generate the table by using the sqlall
command. Just run python manage.py sqlall blogengine
and you should see something like this:
1BEGIN;2CREATE TABLE "blogengine_post" (3 "id" integer NOT NULL PRIMARY KEY,4 "title" varchar(200) NOT NULL,5 "pub_date" datetime NOT NULL,6 "text" text NOT NULL7)8;910COMMIT;
Note the addition of the id
field as the primary key. If you're at all familiar with relational databases, you'll know that every table must have one field, called a primary key, that is a unique reference to that row. This can be overridden, but here it's exactly the behaviour we want.
Creating blog posts via the admin
Now, we need a way to be able to create, edit and delete blog posts. Django's admin interface allows us to do so easily. However, before we do so, we want to create automated acceptance tests for this functionality, in order to test the ability to create posts from an end-user's perspective. While unit tests are for testing sections of an application's functionality from the perspective of other sections of the application, acceptance tests are testing from the user's perspective. In other words, they test what the application needs to do to be acceptable.
First, we will test logging into the admin. Open up blogengine/tests.py
and amend it as follows:
1from django.test import TestCase, LiveServerTestCase, Client2from django.utils import timezone3from blogengine.models import Post45# Create your tests here.6class PostTest(TestCase):7 def test_create_post(self):8 # Create the post9 post = Post()1011 # Set the attributes12 post.title = 'My first post'13 post.text = 'This is my first blog post'14 post.pub_date = timezone.now()1516 # Save it17 post.save()1819 # Check we can find it20 all_posts = Post.objects.all()21 self.assertEquals(len(all_posts), 1)22 only_post = all_posts[0]23 self.assertEquals(only_post, post)2425 # Check attributes26 self.assertEquals(only_post.title, 'My first post')27 self.assertEquals(only_post.text, 'This is my first blog post')28 self.assertEquals(only_post.pub_date.day, post.pub_date.day)29 self.assertEquals(only_post.pub_date.month, post.pub_date.month)30 self.assertEquals(only_post.pub_date.year, post.pub_date.year)31 self.assertEquals(only_post.pub_date.hour, post.pub_date.hour)32 self.assertEquals(only_post.pub_date.minute, post.pub_date.minute)33 self.assertEquals(only_post.pub_date.second, post.pub_date.second)3435class AdminTest(LiveServerTestCase):36 def test_login(self):37 # Create client38 c = Client()3940 # Get login page41 response = c.get('/admin/')4243 # Check response code44 self.assertEquals(response.status_code, 200)
First of all, we import two new objects from django.test
, LiveServerTestCase
and Client
. Then we create the first part of our first test for the admin, named AdminTest
. Eventually, this will test that we can log successfully into the admin interface. For now, we're just doing the following:
- Creating a Client object
- Fetching the
/admin/
route - Asserting that the status code for this HTTP request is 200, (in other words, that the page was fetched successfully).
If you run python manage.py test
, you should see that both tests pass successfully. Now we'll extend AdminTest
- we'll verify that the response contains the string 'Log in', which in the Django admin interface, appears on the login page:
1class AdminTest(LiveServerTestCase):2 def test_login(self):3 # Create client4 c = Client()56 # Get login page7 response = c.get('/admin/')89 # Check response code10 self.assertEquals(response.status_code, 200)1112 # Check 'Log in' in response13 self.assertTrue('Log in' in response.content)
Here response.content
is a string containing the content of the HTTP response - we're asserting that the substring 'Log in' appears in there. If you run python manage.py test
again, it should pass.
Now, we need to actually log in. This could be fiddly, but Django has a handy convenience method to log you in when testing:
1class AdminTest(LiveServerTestCase):2 def test_login(self):3 # Create client4 c = Client()56 # Get login page7 response = c.get('/admin/')89 # Check response code10 self.assertEquals(response.status_code, 200)1112 # Check 'Log in' in response13 self.assertTrue('Log in' in response.content)1415 # Log the user in16 c.login(username='bobsmith', password="password")1718 # Check response code19 response = c.get('/admin/')20 self.assertEquals(response.status_code, 200)2122 # Check 'Log out' in response23 self.assertTrue('Log out' in response.content)
Here, we use the login
method of the Client
object to log into the admin interface, and then we fetch the /admin/
route again. We assert that we get a 200 status code, and we assert that the response contains the string 'Log out' - in other words, that we are logged in.
Try running python manage.py test
and we'll get an error., because the user details we've used to log in don't exist. Let's resolve that.
Now, you could put your own credentials in there, but that's not a good idea because it's a security risk. Instead, we'll create a fixture for the test user that will be loaded when the tests are run. Run the following command:
$ python manage.py createsuperuser
Give the username as bobsmith
, the email address as bob@example.com
, and the password as password
. Once that's done, run these commands to dump the existing users to a fixture:
1$ mkdir blogengine/fixtures2$ python manage.py dumpdata auth.User --indent=2 > blogengine/fixtures/users.json
This will dump all of the existing users to blogengine/fixtures/users.json
. You may wish to edit this file to remove your own superuser account and leave only the newly created one in there.
Next we need to amend our test to load this fixture:
1class AdminTest(LiveServerTestCase):2 fixtures = ['users.json']34 def test_login(self):5 # Create client6 c = Client()78 # Get login page9 response = c.get('/admin/')1011 # Check response code12 self.assertEquals(response.status_code, 200)1314 # Check 'Log in' in response15 self.assertTrue('Log in' in response.content)1617 # Log the user in18 c.login(username='bobsmith', password="password")1920 # Check response code21 response = c.get('/admin/')22 self.assertEquals(response.status_code, 200)2324 # Check 'Log out' in response25 self.assertTrue('Log out' in response.content)
Now, if you run python manage.py test
, you should find that the test passes. Next, we'll test that we can log out:
1class AdminTest(LiveServerTestCase):2 fixtures = ['users.json']34 def test_login(self):5 # Create client6 c = Client()78 # Get login page9 response = c.get('/admin/')1011 # Check response code12 self.assertEquals(response.status_code, 200)1314 # Check 'Log in' in response15 self.assertTrue('Log in' in response.content)1617 # Log the user in18 c.login(username='bobsmith', password="password")1920 # Check response code21 response = c.get('/admin/')22 self.assertEquals(response.status_code, 200)2324 # Check 'Log out' in response25 self.assertTrue('Log out' in response.content)2627 def test_logout(self):28 # Create client29 c = Client()3031 # Log in32 c.login(username='bobsmith', password="password")3334 # Check response code35 response = c.get('/admin/')36 self.assertEquals(response.status_code, 200)3738 # Check 'Log out' in response39 self.assertTrue('Log out' in response.content)4041 # Log out42 c.logout()4344 # Check response code45 response = c.get('/admin/')46 self.assertEquals(response.status_code, 200)4748 # Check 'Log in' in response49 self.assertTrue('Log in' in response.content)
This test works along very similar lines. We log in, verify that 'Log out' is in the response, then we log out, and verify that 'Log in' is in the response. Run the tests again, and they should pass. Assuming they do, let's commit our changes again:
1$ git add blogengine/2$ git commit -m 'Added tests for admin auth'
This code is a little repetitive. We create the client twice, when we could do so only once. Amend the AdminTest class as follows:
1class AdminTest(LiveServerTestCase):2 fixtures = ['users.json']34 def setUp(self):5 self.client = Client()67 def test_login(self):8 # Get login page9 response = self.client.get('/admin/')1011 # Check response code12 self.assertEquals(response.status_code, 200)1314 # Check 'Log in' in response15 self.assertTrue('Log in' in response.content)1617 # Log the user in18 self.client.login(username='bobsmith', password="password")1920 # Check response code21 response = self.client.get('/admin/')22 self.assertEquals(response.status_code, 200)2324 # Check 'Log out' in response25 self.assertTrue('Log out' in response.content)2627 def test_logout(self):28 # Log in29 self.client.login(username='bobsmith', password="password")3031 # Check response code32 response = self.client.get('/admin/')33 self.assertEquals(response.status_code, 200)3435 # Check 'Log out' in response36 self.assertTrue('Log out' in response.content)3738 # Log out39 self.client.logout()4041 # Check response code42 response = self.client.get('/admin/')43 self.assertEquals(response.status_code, 200)4445 # Check 'Log in' in response46 self.assertTrue('Log in' in response.content)47
The setUp()
method is automatically run when the test runs, and ensures we only need to start up the client once. Run your tests to make sure they pass, then commit your changes:
1$ git add blogengine/2$ git commit -m 'Refactored admin test'
Now, we'll implement a test for creating a new post. The admin interface implements URLs for creating new instances of a model in a consistent format of /admin/app_name/model_name/add/
, so the URL for adding a new post will be /admin/blogengine/post/add/
.
Add this method to the AdminTest class:
1 def test_create_post(self):2 # Log in3 self.client.login(username='bobsmith', password="password")45 # Check response code6 response = self.client.get('/admin/blogengine/post/add/')7 self.assertEquals(response.status_code, 200)
Try running it and this will fail, because we haven't registered the Post model in the Django admin. So we need to do that. To do so, open a new file at blogengine/admin.py
and add the following code:
1import models2from django.contrib import admin34admin.site.register(models.Post)
Now, run python manage.py test
and the test should pass. If you want to confirm that the post model appears in the admin, run python manage.py runserver
and click here.
So now we can reach the page for adding a post, but we haven't yet tested that we can submit one. Let's remedy that:
1 def test_create_post(self):2 # Log in3 self.client.login(username='bobsmith', password="password")45 # Check response code6 response = self.client.get('/admin/blogengine/post/add/')7 self.assertEquals(response.status_code, 200)89 # Create the new post10 response = self.client.post('/admin/blogengine/post/add/', {11 'title': 'My first post',12 'text': 'This is my first post',13 'pub_date_0': '2013-12-28',14 'pub_date_1': '22:00:04'15 },16 follow=True17 )18 self.assertEquals(response.status_code, 200)1920 # Check added successfully21 self.assertTrue('added successfully' in response.content)2223 # Check new post now in database24 all_posts = Post.objects.all()25 self.assertEquals(len(all_posts), 1)
Here we submit the new post via HTTP POST, with all the data passed through. This mirrors the form created by the Django admin interface - if you take a look at the HTML generated by the admin, you'll see that the inputs are given names that match these. Note that the pub_date
field, because it represents a datetime object, is split up into a separate date and time field. Also note the parameter follow=True
- this denotes that the test client should follow any HTTP redirect.
We confirm that the POST request responded with a 200 code, denoting success. We also confirm that the response included the phrase 'added successfully'. Finally we confirm that there is now a single Post object in the database. Don't worry about any existing content - Django creates a dedicated test database and destroys it after the tests are done, so you can be sure that no posts are present unless you explicitly load them from a fixture.
We can now test creating a post, but we also need to ensure we can test editing and deleting them. First we'll add a test for editing posts:
1 def test_edit_post(self):2 # Create the post3 post = Post()4 post.title = 'My first post'5 post.text = 'This is my first blog post'6 post.pub_date = timezone.now()7 post.save()89 # Log in10 self.client.login(username='bobsmith', password="password")1112 # Edit the post13 response = self.client.post('/admin/blogengine/post/1/', {14 'title': 'My second post',15 'text': 'This is my second blog post',16 'pub_date_0': '2013-12-28',17 'pub_date_1': '22:00:04'18 },19 follow=True20 )21 self.assertEquals(response.status_code, 200)2223 # Check changed successfully24 self.assertTrue('changed successfully' in response.content)2526 # Check post amended27 all_posts = Post.objects.all()28 self.assertEquals(len(all_posts), 1)29 only_post = all_posts[0]30 self.assertEquals(only_post.title, 'My second post')31 self.assertEquals(only_post.text, 'This is my second blog post')
Here we create a new blog post, then verify we can edit it by resubmitting it with different values, and checking that we get the expected response, and that the data in the database has been updated. Run python manage.py test
, and this should pass.
Finally, we'll set up a test for deleting posts:
1 def test_delete_post(self):2 # Create the post3 post = Post()4 post.title = 'My first post'5 post.text = 'This is my first blog post'6 post.pub_date = timezone.now()7 post.save()89 # Check new post saved10 all_posts = Post.objects.all()11 self.assertEquals(len(all_posts), 1)1213 # Log in14 self.client.login(username='bobsmith', password="password")1516 # Delete the post17 response = self.client.post('/admin/blogengine/post/1/delete/', {18 'post': 'yes'19 }, follow=True)20 self.assertEquals(response.status_code, 200)2122 # Check deleted successfully23 self.assertTrue('deleted successfully' in response.content)2425 # Check post amended26 all_posts = Post.objects.all()27 self.assertEquals(len(all_posts), 0)
Again, this is pretty similar to what we did before. We create a new post, verify that it is the sole post in the database, and log into the admin. Then we delete the post via the admin, and confirm that the admin interface confirmed it has been deleted, and the post is gone from the database.
I think it's now time to commit again:
1$ git add blogengine/2$ git commit -m 'Post admin tests in place'
So we now know that we can create, edit and delete posts, and we have tests in place to confirm this. So our next task is to be able to display our posts.
For now, to keep things simple, we're only going to implement the index view - in other words, all the posts in reverse chronological order. We'll use Django's generic views to keep things really easy.
Django's generic views are another really handy feature. As mentioned earlier, a view is a function or class that describes how a specific route should render an object. Now, there are many tasks that recur in web development. For instance, many web pages you may have seen may be a list of objects - in this case, the index page for a blog is a list of blog posts. For that reason, Django has the ListView generic view, which makes it easy to render a list of objects.
Now, like before, we want to have a test in place. Open up blogengine/tests.py
and add the following class at the end of the file:
1class PostViewTest(LiveServerTestCase):2 def setUp(self):3 self.client = Client()45 def test_index(self):6 # Create the post7 post = Post()8 post.title = 'My first post'9 post.text = 'This is my first blog post'10 post.pub_date = timezone.now()11 post.save()1213 # Check new post saved14 all_posts = Post.objects.all()15 self.assertEquals(len(all_posts), 1)1617 # Fetch the index18 response = self.client.get('/')19 self.assertEquals(response.status_code, 200)2021 # Check the post title is in the response22 self.assertTrue(post.title in response.content)2324 # Check the post text is in the response25 self.assertTrue(post.text in response.content)2627 # Check the post date is in the response28 self.assertTrue(str(post.pub_date.year) in response.content)29 self.assertTrue(post.pub_date.strftime('%b') in response.content)30 self.assertTrue(str(post.pub_date.day) in response.content)
Here we create the post, and assert that it is the sole post object. We then fetch the index page, and assert that the HTTP status code is 200 (ie. the page exists and is returned). We then verify that the response contains the post title, text and publication date.
Note that for the month, we need to do a bit of jiggery-pokery to get the month name. By default Django will return short month names (eg Jan, Feb etc), but Python stores months as numbers, so we need to format it as a short month name using %b
.
If you run this, you will get an error because the index route isn't implemented. So let's fix that. Open up the existing django_tutorial_blog_ng/urls.py
file and amend it to look like this:
1from django.conf.urls import patterns, include, url23from django.contrib import admin4admin.autodiscover()56urlpatterns = patterns('',7 # Examples:8 # url(r'^$', 'django_tutorial_blog_ng.views.home', name='home'),9 # url(r'^blog/', include('blog.urls')),1011 url(r'^admin/', include(admin.site.urls)),1213 # Blog URLs14 url(r'^.*$', include('blogengine.urls')),15)
Then, create a new file at blogengine/urls.py
and edit it as follows:
1from django.conf.urls import patterns, url2from django.views.generic import ListView3from blogengine.models import Post45urlpatterns = patterns('',6 # Index7 url('^$', ListView.as_view(8 model=Post,9 )),10)
A little explanation is called for. The project has its own urls.py
file that handles routing throughout the project. However, because Django encourages you to make your apps reusable, we want to keep the routes in the individual apps as far as possible. So, in the project file, we include the blogengine/urls.py
file.
In the app-specific urls.py
, we import the Post model and the ListView generic view. We then define a route for the index page - the regular expression ^$
will match only an empty string, so that page will be the index. For this route, we then call the as_view()
method of the ListView object, and set the model as Post.
Now, if you either run the tests, or run the development server and visit the index page, you'll see that it isn't working yet - you should see the error TemplateDoesNotExist: blogengine/post_list.html
. This tells us that we need to create a template called blogengine/post_list.html
, so let's do that. First of all, add the following at the end of django_tutorial_blog_ng/settings.py
:
12# Template directory3TEMPLATE_DIRS = [os.path.join(BASE_DIR, 'templates')]
Next, create the folders for the templates, and a blank post_list.html
file:
1$ mkdir templates2$ mkdir templates/blogengine3$ touch templates/blogengine/post_list.html
Now, run your tests again, and you'll see that the template now exists, but a new error is showing up:
1Creating test database for alias 'default'...2......F3======================================================================4FAIL: test_index (blogengine.tests.PostViewTest)5----------------------------------------------------------------------6Traceback (most recent call last):7 File "/Users/matthewdaly/Projects/django_tutorial_blog_ng/blogengine/tests.py", line 189, in test_index8 self.assertTrue(post.title in response.content)9AssertionError: False is not true1011----------------------------------------------------------------------12Ran 7 tests in 2.162s1314FAILED (failures=1)15Destroying test database for alias 'default'...
To fix this, we make sure the template shows the data we want. Open up templates/blogengine/post_list.html
and enter the following:
1<html>2 <head>3 <title>My Django Blog</title>4 </head>5 <body>6 {% for post in object_list %}7 <h1>{{ post.title }}</h1>8 <h3>{{ post.pub_date }}</h3>9 {{ post.text }}10 {% endfor %}11 </body>12</html>
This is only a very basic template, and we'll expand upon it in future.
With that done, you can run python manage.py test
, and it should pass. Well done! Don't forget to commit your changes:
1$ git add django_tutorial_blog_ng/ templates/ blogengine/2$ git commit -m 'Implemented list view for posts'
And that's all for this lesson! We've done a hell of a lot in this lesson - set up our project, created a comprehensive test suite for it, and implemented the basic functionality. Next time we'll make it a bit prettier using Twitter Bootstrap, as well as implementing more of the basic functionality for the blog.
You can find the source code on Github. For your convenience, I've tagged this lesson as lesson-1
, so you can just clone the repository and switch to the end of this lesson with the following commands:
1$ git clone https://github.com/matthewbdaly/django_tutorial_blog_ng.git2$ cd django_tutorial_blog_ng3$ git checkout lesson-1
That way, you can easily check that what you've done matches up with the repository. Future lessons will be similarly tagged to make them easy to navigate.