2012-05-20T07:30:21Z

The Flask Mega-Tutorial, Part IV: Database

(Great news! There is a new version of this tutorial!)

This is the fourth article in the series in which I document my experience writing web applications in Python using the Flask microframework.

The goal of the tutorial series is to develop a decently featured microblogging application that demonstrating total lack of originality I have decided to call microblog.

NOTE: This article was revised in September 2014 to be in sync with current versions of Python and Flask.

Here is an index of all the articles in the series that have been published to date:

Recap

In the previous chapter of the series we created our login form, complete with submission and validation.

In this article we are going to create our database and set it up so that we can record our users in it.

To follow this chapter along you need to have the microblog app as we left it at the end of the previous chapter. Please make sure the app is installed and running.

Running Python scripts from the command line

In this chapter we are going to write a few scripts that simplify the management of our database. Before we get into that let's review how a Python script is executed on the command line.

If you are on Linux or OS X, then scripts have to be given executable permission, like this:

$ chmod a+x script.py

The script has a shebang line, which points to the interpreter that should be used. A script that has been given executable permission and has a shebang line can be executed simply like this:

./script.py <arguments>

On Windows, however, this does not work, and instead you have to provide the script as an argument to the chosen Python interpreter:

$ flask\Scripts\python script.py <arguments>

To avoid having to type the path to the Python interpreter you can add your microblog/flask/Scripts directory to the system path, making sure it appears before your regular Python interpreter. This can be temporarily achieved by activating the virtual environment with the following command:

$ flask\Scripts\activate

From now on, in this tutorial the Linux/OS X syntax will be used for brevity. If you are on Windows remember to convert the syntax appropriately.

Databases in Flask

We will use the Flask-SQLAlchemy extension to manage our application. This extension provides a wrapper for the SQLAlchemy project, which is an Object Relational Mapper or ORM.

ORMs allow database applications to work with objects instead of tables and SQL. The operations performed on the objects are translated into database commands transparently by the ORM. Knowing SQL can be very helpful when working with ORMs, but we will not be learning SQL in this tutorial, we will let Flask-SQLAlchemy speak SQL for us.

Migrations

Most database tutorials I've seen cover creation and use of a database, but do not adequately address the problem of updating a database as the application grows. Typically you end up having to delete the old database and create a new one each time you need to make updates, losing all the data. And if the data cannot be recreated easily you may be forced to write export and import scripts yourself.

Luckily, we have a much better option.

We are going to use SQLAlchemy-migrate to keep track of database updates for us. It adds a bit of work to get a database started, but that is a small price to pay for never having to worry about manual database migrations.

Enough theory, let's get started!

Configuration

For our little application we will use a sqlite database. The sqlite databases are the most convenient choice for small applications, as each database is stored in a single file and there is no need to start a database server.

We have a couple of new configuration items to add to our config file (file config.py):

import os
basedir = os.path.abspath(os.path.dirname(__file__))

SQLALCHEMY_DATABASE_URI = 'sqlite:///' + os.path.join(basedir, 'app.db')
SQLALCHEMY_MIGRATE_REPO = os.path.join(basedir, 'db_repository')

The SQLALCHEMY_DATABASE_URI is required by the Flask-SQLAlchemy extension. This is the path of our database file.

The SQLALCHEMY_MIGRATE_REPO is the folder where we will store the SQLAlchemy-migrate data files.

Finally, when we initialize our app we also need to initialize our database. Here is our updated package init file (file app/__init__.py):

from flask import Flask
from flask_sqlalchemy import SQLAlchemy

app = Flask(__name__)
app.config.from_object('config')
db = SQLAlchemy(app)

from app import views, models

Note the two changes we have made to our init script. We are now creating a db object that will be our database, and we are also importing a new module called models. We will write this module next.

The database model

The data that we will store in our database will be represented by a collection of classes that are referred to as the database models. The ORM layer will do the translations required to map objects created from these classes into rows in the proper database table.

Let's start by creating a model that will represent our users. Using the WWW SQL Designer tool, I have made the following diagram to represent our users table:

users table

The id field is usually in all models, and is used as the primary key. Each user in the database will be assigned a unique id value, stored in this field. Luckily this is done automatically for us, we just need to provide the id field.

The nickname and email fields are defined as strings (or VARCHAR in database jargon), and their maximum lengths are specified so that the database can optimize space usage.

Now that we have decided what we want our users table to look like, the job of translating that into code is pretty easy (file app/models.py):

from app import db

class User(db.Model):
    id = db.Column(db.Integer, primary_key=True)
    nickname = db.Column(db.String(64), index=True, unique=True)
    email = db.Column(db.String(120), index=True, unique=True)

    def __repr__(self):
        return '<User %r>' % (self.nickname)

The User class that we just created contains several fields, defined as class variables. Fields are created as instances of the db.Column class, which takes the field type as an argument, plus other optional arguments that allow us, for example, to indicate which fields are unique and indexed.

The __repr__ method tells Python how to print objects of this class. We will use this for debugging.

Creating the database

With the configuration and model in place we are now ready to create our database file. The SQLAlchemy-migrate package comes with command line tools and APIs to create databases in a way that allows easy updates in the future, so that is what we will use. I find the command line tools a bit awkward to use, so instead I have written my own set of little Python scripts that invoke the migration APIs.

Here is a script that creates the database (file db_create.py):

#!flask/bin/python
from migrate.versioning import api
from config import SQLALCHEMY_DATABASE_URI
from config import SQLALCHEMY_MIGRATE_REPO
from app import db
import os.path
db.create_all()
if not os.path.exists(SQLALCHEMY_MIGRATE_REPO):
    api.create(SQLALCHEMY_MIGRATE_REPO, 'database repository')
    api.version_control(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
else:
    api.version_control(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO, api.version(SQLALCHEMY_MIGRATE_REPO))

Note how this script is completely generic. All the application specific pathnames are imported from the config file. When you start your own project you can just copy the script to the new app's directory and it will work right away.

To create the database you just need to execute this script (remember that if you are on Windows the command is slightly different):

./db_create.py

After you run the command you will have a new app.db file. This is an empty sqlite database, created from the start to support migrations. You will also have a db_repository directory with some files inside. This is the place where SQLAlchemy-migrate stores its data files. Note that we do not regenerate the repository if it already exists. This will allow us to recreate the database while leaving the existing repository if we need to.

Our first migration

Now that we have defined our model, we can incorporate it into our database. We will consider any changes to the structure of the app database a migration, so this is our first, which will take us from an empty database to a database that can store users.

To generate a migration I use another little Python helper script (file db_migrate.py):

#!flask/bin/python
import imp
from migrate.versioning import api
from app import db
from config import SQLALCHEMY_DATABASE_URI
from config import SQLALCHEMY_MIGRATE_REPO
v = api.db_version(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
migration = SQLALCHEMY_MIGRATE_REPO + ('/versions/%03d_migration.py' % (v+1))
tmp_module = imp.new_module('old_model')
old_model = api.create_model(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
exec(old_model, tmp_module.__dict__)
script = api.make_update_script_for_model(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO, tmp_module.meta, db.metadata)
open(migration, "wt").write(script)
api.upgrade(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
v = api.db_version(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
print('New migration saved as ' + migration)
print('Current database version: ' + str(v))

The script looks complicated, but it doesn't really do much. The way SQLAlchemy-migrate creates a migration is by comparing the structure of the database (obtained in our case from file app.db) against the structure of our models (obtained from file app/models.py). The differences between the two are recorded as a migration script inside the migration repository. The migration script knows how to apply a migration or undo it, so it is always possible to upgrade or downgrade a database format.

While I have never had problems generating migrations automatically with the above script, I could see that sometimes it would be hard to determine what changes were made just by comparing the old and the new format. To make it easy for SQLAlchemy-migrate to determine the changes I never rename existing fields, I limit my changes to adding or removing models or fields, or changing types of existing fields. And I always review the generated migration script to make sure it is right.

It goes without saying that you should never attempt to migrate your database without having a backup, in case something goes wrong. Also never run a migration for the first time on a production database, always make sure the migration works correctly on a development database.

So let's go ahead and record our migration:

$ ./db_migrate.py

And the output from the script will be:

New migration saved as db_repository/versions/001_migration.py
Current database version: 1

The script shows where the migration script was stored, and also prints the current database version. The empty database version was version 0, after we migrated to include users we are at version 1.

Database upgrades and downgrades

By now you may be wondering why is it that important to go through the extra hassle of recording database migrations.

Imagine that you have your application in your development machine, and also have a copy deployed to a production server that is online and in use.

Let's say that for the next release of your app you have to introduce a change to your models, for example a new table needs to be added. Without migrations you would need to figure out how to change the format of your database, both in your development machine and then again in your server, and this could be a lot of work.

If you have database migration support, then when you are ready to release the new version of the app to your production server you just need to record a new migration, copy the migration scripts to your production server and run a simple script that applies the changes for you. The database upgrade can be done with this little Python script (file db_upgrade.py):

#!flask/bin/python
from migrate.versioning import api
from config import SQLALCHEMY_DATABASE_URI
from config import SQLALCHEMY_MIGRATE_REPO
api.upgrade(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
v = api.db_version(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
print('Current database version: ' + str(v))

When you run the above script, the database will be upgraded to the latest revision, by applying the migration scripts stored in the database repository.

It is not a common need to have to downgrade a database to an old format, but just in case, SQLAlchemy-migrate supports this as well (file db_downgrade.py):

#!flask/bin/python
from migrate.versioning import api
from config import SQLALCHEMY_DATABASE_URI
from config import SQLALCHEMY_MIGRATE_REPO
v = api.db_version(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
api.downgrade(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO, v - 1)
v = api.db_version(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO)
print('Current database version: ' + str(v))

This script will downgrade the database one revision. You can run it multiple times to downgrade several revisions.

Database relationships

Relational databases are good at storing relations between data items. Consider the case of a user writing a blog post. The user will have a record in the users table, and the post will have a record in the posts table. The most efficient way to record who wrote a given post is to link the two related records.

Once a link between a user and a post is established there are two types of queries that we may need to use. The most trivial one is when you have a blog post and need to know what user wrote it. A more complex query is the reverse of this one. If you have a user, you may want to know all the posts that the user wrote. Flask-SQLAlchemy will help us with both types of queries.

Let's expand our database to store posts, so that we can see relationships in action. For this we go back to our database design tool and create a posts table:

users table

Our posts table will have the required id, the body of the post and a timestamp. Not much new there. But the user_id field deserves an explanation.

We said we wanted to link users to the posts that they write. The way to do that is by adding a field to the post that contains the id of the user that wrote it. This id is called a foreign key. Our database design tool shows foreign keys as a link between the foreign key and the id field of the table it refers to. This kind of link is called a one-to-many relationship, one user writes many posts.

Let's modify our models to reflect these changes (app/models.py):

from app import db

class User(db.Model):
    id = db.Column(db.Integer, primary_key=True)
    nickname = db.Column(db.String(64), index=True, unique=True)
    email = db.Column(db.String(120), index=True, unique=True)
    posts = db.relationship('Post', backref='author', lazy='dynamic')

    def __repr__(self):
        return '<User %r>' % (self.nickname)

class Post(db.Model):
    id = db.Column(db.Integer, primary_key = True)
    body = db.Column(db.String(140))
    timestamp = db.Column(db.DateTime)
    user_id = db.Column(db.Integer, db.ForeignKey('user.id'))

    def __repr__(self):
        return '<Post %r>' % (self.body)

We have added the Post class, which will represent blog posts written by users. The user_id field in the Post class was initialized as a foreign key, so that Flask-SQLAlchemy knows that this field will link to a user.

Note that we have also added a new field to the User class called posts, that is constructed as a db.relationship field. This is not an actual database field, so it isn't in our database diagram. For a one-to-many relationship a db.relationship field is normally defined on the "one" side. With this relationship we get a user.posts member that gets us the list of posts from the user. The first argument to db.relationship indicates the "many" class of this relationship. The backref argument defines a field that will be added to the objects of the "many" class that points back at the "one" object. In our case this means that we can use post.author to get the User instance that created a post. Don't worry if these details don't make much sense just yet, we'll see examples of this at the end of this article.

Let's record another migration with this change. Simply run:

$ ./db_migrate.py

And the script will respond:

New migration saved as db_repository/versions/002_migration.py
Current database version: 2

It isn't really necessary to record each little change to the database model as a separate migration, a migration is normally only recorded at significant points in the history of the project. We are doing more migrations than necessary here only to show how the migration system works.

Play time

We have spent a lot of time defining our database, but we haven't seen how it works yet. Since our app does not have database code yet let's make use of our brand new database in the Python interpreter.

So go ahead and fire up Python. On Linux or OS X:

flask/bin/python

Or on Windows:

flask\Scripts\python

Once in the Python prompt enter the following:

>>> from app import db, models
>>>

This brings our database and models into memory.

Let's create a new user:

>>> u = models.User(nickname='john', email='john@email.com')
>>> db.session.add(u)
>>> db.session.commit()
>>>

Changes to a database are done in the context of a session. Multiple changes can be accumulated in a session and once all the changes have been registered you can issue a single db.session.commit(), which writes the changes atomically. If at any time while working on a session there is an error, a call to db.session.rollback() will revert the database to its state before the session was started. If neither commit nor rollback are issued then the system by default will roll back the session. Sessions guarantee that the database will never be left in an inconsistent state.

Let's add another user:

>>> u = models.User(nickname='susan', email='susan@email.com')
>>> db.session.add(u)
>>> db.session.commit()
>>>

Now we can query what our users are:

>>> users = models.User.query.all()
>>> users
[<User u'john'>, <User u'susan'>]
>>> for u in users:
...     print(u.id,u.nickname)
...
1 john
2 susan
>>>

For this we have used the query member, which is available in all model classes. Note how the id member was automatically set for us.

Here is another way to do queries. If we know the id of a user we can find the data for that user as follows:

>>> u = models.User.query.get(1)
>>> u
<User u'john'>
>>>

Now let's add a blog post:

>>> import datetime
>>> u = models.User.query.get(1)
>>> p = models.Post(body='my first post!', timestamp=datetime.datetime.utcnow(), author=u)
>>> db.session.add(p)
>>> db.session.commit()

Here we set our timestamp in UTC time zone. All timestamps stored in our database will be in UTC. We can have users from all over the world writing posts and we need to use uniform time units. In a future tutorial we will see how to show these times to users in their local timezone.

You may have noticed that we have not set the user_id field of the Post class. Instead, we are storing a User object inside the author field. The author field is a virtual field that was added by Flask-SQLAlchemy to help with relationships, we have defined the name of this field in the backref argument to db.relationship in our model. With this information the ORM layer will know how to complete the user_id for us.

To complete this session, let's look at a few more database queries that we can do:

# get all posts from a user
>>> u = models.User.query.get(1)
>>> u
<User u'john'>
>>> posts = u.posts.all()
>>> posts
[<Post u'my first post!'>]

# obtain author of each post
>>> for p in posts:
...     print(p.id,p.author.nickname,p.body)
...
1 john my first post!

# a user that has no posts
>>> u = models.User.query.get(2)
>>> u
<User u'susan'>
>>> u.posts.all()
[]

# get all users in reverse alphabetical order
>>> models.User.query.order_by('nickname desc').all()
[<User u'susan'>, <User u'john'>]
>>>

The Flask-SQLAlchemy documentation is the best place to learn about the many options that are available to query the database.

Before we close, let's erase the test users and posts we have created, so that we can start from a clean database in the next chapter:

>>> users = models.User.query.all()
>>> for u in users:
...     db.session.delete(u)
...
>>> posts = models.Post.query.all()
>>> for p in posts:
...     db.session.delete(p)
...
>>> db.session.commit()
>>>

Final words

This was a long tutorial. We have learned the basics of working with a database, but we haven't incorporated the database into our application yet. In the next chapter we will put all we have learned about databases into practice when we look at our user login system.

In the meantime, if you haven't been writing the application along, you may want to download it in its current state:

Download microblog-0.4.zip.

Note that I have not included a database in the zip file above, but the repository with the migrations is there. To create a new database just use the db_create.py script, then use db_upgrade.py to upgrade the database to the latest revision.

I hope to see you next time!

Miguel

406 comments

  • #201 Miguel Grinberg said 2014-02-01T19:17:19Z

    @Matt: yes, that's correct. The "from x import y" syntax imports symbol y declared in module or package x. If you are starting with Python I recommend that you review the difference between packages and modules in the documentation, that will help you understand what is the role of the init.py file.

  • #202 Victor said 2014-02-09T04:22:05Z

    The tutorials have been great! There are lots of "Hello Worlds" out there, but this takes me a beyond that. It's just what I needed.

    If you could add some instructions on how to install Flask-SQLAlchemy that would be helpful. The instructions don't seem to be published anywhere (not even at: http://packages.python.org/Flask-SQLAlchemy/index.html).

    Thanks again,

    ~Victor

  • #203 Miguel Grinberg said 2014-02-09T04:29:29Z

    @Victor: that is in the first part of the tutorials. You need to run "pip install flask-sqlalchemy".

  • #204 Fausto said 2014-02-10T23:53:28Z

    Hello Miguel, first of all, thank you so much for this tutorial! I have a doubt and i've been wondering and googling about it. When i call db.create_all() from my db_create.py how does SqlAlchemy.create_all() function know where my model is? How does it know that the class to be represented in the database is the User from models.py? Cheers!

  • #205 Miguel Grinberg said 2014-02-11T00:49:53Z

    @Fausto: Very good question. I don't remember how this works with exact detail, but basically the act of defining your model class as a subclass of db.Model for Flask-SQLAlchemy or declarative_base() for pure SQLAlchemy triggers code that registers the model.

  • #206 philip said 2014-02-13T09:49:57Z

    @Nappleon A temporary fix could be editing file /flask/local/bin/lib/python2.7/site-packages/migrate/versioning/schema.py

    line 10 from sqlalchemy import exceptions as sa_exceptions

    change exceptions to: exc

    As suggested here http://docs.sqlalchemy.org/en/rel_0_8/changelog/migration_07.html?highlight=exception#the-sqlalchemy-exceptions-alias-in-sys-modules-is-removed

  • #207 Julio Guzman said 2014-02-13T22:43:33Z

    First of all, thank you Miguel for this tremendous tutorial.

    I'm trying to do this step using a Mysql database, I changed the config file:

    SQLALCHEMY_DATABASE_URI = 'mysql://root:root@localhost/app' SQLALCHEMY_MIGRATE_REPO = os.path.join(basedir, 'db_repository')

    But when I try to run the script db_create.py, it fails. Any advise or help?

    Thank you again

  • #208 Miguel Grinberg said 2014-02-14T15:24:12Z

    @Julio: Did you create the "app" database in your MySQL server? If that is not the problem, then I need to see the error to know more.

  • #209 Julio Guzman said 2014-02-15T00:18:16Z

    Miguel,

    Thank you for your previous help, I really appreciate it.

    Regarding using the mysql database, I did it as you said later in this tutorial, and I affectively used the db_create.py file. Also, I tried to use the db_migrate.py in the same way, but it doesn't work. The problem is that the script "works" (doesnf fail), but it doesn't update de database structure. So, when I used the app, it fails when trying to incorporate data into the database. Even more, when I run this in mysql:

    u = models.User(nickname='john', email='john@email.com', role=models.ROLE_USER)

    db.session.add(u) db.session.commit()

    it fails when I use db.session.commit() returning the following error. (For the record, a app.db file appears in my folder when running that command.) For this reason, I believe that the problem is that I'm not telling flask to use mysql in some part. Any help?

    Best,

    Julio

    Traceback (most recent call last): File "", line 1, in File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/scoping.py", line 114, in do return getattr(self.registry(), name)(args, *kwargs) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 703, in commit self.transaction.commit() File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 361, in commit self._prepare_impl() File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 340, in _prepare_impl self.session.flush() File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 1718, in flush self._flush(objects) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 1789, in _flush flush_context.execute() File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 331, in execute rec.execute(self) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 475, in execute uow File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 64, in save_obj table, insert) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 558, in _emit_insert_statements execute(statement, params) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1449, in execute params) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1584, in _execute_clauseelement compiled_sql, distilled_params File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1698, in _execute_context context) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1691, in _execute_context context) File "/Users/JulioG/Desktop/Python1/projects/microblog/flask/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 331, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (OperationalError) no such table: user u'INSERT INTO user (nickname, email, role) VALUES (?, ?, ?)' ('john', 'john@email.com', 0)

  • #210 Miguel Grinberg said 2014-02-15T06:09:55Z

    @Julio: Are you using my files or do you have your own version of the application? I'm wondering if there is any chance the models are not getting imported when you run db.create_all(), that would make it succeed but not create any tables, since no models were imported. Then when you try to use a model you get the missing table error.

  • #211 Julio Guzman said 2014-02-16T13:44:39Z

    Miguel,

    Thank you very much, I solved the problem of using mysql commit() by adding the path before calling mysql in the terminal. I'm using your files. The upgrade script works adding new rows to the tables in the database, but the only problem is that it doesn't add the relations between tables (Foreign key).

    I'm working on it and I will let you know the solution as soon as possible.

    Thank you for the help.

  • #212 Zacarias said 2014-02-22T21:34:22Z

    Hi, Miguel, very nice tutorial, thank you very much!

    Just one little bug: api.downgrade(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO, v - 1)

    In this line, we crash the db_downgrade.py when the version is 0.

    Simple solution: if (v > 0): api.downgrade(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO, v - 1) else: api.downgrade(SQLALCHEMY_DATABASE_URI, SQLALCHEMY_MIGRATE_REPO, 0)

    Thanks again!

  • #213 Dan said 2014-02-24T20:43:57Z

    Firstly, thanks. This is by far the best resource I've found for showing how the whole stack fits together in flask. Filling a lot of gaps for me. I am finding I need a db.create_all() line somewhere in my code, maybe at the end of models.py or else I get table doesn't exist type errors when I try the db.session.commit() line after adding a user. Did I miss that in your code or are you doing this another way? Also, does the existence of the sqlalchemy-migrate module mean that database schema updates only happen when you run your migrate script?

  • #214 Miguel Grinberg said 2014-02-25T07:40:42Z

    @Dan: the update happens when you run db_create.py, which replaces the db.create_all() call. And yes to your second question, all changes in the database need to be sent through the migration subsystem.

  • #215 Thomas said 2014-03-05T21:27:23Z

    Awesome tutorial... the only issues I had were my own typos. I bought the early release of your book, as well. Looks awesome!

  • #216 Dennis said 2014-03-13T03:44:28Z

    Awesome tutorial (except for my own typos). I do have the same problem as @Julio that the foreign keys are not respected. I add a user u, add a post p and then delete the user u. It should give me a foreign key error but all the commands succeed and get a post record with a 'NULL' user.

    I tried adding extra code to init.py but this did not resolve the issue.

    from flask import Flask from flask.ext.sqlalchemy import SQLAlchemy from sqlalchemy.engine import Engine from sqlalchemy import event

    app = Flask(name) app.config.from_object('config')

    db = SQLAlchemy(app)

    Force sqllite contraint foreign keys

    @event.listens_for(Engine, "connect") def set_sqlite_pragma(dbapi_connection, connection_record): """ Will force sqllite contraint foreign keys """ cursor = dbapi_connection.cursor() cursor.execute("PRAGMA foreign_keys=ON") cursor.close()

    from app import views, models

  • #217 John said 2014-03-13T11:50:12Z

    Great tutorial! Ive also bought your http://flaskbook.com/ book! I'm a little stuck with the db_create.py script. Where should this be saved and where in the project file structure should I be running the script from?

  • #218 Miguel Grinberg said 2014-03-13T16:08:42Z

    @Dennis: I didn't configure this properly. The default behavior when you delete a row that is referenced is to set that reference to 0. The relationship needs to be configured with "on cascade delete" to force the rows that contain foreign keys to be deleted.

  • #219 Miguel Grinberg said 2014-03-13T16:10:30Z

    @John: The projects that I show in these tutorials and the book are somewhat different, you may want to choose one and stick to it, not do both at the same time. To see how the project is structured and where files go you can look at the project on github: http://github.com/miguelgrinberg/microblog.

  • #220 jmp said 2014-03-19T00:10:38Z

    Trying to follow your example

    graphite linux # pip install Flask-SQLAlchemy Requirement already satisfied (use --upgrade to upgrade): Flask-SQLAlchemy in /usr/lib64/python3.3/site-packages Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib64/python3.3/site-packages (from Flask-SQLAlchemy) Requirement already satisfied (use --upgrade to upgrade): Flask>=0.10 in /usr/lib64/python3.3/site-packages (from Flask-SQLAlchemy) Requirement already satisfied (use --upgrade to upgrade): SQLAlchemy in /usr/lib64/python3.3/site-packages (from Flask-SQLAlchemy) Requirement already satisfied (use --upgrade to upgrade): Werkzeug>=0.7 in /usr/lib64/python3.3/site-packages (from Flask>=0.10->Flask-SQLAlchemy) Requirement already satisfied (use --upgrade to upgrade): Jinja2>=2.4 in /usr/lib64/python3.3/site-packages (from Flask>=0.10->Flask-SQLAlchemy) Requirement already satisfied (use --upgrade to upgrade): itsdangerous>=0.21 in /usr/lib64/python3.3/site-packages (from Flask>=0.10->Flask-SQLAlchemy) Requirement already satisfied (use --upgrade to upgrade): markupsafe in /usr/lib64/python3.3/site-packages (from Jinja2>=2.4->Flask>=0.10->Flask-SQLAlchemy) Cleaning up... graphite linux # python Python 3.3.4 (default, Mar 9 2014, 02:39:38) [GCC 4.7.3] on linux Type "help", "copyright", "credits" or "license" for more information.

    import migrate Traceback (most recent call last): File "", line 1, in ImportError: No module named 'migrate'

    Any ideas ?

  • #221 Miguel Grinberg said 2014-03-19T03:44:22Z

    @jmp: Try "pip install sqlalchemy-migrate".

  • #222 Subhra said 2014-03-19T14:55:15Z

    I am trying to run python db_create but getting an error ImportError: No module named migrate.versioning

  • #223 Miguel Grinberg said 2014-03-19T15:37:14Z

    @Subhra: have you installed sqlalchemy-migrate?

  • #224 Chenna said 2014-03-30T04:46:27Z

    This is incredibly helpful, Miguel!

  • #225 abhishek chatterjee said 2014-03-30T18:02:27Z

    Hi Miguel, Keep up the good work.

    It seems sqlalchamey module is not present in flask.ext. I even noticed this is eclipse. flask.ext shows only (setup, dict, file, init, name, path)

    (flask) PS C:\Users\Abhishek\NotSafeForWork-2.0> python run.py Traceback (most recent call last): File "run.py", line 2, in from app import app File "C:\Users\Abhishek\NotSafeForWork-2.0\app__init__.py", line 2, in from flask.ext.sqlalchemy import SQLAlchemy File "C:\python27\lib\site-packages\flask\exthook.py", line 87, in load_module raise ImportError('No module named %s' % fullname) ImportError: No module named flask.ext.sqlalchemy

    this issue is making me rip my hairs off. any help will be deeply appreciated.