When loading Pokédex data, commit every 1000 rows.

Mostly done to fix RAM usage issues, but seems to have increased speed slightly.
This commit is contained in:
Eevee 2009-09-13 20:10:20 -07:00
parent 5deb9b2d16
commit 149b34b888

View file

@ -175,6 +175,11 @@ def load(session, directory=None, drop_tables=False, verbose=False):
session.add(row) session.add(row)
# Remembering some zillion rows in the session consumes a lot of
# RAM. Let's not do that. Commit every 1000 rows
if len(session.new) > 1000:
session.commit()
session.commit() session.commit()
# Attempt to add any spare rows we've collected # Attempt to add any spare rows we've collected