veniasilente/veekun_pokedex
1
0
Fork 0
mirror of https://github.com/veekun/pokedex.git synced 2024-08-20 18:16:34 +00:00
Code Issues Projects Releases Wiki Activity

When loading Pokédex data, commit every 1000 rows.

Browse source 
Mostly done to fix RAM usage issues, but seems to have increased speed slightly.
This commit is contained in:
Eevee 2009-09-13 20:10:20 -07:00
parent 5deb9b2d16
commit 149b34b888
1 changed files with 5 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
pokedex/db/load.py
View file

@ -175,6 +175,11 @@ def load(session, directory=None, drop_tables=False, verbose=False):
session.add(row) session.add(row)
# Remembering some zillion rows in the session consumes a lot of
# RAM. Let's not do that. Commit every 1000 rows
if len(session.new) > 1000:
session.commit()
session.commit() session.commit()
# Attempt to add any spare rows we've collected # Attempt to add any spare rows we've collected