Opened 12 years ago
Closed 11 years ago
#38 closed enhancement (fixed)
Massive export speedup
Reported by: | Kris Deugau | Owned by: | |
---|---|---|---|
Priority: | major | Milestone: | 1.2 |
Version: | Keywords: | ||
Cc: |
Description
Instead of regenerating the entire on-disk data file straight from the database each time, export individual zones to separate files in a workspace, then concatenate them. Add a "modified" flag to the domain or revzone so we only have to walk through the details of zones that have been modified, and update those files - should give close to an order of magnitude or better speedup.
Observed on test copies of live data:
- 3081 local forward zones
- 2598 imported records from flatfiles in "main" zone
- 271 imported revzones from flatfiles
- 315 imported forward zones from autoaxfr flatfiles
Initial local forward zones only, ~43-65s
Add all current flatfiles, ~114-160s
Change History (4)
comment:1 by , 12 years ago
comment:2 by , 12 years ago
Milestone: | 1.4 → 1.2 |
---|---|
Summary: | Possible massive export speedup → Massive export speedup |
comment:3 by , 11 years ago
comment:4 by , 11 years ago
Resolution: | → fixed |
---|---|
Status: | new → closed |
Resolving; numerous tweaks, enhancements, and "OMG-what-was-I-smoking" block rewrites have brought export time down to ~10s even if we set the flag to always refresh the cache.
(In [368]) /trunk