[Babase] New plan, More conversion errors

Karl O. Pinc kop at meme.com
Tue Feb 7 16:58:41 EST 2006


Hi everybody,

Now that we have a design on paper Susan and Leah
and I decided to prioritize getting the
old data into the new system.  Until that happens
I am suspending work on the code that dynamically
builds the Babase generated tables and checks
errors in real time and otherwise dynamically responds to
database alterations.  Because the "dynamic"
code is partially inoperable at this moment,
I have disabled it entirely so that bugs do not
interfere with data loading.  What remains are
the most basic checks.

With that done the conversion has run to completion.
(It takes about 2 hours.)
There are more conversion errors on papio in
/biology/groups/babase/errors
The sql commands that load the data and that
the line numbers reference are in:
/biology/groups/babase/loadscript

If I had to guess, I'd say there's maybe
700 errors and the remainder are due to
those 700. Many/most are point sample foodcode
errors.

This is a complete run of the conversion
with almost all data checking turned off.
This means that once we resolve these errors
the data in the new system will be the same
as the data in the old system.

Before we can actually use the new system I
need to rebuild all the generated tables,
members, etc.  (This will no doubt take a few
more hours of runtime on the computer.)
I believe I will have all the
'offline' re-generation programs working and
run by tomorrow.  (We need these anyway to have
ready in the event that the change-by-change
code has a bug in it and ruins the generated
data, as is bound to happen.  At that point
you fix the bug and use your 'offline'
program to re-generate the data en-masse
and are then in a position to move forward.)

So, we are close to being able to use the
new system for queries.

After that, as I work on the more general
case error checking we'll re-run the
conversion and there will be more errors
that come up.

Karl <kop at meme.com>
Free Software:  "You don't pay back, you pay forward."
                  -- Robert A. Heinlein



More information about the Babase mailing list