[Babase] New plan, More conversion errors
Jeanne Altmann
altj at princeton.edu
Tue Feb 7 17:03:05 EST 2006
thanks Karl,
jeanne
At 04:58 PM 07/02/2006, you wrote:
>Hi everybody,
>
>Now that we have a design on paper Susan and Leah
>and I decided to prioritize getting the
>old data into the new system. Until that happens
>I am suspending work on the code that dynamically
>builds the Babase generated tables and checks
>errors in real time and otherwise dynamically responds to
>database alterations. Because the "dynamic"
>code is partially inoperable at this moment,
>I have disabled it entirely so that bugs do not
>interfere with data loading. What remains are
>the most basic checks.
>
>With that done the conversion has run to completion.
>(It takes about 2 hours.)
>There are more conversion errors on papio in
>/biology/groups/babase/errors
>The sql commands that load the data and that
>the line numbers reference are in:
>/biology/groups/babase/loadscript
>
>If I had to guess, I'd say there's maybe
>700 errors and the remainder are due to
>those 700. Many/most are point sample foodcode
>errors.
>
>This is a complete run of the conversion
>with almost all data checking turned off.
>This means that once we resolve these errors
>the data in the new system will be the same
>as the data in the old system.
>
>Before we can actually use the new system I
>need to rebuild all the generated tables,
>members, etc. (This will no doubt take a few
>more hours of runtime on the computer.)
>I believe I will have all the
>'offline' re-generation programs working and
>run by tomorrow. (We need these anyway to have
>ready in the event that the change-by-change
>code has a bug in it and ruins the generated
>data, as is bound to happen. At that point
>you fix the bug and use your 'offline'
>program to re-generate the data en-masse
>and are then in a position to move forward.)
>
>So, we are close to being able to use the
>new system for queries.
>
>After that, as I work on the more general
>case error checking we'll re-run the
>conversion and there will be more errors
>that come up.
>
>Karl <kop at meme.com>
>Free Software: "You don't pay back, you pay forward."
> -- Robert A. Heinlein
>
>_______________________________________________
>Babase mailing list
>Babase at www.eco.princeton.edu
>http://www.eco.princeton.edu/mailman/listinfo/babase
More information about the Babase
mailing list