[Babase] conversion run?

Lacey Maryott lacey.maryott at duke.edu
Thu Jun 7 14:54:45 EDT 2007


Jeanne, (et al)

      Karl and I just got off the phone.  The compare programs between 
the old copy of members and the new copy of members is showing some 
differences, but all of them are a change from group 1.0 to group 9.0 
one way or the other, they were in it and are now in 1.0 for the given 
day, or vice versa,  I think these are the types of differences to be 
expected, so for now I am going to push on with entering everything 
through the end of 1988.  This will be done by tomorrow afternoon and 
Karl will run another conversion, and another compare between 
babase_test (the old data) and babase_copy (the new data) to make sure 
that our input of these census files isn't creating huge differences.  I 
will look at all of the members differences either over the weekend or 
on monday, and investigate to see if they are correct differences, or if 
there are some things that need to be changed, or fixed.  Overall 
though, this went a lot better than I had hoped, and I both Karl and 
myself are optimistic that adding in the other 6 years should be 
similarly painless.  We'll keep you posted!

Looks like by next week Leah and I could be working on 2006 B update in 
babase 2.0!!! :-D
We will be doing this in both systems to ensure that our upload programs 
work, but we'll be using the programs!! YAY!

Take Care
Lacey

Jeanne Altmann wrote:
> Sounds good; then we will be ready to be totally in 2.0 won't we?
> Hooray,
> jeanne 
>
> -----Original Message-----
> From: babase-bounces at eeblistserv.princeton.edu
> [mailto:babase-bounces at eeblistserv.princeton.edu] On Behalf Of Lacey
> Maryott
> Sent: Thursday, June 07, 2007 1:48 PM
> To: The Baboon Database Project
> Subject: Re: [Babase] conversion run?
>
> YAY!!!! no errors!!! :-D  Thats really great.  In that case, shall I go
> ahead and add in the other years today and tomorrow (through 88)?
>
> Lacey
>
> Karl O. Pinc wrote:
>   
>> On 06/07/2007 11:42:21 AM, Lacey Maryott wrote:
>>     
>>> Hey Karl,
>>>   I was wondering if you know why the conversion has taken 15+ hours 
>>> to run, does something seem to be VERY wrong, or is it just the new 
>>> census data slowing it down :-\
>>>       
>> Long contiguous series of "old style" census rows, that do not begin 
>> when the individual first appears, take a long time to interpolate.  I
>>     
>
>   
>> did not bother optimizing for this case because I figured it wouldn't 
>> matter.  (And I'm not sure exactly what's possible.  Trouble is that a
>>     
>
>   
>> whole lot of uninterpolating and interpolating and destruction and 
>> creation of MEMBERS rows needs to go on.)  As you put more "real" 
>> census rows in and reduce the "block" where there's just "old" census 
>> rows I'd expect the interpolation to speed up some.
>>
>> Come time to do this in the new system you might find things will go 
>> faster if you, for instance, begin by putting the "new style" census 
>> rows in at the "endpoints", say the first and last month of the year, 
>> and then "fill-in" the middle months.
>>
>>
>>    It's making me scared there are
>>     
>>> going to be a ton of errors.. haha
>>>       
>> So far no errors and it should be done in a few minutes.
>>
>> There.  Done.  No errors.
>>
>> Karl <kop at meme.com>
>> Free Software:  "You don't pay back, you pay forward."
>>                  -- Robert A. Heinlein
>>
>> _______________________________________________
>> Babase mailing list
>> Babase at www.eco.princeton.edu
>> http://www.eco.princeton.edu/mailman/listinfo/babase
>>
>>     
>
> --
> Lacey Maryott
> Alberts Lab
> Department of Biology
> Duke University
> ph: 919-660-7306
> fax: 919-660-7293
> Lacey.Maryott at duke.edu 
>
> _______________________________________________
> Babase mailing list
> Babase at www.eco.princeton.edu
> http://www.eco.princeton.edu/mailman/listinfo/babase
>
> _______________________________________________
> Babase mailing list
> Babase at www.eco.princeton.edu
> http://www.eco.princeton.edu/mailman/listinfo/babase
>
>   

-- 
Lacey Maryott
Alberts Lab
Department of Biology
Duke University
ph: 919-660-7306
fax: 919-660-7293
Lacey.Maryott at duke.edu 



More information about the Babase mailing list