[SFDXA] LOTW Problems - outside help

Mon Dec 10 20:31:02 EST 2012

The ARRL LoTW team are taking note... latest message on the LoTW page is 
encouraging:

*Dec 11, 2012: LoTW Status* -- LotW status in 
http://www.arrl.org/logbook-of-the-world 
<http://mymail.arrl.org/exchweb/bin/redir.asp?URL=http://www.arrl.org/logbook-of-the-world> will 
be updated daily to convey information of interest to the user community, 
including planned downtime and changes that will impact operations. In addition, 
the state of LotW's processing queue is now updated hourly in
http://www.arrl.org/logbook-queue-status 
<http://mymail.arrl.org/exchweb/bin/redir.asp?URL=http://www.arrl.org/logbook-queue-status>  
.

Updated hardware to improve LoTW's throughput is on order and expected in six to 
eight weeks. We appreciate the user community's patience while we while work to 
bring LoTW's performance to an acceptable level.   Harold WJ1B ARRL COO
--------
73
Kai, KE4PT

On 12/10/2012 4:02 PM, Norman Alexander wrote:
> I am not sure if you are monitoring the DXLab Reflector or the VE7CC ARUser 
> reflector but there is a concerted effort to help the league solve the LoTW 
> problems.  See the following excerpt-
>
> ====>Subject: [ARUser] wanted: C++ developers to help with LotW
>
> With encouragement from the ARRL, Rick K1MU and I are rebooting the Trusted
> QSL open source project, which is hosted at
>
> <http://sourceforge.net/projects/trustedqsl/>
>
> If you have demonstrably strong C++ development skills that you're
> interested in applying towards improving LotW's usability and efficiency,
> please contact me via direct email.
> 73,
> Dave, AA6YQ
> ======
>
> Dave, AA6YQ is the author of the DXLab Suite logging program and has been 
> involved with LoTW as a Beta tester before it was released.  Several defects 
> have been detected, the one that overwrote submissions when the queue got 
> large was fixed at the end of November.  But there are fundamental issues 
> remaining in the current design.  Apparently it was known, but not felt the 
> volume to trigger it would be reached, and this individual no longer works for 
> ARRL.  Dave is one  of the most aggressive and response guys I have seen 
> operate when it comes to supporting his DXLab logging program.  Answers, 
> actions and revisions sometimes happen in hours - I am not sure he ever sleeps 
> as I have gotten emails from him posted at 2am, plus he has time to chase DX 
> and go in DX peditions.
>
> If anyone can get inside the ARRL, I think Dave can - we probably should 
> encourage our Director to insist on the league engaging outside  help on the 
> growing LoTW problem.
> Regards,
>
> Norm
>
>
> --------------------------------------------------------------------------------
> *From:* Kai Siwiak <k.siwiak at ieee.org>
> *To:* sfdxa at mailman.qth.net
> *Sent:* Mon, December 10, 2012 1:30:59 PM
> *Subject:* Re: [SFDXA] LOTW Time Lag
>
> I uploaded a time stamped file on 11/30.  It took 6 days and 23 hours before 
> it was processed.  On 11/28 ARRL fixed A bug (noted in Pete's email), but not 
> THE bug. What they fixed was related to overwritten files.  The system is 
> still slow.  In the April-July time frame they were processing an average of 
> 390,000 QSOs per day. During late November that rate was about 170,000 QSOs 
> per day, not counting the mysterious unexplained 3 1/2 day period when they 
> processed exactly ZERO files.  In the last few days they are processing at a 
> rate of about 280,000 QSOs per day, but the queue seems to be growing. The 
> system is diverging! Not good for any data processing operation.
>
> Conclusion:
> - They fixed a problem specific to the overwriting of files, but not THE 
> problem of crappy performance.
> - They continue to ignore user suggestions and complaints.
> - The Directors are acting like buffers who respond directly to members, but 
> they and are not carrying user concerns to HQ. They need to be called on account.
> - The system is diverging and needs serious attention quickly.
>
> 73
> Kai, KE4PT
>
> On 12/10/2012 12:27 PM, Richard M. Gillingham wrote:
> >  I uploaded a log on Dec 1 around 5:30 m..  At that time ARRL was telling us 
> there was a 3 day delay.  It finally was loaded last night at about 7:00 
> pm...  More than 8 days!  They need some serious help there...  And the bug 
> has been fixed for a while.
> >
> > Just sayin'
> >
> > Gil, W1RG
> >
> > ----- Original Message ----- From: "Pete Rimmel" <n8pr at bellsouth.net 
> <mailto:n8pr at bellsouth.net>>
> > To: "SFDXA" <SFDXA at mailman.qth.net <mailto:SFDXA at mailman.qth.net>>
> > Cc: "Fcg at Kkn. Net" <fcg at kkn.net <mailto:fcg at kkn.net>>
> > Sent: Monday, December 10, 2012 12:05 PM
> > Subject: [SFDXA] LOTW Time Lag
> >
> >
> >> Don’t know if you saw this about the problems up at ARRL with LOTW:
> >>
> >> http://www.arrl.org/news/arrl-s-logbook-of-the-world-bug-fix-is-on-the-way
> >>
> >> Now to fix it !
> >>
> >> PeteR
> >> ______________________________________________________________
> >> South Florida DX Assoc.
> >> SFDXA WebSite: http://qsl.net/k4fk
> >> SFDXA Repeater 147.33+ 103.5 Tone
> >> To Post: mailto:SFDXA at mailman.qth.net <mailto:SFDXA at mailman.qth.net>
> >> Subscribe or UNSubScribe:
> >> http://mailman.qth.net/mailman/listinfo/sfdxa
> >> DX Net Wed 7:33 PM Repeater
> >>
> >> This list hosted by: http://www.qsl.net
> >> Please help support this email list: http://www.qsl.net/donate.html
> >
> > ______________________________________________________________
> > South Florida DX Assoc.
> > SFDXA WebSite: http://qsl.net/k4fk
> > SFDXA Repeater 147.33+ 103.5 Tone
> > To Post: mailto:SFDXA at mailman.qth.net <mailto:SFDXA at mailman.qth.net>
> > Subscribe or UNSubScribe:
> > http://mailman.qth.net/mailman/listinfo/sfdxa
> > DX Net Wed 7:33 PM Repeater
> >
> > This list hosted by: http://www.qsl.net
> > Please help support this email list: http://www.qsl.net/donate.html
> ______________________________________________________________
> South Florida DX Assoc.
> SFDXA WebSite: http://qsl.net/k4fk
> SFDXA Repeater 147.33+ 103.5 Tone
> To Post: mailto:SFDXA at mailman.qth.net <mailto:SFDXA at mailman.qth.net>
> Subscribe or UNSubScribe:
> http://mailman.qth.net/mailman/listinfo/sfdxa
> DX Net Wed 7:33 PM Repeater
>
> This list hosted by: http://www.qsl.net
> Please help support this email list: http://www.qsl.net/donate.html