[ADXA] FW: [Special] [ARRL-LoTW] Current Actual Upload Speed QSOs/Second

[Trent Fleming]

I'm always amused at the demand for "prompt" processing of LOTW records . .
. it's a hobby guys, it's not like we are approving debit card transactions!

On Thu, Mar 30, 2023 at 8:43 AM Lanny Aldrich <k1lec at hotmail.com> wrote:

> Have you wondered why your LoTW uploads didn’t upload on a timely basis.
> There was a good reason!
>
> 73, Lanny  K1LEC
>
>
>
> *From: *Naumann, Robert, W5OV via groups.arrl.org
> <rnaumann=arrl.org at groups.arrl.org>
> *Sent: *Thursday, March 30, 2023 7:37 AM
> *To: *ARRL-LoTW at groups.arrl.org
> *Subject: *[Special] [ARRL-LoTW] Current Actual Upload Speed QSOs/Second
>
>
>
> This morning, just a few minutes ago, a large file finished processing,
> and instead of lumping in all the other tasks that LoTW does, and
> ignorantly criticize things unknown, here is what's actually going on:
>
> A fairly rare Jordanian uploaded a multi-Mb  (~30 Mb) file containing
> 67804 QSO records,  Normally, we would not make the origin known, but I
> want everyone to know this is 100% real, and not a fantasy of someone who
> has absolutely no knowledge of what's going on these days with LoTW, but
> speculates long and hard both in this forum and elsewhere.
>
> Unlike most big uploads these days, there's only 1 duplicate in the file.
> The rest of the records actually had work performed on them.  Updates, QSOs
> confirmed, etc,
>
> Overall, this was a good but large upload that I think was actually sent
> by his QSL manager.l
>
> Summary:
> 2023-03-30 11:42:44 LOTW_QSO: Successfully processed 67804 QSO records in
> 1871.999483 seconds According to my calculator, 67804 / 1872 = about *36
> QSOs per second*.
>
> Should it do better?  Yes.
>
> And, when the new version is developed, oh, and not "from scratch" it will
> work as a modern app should.
>
> The completely false notion that we're going to throw out everything and
> start from scratch is sensational, and it's also completely false.  There's
> nothing wrong with LoTW's logic. The infrastructure it's running on is just
> not capable of growing as it needs to from many perspectives.
>
> So this is proof of how fast LoTW is actually processing uploads alone.
> The other specious calculations ignore the Downloads, the certificate
> requests, DXCC updates, the rejections of bad file uploads, many of which
> are emailed-in raw ADIF files, and all the other work that LoTW does as
> routine.  It's not just uploads.
>
> Please review the summary of this file processing below.
>
> *One housekeeping note:  As we have discussed here before, personal
> attacks on any ARRL Staff members is not appropriate for this or any other
> ARRL Forum.  *
>
> * Calling someone "incompetent" is a personal attack that will earn your
> posts being moderated.  Do it enough, you'll be banned from posting at
> all.  *
>
> 73,
> Bob W5OV
> ARRL
>
> JY4CI's upload summary::
> 2023-03-30 11:11:32 LOTW_QSO ADMIN: Processing file:
> /var/lotw/web-queue/20230329215802.27653 2023-03-30 11:11:32 LOTW_QSO:
> Processing file: 20230329215802.27653 2023-03-30 11:11:32 LOTW_QSO: User
> file: <TQSLUpl 20230329-2157> all log.tq8 2023-03-30 11:11:32 LOTW_QSO
> ADMIN: Ident: TQSL V2.3.1 Lib: V2.5 Config: V11.23 AllowDupes: false
> 2023-03-30 11:11:32 LOTW_QSO ADMIN: Verifying certificate #590634, Call:
> JY4CI, Issuer: /C=US/ST=CT/L=Newington/O=American Radio Relay
> League/OU=Logbook of the World/CN=Logbook of the World Production CA/DC=
> arrl.org/Email=lotw at arrl.org 2023-03-30 11:11:32 LOTW_QSO: Certificate
> found for JY4CI - JORDAN (342) 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a
> contact: 2022-06-17 20:04:29Z JY4CI PP1KV 20M SSB 2023-03-30 11:11:33
> LOTW_QSO: QSO QSLs a contact: 2022-04-27 18:05:10Z JY4CI SP7WP 10M SSB
> 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-04-27 18:03:42Z
> JY4CI OZ1ADL 10M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact:
> 2022-03-26 11:08:31Z JY4CI HB0DX 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO
> QSLs a contact: 2022-01-31 14:34:15Z JY4CI MW0RLJ 20M SSB 2023-03-30
> 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-01-31 14:31:40Z JY4CI LB0FI 20M
> SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-01-31 14:30:41Z
> JY4CI OH6LDJ 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact:
> 2022-01-31 14:26:48Z JY4CI SQ9FVE 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO
> QSLs a contact: 2021-04-29 15:37:30Z JY4CI JG3DOC 20M FT8 2023-03-30
> 11:11:34 LOTW_QSO: QSO QSLs a contact: 2021-04-29 15:35:15Z JY4CI JA1GLM
> 20M FT8 2023-03-30 11:11:34 LOTW_QSO: [Additional QSL notices suppressed]
> 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27
> 18:07:17Z JY4CI V51WW 20M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces
> existing record: 2015-02-27 13:36:14Z JY4CI DC1YB 10M SSB 2023-03-30
> 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:35:43Z JY4CI
> F1DSZ 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record:
> 2015-02-27 13:34:19Z JY4CI DL9KWA 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO
> replaces existing record: 2015-02-27 13:32:25Z JY4CI EA8IN 10M SSB
> 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27
> 13:32:11Z JY4CI HB9DXA 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces
> existing record: 2015-02-27 13:31:11Z JY4CI DO5ST 10M SSB 2023-03-30
> 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:30:13Z JY4CI
> F5MBM 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record:
> 2015-02-27 13:29:05Z JY4CI DK3UD 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO
> replaces existing record: 2015-02-27 09:16:13Z JY4CI OE6GLD 12M SSB
> 2023-03-30 11:11:36 LOTW_QSO: [Additional existing-record warnings
> suppressed] 2023-03-30 11:42:44 LOTW_QSO: Successfully processed 67804 QSO
> records in 1871.999483 seconds 2023-03-30 11:42:44 LOTW_QSO: 65950 records
> were replacements 2023-03-30 11:42:44 LOTW_QSO: 1 record was a duplicate
> 2023-03-30 11:42:44 LOTW_QSO: 27289 QSL records entered 2023-03-30 11:42:44
> LOTW_QSO: No errors encountered
>
>
> _._,_._,_
>
> Links:
>
> You only receive special notices.
>
> View/Reply Online (#37889)
> <https://groups.arrl.org/g/ARRL-LoTW/message/37889> | Reply To Group
> <ARRL-LoTW at groups.arrl.org?subject=Re:%20%5BSpecial%5D%20%5BARRL-LoTW%5D%20Current%20Actual%20Upload%20Speed%20QSOs%2FSecond>
> | Reply To Sender
> <rnaumann at arrl.org?subject=Private:%20Re:%20%5BSpecial%5D%20%5BARRL-LoTW%5D%20Current%20Actual%20Upload%20Speed%20QSOs%2FSecond>
> | Mute This Topic <https://groups.arrl.org/mt/97949339/1931972> | New
> Topic <https://groups.arrl.org/g/ARRL-LoTW/post>
> Your Subscription <https://groups.arrl.org/g/ARRL-LoTW/editsub/1931972> | Contact
> Group Owner <ARRL-LoTW+owner at groups.arrl.org> | Unsubscribe
> <https://groups.arrl.org/g/ARRL-LoTW/leave/4153692/1931972/664878324/xyzzy>
> [k1lec at arrl.net]
>
> _._,_._,_
>
>
> ______________________________________________________________
> ADXA mailing list
> Home: http://mailman.qth.net/mailman/listinfo/adxa
> Help: http://mailman.qth.net/mmfaq.htm
> Post: mailto:ADXA at mailman.qth.net
>
> This list hosted by: http://www.qsl.net
> Please help support this email list: http://www.qsl.net/donate.html
>


-- 
Trent Fleming


 My blog on banking topics:

www.bankinginsights.blogspot.com

My web site

        www.trentfleming.com

Follow me on FaceBook
        www.facebook.com/thetechnologyadvisor

Follow me on Twitter
        www.twitter.com/techadvisor
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.qth.net/pipermail/adxa/attachments/20230330/1f8c7031/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 041C4FA652904B66BDD5145B6C37AA82.png
Type: image/png
Size: 132 bytes
Desc: not available
URL: <http://mailman.qth.net/pipermail/adxa/attachments/20230330/1f8c7031/attachment.png>