[ADXA] FW: [Special] [ARRL-LoTW] Current Actual Upload Speed QSOs/Second

Thu Mar 30 09:43:02 EDT 2023

Have you wondered why your LoTW uploads didn’t upload on a timely basis.  There was a good reason!
73, Lanny  K1LEC

From: Naumann, Robert, W5OV via groups.arrl.org<mailto:rnaumann=arrl.org at groups.arrl.org>
Sent: Thursday, March 30, 2023 7:37 AM
To: ARRL-LoTW at groups.arrl.org<mailto:ARRL-LoTW at groups.arrl.org>
Subject: [Special] [ARRL-LoTW] Current Actual Upload Speed QSOs/Second

This morning, just a few minutes ago, a large file finished processing, and instead of lumping in all the other tasks that LoTW does, and ignorantly criticize things unknown, here is what's actually going on:

A fairly rare Jordanian uploaded a multi-Mb  (~30 Mb) file containing 67804 QSO records,  Normally, we would not make the origin known, but I want everyone to know this is 100% real, and not a fantasy of someone who has absolutely no knowledge of what's going on these days with LoTW, but speculates long and hard both in this forum and elsewhere.

Unlike most big uploads these days, there's only 1 duplicate in the file.  The rest of the records actually had work performed on them.  Updates, QSOs confirmed, etc,

Overall, this was a good but large upload that I think was actually sent by his QSL manager.l

Summary:
2023-03-30 11:42:44 LOTW_QSO: Successfully processed 67804 QSO records in 1871.999483 seconds According to my calculator, 67804 / 1872 = about 36 QSOs per second.

Should it do better?  Yes.

And, when the new version is developed, oh, and not "from scratch" it will work as a modern app should.

The completely false notion that we're going to throw out everything and start from scratch is sensational, and it's also completely false.  There's nothing wrong with LoTW's logic. The infrastructure it's running on is just not capable of growing as it needs to from many perspectives.

So this is proof of how fast LoTW is actually processing uploads alone.  The other specious calculations ignore the Downloads, the certificate requests, DXCC updates, the rejections of bad file uploads, many of which are emailed-in raw ADIF files, and all the other work that LoTW does as routine.  It's not just uploads.

Please review the summary of this file processing below.

One housekeeping note:  As we have discussed here before, personal attacks on any ARRL Staff members is not appropriate for this or any other ARRL Forum.
Calling someone "incompetent" is a personal attack that will earn your posts being moderated.
Do it enough, you'll be banned from posting at all.

73,
Bob W5OV
ARRL

JY4CI's upload summary::
2023-03-30 11:11:32 LOTW_QSO ADMIN: Processing file: /var/lotw/web-queue/20230329215802.27653 2023-03-30 11:11:32 LOTW_QSO: Processing file: 20230329215802.27653 2023-03-30 11:11:32 LOTW_QSO: User file: <TQSLUpl 20230329-2157> all log.tq8 2023-03-30 11:11:32 LOTW_QSO ADMIN: Ident: TQSL V2.3.1 Lib: V2.5 Config: V11.23 AllowDupes: false 2023-03-30 11:11:32 LOTW_QSO ADMIN: Verifying certificate #590634, Call: JY4CI, Issuer: /C=US/ST=CT/L=Newington/O=American Radio Relay League/OU=Logbook of the World/CN=Logbook of the World Production CA/DC=arrl.org/Email=lotw at arrl.org 2023-03-30 11:11:32 LOTW_QSO: Certificate found for JY4CI - JORDAN (342) 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-06-17 20:04:29Z JY4CI PP1KV 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-04-27 18:05:10Z JY4CI SP7WP 10M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-04-27 18:03:42Z JY4CI OZ1ADL 10M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-03-26 11:08:31Z JY4CI HB0DX 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-01-31 14:34:15Z JY4CI MW0RLJ 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-01-31 14:31:40Z JY4CI LB0FI 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-01-31 14:30:41Z JY4CI OH6LDJ 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2022-01-31 14:26:48Z JY4CI SQ9FVE 20M SSB 2023-03-30 11:11:33 LOTW_QSO: QSO QSLs a contact: 2021-04-29 15:37:30Z JY4CI JG3DOC 20M FT8 2023-03-30 11:11:34 LOTW_QSO: QSO QSLs a contact: 2021-04-29 15:35:15Z JY4CI JA1GLM 20M FT8 2023-03-30 11:11:34 LOTW_QSO: [Additional QSL notices suppressed] 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 18:07:17Z JY4CI V51WW 20M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:36:14Z JY4CI DC1YB 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:35:43Z JY4CI F1DSZ 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:34:19Z JY4CI DL9KWA 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:32:25Z JY4CI EA8IN 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:32:11Z JY4CI HB9DXA 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:31:11Z JY4CI DO5ST 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:30:13Z JY4CI F5MBM 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 13:29:05Z JY4CI DK3UD 10M SSB 2023-03-30 11:11:36 LOTW_QSO: QSO replaces existing record: 2015-02-27 09:16:13Z JY4CI OE6GLD 12M SSB 2023-03-30 11:11:36 LOTW_QSO: [Additional existing-record warnings suppressed] 2023-03-30 11:42:44 LOTW_QSO: Successfully processed 67804 QSO records in 1871.999483 seconds 2023-03-30 11:42:44 LOTW_QSO: 65950 records were replacements 2023-03-30 11:42:44 LOTW_QSO: 1 record was a duplicate 2023-03-30 11:42:44 LOTW_QSO: 27289 QSL records entered 2023-03-30 11:42:44 LOTW_QSO: No errors encountered

_._,_._,_

Links:

You only receive special notices.

View/Reply Online (#37889)<https://groups.arrl.org/g/ARRL-LoTW/message/37889> | Reply To Group<mailto:ARRL-LoTW at groups.arrl.org?subject=Re:%20%5BSpecial%5D%20%5BARRL-LoTW%5D%20Current%20Actual%20Upload%20Speed%20QSOs%2FSecond> | Reply To Sender<mailto:rnaumann at arrl.org?subject=Private:%20Re:%20%5BSpecial%5D%20%5BARRL-LoTW%5D%20Current%20Actual%20Upload%20Speed%20QSOs%2FSecond> | Mute This Topic<https://groups.arrl.org/mt/97949339/1931972> | New Topic<https://groups.arrl.org/g/ARRL-LoTW/post>
Your Subscription<https://groups.arrl.org/g/ARRL-LoTW/editsub/1931972> | Contact Group Owner<mailto:ARRL-LoTW+owner at groups.arrl.org> | Unsubscribe<https://groups.arrl.org/g/ARRL-LoTW/leave/4153692/1931972/664878324/xyzzy> [k1lec at arrl.net]
_._,_._,_

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.qth.net/pipermail/adxa/attachments/20230330/ac9ed9ac/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 041C4FA652904B66BDD5145B6C37AA82.png
Type: image/png
Size: 132 bytes
Desc: 041C4FA652904B66BDD5145B6C37AA82.png
URL: <http://mailman.qth.net/pipermail/adxa/attachments/20230330/ac9ed9ac/attachment-0001.png>