Page 1 of 1

NOAA tgftp file request issues

Posted: Sun Aug 16, 2020 11:40 am
by Extratropical94
So I have a couple of automated file grabbers set up that download various data files from NOAA's fileserver at tgftp.nws.noaa.gov every 10-60 minutes. Usually, I download a list of ~50 individual files sequentially.
I noticed that, at some point yesterday (August 15), the automated scripts stopped updating. I looked into the logs and found that after downloading somewhere between 1 and 5 files, the download request for the subsequent file takes forever. No error messages, disconnects, timeouts or other indicators of what's happening.
So far, I've tried the downloads with wget and curl on both a Windows and a Linux machine, as well as the Python modules requests and urllib3. I've also run those scripts from a different network and remotely on a machine at my university to rule out firewall/network issues, but to no avail. The downloads always start to hang after successfully downloading 1-5 files.

Has anyone else encountered this issue recently?

Re: NOAA tgftp file request issues

Posted: Sun Aug 16, 2020 12:42 pm
by TheAustinMan
I have a Python3 script regularly downloading recon data from tgftp and it also ran into a issue occasionally when the download request simply wouldn't return. I was under the assumption that it was just some hangup with my internet connection but now that you've brought it up I wonder if it's a server issue.

Re: NOAA tgftp file request issues

Posted: Sun Aug 16, 2020 12:57 pm
by Extratropical94
Ok, I guess I'll have to wait and see if the problem persists. Thank you!