So I have a couple of automated file grabbers set up that download various data files from NOAA's fileserver at tgftp.nws.noaa.gov every 10-60 minutes. Usually, I download a list of ~50 individual files sequentially.
I noticed that, at some point yesterday (August 15), the automated scripts stopped updating. I looked into the logs and found that after downloading somewhere between 1 and 5 files, the download request for the subsequent file takes forever. No error messages, disconnects, timeouts or other indicators of what's happening.
So far, I've tried the downloads with wget and curl on both a Windows and a Linux machine, as well as the Python modules requests and urllib3. I've also run those scripts from a different network and remotely on a machine at my university to rule out firewall/network issues, but to no avail. The downloads always start to hang after successfully downloading 1-5 files.
Has anyone else encountered this issue recently?
NOAA tgftp file request issues
Moderator: S2k Moderators
- Extratropical94
- Professional-Met
- Posts: 3538
- Age: 30
- Joined: Wed Oct 20, 2010 6:36 am
- Location: Hamburg, Germany
- Contact:
NOAA tgftp file request issues
0 likes
54° 11' 59'' N, 9° 9' 20'' E
Boomer Sooner!
Go Broncos! Go Cards! Go Niners!
- Daniel
Boomer Sooner!
Go Broncos! Go Cards! Go Niners!
- Daniel
- TheAustinMan
- Category 5
- Posts: 1046
- Age: 25
- Joined: Mon Jul 08, 2013 4:26 pm
- Location: United States
- Contact:
Re: NOAA tgftp file request issues
I have a Python3 script regularly downloading recon data from tgftp and it also ran into a issue occasionally when the download request simply wouldn't return. I was under the assumption that it was just some hangup with my internet connection but now that you've brought it up I wonder if it's a server issue.
2 likes
- Extratropical94
- Professional-Met
- Posts: 3538
- Age: 30
- Joined: Wed Oct 20, 2010 6:36 am
- Location: Hamburg, Germany
- Contact:
Re: NOAA tgftp file request issues
Ok, I guess I'll have to wait and see if the problem persists. Thank you!
0 likes
54° 11' 59'' N, 9° 9' 20'' E
Boomer Sooner!
Go Broncos! Go Cards! Go Niners!
- Daniel
Boomer Sooner!
Go Broncos! Go Cards! Go Niners!
- Daniel
Return to “Got a question? I'm listening”
Who is online
Users browsing this forum: No registered users and 18 guests