Server is out of disk space

Message boards : Number crunching : Server is out of disk space
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
WezH

Send message
Joined: 6 Sep 20
Posts: 40
Credit: 2,230,322
RAC: 935
Finland
Message 911 - Posted: 20 Nov 2020, 12:54:15 UTC
Last modified: 20 Nov 2020, 13:43:27 UTC

Upload fails, event log has these: [error] Error reported by file upload server: Server is out of disk space

[EDIT] Now it seems to be working somehow, every now and then uploads work...
ID: 911 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 913 - Posted: 20 Nov 2020, 13:49:02 UTC

I am seeing the same thing across 6 PC's:
11/20/2020 07:40:06 | iThena | [error] Error reported by file upload server: can't write file PERF_TESTS_0D_T1605843006_14728039_2_30_0_r1948064463_0: No space left on server
11/20/2020 07:40:06 | iThena | Temporarily failed upload of PERF_TESTS_0D_T1605843006_14728039_2_30_0_r1948064463_0: transient upload error


ID: 913 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
swiftmallard

Send message
Joined: 22 Sep 20
Posts: 2
Credit: 40,230
RAC: 0
United States
Message 914 - Posted: 20 Nov 2020, 15:08:09 UTC

I see it too:
11/20/2020 8:49:42 AM | iThena | Started upload of PERF_TESTS_0D_T1605843006_14732792_2_30_0_r748016233_0
11/20/2020 8:49:45 AM | iThena | [error] Error reported by file upload server: Server is out of disk space
11/20/2020 8:49:45 AM | iThena | Temporarily failed upload of PERF_TESTS_0D_T1605843006_14732792_2_30_0_r748016233_0: transient upload error
11/20/2020 8:49:45 AM | iThena | Backing off 01:59:43 on upload of PERF_TESTS_0D_T1605843006_14732792_2_30_0_r748016233_0
ID: 914 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 917 - Posted: 21 Nov 2020, 2:46:38 UTC

It was fine for about 3 to 4 hours and now it's full again:
11/20/2020 20:37:56 | iThena | [error] Error reported by file upload server: can't write file PERF_TESTS_0D_T1605861901_14909634_2_30_0_r194253621_0: No space left on server
11/20/2020 20:37:56 | iThena | Temporarily failed upload of PERF_TESTS_0D_T1605861901_14909634_2_30_0_r194253621_0: transient upload error


ID: 917 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 12 Nov 19
Posts: 34
Credit: 110,739,392
RAC: 21,155
United States
Message 918 - Posted: 21 Nov 2020, 3:11:50 UTC - in response to Message 911.  

Yep. Getting the same errors again now.
ID: 918 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Saenger

Send message
Joined: 25 Jan 20
Posts: 18
Credit: 230,354
RAC: 156
Germany
Message 919 - Posted: 21 Nov 2020, 13:34:11 UTC

Same here:
Sa 21 Nov 2020 14:38:33 CET | iThena | [fxd] starting upload, upload_offset -1
Sa 21 Nov 2020 14:38:33 CET | iThena | Started upload of MAP_SERIES_2_912737_1000_0_r231400269_0
Sa 21 Nov 2020 14:38:33 CET | iThena | [file_xfer] URL: https://root.ithena.net/ithena_cgi/file_upload_handler
Sa 21 Nov 2020 14:38:36 CET | iThena | [file_xfer] http op done; retval 0 (Success)
Sa 21 Nov 2020 14:38:36 CET | iThena | [error] Error reported by file upload server: Server is out of disk space
Sa 21 Nov 2020 14:38:36 CET | iThena | [file_xfer] parsing upload response: <data_server_reply>    <status>1</status>    <message>Server is out of disk space</message></data_server_reply>
Sa 21 Nov 2020 14:38:36 CET | iThena | [file_xfer] parsing status: -127
Sa 21 Nov 2020 14:38:36 CET | iThena | [file_xfer] file transfer status -127 (transient upload error)
Sa 21 Nov 2020 14:38:36 CET | iThena | Temporarily failed upload of MAP_SERIES_2_912737_1000_0_r231400269_0: transient upload error
Sa 21 Nov 2020 14:38:36 CET | iThena | Backing off 05:05:19 on upload of MAP_SERIES_2_912737_1000_0_r231400269_0

An error, that's quite common with this project ;)
Grüße vom Sänger
ID: 919 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 20 Jul 20
Posts: 7
Credit: 540,394
RAC: 195
Canada
Message 920 - Posted: 21 Nov 2020, 19:20:08 UTC

How are you all getting work to begin with? I have over 12 machines connected and I haven't gotten a single bit of it. Yet the server status page gives thousands of tasks available.
ID: 920 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
WezH

Send message
Joined: 6 Sep 20
Posts: 40
Credit: 2,230,322
RAC: 935
Finland
Message 921 - Posted: 21 Nov 2020, 19:25:08 UTC - in response to Message 920.  

How are you all getting work to begin with? I have over 12 machines connected and I haven't gotten a single bit of it. Yet the server status page gives thousands of tasks available.

Have You checked "Run test applications?" in preferences? Have to be checked.
ID: 921 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 12 Nov 19
Posts: 34
Credit: 110,739,392
RAC: 21,155
United States
Message 922 - Posted: 21 Nov 2020, 23:06:38 UTC - in response to Message 920.  

How long have they been connected? It's not uncommon for clients to not get work for hours (or even days) sometimes due to overloaded resources on the server. And when there's an actual server crash/problem like right now with the full hard drive, the server isn't properly responding to requests.
ID: 922 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Saenger

Send message
Joined: 25 Jan 20
Posts: 18
Credit: 230,354
RAC: 156
Germany
Message 923 - Posted: 22 Nov 2020, 9:09:25 UTC - in response to Message 921.  

Have You checked "Run test applications?" in preferences? Have to be checked.

And where ist that checkbox supposed to be? In my project preferences it ain't.
Grüße vom Sänger
ID: 923 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile PDW

Send message
Joined: 23 Sep 19
Posts: 7
Credit: 302,672,956
RAC: 70,297
Ukraine
Message 925 - Posted: 22 Nov 2020, 10:30:54 UTC - in response to Message 923.  

Have You checked "Run test applications?" in preferences? Have to be checked.

And where ist that checkbox supposed to be? In my project preferences it ain't.

3rd item down in my project preferences, below Resource share and Use CPU.
ID: 925 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Saenger

Send message
Joined: 25 Jan 20
Posts: 18
Credit: 230,354
RAC: 156
Germany
Message 927 - Posted: 22 Nov 2020, 11:02:48 UTC - in response to Message 925.  

3rd item down in my project preferences, below Resource share and Use CPU.

Just found it, didn't expect it there, it should be more down with the apps. I had it checked, but with a full disc in the server, it's irrelevant.
Grüße vom Sänger
ID: 927 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 931 - Posted: 23 Nov 2020, 16:19:49 UTC

Anyone home?¿?????????
3+ DAYS LATER
... SERVER IS STILL OUT OF DISK SPACE.


ID: 931 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Opie

Send message
Joined: 21 Oct 20
Posts: 3
Credit: 32,256
RAC: 21
United States
Message 934 - Posted: 24 Nov 2020, 2:20:21 UTC - in response to Message 931.  

Throw me into this bucket also....

11/23/2020 20:14:06 | iThena | Started upload of PERF_TESTS_0D_T1605857402_14884378_2_30_0_r1333816162_0
11/23/2020 20:14:09 | iThena | [error] Error reported by file upload server: can't write file PERF_TESTS_0D_T1605857402_14884378_2_30_0_r1333816162_0: No space left on server
11/23/2020 20:14:09 | iThena | Temporarily failed upload of PERF_TESTS_0D_T1605857402_14884378_2_30_0_r1333816162_0: transient upload error
11/23/2020 20:14:09 | iThena | Backing off 04:34:48 on upload of PERF_TESTS_0D_T1605857402_14884378_2_30_0_r1333816162_0
ID: 934 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
gemini8

Send message
Joined: 13 Nov 19
Posts: 4
Credit: 1,243,086
RAC: 897
Germany
Message 935 - Posted: 24 Nov 2020, 6:25:41 UTC

Was wondering why the credit stalled.
Well, now it's clear.
Count me in here! ;-)
- - - - - - - - - -
Greetings, Jens
ID: 935 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile MarkRBright

Send message
Joined: 12 Mar 20
Posts: 4
Credit: 120,072
RAC: 0
United Kingdom
Message 936 - Posted: 24 Nov 2020, 13:23:03 UTC

Trying to get into this bucket myself, but there doesn't seem to be any space left in it! We need a bigger bucket!
ID: 936 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Brian Uitti

Send message
Joined: 14 Oct 20
Posts: 1
Credit: 42,322
RAC: 0
United States
Message 939 - Posted: 25 Nov 2020, 5:11:19 UTC

Yep!

11/24/2020 9:15:57 PM | iThena | Started upload of PERF_TESTS_0D_T1605861901_14912570_2_30_0_r752611548_0
11/24/2020 9:15:59 PM | iThena | [error] Error reported by file upload server: Server is out of disk space
11/24/2020 9:15:59 PM | iThena | Temporarily failed upload of PERF_TESTS_0D_T1605861901_14912570_2_30_0_r752611548_0: transient upload error
11/24/2020 9:15:59 PM | iThena | Backing off 04:48:44 on upload of PERF_TESTS_0D_T1605861901_14912570_2_30_0_r752611548_0
ID: 939 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 940 - Posted: 25 Nov 2020, 5:25:59 UTC
Last modified: 25 Nov 2020, 5:34:17 UTC

Lights are on but nobody is home..
Entertainment until the problem is fixed
Now FOUR PLUS DAYS LATER TASKS HAVE TIMED OUT AND MARKED INVALID.

ID: 940 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
WezH

Send message
Joined: 6 Sep 20
Posts: 40
Credit: 2,230,322
RAC: 935
Finland
Message 941 - Posted: 25 Nov 2020, 6:39:57 UTC

It seems that aborting uploads after retries and updating project tasks are validated and new ones downloaded
ID: 941 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 942 - Posted: 25 Nov 2020, 7:38:30 UTC - in response to Message 941.  

It seems that aborting uploads after retries and updating project tasks are validated and new ones downloaded

Worked to remove the stuck uploads, download new work but we are back to the SAME:
11/25/2020 01:40:41 | iThena | [error] Error reported by file upload server: can't write file PERF_TESTS_0D_T1605861901_14912979_2_30_0_r496407097_0: No space left on server
11/25/2020 01:40:41 | iThena | Temporarily failed upload of PERF_TESTS_0D_T1605861901_14912979_2_30_0_r496407097_0: transient upload error
11/25/2020 01:40:41 | iThena | Backing off 00:02:44 on upload of PERF_TESTS_0D_T1605861901_14912979_2_30_0_r496407097_0


ID: 942 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Server is out of disk space

© 2019-2024 iThena. All rights reserved. | Private Policy

Page generated on 28 Mar 2024, 14:22:59 UTC in 0.2698 seconds.