No work available for PERF tasks

Message boards : Number crunching : No work available for PERF tasks
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Profile Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 25 Aug 19
Posts: 409
Credit: 1,240,185
RAC: 0
Poland
Message 831 - Posted: 21 Sep 2020, 17:06:37 UTC

The problem is probably caused by too many tasks in the database.
The database server has performance problems.
This is related to earlier problems (bug) with the task generator.
I think that if the number of tasks in the queue (PERF) decreases, the problem will also be minimized.
ID: 831 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 837 - Posted: 25 Sep 2020, 16:10:35 UTC - in response to Message 831.  

The problem is probably caused by too many tasks in the database.
The database server has performance problems.
This is related to earlier problems (bug) with the task generator.
I think that if the number of tasks in the queue (PERF) decreases, the problem will also be minimized.

Still getting the "No Work Availabe" message when requesting new work

Below is the work request log from one of my Windows host #5041 from the last aprox 30 minutes.
Last task received on this host was sent out on 25 Sep 2020, 14:28:41 UTC -- over 90 minutes ago and returned about 3 minutes later.
Server status page shows lots of iThena CNode work available: 480070

Add 5 hours to times below get UTC time.
9/25/2020 10:23:32 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:23:32 | iThena | No tasks sent
9/25/2020 10:23:32 | iThena | Project requested delay of 303 seconds
9/25/2020 10:28:38 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:28:38 | iThena | Requesting new tasks for CPU
9/25/2020 10:28:40 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:28:40 | iThena | No tasks sent
9/25/2020 10:28:40 | iThena | Project requested delay of 303 seconds
9/25/2020 10:33:47 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:33:47 | iThena | Requesting new tasks for CPU
9/25/2020 10:33:50 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:33:50 | iThena | No tasks sent
9/25/2020 10:33:50 | iThena | Project requested delay of 303 seconds
9/25/2020 10:38:57 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:38:57 | iThena | Requesting new tasks for CPU
9/25/2020 10:39:01 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:39:01 | iThena | No tasks sent
9/25/2020 10:39:01 | iThena | Project requested delay of 303 seconds
9/25/2020 10:44:07 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:44:07 | iThena | Requesting new tasks for CPU
9/25/2020 10:44:09 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:44:09 | iThena | No tasks sent
9/25/2020 10:44:09 | iThena | Project requested delay of 303 seconds
9/25/2020 10:49:17 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:49:17 | iThena | Requesting new tasks for CPU
9/25/2020 10:49:20 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:49:20 | iThena | No tasks sent
9/25/2020 10:49:20 | iThena | Project requested delay of 303 seconds
9/25/2020 10:54:27 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:54:27 | iThena | Requesting new tasks for CPU
9/25/2020 10:54:30 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:54:30 | iThena | No tasks sent
9/25/2020 10:54:30 | iThena | Project requested delay of 303 seconds
9/25/2020 10:59:39 | iThena | Sending scheduler request: To fetch work.
9/25/2020 10:59:39 | iThena | Requesting new tasks for CPU
9/25/2020 10:59:42 | iThena | Scheduler request completed: got 0 new tasks
9/25/2020 10:59:42 | iThena | No tasks sent
9/25/2020 10:59:42 | iThena | Project requested delay of 303 seconds


ID: 837 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Henk Haneveld

Send message
Joined: 31 Mar 20
Posts: 7
Credit: 119,540
RAC: 60
Netherlands
Message 841 - Posted: 30 Sep 2020, 10:55:19 UTC - in response to Message 831.  

The problem is probably caused by too many tasks in the database.
The database server has performance problems.
This is related to earlier problems (bug) with the task generator.
I think that if the number of tasks in the queue (PERF) decreases, the problem will also be minimized.

Now the send queue is empty that problem should be gone.

Please turn on the task generator so we can find out of the problem is fixed.
ID: 841 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 12 Nov 19
Posts: 34
Credit: 110,739,392
RAC: 21,155
United States
Message 843 - Posted: 3 Oct 2020, 14:39:46 UTC

My Linux machines almost always have a task running. It's rare to see them NOT have one active.

None of my Windows machines have had any work for several months...
ID: 843 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 25 Aug 19
Posts: 409
Credit: 1,240,185
RAC: 0
Poland
Message 845 - Posted: 4 Oct 2020, 18:55:18 UTC

Continuous problems...
Please be patient :)
ID: 845 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 868 - Posted: 9 Oct 2020, 21:03:19 UTC - in response to Message 845.  

Continuous problems...
Please be patient :)

Been 5 days now... Any update on PERF tasks will be available?

ID: 868 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Opolis

Send message
Joined: 14 May 20
Posts: 2
Credit: 71,040
RAC: 0
United States
Message 869 - Posted: 14 Oct 2020, 18:17:09 UTC

My log file looks just like Dr Who Fan's.
Cannot get tasks and then timeout for 303 sec,

Haven't received a task in literally months, yet there are 10's of thousands available?
ID: 869 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 871 - Posted: 18 Oct 2020, 6:36:20 UTC - in response to Message 845.  

Message 845 - Posted: 4 Oct 2020, 18:55:18 UTC
Continuous problems...
Please be patient :)

HAVE BEEN WAITING FOR REPLY FROM ADMIN FOR 2 WEEKS NOW!

ID: 871 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 25 Aug 19
Posts: 409
Credit: 1,240,185
RAC: 0
Poland
Message 872 - Posted: 20 Oct 2020, 17:11:45 UTC

Unfortunately, the problem is on the storage layer.
More precisely on the results data archiving layer.

Unfortunately this is not to be done very quickly and we have delays. Very long delays...

At the moment (in a fast way) I want to introduce badges.
ID: 872 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 875 - Posted: 20 Oct 2020, 19:45:20 UTC - in response to Message 872.  

Thank you for the update. Hope you can get the storage/archive problem fixed.

ID: 875 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F

Send message
Joined: 4 Aug 20
Posts: 25
Credit: 161,698
RAC: 104
United States
Message 882 - Posted: 26 Oct 2020, 5:32:04 UTC
Last modified: 26 Oct 2020, 5:32:57 UTC

The new automatic work generator gave us plenty of work for a few days, but once again no Windows tasks available.

Thanks
Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 882 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F

Send message
Joined: 4 Aug 20
Posts: 25
Credit: 161,698
RAC: 104
United States
Message 888 - Posted: 29 Oct 2020, 0:16:11 UTC

Well we have 184,000 tasks available and none of them are iThena PERF tasks

iThena PERF was supposed to me leaving BETA and becoming a main line production application ?

Bill F
Dallas TX
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 888 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 889 - Posted: 29 Oct 2020, 4:03:20 UTC - in response to Message 888.  

Well we have 184,000 tasks available and none of them are iThena PERF tasks

iThena PERF was supposed to me leaving BETA and becoming a main line production application ?

Bill F
Dallas TX

Not only that..
1) For about 48 hours now, the project website is either slow to load or outright fails to load.
2) Multiple upload and download errors on the few tasks have been able to get where the BOINC client times out due to website unavailability.

This project is starting to go the same route as the currently deceased NCI Goofyxgrid aka "monkey" project.

ID: 889 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 890 - Posted: 29 Oct 2020, 15:42:22 UTC

Tried to post this about 3 hours ago but the server's SSL connection kept failing.. Google Chrome and Mozilla Firefox both refused connections with or without HTTPS/SSL.

APPEARS THERE IS A "Unknown SSL protocol error" causing the upload/download issues.
3 Common Causes of Unknown SSL Protocol Errors with cURL

Add 5 hours to time below to get UTC time:
10/29/2020 07:57:31 | iThena | Started upload of PERF_TESTS_0D_T1603967402_2611016_2_30_0_r119385833_0
10/29/2020 07:57:32 | iThena | [http] [ID#19676] Info: successfully set certificate verify locations:
10/29/2020 07:58:42 | iThena | [http] [ID#19676] Info: Unknown SSL protocol error in connection to root.ithena.net:443
10/29/2020 07:58:42 | iThena | [http] [ID#19676] Info: Closing connection 6771
10/29/2020 07:58:42 | iThena | [http] HTTP error: SSL connect error
10/29/2020 07:58:43 | iThena | Temporarily failed upload of PERF_TESTS_0D_T1603967402_2611016_2_30_0_r119385833_0: transient HTTP error

10/29/2020 07:58:43 | iThena | Backing off 04:13:52 on upload of PERF_TESTS_0D_T1603967402_2611016_2_30_0_r119385833_0


ID: 890 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Volunteer moderator

Send message
Joined: 7 Apr 20
Posts: 428
Credit: 1,119,176
RAC: 461
United States
Message 893 - Posted: 5 Nov 2020, 6:42:26 UTC

Server Empty:
Task data as of 5 Nov 2020, 5:48:55 UTC
iThena CNode 9793 688 0.61 (0.11 - 3.28) 98
iThena PERF 0 1298 0.05 (0.01 - 27.82) 193


ID: 893 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Rysiu
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 25 Aug 19
Posts: 409
Credit: 1,240,185
RAC: 0
Poland
Message 894 - Posted: 8 Nov 2020, 12:54:40 UTC

Currently, tasks for the iThena PERF application are automatically generated.
However, they are generated in a limited amount.
The tasks consumption is higher.
I don't want to increase the number of generated tasks significantly at this point due to the system load.
I will gradually increase the number of tasks available in a given period of time.
ID: 894 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Opolis

Send message
Joined: 14 May 20
Posts: 2
Credit: 71,040
RAC: 0
United States
Message 897 - Posted: 9 Nov 2020, 21:21:27 UTC

Lately I have been receiving an almost steady stream of PERF tasks...much better now!
ID: 897 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 20 Jul 20
Posts: 7
Credit: 540,394
RAC: 195
Canada
Message 909 - Posted: 18 Nov 2020, 5:34:09 UTC

A bunch of machines on the project, no tasks at all. 10000 tasks to be sent.
What gives?
ID: 909 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F

Send message
Joined: 4 Aug 20
Posts: 25
Credit: 161,698
RAC: 104
United States
Message 910 - Posted: 18 Nov 2020, 23:08:40 UTC - in response to Message 909.  

A bunch of machines on the project, no tasks at all. 10000 tasks to be sent.
What gives?


Currently both Applications are new release and are BETA. To get these you have to answer "Yes" Run test applications? in the iThena Preferences on your account.

Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 910 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 20 Jul 20
Posts: 7
Credit: 540,394
RAC: 195
Canada
Message 945 - Posted: 25 Nov 2020, 19:46:17 UTC - in response to Message 910.  

A bunch of machines on the project, no tasks at all. 10000 tasks to be sent.
What gives?


Currently both Applications are new release and are BETA. To get these you have to answer "Yes" Run test applications? in the iThena Preferences on your account.

Bill F

Thanks! Added the fleet. Now apparently server is out of diskspace so I guess I'll just hope I can get tasks in before the deadline, assuming I get any tasks to begin with. Did just check the box for run test applications so we'll see what happens throughout the day.
ID: 945 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : No work available for PERF tasks

© 2019-2024 iThena. All rights reserved. | Private Policy

Page generated on 28 Mar 2024, 14:21:19 UTC in 0.2972 seconds.