Comments you submit will be routed for moderation. If you have an account, please log in first.

Ticket #3911 (new enhancement)

Opened 8 years ago

Dynamic executor count for "PBS Slave"

Reported by: jdsiiro Owned by: jdsiiro
Priority: major Milestone:
Component: Hudson Version:
Keywords: Cc:


The idea is to have a special slave for monitoring jobs under the control of PBS. Right now, we have a "normal" slave for cluster login nodes. That slave is responsible for both building the job and for monitoring PBS to wait for the job completion. Unfortunately, that job "ties up" the login node while it is waiting for the job (that no longer makes use of the login node) to run out on the cluster.

What we would like is a new slave type that is only for monitoring external schedulers. All jobs would consume only one executor (i.e. a slot in the PBS queue). The node would "dynamically" provision an additional executor when the free executor was consumed, and then consume and eliminate idle executors when more than 1 free executor existed.

With this additional slave, a job would run on the normal login node slave for building, and then spawn a downstream job to run on the "PBS slave" to queue up and wait for the actual tests to run out on the cluster.



Add a comment

Modify Ticket

Change Properties
<Author field>
as new

E-mail address and user name can be saved in the Preferences.

Note: See TracTickets for help on using tickets.