wip: prototype for fractale feasibility and delegation with flux#1
Open
wip: prototype for fractale feasibility and delegation with flux#1
Conversation
Signed-off-by: vsoch <vsoch@users.noreply.github.com>
This adds the basic structure for flux remote submit, which basically wraps the flux submit command (and is designed to support other subcommands in the future). This can be moved into the flux libexec cmd directory or just used as is. I next need to parse the submit request and then map attributes, etc. to the user defined compatibility data (cluster and resource needs) and I think then we are good. Signed-off-by: vsoch <vsoch@users.noreply.github.com>
Signed-off-by: vsoch <vsoch@users.noreply.github.com>
vsoch
changed the title
Signed-off-by: vsoch <vsoch@users.noreply.github.com>
Signed-off-by: vsoch <vsoch@users.noreply.github.com>
This allows adding an --export flag to flux detect, which will either create a temporary context and detect (and export to zip) all local subsytems, or if given a config directory, run detect there (honoring force or not) and then export. Of course not cleaning up if it is not a temporary cluster/subsystem root. Signed-off-by: vsoch <vsoch@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
I think I know how I'm going to do this now - see notes in README in this PR. It should be fairly simple, and the details will come down to a neat organization of metadata in the user home, and then how that data is queried and sent between stages. Basically:
Then it goes to the delegate JobTap plugin included in this repository, and only includes feasible clusters. I'm designing it so the command can be installed cleanly to a flux install or used a la carte, and can also be extended with other subcommands. With this design, we don't need to reimplement flux submit - the above is using that exact class.