u/krishnatamakuwala

We are a small team working in new ML project, and we are evaluating different orchestration tools like Trigger.dev, Prefect, Temporal, and others. However, before making sure that whatever tool we chose would meet our needs, we must ensure that changing the tool in the case of it being unfit for our work would not turn into a problem. I feel like there is no winning here because once the commitment is made, there is little to do about it.

Your opinion in the matter would be much appreciated:

have you had an experience of having to change orchestration tools mid-project? what made you do so?
why did you think it was necessary to choose that particular orchestration tool?
is there any set of conditions for those choices, or everything depends on the particular circumstances?

Did anyone actually trial Flyte, Prefect, or Temporal properly before walking away, or was it more of a ‘looked at the docs and noped out’ situation? Specifically curious what the breaking point was — setup complexity, ongoing maintenance, or something else entirely?

Did anyone actually trial these properly for Machine Learning Jobs before walking away, or was it more of a ‘looked at the docs and noped out’ situation? Specifically curious what the breaking point was — setup complexity, ongoing maintenance, or something else entirely.