Reputation
Badges 1
14 × Eureka!I have attached the screenshot of logs earlier
thank you @<1523701435869433856:profile|SmugDolphin23>
@<1523701435869433856:profile|SmugDolphin23> I have attached two screenshots, One is pipeline initialization & other one is the task of the pipeline.
The project's directory is as follows:
The pipeline.py includes the code to run the pipeline & tasks of the pipeline.
├── Makefile
├── README.md
├── ev_xxxxxx_detection
│ ├── __init__.py
│ ├── __pycache__
│ │ └── __init__.cpython-311.pyc
│ ├── clearml
│ │ ├── __pycache__
│ │ ├── clearml_wrapper.py
│ │ ├── constants....
Hi, @<1523701435869433856:profile|SmugDolphin23> , the provided SDK still doesn't provide the version details, once the pipeline created from the draft state.
I’m encountering an issue that I hope you can assist with.
Issue #1:
As discussed in previous comments, we have a scenario where we create a draft pipeline and enqueue it for later. The problem arises when the pipeline is triggered - the version details are not being added to the pipeline that is enqueued from the draft state.
Cou...
@<1523701435869433856:profile|SmugDolphin23> Can you please help me out here
sure, I'll add those details & check. Thank you
Thank you @<1523701435869433856:profile|SmugDolphin23> It is working now after the addition of repo details into each task. It seems that we need to specify repo details in each task to pull the code & execute the tasks on the worker.
T hank you @<1523701435869433856:profile|SmugDolphin23> I got the info. I missed to update you here Im handling manually using the version argument.
@<1523701435869433856:profile|SmugDolphin23> I have tried another way by including pipeline.py in the root directory of the code and executed “python3 pipeline.py” & still faced same issue
@<1523701435869433856:profile|SmugDolphin23> I have tried the same method as suggested by you and the pipeline still failed, as it couldn't find "modules". Could you please help me here?
I would like to describe the process again, which I was following:
- I created a queue and assigned 2 workers to the queue.
- In the pipeline.py file, to start the pipeline I used
pipe.start(queue="queue_remote")
and for the tasks I usedpipe.set_default_execution_queue('queue_remote')
- In the `wo...
Hi, @<1523701435869433856:profile|SmugDolphin23> Good morning,
I am currently working with the ClearML pipeline and have automated the process of retrieving the pipeline version using a specific provided method, which is then added to the pipeline controller.
While the pipeline was in a draft state, this method worked perfectly fine. However, once the pipeline was created in the draft state and enqueued to the queue, I encountered an issue. Specifically, I was unable to retrieve the pipel...
@<1523701435869433856:profile|SmugDolphin23> Sure, Thank you for the suggestion. I'll try to add imports as mentioned by you and execute the pipeline & check the functionality.
In Local I'm running using python3 pipelin.py
and used pipe.start_locally(run_pipeline_steps_locally=True)
in the pipeline to initialize & it's working fine.
@<1523701435869433856:profile|SmugDolphin23> , I’ve updated both the ClearML server and client to the latest version, 1.14.0, as per our previous conversation. However, I’m still encountering the same issue as described earlier.
WebApp: 1.14.0-431
Server: 1.14.0-431
API: 2.28
I attempted to use the same queue for both the controller and the steps, and assigned two workers to this queue. Upon executing the code, the pipeline was initiated on the “queue_remote” queue, and the tasks of the pip...