Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Team, I Have Been Trying To Setup Pipeline Using Clearml. I Set Up An Agent In Colab And Also In Ec2. However In Both Cases, The Pipeline Is Pending. I Checked The Logs In The Agent And It Is As Below. Can Someone Help Me Understand What Is Wrong? Fy

Hi Team,

I have been trying to setup pipeline using clearml. I set up an agent in colab and also in ec2. However in both cases, the pipeline is pending. I checked the logs in the agent and it is as below. Can someone help me understand what is wrong?

FYI: The code i am using is here None

Executing task id [738b36b74e71480ca5c7257fa3d49353]:
repository = git@github.com:adrshm91/numenta_anomaly_detection.git
branch = 1_clearml
version_num = ce9a2a486e20611cfd75fb210c3dd796071fd712
tag = 
docker_cmd = 
entry_point = src/main.py
working_dir = .

::: Using Cached environment /home/ubuntu/.clearml/venvs-cache/2dc3ca1582d206c2886ec5541bc9b45e.595f92c6c24ec8d63ac96f8e5cfc0322 :::
Using cached repository in "/home/ubuntu/.clearml/vcs-cache/numenta_anomaly_detection.git.93dfa0dfe46560a69a8179cc9461f5df/numenta_anomaly_detection.git"
Note: switching to 'ce9a2a486e20611cfd75fb210c3dd796071fd712'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at ce9a2a4 add latest changes
type: git
url: git@github.com:adrshm91/numenta_anomaly_detection.git
branch: HEAD
commit: ce9a2a486e20611cfd75fb210c3dd796071fd712
root: /home/ubuntu/.clearml/venvs-builds/3.10/task_repository/numenta_anomaly_detection.git
Applying uncommitted changes
  
  
Posted 8 months ago
Votes Newest

Answers 12


Hi @<1552101447716311040:profile|SteadySeahorse58> , if the experiment is still in pending mode it means that it wasn't picked up by any worker. Please note that in a pipeline you have the controller that usually runs on the services queue and then you have the steps where they all can run on different queues - depending on what you set

  
  
Posted 8 months ago

Hi @<1523701070390366208:profile|CostlyOstrich36> @<1523701087100473344:profile|SuccessfulKoala55> I had given a wrong queue. Everything works now. Sorry for the confusion. Have a nice day!

  
  
Posted 7 months ago

yes, sure. It is all here None

  
  
Posted 8 months ago

None

  
  
Posted 8 months ago

@<1552101447716311040:profile|SteadySeahorse58> continuing John's reply, what queue did you set the agent to monitor?

  
  
Posted 8 months ago

Can you point to the exact piece of code?

  
  
Posted 8 months ago

It seems more related to the pipeline setup/code

  
  
Posted 8 months ago

I run the pipeline here

  
  
Posted 8 months ago

I restarted the agent and it picks the task and hangs at that log message i posted in the chat

  
  
Posted 8 months ago

Is it something with git commits?

  
  
Posted 8 months ago

Hi @<1523701070390366208:profile|CostlyOstrich36> , I am running the agent to listen to both queues: services and default queue

clearml-agent daemon --queue default services

Also, I set pipe.set_default_execution_queue("default") in order to run pipeline steps in default queue and calling pipe.start() to run the controller in services queue.

  
  
Posted 8 months ago

Can you share the pipeline code you're using?

  
  
Posted 8 months ago
460 Views
12 Answers
8 months ago
7 months ago
Tags
Similar posts