Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
How Do You Start An Agent On The Clearml Server With A Specific

How do you start an agent on the ClearML server with a specific clearml.conf file? ie. I am running something like this:

clearml-agent daemon --queue forecasting --docker image-name --cpu-only -d

The clearml.conf file now has an environment section with variables that are specific to this agent with the pipelines that will run here. I will have other agents running with different environment variables. So, is it possible to have multiple clearml.conf files and specify which one to use when spinning up an agent? I can't find anything in the docs about this.

  
  
Posted 23 days ago
Votes Newest

Answers 13


it always show Running .
the logs are :

Adding venv into cache: /home/ubuntu/.clearml/venvs-builds/3.10
Running task id [e7f7792081ef438bb8a6f993c71a0515]:
[.]$ /home/ubuntu/.clearml/venvs-builds/3.10/bin/python -u pipelines/pp_task.py
Summary - installed python packages:
pip:
- attrs==23.2.0
- boto3==1.34.78
- botocore==1.34.79
- certifi==2024.2.2
- charset-normalizer==3.3.2
- clearml==1.15.0
- Cython==3.0.10
- furl==2.1.3
- idna==3.6
- jmespath==1.0.1
- jsonschema==4.21.1
- jsonschema-specifications==2023.12.1
- numpy==1.26.4
- orderedmultidict==1.0.1
- pathlib2==2.3.7.post1
- pillow==10.3.0
- psutil==5.9.8
- PyJWT==2.8.0
- pyparsing==3.1.2
- python-dateutil==2.9.0.post0
- PyYAML==6.0.1
- referencing==0.34.0
- requests==2.31.0
- rpds-py==0.18.0
- s3transfer==0.10.1
- six==1.16.0
- urllib3==2.2.1

Environment setup completed successfully

Starting Task Execution:
  
  
Posted 22 days ago

I start clearml-agent on another awc ec2 using below command:

clearml-agent daemon --queue default

I just run examples examples/pipeline/pipeline_from_tasks.py after commit all files (step1*, step2*, step3*, etc) to my bitbucket repo.

  
  
Posted 22 days ago

Ah, great, thanks.

  
  
Posted 23 days ago

I follow this example:
None

  
  
Posted 22 days ago

there is no problem if i run task manually
image

  
  
Posted 22 days ago

log file:
image

  
  
Posted 22 days ago

it always show
image

  
  
Posted 22 days ago

the worker:
image

  
  
Posted 22 days ago

but i can run the experiments “Step 1…“, “Step 2…” manually (ClearML server -> Projects -> examples -> pipeline step 1 dataset artifact)

  
  
Posted 22 days ago

Hi @<1654294828365647872:profile|GorgeousShrimp11> , you can set it with an env var - CLEARML_CONFIG_FILE
None

  
  
Posted 23 days ago

then i check the status using WebApp

  
  
Posted 22 days ago

no other output after “ starting Task Execution"

  
  
Posted 22 days ago

task 1 cannot complete.

  
  
Posted 22 days ago
79 Views
13 Answers
23 days ago
21 days ago
Tags
Similar posts