Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
TenseOstrich47
Moderator
22 Questions, 100 Answers
  Active since 10 January 2023
  Last activity 3 months ago

Reputation

0

Badges 1

90 × Eureka!
0 Votes
15 Answers
697 Views
0 Votes 15 Answers 697 Views
Hey all. Question regarding scheduling and orchestration. Does ClearML provide any tooling to schedule entire training pipelines and to trigger training pipe...
2 years ago
0 Votes
14 Answers
701 Views
0 Votes 14 Answers 701 Views
Any ideas why this is happening? It was fine yesterday
3 years ago
0 Votes
2 Answers
670 Views
0 Votes 2 Answers 670 Views
Has anybody integrated Airflow with ClearML here? If so, what has been your experience?
3 years ago
0 Votes
13 Answers
712 Views
0 Votes 13 Answers 712 Views
Why would every submitted task be aborted directly?
2 years ago
0 Votes
3 Answers
799 Views
0 Votes 3 Answers 799 Views
Also, is there a way to remove the Examples from my server deployment? I can't delete the tasks. I tried to archive the task prior to deletion and I get the ...
3 years ago
0 Votes
11 Answers
705 Views
0 Votes 11 Answers 705 Views
Hey all. I'm seeing a strange error when trying to run hyperparameter optimisation by cloning a base training task Action failed <500/0: tasks.clone/v1.0 (ke...
3 years ago
0 Votes
6 Answers
617 Views
0 Votes 6 Answers 617 Views
Hey all. Question about the bucket config for clearml. Is it possible to have two buckets in the config? We have partners in EU and US, and due to data gover...
2 years ago
0 Votes
11 Answers
769 Views
0 Votes 11 Answers 769 Views
3 years ago
0 Votes
30 Answers
727 Views
0 Votes 30 Answers 727 Views
3 years ago
0 Votes
6 Answers
643 Views
0 Votes 6 Answers 643 Views
2 years ago
0 Votes
5 Answers
709 Views
0 Votes 5 Answers 709 Views
Hi. I'm struggling with executing a python script which is a replica of a notebook, which executes fine. The issue I am encountering is clearml_agent: ERROR:...
3 years ago
0 Votes
6 Answers
665 Views
0 Votes 6 Answers 665 Views
Hey all. Thinking about organisation of artefacts and how we store them in S3. We have been using the StorageManager to upload files to target S3 destination...
3 years ago
0 Votes
18 Answers
728 Views
0 Votes 18 Answers 728 Views
3 years ago
0 Votes
12 Answers
657 Views
0 Votes 12 Answers 657 Views
2 years ago
0 Votes
5 Answers
687 Views
0 Votes 5 Answers 687 Views
Can the StorageManager upload directly from memory or does it have to be from a local file?
2 years ago
0 Votes
2 Answers
837 Views
0 Votes 2 Answers 837 Views
one year ago
0 Votes
5 Answers
708 Views
0 Votes 5 Answers 708 Views
Hey all. Is there a best practice approach to deploying models trained in clearml? Does anyone have a standard workflow that they employ?
3 years ago
0 Votes
9 Answers
670 Views
0 Votes 9 Answers 670 Views
Hey. May be a question asked previously , but does clearml support ECR? I have a series of pre-created containers that I would like to use during training. I...
2 years ago
0 Votes
25 Answers
662 Views
0 Votes 25 Answers 662 Views
Hey all. Quick question about the ~/.clearml directory on the clearml-agent. It seems to be filling up disk storage quite quickly 440M /home/ubuntu/.clearml/...
3 years ago
0 Votes
3 Answers
599 Views
0 Votes 3 Answers 599 Views
3 years ago
0 Votes
6 Answers
636 Views
0 Votes 6 Answers 636 Views
Hey. This may be a silly question ... but I am unsure about how the clearml-agent works. Does it need to be installed on the local server (from which the exp...
3 years ago
0 Votes
4 Answers
184 Views
0 Votes 4 Answers 184 Views
Can't access the docs at the moment. SSL error. Can you guys verify whether your SSL certificate has expired or not please? Unsure whether the error is on my...
2 years ago
0 Hey All. Quick Question About The

are the envs named after the worker enumeration? e.g. venv-bulds-0 is linked to worker 0?

3 years ago
0 Hi All, We'Ve Been Using Clearml For Quite Some Time Now. Our Deployment Is A Simple Docker Container On A Dedicated Ec2 Instance. More Recently, We Have Been Running Out Of Storage, And It Looks To Be That Elasticsearch Is The Main Culprit. What Data I

SuccessfulKoala55 thanks for your help as always. I will try to create a DAG on airflow using the SDK to implement some form of retention policy which removes things that are not necessary. We independently store metadata on artefacts we produce, and mostly use clearml as the experiment manager, so a lot of the events data can be cleared.

one year ago
3 years ago
0 Can The

Reason I am asking is because we have servers with large RAM capacity, but minimal storage capacity, meaning that objects held in memory can sometimes surpass storage capacity if export is required

2 years ago
0 Hi Folks, We Are Trying To Find A Tool To Help With Workflow Orchestration. This Is Our Stack So Far (Label Studio/Clearml/Seldon). Does Anyone Have Any Experience With Using Any Workflow Which Is Most Compatible Esp Wrt To Clearml.

We are planning on using airflow as the orchestration, but that may not fit your needs. I would say that the tool of choice is highly context specific.

We will be using airflow to trigger clearml-defined pipelines based on 'trigger' events, such as degradation in model performance, error alerts (e.g. at the data transformation task) etc.

2 years ago
0 Can The

I may just chunk the exports and see how I get on there 🙂 thanks for your help!

2 years ago
0 Hey. Seeing A Strange Error When Trying To Install A Private Python Package When The Agent Executes The Task. We Use Aws Codeartifact As The Private Pypi Repository. The Agent Attempts To Install The Package From Git, Rather Than A Regular Pip Install And

Using SSH credentials - replacing https url ' ' with ssh url ' ' Replacing original pip vcs 'git+ ' with ' ` '
Collecting py_db
Cloning ssh://@github.com/15gifts/py-db.git (to revision 851daa87317e73b4602bc1bddeca7ff16e1ac865) to /tmp/pip-install-zpiar1hv/py-db
Running command git clone -q 'ssh://
@github.com/15gifts/py-db.git' /tmp/pip-install-zpiar1hv/py-db
2021-12-08 15:56:31
ERROR: Repository not found.
fatal: Could not read from remote repository.
Please...

2 years ago
0 Hey. Seeing A Strange Error When Trying To Install A Private Python Package When The Agent Executes The Task. We Use Aws Codeartifact As The Private Pypi Repository. The Agent Attempts To Install The Package From Git, Rather Than A Regular Pip Install And

I can authorise CodeArtifact if I ssh into the server, and install the private package with no issues. Seems like something is forcing clearml-agent to use github cloning to install, rather than directly pip. Not sure if this is a configuration I have set up myself, or whether the server is configured to do this

2 years ago
0 Hey. Seeing A Strange Error When Trying To Install A Private Python Package When The Agent Executes The Task. We Use Aws Codeartifact As The Private Pypi Repository. The Agent Attempts To Install The Package From Git, Rather Than A Regular Pip Install And

Okay solved the problem. It is using the version that is locally installed (on my laptop). Is there a way to prevent this? Perhaps a requirements.txt or something like that>

2 years ago
0 Good Morning, I'M Wondering If Someone Has Any Advice/Experience Configuring Clearml-Agent To Include Private Packages From Aws Codeartifact? So Far I Know I Have To Edit The

One question - you can also set the agent.package_manager.extra_index_url , but since this is dynamic, will pip install still add the extra index URL from the pip config file? Or does it have to be set in this agent config variable?

2 years ago
0 Good Morning, I'M Wondering If Someone Has Any Advice/Experience Configuring Clearml-Agent To Include Private Packages From Aws Codeartifact? So Far I Know I Have To Edit The

Did the shell script route work? I have a similar question.

It's a little more complicated because the index URL is not fixed; it contains the token which is only valid for a max of 12 hours. That means the ~/.config/pip/pip.conf file will also need to be updated every 12 hours. Fortunately, this editing is done automatically by authenticating AWS codeartefact in the command line by logging in.

My current thinking is as follows:

Install the awscli - pip install awscli (c...

2 years ago
0 Hey All. Another Question - How Are Private Packages Handled/Installed So That Clearml-Agent Can Execute A Task? I Have A Bunch Of Private Repos For Communicating With The Data Warehouse. I Could Do A System-Wide Installation For It On The Clearml-Agent I

That is a neat way of making it work! Thanks Martin. Once I've added the SSH key to the deployment keys in that repo, then the change in the config should work right? I'm guessing the extra index URL can be a URL to the github repo of interest? (not another privately hosted pypi repo)

3 years ago
0 Hey All. Another Question - How Are Private Packages Handled/Installed So That Clearml-Agent Can Execute A Task? I Have A Bunch Of Private Repos For Communicating With The Data Warehouse. I Could Do A System-Wide Installation For It On The Clearml-Agent I

Hey guys. Installing from the private repo is still failing. We have added the relevant deploy key to the repo, but I still get an error when trying to clone and install. Any ideas?

This is what I see under the 'Installed Packages' section
` # Python 3.8.5 (default, Sep 4 2020, 02:22:02) [Clang 10.0.0 ]
azure_storage_blob == 12.6.0
boto3 == 1.11.17
clearml == 0.17.4
git+ssh://git@github.com/15gifts/py-db.git

Detailed import analysis

**************************

IMPORT PACKAGE azure_st...

3 years ago
0 Hey All. Another Question - How Are Private Packages Handled/Installed So That Clearml-Agent Can Execute A Task? I Have A Bunch Of Private Repos For Communicating With The Data Warehouse. I Could Do A System-Wide Installation For It On The Clearml-Agent I

Here is the error message from the console
Collecting git+ssh://****@github.com/15gifts/py-db.git Cloning ssh://****@github.com/15gifts/py-db.git to /tmp/pip-req-build-xai2xts_ Running command git clone -q 'ssh://****@github.com/15gifts/py-db.git' /tmp/pip-req-build-xai2xts_ ERROR: Repository not found. fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists.

3 years ago
0 Hey All. Another Question - How Are Private Packages Handled/Installed So That Clearml-Agent Can Execute A Task? I Have A Bunch Of Private Repos For Communicating With The Data Warehouse. I Could Do A System-Wide Installation For It On The Clearml-Agent I

While we are here - excuse my ignorance for now if this has already been stated in the docs ..

Is it possible to launch multiple clearml-agents on a dedicated clearml-agent server? I noticed that with one agent, only one task gets executed at one time

3 years ago
0 Hey All. Quick Question About The

ohhh ok. so I can actually remove this if those workers are no longer in use

3 years ago
0 Any Ideas Why This Is Happening? It Was Fine Yesterday

From what I can tell, docker has some leakage here. Temp files are not removed correctly, resulting in the build up of disk storage usage.
See the following for more details
https://stackoverflow.com/questions/46672001/is-it-safe-to-clean-docker-overlay2
https://forums.docker.com/t/some-way-to-clean-up-identify-contents-of-var-lib-docker-overlay/30604
https://docs.docker.com/storage/storagedriver/overlayfs-driver/

Im going to write a clean up script and add that to the cron. I dont bel...

3 years ago
0 Good Morning, I'M Wondering If Someone Has Any Advice/Experience Configuring Clearml-Agent To Include Private Packages From Aws Codeartifact? So Far I Know I Have To Edit The

By script, you mean entering these two lines separately as a list for that extra_docker_shell_scripts arugment?

2 years ago
Show more results compactanswers