Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
GentleSwallow91
Moderator
17 Questions, 32 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

32 × Eureka!
0 Votes
17 Answers
668 Views
0 Votes 17 Answers 668 Views
Migration ClearML 1.5.0 -> 1.8? -> 1.9? Good day to all. I am currently on ClearML Server 1.5.0 Everything seems to be just fine. Maybe some minor stuff in t...
one year ago
0 Votes
2 Answers
625 Views
0 Votes 2 Answers 625 Views
controlling artifacts logging Is there a way tell ClearML Task not to do automatic file reporting? My code does tflight model conversion. So the problem here...
one year ago
0 Votes
2 Answers
802 Views
0 Votes 2 Answers 802 Views
Good day to all! Any clue how to make upload dataset to minio S3? I have setup a custom s3 in clearml.conf as per docs: aws { s3 { # default, used for any bu...
aws
2 years ago
0 Votes
1 Answers
638 Views
0 Votes 1 Answers 638 Views
additional mounts in docker when running agent task Is there a way to mount specific files into docker container through agent configuration? My point is tha...
one year ago
0 Votes
3 Answers
634 Views
0 Votes 3 Answers 634 Views
Is there a way to use agent for dataset creation tasks? My point is that I want to use agents to create datasets. For that purpose I need to pass parameters ...
one year ago
0 Votes
3 Answers
609 Views
0 Votes 3 Answers 609 Views
Adding --privileged to docker arguments in agent docker mode Minor stuff but by default GPUs are passed to container running with this flag (I am on archlinu...
one year ago
0 Votes
4 Answers
675 Views
0 Votes 4 Answers 675 Views
one year ago
0 Votes
9 Answers
660 Views
0 Votes 9 Answers 660 Views
Reducing docker container spin-up time with ClearML agent I have made a training experiment with clearML in docker container. Now I have the same image that ...
one year ago
0 Votes
2 Answers
640 Views
0 Votes 2 Answers 640 Views
2 years ago
0 Votes
1 Answers
684 Views
0 Votes 1 Answers 684 Views
Proper way to upload artifacts Good day to all. I am running a pytorch lightning notebook with ClearML integration. As was advised in lightning example just ...
one year ago
0 Votes
1 Answers
698 Views
0 Votes 1 Answers 698 Views
What's the proper way to build a pipeline? In ClearML there are several approaches to build a pipeline. I am about to make a pipeline for the following scena...
tf
one year ago
0 Votes
3 Answers
635 Views
0 Votes 3 Answers 635 Views
automatic ssh keys export to agent in docker mode I don't know how about you - but I have struggled with mounting my host ssh keys inside a docker while usin...
one year ago
0 Votes
17 Answers
659 Views
0 Votes 17 Answers 659 Views
upload_artifact not working with minio I have a minio server integrated with ClearML and it works fine for storing jupyter notebooks on minio but I can not s...
one year ago
0 Votes
2 Answers
651 Views
0 Votes 2 Answers 651 Views
post_packages: clearml.conf I had a problem with one python package - it is installed in base docker image but clearML has not determined it during the scrip...
one year ago
0 Votes
2 Answers
643 Views
0 Votes 2 Answers 643 Views
logger.report_image and logger.report_matplotlib_figure not working I get a positive response from SDK call (see the screenshot) but the images/figures do no...
one year ago
0 Votes
1 Answers
683 Views
0 Votes 1 Answers 683 Views
clearml-data sync not working I am using clearml-data cli to work with the dataset and the workflow is that I get a local copy and then make some changes to ...
one year ago
0 Votes
7 Answers
636 Views
0 Votes 7 Answers 636 Views
Correct way to configure ssh authentication for git in agent with docker mode I am struggling with configuring ssh authentication in docker mode with agent. ...
one year ago
0 Controlling Artifacts Logging

Yeap. Thanks - I've already did that and faced another issue - https://github.com/allegroai/clearml/issues/740
Now model stays local and is not uploaded to s3.

one year ago
0 Logger.Report_Image And Logger.Report_Matplotlib_Figure Not Working

It was some issue with the server - after restarting all seems to work.

one year ago
0 Upload_Artifact Not Working With Minio

I am using
WebApp: 1.5.0-186
Server: 1.5.0-186
API: 2.18
On client side:
clearml==1.4.1
clearml-agent==1.2.3

one year ago
0 Upload_Artifact Not Working With Minio

Hi SweetBadger76
So - I have turned off SSL for minio and tried a test script for uploading those two artifacts.
The result is that it works - the file got uploaded to a bucket.
Although it has taken a long time to finish upload and the files are less than 1Mb
$ python3 test.py ClearML Task: overwriting (reusing) task id=72e7c0b098e14197a9ffe82d7444337f ClearML results page: `
2022-06-10 14:14:00,894 - clearml.Task - INFO - Waiting to finish uploads
2022-06-10 14:14:11,888 - clearml.T...

one year ago
0 Upload_Artifact Not Working With Minio

So I have switched back to ssl to give a try to the script again - and it works with ssl now.
I even have tried it with big files - still works.
SweetBadger76 thanks for giving a hand - don't know what was the issue but now that works.

one year ago
0 Correct Way To Configure Ssh Authentication For Git In Agent With Docker Mode

Hi AgitatedDove14
Either I do smth wrong or it works only in theory 😃
Here are my mounts in agent clearml.conf
sdk_cache: "/clearml_agent_cache" ssh_folder: "/home/testuser/.ssh" pip_cache: "/home/testuser/.cache/pip" vcs_cache: "/home/testuser/.clearml/vcs-cache" venv_build: "/home/testuser/.clearml/venvs-builds" pip_download: "/home/testuser/.clearml/pip-download-cache"testuser is inside Docker container
and I run agent from local user and I would expect...

one year ago
0 Correct Way To Configure Ssh Authentication For Git In Agent With Docker Mode

Yeap. It is configured this way
force_git_ssh_protocol: trueBut I don't see the mount of .ssh
One thing though - my container is running on behalf of non-root user.
` Here are my docker mounts:
docker_internal_mounts {
sdk_cache = /clearml_agent_cache
# apt_cache = /var/cache/apt/archives
ssh_folder = /home/testuser/.ssh
pip_cache = /home/testuser/.cache/pip
poetry_cache = /home/testuser/.cache/pypoetry
vcs_cache = /home/testuser/.clearml/vcs-cache
venv_build =...

one year ago
0 Post_Packages:

AgitatedDove14 thanks - that makes it clear.
In particular there are some optional dependencies - in my case I am using pandas.read_xls and it requires openpyxl .
Meanwhile I have changed a script and inserted an explicit import - now agent makes this install.

Are you running in docker mode ? the venv inside the docker inherits from all the installed packages, how come it is missing?

My fault - I was in pip mode...

one year ago
0 Adding

Yeap. That's an arch thing but in case of arch --gpus is not enough.
One thing though - I am running agent on behalf of a regular user.

one year ago
0 Reducing Docker Container Spin-Up Time With Clearml Agent

Hi AgitatedDove14
Thanks for the update.
Well, it's a pain... I use specifically pytorch docker image and still agent will download it?
My image is build based on FROM pytorch/pytorch:1.11.0-cuda11.3-cudnn8-devel
And a portion of agent log on top of that image:
` Package(s) not found: torch
Torch CUDA 113 download page found
Found PyTorch version torch==1.11.0 matching CUDA version 113
Package(s) not found: torchvision
Found PyTorch version torchvision==0.12.0 matching CUDA version 113
Co...

one year ago
0 Reducing Docker Container Spin-Up Time With Clearml Agent

This time it runs smoothly - here's the output:
` Local file not found [torch @ file:///home/testuser/.clearml/pip-download-cache/cu113/torch-1.11.0%2Bcu113-cp39-cp39-linux_x86_64.whl], references removed
Local file not found [torchvision @ file:///home/testuser/.clearml/pip-download-cache/cu113/torchvision-0.12.0%2Bcu113-cp39-cp39-linux_x86_64.whl], references removed
Adding venv into cache: /home/nino/.clearml/venvs-builds/3.9
Running task id [b15553c045ab4c3283bbdb040ec19f1f]:
[src/models]...

one year ago
0 Reducing Docker Container Spin-Up Time With Clearml Agent

and this is inside a container to check that package is installed:
docker run -it --rm torch2022 pip show torch
Name: torch Version: 1.11.0 Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration Home-page: Author: PyTorch Team Author-email: packages@pytorch.org License: BSD-3 Location: /opt/conda/lib/python3.8/site-packages Requires: typing_extensions Required-by: torchmetrics, pytorch-lightning, torchvision, torchtext, torchelastic
I build my own ...

one year ago
0 Reducing Docker Container Spin-Up Time With Clearml Agent

clearml-agent --version CLEARML-AGENT version 1.2.3

one year ago
one year ago
0 1St Of All I Want To Thank The Developers Team Of Clearml - You Are Awesome And So Your Product Is! I Had Some Frustration Setting Up The Stuff And Still Struggle But All In All - It'S The Best Product On The Market Of Mlops. More Of An Information Reques

Thanks Jake SuccessfulKoala55 !
I used to have problems with clearML agents and multi-GPU training with agents - have put it on hold.
Now my problem is with ClearML serving.
I have managed to run a demo https://clear.ml/docs/latest/docs/clearml_serving/clearml_serving_tutorial
But had problems :
` clearml-serving --id c605bf64db3740989afdd9bee87e6353 model add --engine sklearn --endpoint "test_model_sklearn" --preprocess "examples/sklearn/preprocess.py" --name "initial model training" --p...

one year ago
0 Upload_Artifact Not Working With Minio

Good weekend to all! Any update on this? Thanks!

one year ago
0 Upload_Artifact Not Working With Minio

Sure will do and get back to you - not that difficult.

one year ago
0 Automatic Ssh Keys Export To Agent In Docker Mode

Hi Martin.
I think a proper place would be somewhere in https://clear.ml/docs/latest/docs/clearml_agent#execution

And one more question - I have compared two docker commands - 1st without cleaning SSH_AUTH_SOCK
It's portion regarding SSH mount looks like this:
'-v', '/tmp/ssh-XXXXXXnfYTo5/agent.8946:/tmp/ssh-XXXXXXnfYTo5/agent.8946', '-e', 'SSH_AUTH_SOCK=/tmp/ssh-XXXXXXnfYTo5/agent.8946'To me all seems to be correct it maps temporary folder with ssh keys and points SSH_AUTH_SOCK to it...

one year ago
0 Correct Way To Configure Ssh Authentication For Git In Agent With Docker Mode

Hi Martin. Sorry - missed your reply.
Yeap I am aware that docker_internal_mounts is inside agent section.
Here is the actual docker command from the log
` INFO Executing: ['docker', 'run', '-t', '--gpus', '"device=0"', '-v', '/tmp/ssh-XXXXXXnfYTo5/agent.8946:/tmp/ssh-XXXXXXnfYTo5/agent.8946', '-e', 'SSH_AUTH_SOCK=/tmp/ssh-XXXXXXnfYTo5/agent.8946', '-l', 'clearml-worker-id=agent-gpu:gpu0', '-l', 'clearml-parent-worker-id=agent-gpu:gpu0', '-e', 'CLEARML_WORKER_ID=agent-gpu:gpu0', '-e', 'CLEARM...

one year ago
0 Upload_Artifact Not Working With Minio

Hi David. Sorry I got stuck with agent in docker mode training on multiple GPUs. Will get that sorted and finish that stuff with minio.

one year ago
0 Is There A Way To Use Agent For Dataset Creation Tasks?

Well actually I have tried a different approach and it works.
` task = Task.init(project_name=args['cml_project_name'],
task_type=TaskTypes.data_processing,
task_name=f'Dataset for {os.path.basename(OBJECT_NAME)}',
tags=args['cml_tags'].split(','),
output_uri = args['cml_output_uri'],
auto_connect_frameworks=True)

    dataset = Dataset.create(
        dataset_n...
one year ago
0 Upload_Artifact Not Working With Minio

Hi David,
In my case I have a remote minio with ssl enabled - do you want me to run a local one with HTTP to test if all works fine in that config?

one year ago
0 Upload_Artifact Not Working With Minio

Currently I have the following config re S3:
` aws {
s3 {
# default, used for any bucket not specified below
key: ""
secret: ""
region: ""

        credentials: [
            {
                # This will apply to all buckets in this host (unless key/value is specifically provided for a given bucket)
                host: "mydomain.com:9000"
                key: "minio"
                secret: "secret data"

...

one year ago
0 Upload_Artifact Not Working With Minio

SweetBadger76 thanks for looking into this. Here's a screenshot that displays files in clearML that should be available in minio. I can see them in clearML (I refer to this as clearML metadata) but when I press the link it redirects me to minio and shows that this file is not there. Also when I explore minio with console - I don't see those files there. But notebooks and datasets get uploaded just fine.

one year ago
0 Migration Clearml 1.5.0 -> 1.8? -> 1.9?

Made an upgrade to the latest version from 1.5 and have stumbled upon an issue with webserver:
I am saving all artefacts to a custom s3 server. Used to work fine - saving and downloading them from webserver. Now I can now download anything that resides on s3 - getting the following errors in browser console:
Unable to parse "https None " as a whatwg URL.
ERROR EndpointError: Custom endpoint https [None](//storage.yandexcloud.net) was not a valid URI

Back at 1....

one year ago
0 Migration Clearml 1.5.0 -> 1.8? -> 1.9?

Thanks @<1523701087100473344:profile|SuccessfulKoala55>
I've looked into the docker-compose and found a new image async_delete
Not sure what it does and if I should include it into upgraded installation.
If I do - there is a parameter CLEARML__services__async_urls_delete__fileserver__url_prefixes: "[${CLEARML_FILES_HOST:-}]"
I guess I should set it to fileserver in case of one docker-compose?

one year ago
0 Migration Clearml 1.5.0 -> 1.8? -> 1.9?

Thanks @<1523703436166565888:profile|DeterminedCrab71>
I've tried that - it does not work - I have a valid endpoint in settings but a missing colon in js console
Waiting for a fix 🙏
image

one year ago
0 Migration Clearml 1.5.0 -> 1.8? -> 1.9?

Hi! any update on that fix? @<1523703436166565888:profile|DeterminedCrab71>
maybe it is not present in 1.8 and will just use that version?

one year ago
0 Migration Clearml 1.5.0 -> 1.8? -> 1.9?

ClearML is awesome - all works fine now! Will test the rest.

one year ago
Show more results compactanswers