Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
SubstantialElk6
Moderator
115 Questions, 310 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

282 × Eureka!
0 Votes
4 Answers
638 Views
0 Votes 4 Answers 638 Views
Hi, I'm running clearml agents via K8s glue. I noticed that the agent is not pulling latest images even though docker_force_pull is set to true. A kubectl de...
2 years ago
0 Votes
0 Answers
154 Views
0 Votes 0 Answers 154 Views
Hi, is there a way to export ClearML experiments into a file package and import them on another ClearML instance?
3 months ago
0 Votes
2 Answers
819 Views
0 Votes 2 Answers 819 Views
Hi, i have a scenario where when the code is run remotely via clearml-agent, the code appears to get stuck at task.init() . It seems to only affect the attac...
one year ago
0 Votes
2 Answers
745 Views
0 Votes 2 Answers 745 Views
one year ago
0 Votes
7 Answers
592 Views
0 Votes 7 Answers 592 Views
2 years ago
0 Votes
16 Answers
693 Views
0 Votes 16 Answers 693 Views
Hi, we recently upgraded clearml to 1.1.1-135 . 1.1.1 . 2.14. The task init is task=Task.init(project_name='myproject', task_name='mytask', output_uri=' s3:/...
aws
2 years ago
0 Votes
10 Answers
591 Views
0 Votes 10 Answers 591 Views
Hi, we are using GitLab and it is a security requirement to use ssh keys to access the repos for each individual. We are also using k8s glue. Is there any pr...
2 years ago
0 Votes
8 Answers
754 Views
0 Votes 8 Answers 754 Views
Hi, I've a few questions on clearml-session. We will be running some GUI applications so is it possible to forward the GUI to the clearml-session? We have a ...
2 years ago
0 Votes
7 Answers
600 Views
0 Votes 7 Answers 600 Views
Hi, i would like to understand more on how ClearML deal with codes. I noticed that i am able to read the source codes of the python script that i have used a...
3 years ago
0 Votes
0 Answers
552 Views
0 Votes 0 Answers 552 Views
Hi, we are encountering an increasing number of cases where it takes quite a while before actual training (GPU utilisation) can be done. After observing, thi...
one year ago
0 Votes
1 Answers
623 Views
0 Votes 1 Answers 623 Views
Hi, is there a pdf version of your documentation at https://clear.ml/docs/latest/docs ? We work mostly in an offline environment and would benefit from this ...
2 years ago
0 Votes
1 Answers
536 Views
0 Votes 1 Answers 536 Views
ClearML is distinctly missing in the curated MLOps landscape. Https://mad.firstmark.com
one year ago
0 Votes
3 Answers
654 Views
0 Votes 3 Answers 654 Views
one year ago
0 Votes
6 Answers
641 Views
0 Votes 6 Answers 641 Views
Hi, i notice a new behavuour with clearml-agent=1.1.0. When it is installing the packages i nrequirements.txt, it failed with. clearml_agent: ERROR: HTTPSCOn...
2 years ago
0 Votes
2 Answers
704 Views
0 Votes 2 Answers 704 Views
Hi i saw this announcement from NVIDIA on TAO's integration with ClearML. How can we use it?
one year ago
0 Votes
4 Answers
658 Views
0 Votes 4 Answers 658 Views
Hi recently upgraded all the clearml, clearml-server, clearml-agent. Now running k8s glue with clearml-agent=1.0.1rc1. python3 k8s_glue_example.py --queue 1b...
2 years ago
0 Votes
30 Answers
679 Views
0 Votes 30 Answers 679 Views
Hi, i'm getting this long error when running task.execute_remotely(queue_name="1gpu", exit_process=True) . I also notices an error Failed to fetching activit...
3 years ago
0 Votes
6 Answers
627 Views
0 Votes 6 Answers 627 Views
2 years ago
0 Votes
2 Answers
604 Views
0 Votes 2 Answers 604 Views
3 years ago
0 Votes
5 Answers
696 Views
0 Votes 5 Answers 696 Views
Hi, i'm running the following and encountering some SSL errors. SSL_CERT_FILE=ca.crt clearml-data upload --id 12314jhg42342j4j --storage clearml.storage - ER...
2 years ago
0 Votes
0 Answers
624 Views
0 Votes 0 Answers 624 Views
Hi, we are working on a mini project to 'integrate' ClearML Datasets with CKAN. Wondering if the community could share some ideas.
one year ago
0 Votes
1 Answers
592 Views
0 Votes 1 Answers 592 Views
Hi, can you run clearml experiments on docker images that does not have root?
one year ago
0 Votes
2 Answers
720 Views
0 Votes 2 Answers 720 Views
one year ago
0 Votes
3 Answers
640 Views
0 Votes 3 Answers 640 Views
Hi, I've multiple tasks setup in a complex pipeline. How can I; Define prior to running the pipeline, which tasks to be running on which remote queue using w...
2 years ago
0 Votes
4 Answers
610 Views
0 Votes 4 Answers 610 Views
Hi, i would like to start logging how often my users uses ClearML. How might i query this kind of information?
2 years ago
0 Votes
5 Answers
677 Views
0 Votes 5 Answers 677 Views
2 years ago
0 Votes
8 Answers
602 Views
0 Votes 8 Answers 602 Views
I just getting this in my agent run task. Would appreciate if someone can advise where i externalrequirement is pointing at. RequirementsManager handler rais...
3 years ago
0 Votes
4 Answers
686 Views
0 Votes 4 Answers 686 Views
Hi, i am trying to understand clearml-data and only found this piece of article explaining it. https://github.com/allegroai/clearml/blob/master/docs/datasets...
3 years ago
0 Votes
3 Answers
638 Views
0 Votes 3 Answers 638 Views
3 years ago
0 Votes
2 Answers
578 Views
0 Votes 2 Answers 578 Views
Hi, we have been using ClearML in our development environment to train our models and benchmarking them. I was wondering what is ClearML's role in transition...
3 years ago
Show more results questions
0 I Am Facing This Error While Trying To Run My Code

I'm having the same problem. You using latest clearmagent? Is your docker image a root user by default?

one year ago
0 Hi, Can I Ask How I Can Make Clearml-Datasets In Comparison With Pytorch Datasets/Dataloader? In Particular, Pytorch Dataloaders Would Be Able To Batch Pull And Then Preprocess Data Using Multi-Cpus, Feed It Into The Training Loop And Achieve As High Util

Thanks CostlyOstrich36 , how do i know how is the parts indexed in the first place? Or rather, how is chunk and parts defined? Say in the context of images, videos, text documents...etc.

2 years ago
0 Prev, I Worked With Clearml (1 Year Back) And Back Then, We Config Seldon Core For The Deployment And Clearml For The Training.. Now There Is Clearml-Serving, Does It And Can It Fulfill A Similar Objective ?

Hi, by deployment strategies I meant by canary, blue-green...etc..etc. I figured this should be done by clearml-serving and maybe seldon as well.

2 years ago
0 Hi We Have Had Some Crashes On Clearml Server And It Was Caused By Clearml Uploading The Models Into Clearml Server (By Default). Is It Possible To Have An Overriding Config So Clients Can Never Upload To Clearml Server Itself As Default?

Hi SuccessfulKoala55 , would they need the fileserver to route to minio then? E.g.

This will ensure that any actions by clearml-data and models are saved into the S3 object store.
api {
files_server: s3://ecs.ai:80/clearml-data/default
}

aws {
s3 {
credentials {
host: http://ecs.ai:80
## Insert the iam credentials provided by your SAs here.
}
}
}

But if user forgot to do above, they will be saved on ClearML server. If I switch off f...

2 years ago
0 Hi, I Would Like To Ask Around If Anyone Has Following Languages Working With Clearml? It Can Be Direct From Clearml Sdk Or Via Any Indirect Method.

Hi, currently the ClearML SDK only supports python. If i want to run my ML in other languages, can i use a SDK in that language? Or is there other means such as a Web API calls that does the same as the SDK?

2 years ago
0 Hi

Hi i missed this. Is there a recording?

2 years ago
0 Hi

Thanks. Which brings me to the question. How does ClearML deal with all the CVEs? What is your process for response?

2 years ago
0 Hi, The `

ah thanks. Hopefully the old ones get flushed out by Google soon.

2 years ago
0 Hi, We Are Using Gitlab And It Is A Security Requirement To Use Ssh Keys To Access The Repos For Each Individual. We Are Also Using K8S Glue. Is There Any Provisions To Do This Seamlessly?

Thanks SuccessfulKoala55 . I can try my hand on a patch. But the pod spinning is handled by the k8s glue, which has no link to the client side. How should the client pass the key over to k8s glue during runtime via clearml server?

2 years ago
0 Hi, V1 Of Agent Seems To Have Removed Agent.Package_Manager.Force_Repo_Requirements_Txt. Is This Still Available In Other Forms?

yup. in this case it wasn't root. Removing that USER and -u in pip solves the problem. However, in our production images, we are required to remove root access.
` FROM nvidia/cuda:10.1-cudnn7-devel

ENV DEBIAN_FRONTEND noninteractive
RUN apt-get update && apt-get install -y
python3-opencv ca-certificates python3-dev git wget sudo ninja-build
RUN ln -sv /usr/bin/python3 /usr/bin/python

create a non-root user

ARG USER_ID=1000
RUN useradd -m --no-log-init --system --uid ${USER_ID} a...

3 years ago
0 Hi, I Started My Agent Using. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground, With The Following Parameters In Clearml.Conf.

Hi, the problem is the same.

I noticed that its not checking out the latest version in gitlab. This latest version would contain the requirements.txt.
Using cached repository in "/root/.clearml/vcs-cache/pytorchmnist.f220373e7227ec760b28c7f4cd99b534/pytorchmnist" warning: redirecting to Note: checking out 'cfb833bcc70f3e10d3b6a96cfad3225ed682382b'.But i'm guessing this block below applied the diff..does it include the requirements.txt though?
` HEAD is now at cfb833b Upload New Fil...

3 years ago
0 Hi, How Can I Pass A Env Variable To The Docker That'S Running The Agent When I Run This? I'M Havving Issues With The Agent'S Git Clone Where It Requires Sslverification To Be Disabled. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground

After some churning, this is the answer. Change it in the clearml-agent init generated clearml.conf.

` default_docker: {
    # default docker image to use when running in docker mode
    image: "nvidia/cuda:10.1-runtime-ubuntu18.04"

    # optional arguments to pass to docker image
    # arguments: ["--ipc=host", ]
    arguments: ["--env GIT_SSL_NO_VERIFY=true",]
  } `

3 years ago
0 Hi Recently Upgraded All The Clearml, Clearml-Server, Clearml-Agent. Now Running K8S Glue With Clearml-Agent=1.0.1Rc1.

Ok thanks, looking forward to it. Would you advise on the bug you encountered?

2 years ago
0 Hi, Is There A Command I Can Use To Generate A Report That Can

Can i dig into the mongodb or ES to pull these data?

2 years ago
0 Hi, I Have Been Getting The Following For A While. Is There A More Detailed Log I Can Look Into? This Happens On Both Https And Http.

i see. Can i take it that when the client uses
task.execute_remotely(queue_name="1gpu", exit_process=True)then none of the content in its clearml.conf will be used, except for the API part. And Clearml simply uses whatever is on the Agent side.
api { # Notice: 'host' is the api server (default port 8008), not the web server. api_server: web_server: files_server: # Credentials are generated using the webapp, `
# Override with os environment: ...

2 years ago
0 Hi, I Have Been Getting The Following For A While. Is There A More Detailed Log I Can Look Into? This Happens On Both Https And Http.

Hi SuccessfulKoala55 , just to add, my clearml.conf (client) and clearml.agent.conf (agent) can have differing values. I'm not sure which one takes precedence and if this could be the cause.

2 years ago
0 Hi, I Have Been Getting The Following For A While. Is There A More Detailed Log I Can Look Into? This Happens On Both Https And Http.

yes its on purpose, each user would have their own AWS credentials for default_output_uri.

2 years ago
0 Hi, I Have Been Getting The Following For A While. Is There A More Detailed Log I Can Look Into? This Happens On Both Https And Http.

Do you have more info on vault?
Actually it only make sense if the entire department or organisation are saving their models in a common repo. In our case this is not possible due to client security (e.g. training data from clients can potentially be 'reverse engineered' from trained models in future). So each department and even projects will need their own repo.

2 years ago
0 Hi, Can I Default The Clearml Fileserver To A S3 Path?

In the ClearML config that's being run by the ClearML container?

2 years ago
0 Hi, I Have Been Getting The Following For A While. Is There A More Detailed Log I Can Look Into? This Happens On Both Https And Http.

Hi, we are still not getting the model repo to work, mainly due to clearml.storage failing to save the models.
We tried a vanilla boto3 code and it works, but we can't figure out why we get connectionreseterror 104 when clearml does it.

How do we configure clearml in correspondence to following boto code?

S3= boto3.resource('s3', endpoint_url=' https://ecs.ai ', aws_access_key_id='mykey', aws_secret_access_key='mysevret', config=Config(signature_version='s3v4'), region_name='us-east-1', ve...

2 years ago
0 Hi, I Have Been Getting The Following For A While. Is There A More Detailed Log I Can Look Into? This Happens On Both Https And Http.

Hi.

We tried as advised above and it still didn't work.
Host: http://ecs.ai:443
output_uri = S3://ecs.ai:443/bucketname

This time round the client gave this error.
Botocore.exceptions.connectiinclosederror: connection was closed before we received a valid response from endpoint URL: ' http://ecs.ai/bucketname/.clearml.test '.

It's quite apparent that whatever clearml passed to boto3 ends up as a http call instead of https, which is wrong.

2 years ago
0 Hi, Can I Default A Docker Image When Running A Pipeline? I Currently Set It As

Hi CostlyOstrich36 , What you described is task. I was referring to the pipeline controller.

one year ago
0 Hi, Clearml Console Leaks Credentials Passed In As Env Vars. The Issue Remains With Clearml Version==1.1.1.135 - 1.1.1 - 2.1.4 (As Listed On The Profile Page) I Am Using K8S Glue And The Clearml.Conf Has The Following In The Agent Section.

I also see this on my logs, noting that the config is read in but its still printing the supposedly hidden keys on the logs and UI.
agent.hide_docker_command_env_vars.enabled = true agent.hide_docker_command_env_vars.extra_keys.0='TRAINS_AGENT_GIT_USER' ..... docker_cmd=harbor.ai/public/detectron2:v3 --env TRAINS_AGENT_GIT_USER=gituser

2 years ago
Show more results compactanswers