CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Im Trying To Run This Exmple :

It looks as it is running, did the status of the experiment change?

3 years ago

0 Hello Everyone! I Launched An Ec2 Instance That'S Free Tier (

CluelessElephant89 , I think the RAM requirements for elastic might be 2GB, you can try the following hack so it maybe will work.

In the machine that it's running on there should be a docker-compose.yml file (I'm guessing at home directory).

For the following https://github.com/allegroai/clearml-server/blob/master/docker/docker-compose.yml#L41 you can try changing it to ES_JAVA_OPTS: -Xms1g -Xmx1g and this might limit the elastic memory to 1 gb, however please note this might ...

3 years ago

0 All Of Our Users Suddenly Cant Log In. We Get 401, Existing Logged Users Are Fine, But Once Logged Out Cant Log Back In. Here Is What Webserver Says In Logs:

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , what version is your server? Can you provide logs from the apiserver container?

one year ago

0 Hi, Guys! How Do You Keep Your Secrets (User, Password, Host And So On For Data Base, For Example)? I Mean Remote Experiments With Clearml. I Think There Is Two Ways: 1. Use Argparse (Or Hydra) 2. Download Them From S3 As Txt File And Parse It. What Is

SharpHedgehog60 hi!

All passwords/secrets can be kept in ~/clearml.conf on the relevant machine.

Is this what you meant?

3 years ago

0 Hello Everyone! I Launched An Ec2 Instance That'S Free Tier (

CluelessElephant89 , the relevant command should be something of the sort sudo docker logs clearml-apiserver

3 years ago

0 Hello! Is It Possible To Use S3 Backblaze With Clearml? Can I Use The Aws Section For That Settings? Or Another Section In Clearml.Conf Corresponding To Backblaze Would Work? Or There Is No Way To Use Backblaze In This Case At All?

Try removing the region, it might be confusing it

8 months ago

0 I Am Working On Versioning My Data With Clearml-Data. I Have Clearml Server Deployed On One Machine And On Another Machine I Have My Clearml.Conf Setup To Use The Deployed Clearml Server. Also, On Both Machines I Have A Nas Storage Mounted On The Same Pat

Please note that this configuration is on the client side, not the clearml server side 🙂

3 years ago

0 When Saving The Model, There'S A Label Tab But It'S Empty.

VexedCat68 , You can add labels to your model to keep track of what each model ID means (for example cat=1, dog=2). Please take a look here 🙂
https://github.com/allegroai/clearml/blob/master/examples/reporting/model_config.py#L41

3 years ago

0 Hello, Where Are Projects And Logging File Saved Default? Are They Saved In Fileserver? Then What Is The Exact Path?

Hi @<1524922424720625664:profile|TartLeopard58> , projects and many other internals like tasks are all saved in internal databases of the ClearML server, specifically in mongo & elastic

2 years ago

0 Hey, Guys! I Have A Problem. I Launched Clearml Server And Trying To Run A Worker On Another Machine. When I Run

What version of clearml and clearml-agent are you using, what OS? Can you add the line you're running for the agent?

2 years ago

0 Hi Guys, I Have Been Pondering How Does Clearml Generate The "Installed Packages" List. I Triggered My Training Through Machine A (With Some Python Packages) And The Actual Training Is Done In A Docker Container (With Both Global Packages + Packages Insta

Can you please give an example?

3 years ago

0 Hi, I Am Having Difficulties When Using The Dataset Functionality. I Am Trying To Create A Dataset With The Following Simple Code:

Also, can you try with dataset.upload(output_url="/home/user/server_local_storage/clearml_training_dataset/")

(note the added '/' at the end of the line)

3 years ago

0 Hi All, Any Idea Why Spawned Trainings During Optimization Can End With The Following Message

CurvedHedgehog15 , isn't the original experiment you selected to run against is the basic benchmark?

3 years ago

0 Hello, Where Are Projects And Logging File Saved Default? Are They Saved In Fileserver? Then What Is The Exact Path?

Yep 🙂

2 years ago

0 Hey, While Trying To Run A Pipeline With The Pipelinedecorator Scheme, I Encounter The Following Error: Traceback (Most Recent Call Last): File "C:\Users\*****\Documents\*****\\*****\Mlops\Tasks\Preprocessing\Insert_Missing_Rows_Based_On_Stock.Py", Lin

Hi @<1544853695869489152:profile|NonchalantOx99> , as the error states:

    raise ValueError('Could not find queue named "{}"'.format(queue_name))
ValueError: Could not find queue named "services"

It couldn't find the queue services. This is for the pipeline controller to run on. Pipelines consist of steps and the controller and they all can run on different machines. By default, the controller will try to run on the services queue. Makes sense? 🙂

2 years ago

0 Hello Everyone, I Need A Clarity In Clearml Serving, I Have Deployed The Clearml Serving In Docker With Proper Envs Created Model And Saved In Clearml Dashboard (Server) Then Using Clearml-Serving Model Add Created Endpoint But The Endpoint Is Not Liste

Next release of clearml-serving , correct

5 months ago

0 Is There Any Way To: Within The Ui, Select And Compare The Scalars For More Than 10 Experiments? I'D Like To Do Something Like:

SmallDeer34 Hi! 🙂

I'm afraid that currently we support only up to 10 experiments in comparison at once. However you can add/remove experiments mid comparison. Is there a specific reason why you'd need to compare specifically 20?

Regarding the coloring, if you do 5/5 it would be supported.

3 years ago

0 Hello I Wanted To Set Up My Clearml Server Locally, Is It Normal That The Webpage On

It looks that ES is unable to write to the volume that you provided.

Did you provide access to the folder where ES is trying to write? On what OS are you running the server?

2 months ago

0 Hi! We Are Trying To Upload Datasets To Clearml From Redshift. Is There Any Direct Integration Between With Redshift? We Would Like To Avoid Downloading The Whole Dataset And Uploading It Every Time. Thank You!

Hi @<1617693654191706112:profile|HelpfulMosquito8> , can you please elaborate? Did you self deploy on Redshift? I don't think it really matters. What is the workflow you're trying to achieve?

one year ago

0 Hi! For

How about this by the way?
https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel#outputmodelset_default_upload_uri

3 years ago

0 Hello Community, I'M Planning To Deploy A Self-Hosted Clearml Server On Aws. Our Usage Pattern Is To Run It Intensively Once A Week, With A Few Additional Sessions During The Week To Review Results And Navigate The Ui. I Noticed Clearml Offers A Custom Am

Hi @<1717350332247314432:profile|WittySeal70> , just to clarify, are you talking about the ClearML server itself or about agents?

From my understanding the AMI is simply an image with the ClearML server preloaded to it.

7 months ago

0 Hello We Are Using Enterprise Version And The Question Is About The Agents And The Queues We Know That We Can Configure Container Image At The Agent Level This Means That Agent Will Use This Base Image To Spawn New Pods Can We Also Configure Container

Hi @<1800699527066292224:profile|SucculentKitten7> , you can control the docker image on the task level, either through the code ( Task.set_base_docker ) or through the webUI in the 'execution' section of the task

7 months ago

0 I Have A Question About Accessing The Parameters From Hydra Omegaconfig. I Am Trying To Follow The Hyperparam Optimization Example, And There It Is Written

YummyLion54 , please try the following:

` from clearml import Task

base_task = Task.get_task(task_id="base task id")
cloned_task = Task.clone(source_task=base_task)
cloned_task.connect_configuration(name="OmegaConf", configuration="path/to/conf/file") `

3 years ago

0 Ist It Possible To Move Artifacts From Local Storage To S3? Or Do I Have To Delete The Old One And Create A New One With A Location In S3?

You would also need to edit the links somehow that are connected to the task

3 years ago

0 Hi Everyone!. I Was Trying To Setup Clearml In Kubernetes Using Helm Chart

It seems that the SDK can't reach the API server. Are you seeing anything in the API server logs? Is it possible you're being blocked by an internal firewall?

one year ago

0 Hello! My Workers Utilization Is Empty And Not Showing Any Graphs. Do You Know How I Can Troubleshoot This?

What version is the server? Do you see any errors in the API server or webserver containers?

one year ago

0 Hi Everyone! Is There A Way To Store Env_Vars Or Secrets In Clearml When We Use Remote Agent To Run The Task? Actually I Have Too Many Envs That Are Confidential.

and also take a look into development.apply_environment

one year ago

0 Hi Again, I Am Trying To Create A Docker For My Training, I Would Like To Know How Can I Control The Docker Launch Command, For Example To:

Hi @<1708653001188577280:profile|QuaintOwl32> , you can control all of this on the task level. For example through code you can use Task.set_base_docker - None

You can add all of these as arguments

one year ago

0 Hi. I'M Using Clearml To Log My Experiments. During Training, I Load Files Using Torch.Load.Clearml Displays The Following Message:

SoreDragonfly16 , let me take a look 🙂

4 years ago

0 Hi, Are There Any Plans Or Already Ways To Deploy A Pipeline With Clearml-Serving To Triton? I Would Also Be Interested In The Support Of Deploying Pure Python Models Using The New Python_Backend Of Triton.

ClumsyElephant70 , I understand it's possible to already combine python and Triton, however it is quite difficult to do and requires a lot of work.

We're working on making ClearML-Serving easier to use and this is one of our next plans in the to do list.

We hoped to release it earlier but got caught with some other pressing issues we had to take care of.

So to sum up the long answer, yes, it is in our plans and will be supported eventually 🙂

3 years ago

Show more results