CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Hi, I Logged My Params To Clearml Like This:

When you want to connect your parameters and other objects. Please take as look here:
https://clear.ml/docs/latest/docs/references/sdk/task#connect
You can find a usage example in
https://github.com/allegroai/clearml/blob/master/examples/reporting/hyper_parameters.py

3 years ago

0 Does Anyone Have A Good Idea On How To Set The Correct Python Version For A Task? Apparently I Can Set It On A Task Level Or Via The Web-Interface.

Hi @<1806135344731525120:profile|GrumpyDog7> , it shows the reason in the log:

Python executable with version '3.9' requested by the Task, not found in path, using '/usr/bin/python3' (v3.12.3) instead

You either need a container with the relevant python version available or have it installed using the bash script section.

Makes sense?

6 months ago

0 I Have A Docker Container That Have Clearml-Agent Running Inside In Normal Mode. The Agent Take On A Task And Execute It Fine. I Just Want To Somehow Log The Docker Image Version That The Agent Is Running Inside. I Start My Container With Something Like:

Hi @<1576381444509405184:profile|ManiacalLizard2> , is there a specific reason you're running the agent inside a docker container instead of running the agent in docker mode which would make it spin up a container?

one year ago

0 Hi All, I'M Trying To Set Up Aws Autoscaler To Spin Up Ec2 Instances From Predefined Ami So I Was Able To Set Up The Autoscaler, But I Am Experiencing Some Issues With Spinning Up The Ec2 Instance. Seems Like It Keeps Failing (Spinning Up An Instance, The

The AMI you used, does it have python preinstalled?

7 months ago

0 Anyone Experiencing This With A Custom S3 Bucket In The Debug Samples? The S3 Configuration In The Webapp Is Correct

Please do 🙂

2 years ago

0 I Realize I'M Asking Many Niche Questions - My Apologies

SuccessfulKoala55 , is this hack applicable for most API calls in ClearML?

3 years ago

0 Hi There, I Am Intending To Work More Often With The Datasets, But Not Sure If There Is A Way To Retrieve Specific Files From A Uploaded Dataset. I Saw I Can Retrieve Chunks Of Data, But Not Sure How That Would Work With A Dataset Of Parquet Files. If I H

ShallowGoldfish8 , I think the best would be storing them as separate datasets per day and then having a "grand" dataset that includes all days and new days are being added as you go.

What do you think?

3 years ago

0 Hi, How Is The Priority Of The Configuration Like? Which One Takes Precedence? For Example, Output_Uri

HI SubstantialElk6 ,

If I'm not mistaken the order is as goes:
output_uri (Both code and CLI) Configurations vault default_output_uri in clearml.conf

2 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

but you can use it with or without K8s

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

It means you can run your code on a different machine very very easily using ClearML 🙂

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

It can run dockers and it can run over K8s

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

clearml-agent is for orchestration - remote execution. clearml is the python package you need to install and add the magic lines of code:
https://github.com/allegroai/clearml

3 years ago

0 Hi All, What Is The Best Practice To Handle Connection Errors And Timeouts To Clearml Server? Is There A Configuration In The Python Sdk For Timeouts / Max Attempts Without Interrupting The Training Session?

Hi @<1582179661935284224:profile|AbruptJellyfish92> , connectivity issues should not affect training and should cache everything until connection is restored and everything should be sent to the server. Did you encounter a different behavior?

2 years ago

0 Hi, When I Read An Argument From The Configuration Tab In The Clearml Using The

Hi,
From the looks of it, it always returns a string. What is your use case for this? Do you have some conditionality on the type of variable the parameters are?

3 years ago

0 Hi All! I Am Trying To Run The Notebook From The Remote Server Using Aws. It Seems Like I Successfully Installed Clearml Using !Pip Install Clearml Command, But When I Am Trying To Run !Clearml-Init I Got The Following Error: /Bin/Bash: Clearml-Init: Comm

Also please note that your path is wrong

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

I am not very familiar with KubeFlow but as far as I know it is mainly for orchestration whereas ClearML offers a full E2E solution 🙂

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

run on dockers - i.e. execute your code inside of a docker image

3 years ago

0 Hello Everyone, If I Use This Code, Where Is The File Downloaded To My Machine?

@<1681111528419364864:profile|SmoothGoldfish52> , it will be saved to a cache folder. Take a look at what @<1576381444509405184:profile|ManiacalLizard2> wrote. I think tar files might work already. Give it a test

one year ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

It depends on what you use K8s for

3 years ago

0 Is The

Hi WackyRabbit7 , the link seems to lead to somewhere unrelated. Can you elaborate?

2 years ago

0 Hello, I Am Using Clearml In Docker Mode. I Have A Simple Script That Runs Locally, Runs On The Target Machine Running The Same Tensorflow Container, But Doesn'T Run When I Deploy It Using Clearml. Here'S The Log Of The Error:

Just adding this here for easier readability
` ClearML results page: https:/xxxxt/projects/xxx/experimentsxxx
2022-11-21 11:02:07.590338: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-11-21 11:02:07.733169: I tensor...

2 years ago

0 Hi! I'Ve Been Trying Out The

You're getting
Syncing scheduler Failed deserializing configuration: the JSON object must be str, bytes or bytearray, not NoneTypeLike before? Are all the symptoms the same as above?

3 years ago

0 Hi! Im Trying Pipelines With Data Creating And Model Training.

Hi AbruptHedgehog21 , it looks like you need to parameters.dataset_id on step data_creation

2 years ago

You must perform Task.init() to have something reported 🙂

3 years ago

0 Hey Guys! I'M Having Some Issues With Pytorch And Clearml. I Am Starting A New Task Using Task.Create And Setting Pytorch As A Requirement Under `Packages`. For Some Reason Pytorch With Cuda 12 Is Being Installed, But I Need Cuda 11. Do You Know How To Se

I think it tries to get the latest one. Are you using the agent in docker mode? you can also control this via clearml.conf with agent.cuda_version

one year ago

0 I'M Having Trouble With Storagemanager Leaving Files In The Local Cache On The Clearml Agent Node. Somehow, These Files Are Not Cleaned Up By Storagemanager When I Try To Run New Experiments, Which Then Fail Due To Lack Of Local Storage. Archiving Old E

Hi @<1760474471606521856:profile|UptightMoth89> , I'm not sure that Task.get_task is related to the cache. Also the cache should be auto cleared by the SDK. Can you provide the full log of the experiment? What exactly are you trying to do in the code?

10 months ago

0 Hello Hello! I Recently Started Trying Out Clearml For Experiment Tracking, Thanks Devs For The Beautiful Product! I Can Across An Issue That I Couldn'T Resolve Despite Checking Documentation/Googling So Thought Would Ask Here For Help: I Am Logging Arti

Hi @<1736194481398484992:profile|MoodySeaurchin62> , how are you currently reporting it? Are you reporting iterations?

one year ago

0 I Am Trying To Run A Task That Is Completely Detached From Git - Remotely. The Script Uploads Fine But In The Ui, The Git Repo Appears As “Origin”. When The Agent Tries To Pick This Up, It Fails On Trying To Clone “Origin”. What Can I Do To Let The Agent

You mean it works that way?

3 years ago

0 Has Anyone Found A Workaround For The Bug?

BitterLeopard33 , ReassuredTiger98 , my bad. I just dug a bit in slack history, I think I got the issue mixed up with long file names 😞

Regarding http/chunking issue/solution - I can't find anything either. Maybe open a github issue / github feature request (for chunking files)