CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hi, I Have A Question About Migrating From Tensorflow 2.14 To 2.16. Up Until Now I Have Been Using

Hi @<1558986867771183104:profile|ShakyKangaroo32> , what version of clearml are you using?

one year ago

0 Hey, I Am New With Clearml And Need Some Help

Think of it this way. You have the pipeline controller which is the 'special' task that manages the logic. Then you have the pipeline steps. Both the controller and the steps need some agent to execute them. So you need an agent to execute the controller and also you need another agent to run the steps themselves.

I would suggest by clicking on 'task_one' and going into full details. My guess it is in 'enqueued' state probably to the 'default' queue.

one year ago

0 Hi, I Am Trying To Use Agent, But I Have A Problem. Execution Of Task Stucks Like This

Can you add the full log?

3 years ago

0 Hi. I'M Using Clearml To Log My Experiments. During Training, I Load Files Using Torch.Load.Clearml Displays The Following Message:

SoreDragonfly16 , let me take a look 🙂

4 years ago

0 Is There A Way To Use Agent For Dataset Creation Tasks?

GentleSwallow91 , you can also use Task.create()
https://clear.ml/docs/latest/docs/references/sdk/task#taskcreate

3 years ago

0 For Proj In Inference_Projs: Print("Getting Tasks") Tasks = Task.Get_Tasks(Project_Name=Proj['Name'])

You can do it in one API call as follows:
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all

3 years ago

0 Is There An External Way To Access Pipelinecontroller._Relaunch_Node(Node) ?

Hi @<1639799308809146368:profile|TritePigeon86> , can you please elaborate? What do you mean by external way?

one year ago

0 I Am Experiencing Performance Issues With Using Clearml Together With Pytorch Lightning Cli For Experiment Tracking. Essentially What We'Re Doing Is Fetching The Logger Object Through Task.Get_Logger() And Then Using The Reporting Methods. However, It Ad

Hi SoreHorse95 ,

Does ClearML not automatically log all outputs?

Regarding logging maybe try the following setting in ~/clearml.conf sdk.network.metrics.file_upload_threads: 16

3 years ago

0 I'M Getting This Error Across Different Machines

@<1547028079333871616:profile|IdealElephant83> , what are you trying to do during the code execution?

Is it a self hosted server?

2 years ago

0 Hi Team, I Need Some Help, I'M Working On A Pipeline And I Need To Clone A Remote Repository, Where Do I Have To Set The Credentials Of Bitbucket? Thanks A Lot For Your Help

Hi @<1668427950573228032:profile|TeenyShells80> , you would need to configure it in the clearml.conf of the machine running the clearml-agent

one year ago

0 I Am Working On Versioning My Data With Clearml-Data. I Have Clearml Server Deployed On One Machine And On Another Machine I Have My Clearml.Conf Setup To Use The Deployed Clearml Server. Also, On Both Machines I Have A Nas Storage Mounted On The Same Pat

RipeAnt6 , you have to manage your storage on the NAS yourself. We delete data only on the fileserver.

However, you could try mounting the NAS to the fileserver docker as a volume and then deletion should also handle files on the NAS 🙂

4 years ago

0 How Does One Create An Additional Workspace? I'M Already A Member Of A Workspace I Had Created. I Need Another One. How Can I Make That Happen?

Hi @<1529271098653282304:profile|WorriedRabbit94> , you can sign up with a new email

2 years ago

0 Hi, I Have An Error With Clearml-Agent 1.5.1 When Importing Tensorflow 2.10

I see, thanks for the input!

2 years ago

0 Hi, I'M Having Problems With The Installed Packages When Creating An Experiment. The Installed Packages Used To Be A List With The Versions Of All The Installed Packages In The Venv. However, Now I Get The Following:

Nope, will try with 🙂

3 years ago

0 Hey There, I Am Trying To Use A Local Docker Agent, But I Cannot Run Tasks There. Using The Bare Metal Variant With Venvs Works Fine. It Seems As The Process Cannot Proceed After Installing Clearml-Agent On The Docker Container, Because The Experiment Is

Hi @<1690896105262288896:profile|EnergeticTiger5> , can you add a full long of the run please?

one year ago

0 ..

Hi @<1539780284646428672:profile|PoisedElephant79> , please post in the same thread you started, no need to spam the main channel 🙂

Regarding your issue - it looks like you have some issue with authentication. How are you spinning the server?

2 years ago

0 What Is The Right Way To Increase Number Of Retries When Using

DilapidatedDucks58 , I think this is what you're looking for
https://github.com/allegroai/clearml/blob/master/docs/clearml.conf#L69

3 years ago

0 Hi All! Is It Possible To Initialize Multiple Tasks, Each Containing

Hi @<1874989039501709312:profile|LividDragonfly0> , you can easily achieve that with pipelines

28 days ago

0 I Have A Question Related To Pipelinev2 (Using Decorator) Is Pipelinev2 Support Uploading Artifacts To S3 (Instead Of Fileserver)?

Try configuring the following and tell me if this helps 🙂
In your ~/clearml.conf configure the following:
sdk.development.default_output_uri: "<S3_bucket>"

4 years ago

0 Hi Folks, Any Of You Has Experience In Deploying Clearml To Kubernetes Using Argocd? I Managed To Make It Run Pointing It To The Clearml-Charts-Repo, It Recognizes The Helm Chart And It Works. But I Am Struggling A Bit To Write My Own Definition To Make I

Hmmm maybe SuccessfulKoala55 can help 🙂

3 years ago

0 Two Questions Today. First, Is There Some Way To Calculate The Number Of Gpu-Hours Used For A Project? Could I Select All Experiments And Count Up The Number Of Gpu-Hours/Gpu-Weeks? I Realize I Could Do This Manually By Looking At The Gpu Utilization Grap

Ok, will do once I get back to the office, thanks for the heads up! 🙂

3 years ago

0 Hello Everyone! Does Anyone Use Pipelines? I Have The Issue With The Logger. Scenario:

SmugDolphin23 , maybe you have an idea?

3 years ago

0 Good Afternoon! Please Tell Me How To Get A List Of Tasks For The Last 24 Hours Using Task.Query_Tasks? Can This Be Done By Specifying A Specific Filter? I Looked Through The Documentation But Didn'T Find Any Explicit Mention Of It. My Attempts Were Unsu

I would suggest directly using the API for this. Then simply look at what the web UI sends as a reference 🙂

one year ago

0 Hi Everyone, I Want To Use Clearml Agent On My Remote Machine, Where I'Ve Setup My Codebase, Along With Cred Files, Dataset Dir, Dockerfile And Docker Run Script. Now I Want To Run Experiments Using Agent. How Can I Make My Agent Use These, Instead Of Clo

Did you provide an entry point?

10 months ago

0 Hi, I’Ve Recently Started Experimenting With Clearml And The Various Features It Offers. I’M Primarily Working On Creating Different Pipelines, And I’Ve Encountered An Issue I’D Appreciate Your Help With. I’Ve Noticed That, Somewhat Inconsistently, The In

Are you using a self hosted server or app.clear.ml ?

7 months ago

0 Hi, Is There A Way To Enqueue The Dataset

EnormousCormorant39 , there are SDK methods for using the datasets. I think this will simplify your process immensely.
https://clear.ml/docs/latest/docs/references/sdk/dataset

Also here is a small example for the usage 🙂
` task = Task.init(project_name="<PROJECT_NAME>", task_name="<TASK_NAME>")

#Create dataset
ds = Dataset.create(dataset_name="<DATASET_NAME>", dataset_project="PROJECT_NAME")
ds.add_files("<PATH_TO_FILE/S>")
ds.upload()
ds.finalize() `

3 years ago

0 Hi All, I'M New To Clearml, And Trying To Understand The Set_Metadata Method Of The Dataset Class. The Documentation Is Almost Non-Existent Does Anyone Have An Example Script? How Would I Add Data Using E.G. Pandas. I Assume One Column Would Relate To The

The metadata would relate to the entire dataset.

For your use case I think what's relevant is HyperDatasets

None

2 years ago

0 Hi Everyone!! Is Clearml Multi Gpu Support. I Have 2 Machines. Each Machine Have 2 A100 Gpu. Do We Have Any Option To Run Workload In These Gpu. Same Time Like Virtually. Do We Have The Support??

Hi @<1561885921379356672:profile|GorgeousPuppy74> , ClearML does support running with multiple GPUs

one year ago

0 Hi All. In Self Hosted Clearml Suddenly Scalars Stopped To Be Shown In Scalars Tab. Any Ideas?

@<1523701553372860416:profile|DrabOwl94> , I would suggest restarting the elastic container. If that doesn't help, check the ES folder permissions - maybe something changed

2 years ago

0 Hello Everyone. I Was Following The Docs About Creating Pipelines Using Decorators (As It Looked Really Neat). Everything Worked Well For My Example, But I'Ve Noticed That Much Time For Building The Container Was Taken By Installing Packages That Weren'

I was also curious if I've missed an easy way to mention required packages for the controller, like you can do that in components (by providing

packages=[...]

).

I think you can do this using https://clear.ml/docs/latest/docs/references/sdk/task#taskadd_requirements
I'm not sure how the pipeline controller is handled but it still should be regarded as a task on a deeper level.

Meaning that you might need to use task = Task.current_task() and then ` task.add_r...

3 years ago

Show more results