TimelyPenguin76

Administrator

0 Questions, 711 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 711

0 One More Strange Behaviour Of Clearml-Agent. Two Tasks With The Same Code (Except Usage Of Task.Execute_Remotely()) Generate Different Structure Of Output Artifacts. The Code Is A Regular Training With Keras That Includes Lines:

didn't get it, do you get the model in the task with local path?

3 years ago

0 Hi Clearml. I'M Trying To Look At Datasets Functionality (With The Help Of

Hi HelpfulHare30 ,

Is dataset a separate object that can be used within different project or it is a project part?

You can use the dataset in every project you like. Dataset task is part of a specific project, but it can be shared between projects.
dataset_folder = Dataset.get(dataset_id="dataset_id").get_local_copy()

Can I find a dataset created with cli in Web UI?

Yes. it should create a Data processing task.

Can I configure clearml to store datasets by...

3 years ago

0 Hi, Is It Possible To Delete A Parameter From A Task After It Is Connected? So Far I'Ve Tried Using Connect(...) And Set_Parameters_As_Dict() Method, But They Appear To Merge But Never Remove Parameters. Is There Another Way To Reset/Remove Parameters?

Correct 🙂

3 years ago

0 Trying To Make A Pipeline Through Pipelinecontroller But Running Into This Error: Modulenotfounderror: No Module Named 'Trains.Automation.Controller'; Has This Been Released Yet?

Hi GiddyTurkey39 , it should be released next week, I will update you on this thread once out 🙂

4 years ago

0 Hi Everyone, I’Ve Been Using Clearml For A While Now And I Wanted To Add The Option To Execute My Code Remotely As A Command Line Argument. I Have The Clearml Agents And Queues Set Up, And That Seems To Be Working Correctly (Cloning And Running Experiment

SteepDeer88 which clearml version are you using?

2 years ago

0 Hi, When I Use The Slack Monitoring Service It Creates A Link With

👍
let me check

4 years ago

0 Hi! I Changed From Trains To Clearml And Ran Some Experiments Using Keras But It Seems The Metrics Are Not Being Tracked Automagically, Has Anyone Ran Into The Same Issue? I Can Even See The Metrics On The Progress Bar During The Fit Process.

Hi GrievingTurkey78 ,

Can you try running https://github.com/allegroai/clearml/blob/master/examples/frameworks/keras/keras_tensorboard.py example? do you get metrics with it?

4 years ago

0 Hi, It Seems That Report_Image Puts The Image Both In Plots And Both In Debug Samples, Why Is That?

Hi SmarmySeaurchin8

I tried to reproduce your issue (run https://github.com/allegroai/trains/blob/master/examples/reporting/image_reporting.py example with many report_image calls) and got all the outputs in the debug samples section, can you share a snippet or how can I reproduce this issue?

4 years ago

0 Hi, It Seems That Report_Image Puts The Image Both In Plots And Both In Debug Samples, Why Is That?

Can you try it?

4 years ago

0 Another Question On The Topic Of How A Remote Execution Of A Pipeline Kills The Calling Process (Previously Discussed

👍

What if (I were able to iterate and) I wanted the pipelines calls to be blocking so that the next pipeline executes only after the previous one completes

You can have parents as one of the @PipelineDecorator.component args. The step will be executed only after all the parents are executed and completed

2 years ago

0 Hi, I'M Using Clearml Python Package On Sagemaker Notebook Instance. If I Want To Edit The Clearml.Conf On The Notebook Instance, How Could I Do That?

SquareFish25 Still on it 🤞

4 years ago

0 Hello, I Am Starting To Use Clearml And Would Like To Deactivate The Detection Of A Git Repository. The Reason Is That The Repository Is Currently Only On My Local Machine And There Is No Remote To Check Out On The Worker Machines. The Error I Am Getting

or do you mean this by your note? i.e. leaving the execution parts empty.

yep 🙂

Currently, when ClearML detect a .git file, it will store your running script as part of your git repo. The workaround to store the whole script as a standalone is just like you did (or to run it outside of the repo).
We currently don’t have such an option to store the script as a standalone, but this could be a useful feature.

Can you add a new https://github.com/allegroai/clearml/issues issue...

3 years ago

0 Hi, When I Create A Task Using

Hi TrickyFox41 , does you script contains hydra integration? do you import hydra? using some configuration file?

2 years ago

0 I’Ve Played Around With Clearml Data And Spotted Sth Weird Basically, I’Ve Created 3 Datasets

Hi GrittyKangaroo27

did you also closed the dataset?
Can you attach the commands with the order of all the datasets?

3 years ago

0 Hi! Using Pytorchlightning. How Do I Define The Names Of The Plots In The Legend?

Hi SuperficialDolphin93 ,

Can you share a small code example for you reporting?

About many series in the same plot, you can change this view with Group by None

3 years ago

0 Hi Everyone, I Am Trying To Use Docker Mode For Trains-Agent, But It Seems That It Has Problem With The Use Of Multiple Gpus This Is My Trains-Agent Command: Trains-Agent Daemon --Gpus 0,1 --Queue Dual_Gpu --Docker --Foreground And It Gets The Error: Doc

You can try running the trains-agent with --gpus all if you have two gpus on your machine.

The flag --gpus all is used to assign all available gpus to the docker container.

Did you get the same error message? What do you have in the error under ‘device=XXX’?

What is the OS / docker / Nvidia drivers you have on the machine?

4 years ago

0 Hi, I Attached An Iam Role To An Ec2 Instance To Grant Access To An S3 Bucket. The Ec2 Instance Is Running A Clearml-Agent (V1.1.0). I Didn’T Specify Any Key/Secret For Clearml. The Tasks Fail With The Following Error:

This seems to be the same issue like in https://clearml.slack.com/archives/CTK20V944/p1633599511350600

Whats the pyjwt version you are using?

3 years ago

0 Hi, I'M Having Trouble Creating My Experiment Environment In The Clearml-Agent Worker. I Have A Set Of Dependencies Which Are Hard To Setup, So I Opted To Work In Docker Mode. My Image Contains The Python Virtualenv Needed For My Experiments, But Clearml

Currently the agent create venv when you start it, but system_site_packages should install the packages from the docker

3 years ago

0 Hi. I'D Like To Try The Gcp Autoscaler.

Will check now and will send you the machine image + full configuration I used

Machine image: projects/ubuntu-os-cloud/global/images/ubuntu-1804-bionic-v20220131

Extra vm bash script:
sudo apt install apt-transport-https ca-certificates curl software-properties-common -y curl -fsSL | sudo apt-key add - sudo add-apt-repository "deb [arch=amd64] lsb_release -cstest" sudo apt update sudo apt install docker-ce -y

2 years ago

0 I'M Looking To Utilize The Trains Aws Autoscaler Functionality, But After Going Through Its Docs A Few Times I Still Don'T Get It. Ultimately, My Setup Is That I Have Multiple Data Scientists Working On Static Instances, And They Have Queues Available To

permission management

Same as your aws credentials

4 years ago

0 Hi All. I'M Having Some Issues Authenticating With Clearml In Google Colab. Here'S What I Did Locally, Which Worked:

can you try with

import os os.environ["CLEARML_CONFIG_FILE"] = "/root/clearml.conf"at the top?

3 years ago

Show more results