CostlyOstrich36

0 Questions, 4173 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4173

0 Hello All, I'M Trying To Adapt Clearml With My Workflow. I Installed A Server At My Server, With Workers Attached To It. I'M Trying To Execute A Task From My Local Within One Of My Workers. Trying To Use Docker Mode And A Custom Image. I Also Have A Local

Can you also try specifying the branch/commit?

3 years ago

0 Hello Everyone, Is There A Way To Download The Clearml Documentation Without Having To Scrape The Pages? Thank You Very Much.

Hi @<1669152726245707776:profile|ManiacalParrot65> , you can find the full documentation here - None

one year ago

0 Is There Any Way To Change The X-Axis On The Charts For Scalars, To Say E.G. "Epochs" Instead Of "Iterations"? Or Is That Hardcoded?

I'm not sure. Maybe @<1523703436166565888:profile|DeterminedCrab71> might have some input

2 years ago

0 Hi, Does Anyone Faced This Problem? I'M Trying To Run A Task From A Queue. The Same Task Is Running Locally Just Fine. Moreover, I Have An Experience Running Large Scale Of Experiments From Clearml'S Queues, This Problem Is New. After Setting The Env, I G

Hi @<1531807732334596096:profile|ObliviousClams17> , are you self deployed? Can you please provide the full log?

What happens if you clear the commit and just run with latest master?

one year ago

0 Hi Everyone! I Am Using Clearml Pipeline For Retraining Purpose, I Just Want To Ask Why Model From Retraining Process Is Stored Under Project "Project_Name/.Pipeline/Pipeline_Name" ? How Do I Make It To Store The Model To "Project_Name" Instead Of "Proje

Hi @<1750689997440159744:profile|ShinyPanda97> , I think you can simply move the model to a different project as part of the pipeline

11 months ago

0 Hi Everyone, I Noticed That Es Database Of My Local Server Instance Is Taking Up Huge Amount Of Ram (>32Gb Ram Usage For A ~80Gb Disk Space). There Is Enough Memory But I Also Run An Agent Instance On The Same Machine And Don'T Want To Dedicate That Much

Hi @<1547028074090991616:profile|ShaggySwan64> , You can try this. However, Elastic takes space according to the amount of metrics you're saving. Clearing some older experiments would free up space. What do you think?

8 months ago

0 `I'M Attempting My First Project In Clearml And Have A Few Questions. I'M Migrating My Video Encoding Pipeline In Python3.12 To Clearml Using The Decorators.: @Pipelinedecorator.Pipeline( Name="Run Video Encoder Pipeline", Project="Video Encoder

You need the agents to run the various pipeline steps + controllers

6 months ago

0 Hello, We Have A Private Clearml Server For Our Organization, So When I Try To Connect The Google-Collab With The Server, It Needs To Be Fixed. It Refuses To Connect, And Shows Some Errors. But I Could Connect My Private Account To The Clearml Server With

Hi @<1533619734988197888:profile|DistressedSquid12> , what errors are you getting? How are you trying to connect it?

2 years ago

0 Is This The Write Way To Add A Tag To An Output Model Artifact Of A Task? Torch.Save(Model, '

Please try like this model.tags=['Test'] and not with append

3 years ago

0 Hey All, We Have Clearml Running On Our K8S On Prem With 4 Worker Nodes For Clearml-Agents And One Node For Clearml-Server. We Would Like To Start Using Clearml Datasets And Running Pipelineg Training On It. The Datasets Might Be Very Large, About 20G. I

Hi @<1726047624538099712:profile|WorriedSwan6> , to answer your questions:

Would you recommend to:

Host the dataset on clearml-server ?
Host on S3 \ R2 ?
Host in our K8S with minio \ on specific NFS path?

I personally like using AWS S3 if available or minio if running locally. It really depends on your infrastructure. I would suggest testing what setup works best for you.

Also, is it true unless streaming is explicitly enabled, ClearML Agent downloads the entire dataset befo...

3 months ago

0 Hi All, I Was Using The Cleaning Script, But It'S (I Think The Elasticsearch, Since It'S A Java Process) Consuming A Lot Of Memory. So Much That It'S Blocking The Server'S Access. The Cleaning Script Is Running On The Services Queue On The Server. Can I R

I think in venv mode you cannot limit memory usage but with containers you can limit memory usage

7 months ago

0 I Am Using Clearml Pro And Pretty Regularly I Will Restart An Experiment And Nothing Will Get Logged To Clearml. It Shows The Experiment Running (For Days) And It'S Running Fine On The Pc But No Scalers Or Debug Samples Are Shown. How Do We Troubleshoot T

My bad, if you set auto_connect_streams to false, you basically disable the console logging... Please see the documentation:

auto_connect_streams (Union[bool, Mapping[str, bool]]) – Control the automatic logging of stdout and stderr.

one year ago

0 To Be Specific, In My Base Task, The Parameters That I Want To Optimize On Appear Under Hyperparameters/General. However When I Execute The Optimization Task, I Get An Error That "Could Not Find Requested Hyper-Parameters"

Hi @<1714813627506102272:profile|CheekyDolphin49> , how are you setting the parameter in the HPO?

one year ago

0 Does Anyone Know How To Setup “Web App Cloud Access” For Non-Aws Cloud Providers? Setting All The Fields “Bucket”, “Key”, “Secret”, “Aws Region” And “Host Endpoint” Has No Effect. Thus, Everytime An Experiment Is Deleted, Clearml Says That Artifacts Were

Hi SpotlessPenguin79 , can you please elaborate on this?

for non-aws cloud providers?

What exactly are you trying to do?

3 years ago

0 Dear Clearml Team! I Have Experiments Running With Your Tool, And Displaying Images In The "Debug Samples" Section. After Few Iteration, It Stopped Showing Images, And Showed A Broken Image Icon Saying "Unable To Load Image Binary%20Preds_Sample_0_0000005

BoredPigeon26 , when you copy and paste the link provided to you by the UI into the browser, can you see the image?

3 years ago

0 Hi There, I'M Trying To Set Default Aws Storage Credentials But Keep Getting An Error. I Tried To Fill In The Default Storage As Well As The Bucket Specific Credentials. Note That Adding Config In The "Confuguration Tab" Under User Settings Works Though.

Please see the relevant docks. Also for the update failures, can you open Developer tools (F12) and see what you get in the network for the failed API Calls?

6 months ago

0 Hi All I Am Would Like To Somehow Prevent Clearml Caching From Caching A Task That Hasn'T Uploaded Artifacts (Using Cache_Executed_Step In

Hi @<1533619716533260288:profile|SmallPigeon24> , can you please elaborate on your usecase ?

one year ago

0 Hi. Executing Reports I Noticed Quadruple, Identically Rendered Results. Does Anybody Know A Solution? E.G.

@<1543766544847212544:profile|SorePelican79> , what version of the SDK are you using? Also, what version of the backend are you running?

one year ago

0 Hello Everyone! Does Anyone Use Pipelines? I Have The Issue With The Logger. Scenario:

Hi GrotesqueDog77 ,

Can you please add a small code snippet of this behavior? Is there a reason you're not reporting this from within the task itself or to the controller?

2 years ago

0 Hello, I See There Are Two Different Classes For Clearml-Dataset I.E. Dataset And Datasetversion. May I Know Why There Is A Need For Both When There Are Large Overlaps Between Them.

Hi OddShrimp85 ,

Please note that Datasets in this context are part of the HyperDatasets feature. This is an advanced feature for managing unstructured data. So in context of HyperDatasets, a Dataset is a collection of DatasetVersions that are structured by some logic within.

2 years ago

Hi @<1577468611524562944:profile|MagnificentBear85> , are you running the services agent in docker mode or venv?

7 months ago

0 Hey.

TenseOstrich47 , you can specify a docker image with
task.set_base_docker(docker_image="<DOCKER_IMAGE>")You will of course need to login to ECR on that machine so it will be able to download the docker image.

3 years ago

0 Hello All, I Am Trying To Have A Grasp On Clearml Agents, And I'M Struggling With Docker Mode. Let'S Say, I Have A Dockerfile For My Custom Made Docker Image. However, I Want To Build That Image On The Fly, Just Because Of Having The Freedom To Have Full

Also a small clarification:
ClearML doesn't build the docker image itself. You need to have a docker image already built to be used by ClearML

3 years ago

0 Hello, I Have Been Starting To Test And Integrate Clearml Into Our Stack And I Like It. I Started Adding People To My Workspace To Share Datasets And Experiments, But It Seems They Don'T Have Access Directly, They Need To Use Stuff From My Personal Worksp

They need to switch to your workspace, create credentials on your workspace and then use them instead of their own. Makes sense?

one year ago

0 I Have A Question Regarding Dataset Versioning Lets Say I Create Dataset A Which Has 1000 Files Then I Create Dataset B With Dataset A As It'S Parent. All I Did Was Delete 900 Files That Were Corrupted. When I Pull A Local Copy Of Dataset B, Do I Just Pul

Hi @<1547028031053238272:profile|MassiveGoldfish6> , the expected behavior would be pulling only the 100 files 🙂

2 years ago

0 Hi Everyone!! Is Clearml Multi Gpu Support. I Have 2 Machines. Each Machine Have 2 A100 Gpu. Do We Have Any Option To Run Workload In These Gpu. Same Time Like Virtually. Do We Have The Support??

Hi @<1561885921379356672:profile|GorgeousPuppy74> , ClearML does support running with multiple GPUs

one year ago

0 Hello Everyone, When I Try To Connect To Clearml Server But I Put A Wrong Url, I See This Error And It Keeps On Trying. Shouldn'T I See Some Kind Of Error Telling Me The Url Is Wrong?

Slow network or network died all of a sudden - you wouldn't want your experiments to fail just because there is a network issue. Once network is restored - everything is sent as it should be to the backend. This is the resilience I was talking about

Regarding mistake in URL - I guess it is your responsibility to keep track of not using wrong URLs. As I said before - How would you suggest the SDK know what is the 'right' URL and what is the 'wrong'...

2 years ago

0 Hi! From A Task Created Using

GiganticTurtle0 , I think this would be up your alley, there is a 'parent' parameter even 🙂

https://clear.ml/docs/latest/docs/references/sdk/task#taskget_tasks

3 years ago

So even if you abort it on the start of the experiment it will keep running and reporting logs?

one year ago

0 Agent And Env Variables (This Is Almost Duplicate

Try setting it outside of any section. Basically set an environment section by itself

one year ago

Show more results