CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hi Guys! Anyone Else Has Trouble Caching Virtual Environments In The Agent? I Manually Installed A Single Agent On A Virtual Machine, And I'M Using This Conf For Venv Caching :

@<1691620877822595072:profile|FlutteringMouse14> , what version of the agent are you using?

one year ago

0 Why Would The Mongo4 Migration Scripts (For Clearml-Server 1.2) Try To Chown 1000:1000?

I think because they create a folder in /opt/clearml/data/mongo_4 and the folder needs same permissions as were made in the setup

3 years ago

0 Hi, I Am Trying To Use Omegaconf With Task.Connect_Configuration And I Get The Following Error:

From the looks of this example this should be connected automatically actually
https://github.com/allegroai/clearml/blob/master/examples/frameworks/hydra/hydra_example.py

3 years ago

0 Hello Clearml Ppl

FreshKangaroo33 , what do you mean by syntax examples?
I think this should give you some context on usage 🙂
https://github.com/allegroai/clearml/blob/master/examples/reporting/hyper_parameters.py

3 years ago

0 Hey Clearml Experts Is There A Way To Copy Entire Exp. Including Results/Scalars/Plots? Right Click > Clone Creates A Duplicate Of The Exp. , Only With It'S Configuration, Without It'S Results

Hi @<1523701842515595264:profile|PleasantOwl46> , I'm afraid that such a capability doesn't really exist in ClearML. You could technically populate an experiment using the API.

I'm however curious - what is your use case for this?

2 years ago

0 Hi. I'D Like To Try The Gcp Autoscaler.

Can you try relaunching it just to make sure?

3 years ago

0 Good Week Clearml Team

UnevenDolphin73 , I think this is fair. Why not open a feature request?

3 years ago

0 Hello! @<1523701070390366208:profile|CostlyOstrich36>, if I have a pipeline and my second task create my trials, that are running on my workers. If one Trial fails, all my optimization if cancelled because I do not have more trials been generated. Is this

Hi @<1821355631278297088:profile|ThoughtlessTiger0> , can you please elaborate a bit on what exactly is the process? Why are steps failing? Is this to be expected?

7 months ago

0 Another Question About Pipelines: Is It Possible To Run A Component On The Same Machine Of The Main Pipeline Controller? I Have A Function That It'S Rather Fast To Execute, So I Don'T Want To Start A Separate Container Just For It, But I'D Like To Track I

Check the pre_execute_callback and post_execute_callback arguments of the component.

None

2 years ago

0 Hi Everyone, I Am Having A Few Problems With The Ui: 1. I Uploaded An Optimization Task Yesterday - And I See It Running, But The Hyper-Parameter Optimization App Disappeared From The Ui. I Managed To Access It Only In An Indirect Way - Through The Worker

AbruptWorm50 , can you try deleting your cookies/data on your browser to see if you manage to load the debug samples? I think this might be related: https://github.com/allegroai/clearml/issues/637

3 years ago

0 Hi! I Am Saving Some Intermediate

GrievingTurkey78 , it appears to be bad methodology on my side as disconnecting the framework won't log any scalars etc...

I think a better solution would be to set the log level to something else, however you will not see 'INFO' messages from the module.

Try something like this:
logging.getLogger('clearml.model').setLevel(logging.WARNING)
This will only show you the warnings regarding the models module.

4 years ago

0 Hi! How To Correctly Configure Clearml With Pytorch-Ignite To Write Checkpoints To The

Hi @<1523708920831414272:profile|SuperficialDolphin93> , simply set output_uri=/mnt/nfs/shared in Task.init

11 months ago

0 Hey Everyone, I Have Another Question: Is It Possible To Change Agent Config For Each Task? E.G.

I think you can set this code wise as well - https://clear.ml/docs/latest/docs/references/sdk/task#taskforce_requirements_env_freeze

2 years ago

0 Hello All, Does Anyone Know How To Change The Id Of A Running Agent? Or Create An Agent With A Predetermined Id?

Hi @<1533619716533260288:profile|SmallPigeon24> , I think the worker id is dependent on the worker name, so you can control it this way

2 years ago

0 Is Is Intended That Restarting The Server Somestimes Leads To Abortion Of Experiments On Clearml-Agents

I don't think this the intended behavior. Can you please elaborate how it happens exactly?

3 years ago

0 Q: Hello, I Am A Clearml Begineer, Can I Use Clearml Open-Source To Build Our Customized Platform? What Are The Limits Of Clearml While Building Mlops Platform?

I am not very familiar with KubeFlow but as far as I know it is mainly for orchestration whereas ClearML offers a full E2E solution 🙂

3 years ago

0 Hi Guys! Is There Any Way To Get Full State Of Dataset From Somewhere, Except My S3 Bucket? I Need A Mapping Of Files And Batches That Were Uploaded As A Dataset. Maybe This Information Is Also Available In One Of The Clearml Databases?

o, if I pull this file from s3 bucket, I can conclude which chunk I should download to get a specific file. Am I wrong?

I think you're right. Although I'm not sure if you can decompress individual chunks - worth giving it a try!

I also though clearML writes this mapping (

state.json

) into one of its databases: Mongo, Redis, Elasticsearch.

I think the state.json is saved like an artifact so the contents aren't really exposed into one of the dbs

2 years ago

0 Trying To Access The Csv File Uploaded On The Clearml Dataset In My Local Device Is Giving Me Some Errors

What is the dataset URL you see in the UI? If you go to the dataset, there should be a view to the dataset link

3 years ago

0 Is This The Write Way To Add A Tag To An Output Model Artifact Of A Task? Torch.Save(Model, '

Which version of clearml are you using?

3 years ago

0 Hi! I'M Building A Model Registry With Clearml And I Can'T Figure Out How To Do Model Versioning: Is There A Way To Set Model Versions And Load Specific Versions Of Models For Experiments And Serving Somehow?

Hi @<1635088270469632000:profile|LividReindeer58> , I think the best ways are either using tags or metadata on the model itself. What do you think?

2 years ago

0 Hi Everyone, I Am Launching Clearml Webapp. Asks Me For User And Pass. How Do I Get That?

You need to follow the instructions here - None

one year ago

0 Hi, I'Ve Run Into A Problem And Would Appreciate Some Help. I Installed Clearml Locally. When I Run A New Task On A Remote Server And In The Python Training Code I Set It To Only Train On One Gpu. Everything Works Fine And I See All The Scalars Automatica

Just to make sure we're on the same page, you're referring the machine statistics or ALL scalars don't show up?

11 months ago

0 Hello, Is It Possible To Migrate From A Domain Name To Another ? I Have Instanciated A Clearml Server With Domain Name Myclearml.Server Et A Data File Server With Domaine Name Myminio.Server And Some Data Scientists Used It. Now I Have Backuped The Data

Do you see any errors in the apiserver on startup or after?

3 years ago

0 How Can I Modify The Line Executed By The Agent At The Beginning

What exactly would you like to change?

3 years ago

0 Hey I Hope Everyone Is Having A Good Day, Two Quick Questions About Datasets:

And additionally does the

When executing a Task (experiment) remotely, this method has no effect).

part means that if it is executed in a remote worker inside a pipeline without the dataset downloaded the method will have no effect ?

I think this means the add tags specifically will have no effect

3 years ago

0 Hello Everyone. If I Use Self-Hosted Clearml, Am I Limited By The Number Of Users, Artifact Storage, Or Api Calls?

Hi @<1673501397007470592:profile|RelievedDuck3> , no 🙂

one year ago

0 Hello! I Need To Run Clearml Pipeline With Caching Of Steps. I Specify Cache_Executed_Step=True For Each Step, But My Steps Are Not Cached And Ended With The Status - Completed.

Hi @<1578555761724755968:profile|GrievingKoala83> , what happens if you rerun this via the webUI ?

8 months ago

0 Given I Want To Run A Task In A Pipeline Using A Base Task Id. One Of My Steps Just Finds The Latest Results To Use. I Want The Task To Output The Id Of The Results And The Next Step To Use It. How Would I Go About Doing This? Is There A Way To Pass Just

Well if you save it as an artifact, that artifact is accessible by other tasks and passable via the pipeline with monitor_artifacts parameter in add_step()
https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#add_step

3 years ago

0 Anyone Experiencing This With A Custom S3 Bucket In The Debug Samples? The S3 Configuration In The Webapp Is Correct

Hi TrickyFox41 , I'm sorry for the confusion. It appears that the issue is solved in the unreleased version 1.9.2 of the server that should be coming out in the next few days (Thursday or start of next week).

2 years ago

0 Hi All — Has Anyone Run Into Degrading Download Performance With Clearml Storage Manager?

Hi @<1806135344731525120:profile|GrumpyDog7> , what about the load on the server itself? Also, are you downloading from the files server or from some arbitrary source?

2 months ago

Show more results