CostlyOstrich36

0 Questions, 4173 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4173

0 Hi All, What Is The Best Way Of Getting Clearml To Pull Code From Github Repos? At The Moment We Can Pull Using A Users Ssh Credentials, But Afaik It'S Not Possible To Create "Service Accounts" For Github. The Preferred Method For

Hi @<1724960464275771392:profile|DepravedBee82> , I believe this is not currently supported

4 months ago

0 Hey Guys. Ive Uploaded A Dataset (Lets Call It Total) And Then I Want To Make A Train / Test Split Of It That Refers Back To Total Dataset. My Files Are Stored In S3 So Clearml Just Points To The External Files. But If I Link The Train Back To The Total

Hi @<1663354533759160320:profile|ExhilaratedLizard23> , can you please elaborate on how you built the dataset and how you're consuming it?

6 months ago

0 Hi Folks, I’M Having Some Trouble Getting An A100 Instance In Gcp. I’M Talking With A Google Rep And Need Some Info On The Gcp Autoscaler, Can You Tell Me What Method It Uses To Spin Up An Instance? Any Chance It Uses Dws? Also Have People Encountered Thi

Hi @<1745616566117994496:profile|FantasticGorilla16> , under the hood the google API is being used - None

Regarding getting machines faster, I think that really depends on availability on Google's side 🙂

12 months ago

0 Hi, I'M Experiencing With Hydra Integration With Clearml. As The Docs

Hi @<1594863230964994048:profile|DangerousBee35> , did you follow the specific instructions to set _ allow omegaconf_edit_ to True as in the docs?
None

4 months ago

0 Hi, I Was Wondering How Come My Api Calls Keeps Going Up While I'M Not Executing Any Tasks\Experiments? I Think It Is Related To The Fact That I Have A Worker That Is Running In The Background, And I Was Wondering How Many Api Calls A Worker Is Doing Per

worker by default checks the backend every 5 seconds for new tasks in the queue. While running a task I think it basically sends whatever api calls a regular local task sends

2 years ago

Hi @<1594863230964994048:profile|DangerousBee35> , using the UI uses API calls, agents listening to a queue send API calls and also the applications send API calls all the time while running

2 years ago

0 Pymongo.Errors.Operationfailure: Not Authorized On Backend To Execute Command { Find: "Queue", Filter: {}, Lsid: { Id: Uuid("Ce3095Ec-4E0C-4392-93C1-52Aeebb1B47C") }, $Db: "Backend" }, Full Error: {'Ok': 0.0, 'Errmsg': 'Not Authorized On Backend To Execut

Hi @<1714451225295982592:profile|FreshWoodpecker88> , is it possible that you didn't get permissions to the relevant directories to act as the actual storage for mongodb?

one year ago

0 Hi Everyone ! I'M Working With Pipelinecontroller. Is It Possible To Create A Pipeline With Optional Steps ? To Clarify I Add An Example Of A Pipeline In The Picture. For Example, The User Would Be Able To Modify The Value Of A Parameter To Execute The St

Hi @<1546303293918023680:profile|MiniatureRobin9> , if you use pipelines from decorator your can certainly set if statements to decide where/how to go

one year ago

I suggest you see this example - None
And see how you can implement an if statement into this sample to basically create 'branches' in the pipeline 🙂

one year ago

Yes, and even more 🙂

one year ago

0 Hi, I Got Some Issue When Using

Hi @<1597762318140182528:profile|EnchantingPenguin77> , you can set this in the docker extra arguments section of the task

one year ago

0 Hello, I Always Got A "Modulenotfounderror: No Module Named..." Error When I Run A Pipeline And Import A Local .Py File. I'M Using Decorator Pipeline, How Can I Import That Local .Py Files? My Pipeline Code And That .Py Files I Wanted To Import Already In

Hi MoodyCentipede68 ,

What versions of ClearML & Agent are you using?

3 years ago

pip freeze | grep clearml

3 years ago

0 After Launching Remote Controller I Get The Following Error Message In The Clearml Task Console : Traceback (Most Recent Call Last): File "Src/Clearmlpipeline/Source_File_Anchor.Py", Line 107, In <Module> Main() File "Src/Clearmlpipeline/Source_Fi

I'll take a large snippet too 😛
Do you have any idea what's the source of this?
TypeError: __init__() got an unexpected keyword argument 'configurations'

3 years ago

0 Hello Everyone! I Need To Run The Pipeline On Schedule. Are There Any Restrictions On Running Pipelines Through The Scheduler? Would Hidden Project For Pipe Step Tasks Be A Problem For Scheduler?

Hi @<1578555761724755968:profile|GrievingKoala83> , I don't think so.

7 months ago

Hi SweetHippopotamus84 , what version of ClearML are you using? Also, do you have a small snippet to play with?

3 years ago

0 Hello, I’M Integrating Clearml Into My Training Code To Track Experiments. I See That Clearml Logs Automatically The Python Env In The “Installed Packages” Section But The List Logged Is Very Different From The

RattyLouse61 , I think you can save the yml conda env file as an artifact, this way it would also be accessible by other tasks 🙂

3 years ago

0 Is There A Way To Launch A Clearml-Task From The Cli, Without Specifying Any Requirements.Txt? I Want The Script To Run Locally, But Just Record Metrics On Clearml-Server

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , why not just run it as python script.y ?

2 years ago

0 Is There A Way To Launch A Clearml-Task From The Cli, Without Specifying Any Requirements.Txt? I Want The Script To Run Locally, But Just Record Metrics On Clearml-Server

Yes, you can also manually specify packages using --packages flag 🙂

2 years ago

0 Hi! I’Ve Been Using Clearml For Some Time In My Previous Company, But I Have A New Job Now, And Naturally I Want To Continue Using It And Hopefully Convince My Team Mates! But I Couldn’T Set The Clearml-Server Docker. We Are Discouraged From Using

Maybe those are internal ports for the docker since I can see the following for one of the dockers ports section
8008/tcp, 8080-8081/tcp, 0.0.0.0:8085->8085/tcp, :::8085->8085/tcp

3 years ago

0 I Have A Problem That Might Not Directly Be Clearml Related, But Maybe Someone Here Has An Idea: I Run A Clearml-Server On A Machine With 128Gb Ram, 32 Cores And 2 Gpus. On The Same Machine I Run 2 Clearml-Agent Each With Access To 1 Gpu, 12 Cores, An 48G

than maybe a process inside the container gets killed and the container will hang? Is this possible?

I'm not sure. Usually if Elastic is unresponsive/not working properly the API server will have issues raising/working and will print out errors

3 years ago

0 Hi, I Want To Upgrade Clearml Server From 1.1 To 1.2 (Self Hosted). I Have The Following Setup:

Looks great, I would suggest having at least 150 gb free when you do the upgrade 🙂

3 years ago

0 Hi. Is There A Way To Pass Multiple Pre/Post Execution Callbacks For A Step?

Hi @<1639799308809146368:profile|TritePigeon86> , what is the use case for passing multiple callbacks? Why not have it in the same function simply?

one year ago

0 Are There Any Platform Built On Top Of Clearml?

Hi GiganticKoala17 , can you please elaborate?

2 years ago

0 Hello Everyone! I Hope You Can Help Me. I Have A Local Workstation Where I Want To Deploy The Clearml Server And Clearml Agent. I Have Prepared Two Independent Docker-Compose Files, While I Need To Explicitly Specify The External Docker Network? Or With C

Hi @<1707203455203938304:profile|FoolishRobin23> , not sure I understand. Are you setting something in addition to the services agent in the docker compose?

one year ago

0 Hey When I Create An Agent And Run An Interactive Session On It - I Have Access To Only One Gpu

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , it depends on how you run the agent that is listening to your queue. If you set it to run with multiple gpus you'd be able to utilize multiple gpus in your sessions 🙂

one year ago

0 What Is The Best Way To Set S3 As A Files Server? We Have A Clearml Deployment Without A Files Server, But After/During A Training Run Clearml.Metrics Always Fails Due To A Connection Error While Trying To Call <Url>:8081 (We Don'T Have 8081 Because Of

Hi @<1535069219354316800:profile|PerplexedRaccoon19> you can setup api.files_server in clearml.conf to point to your s3 bucket

one year ago

0 Hello! Are You Able To Help Be Debug This Message?

On prem is also K8s? Question is if you run the code unrelated to ClearML on EKS, do you still get the same issue?

one year ago

0 We Use Environment Variables In Our

Hmmm Regarding your issue you can use the following env vars to define your endpoint
https://clear.ml/docs/latest/docs/configs/env_vars/#server-connection

What is your usecase? Do you want to change the endpoint mid run?

3 years ago

0 Hi All Im Trying To Save My Model Checkpoints During Runtime But Am Running Into A Confusing Snag. I'M Using The Huggingface Architecture For A Transformer. Using Their Training Module To Control Training. In The Training Args, I Have The

Hi @<1730033904972206080:profile|FantasticSeaurchin8> , can you provide a sample script that reproduces this behaviour?

one year ago

Show more results