CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hi, I'M Trying To Access/Use Experiment'S Model+Data+Params My Model And Data Are Stored In S3 And I'M Not Sure What Is The Practice Of Getting Them Reddy To Use. When I Use

You can clone it via the UI, enqueue it to a queue that has a worker running against that queue. You should get a perfect 1:1 reproduction

3 years ago

0 Hi Team,May I Get Any Reference To Check On Model Drifting And How We Can Automate This For Retraining Of Model

You can see my answer in channel

2 years ago

0 Hi Everone! We'Re Trying To Start Using Clearml For Both Experiment Tracking And Data Management, And I Have A Question About Clearml-Data: Is It Possible To Specify Two Different Storage Locations For A Dataset? Background: We'Re Using Both Local Machine

Hi @<1618418423996354560:profile|JealousMole49> , why not just use different datasets? Just to make sure I'm understanding correctly - you have a duplication of data on both s3 and local?

2 years ago

0 Is There Something Like

ReassuredTiger98 , nothing CLI based but you can do it programmatically via the API quite easily.
Also, what happens if you do clearml-data delete --id <TASK_ID> ? It's a bet but it could actually work as well 🙂

3 years ago

0 Hi All! I Am Solving The Following Issue -> File1.Py

Hi @<1523701181375844352:profile|ExasperatedCrocodile76> , and now the worker clones the repo correctly?

2 years ago

0 Hi, I Have Another Bug To Report For Clearml-Server 1.2 (Self Hosted) In The Console Logs Of An Experiments, I Cannot See The Latest Logs. Eg My Experiment Is Done, But I Can Only See The Logs Of To The Installation Of The Packages. If I Download The Log

JitteryCoyote63 , if you hit F12 and open the console in the webUI you should see some calls going out called events.get_task_log , can you take a peek and see if the logs are missing from there?

3 years ago

0 I Have The User/Pass Set Up On The

Can you add the full log of the run?

11 months ago

0 How To Run The Scripts To Make Clearml Agent Pass The Correct Repo And Branch?

Hi @<1874626649442488320:profile|KindTurkey44> , can you elaborate on what is happening?

2 months ago

0 In Pipelines. Is It Possible To Inject A Requierment.Txt Such That The Executing Node Will Install Before Running Tasks?

the question how does ClearML know to create env and what files does it copy to the task

Either automatically detecting the packages in requirements.txt OR using the packages listed in the task itself

3 years ago

0 Hi, After Today'S Update Clear.Ml Asks To Restart Autoscaler And It'S Still Pending. What'S Wrong? Somebody Has Same Issue?

Strange, let me check with the guys

3 months ago

0 Hey Everyone! I Have A Quick Question Regarding Scalar Graphs In The Dashboard. When My Model Starts Training, The Loss Values Are Very Large And Drop To The Appropriate Range Within A Few Iterations. The Problem Is That Because The Range Is So Big, The

Hi @<1659368250930106368:profile|ConfusedFlamingo31> , I second Jean 🙂
You should have a small cogwheel icon you can click to enable this behavior

one year ago

0 Hey, I'M Using Clearml Gcp Autoscaler And It Seems That

Sharing the same workspace so it makes sense that you'd encounter the same issue being on the same network 🙂

@<1808672054950498304:profile|ElatedRaven55> , If you manually spin up the machines, does the issue reproduce? Did you try running the same exact VM setup manually?
@<1594863230964994048:profile|DangerousBee35> , I'd ask the DevOps to check if there might be something slowing communication from your new network in GCP to the app.clear.ml server

8 months ago

0 Hi There, Is There A Way To Save A Model Simply To The Fileserver Such That The Model Url Will Point There And Not To A Local Disk (I Am Running In Docker Containers And Local Path Is Not Always Available).

Hi @<1577468611524562944:profile|MagnificentBear85> , you can also use Task.init(... , output_uri=True) in the code as well

one year ago

0 When Trying To Run My Agent With Poetry As Package Manager (Could Also Be With Pip, But Definitely With Poetry), Strange Things Seem To Happen When Trying To Execute A Pipeline:

Hi @<1724960468822396928:profile|CumbersomeSealion22> , can you provide a log of such a run?

one year ago

0 Question About The Task And Queue In The Clearml Sdk. There Are Three Machine, Machine A(Running The Clearml Server), Machine B (Linux, Target Machine To Run Task), Machine C(Windows, My Woring Machine). B And C Already Installed Clearml-Agent. I Want T

Hi @<1572395190897872896:profile|ShortWhale75> , that is not the correct way to use workers & queues.

First of all, Task.init will mark your task as running so this error makes sense.

The idea is first you run the code locally on your machine, once everything is logged (packages, repo, uncomitted changes & configurations) you can clone the task and then enqueue it into the agent.

Programmatically, you would watch to fetch an existing task in the system, clone it and then enqueue the n...

2 years ago

0 Is There A Way To Configure A Clearml-Agent So That It Shutdown The Server After It Has Been Idle For A Certain Time Period? We Are Using Gpu Resources From A Provider That Autoscaling Doesn'T Support (Such As Sagemaker Training Jobs).

BTW, considering the lower costs of EC2, you could always use longer timeout times for the autoscaler to ensure better availability of machines

2 years ago

0 Hi Everyone, I Have A Question On How To Disable Running Pipelines In Hybrid Mode, So That Agent Only Considers The Code From Git And Not From Local Repo While Running A Task Remotely. I Am Trying To Run A Demo Pipeline Remotely Using Clearml-Agent. Some

You can also set just specific commit/branch in the component object - None

one year ago

0 Hi, I Tried Download Model From Clearml.Storage (From S3 Bucket), But I Got This Error. Err: [Errno 36] File Name Too Long: Is There Any Way To Fix This? Thanks

VictoriousPenguin97 , can you please try with the latest version? 1.1.3 🙂

4 years ago

0 Is There Anyone Who Is Using Clearml In A Jupyter Notebook. It Looks Like When Using Execute_Remotely Together With A Jupyter Noteebok, Clearml Tries To Launch A Jupyter Notebook Inside The Docker Container. It Fails Then With

Hi @<1582542029752111104:profile|GorgeousWoodpecker69> , can you elaborate please on the exact steps you took?

2 years ago

0 Hello, Friends! I'Ve Got A Problem. I Am Trying To Restore Clearml Server From Backup. I Did What Docs Tell: Archived "Config" And "Data" Folders, Moved Them To New System. I Copied Docker Compose File And Set Correct Paths. When I Try To Run This Apiserv

Hi @<1526734383564722176:profile|BoredBat47> , do you see any errors in the elastic container?

one year ago

0 Why Is Async_Delete Not Working?

Again, I'm telling you, please look at the documentation and what it says specifically on minio like solutions.
The host should be
host: " our-host.com :<PORT>"
And NOT
host: " s3.our-host.com "
Maybe you don't require a port I don't know your setup, but as I said, in the host settings you need to remove the s3 as this is reserved only to AWS S3.

one year ago

0 Is There Any Way To: Within The Ui, Select And Compare The Scalars For More Than 10 Experiments? I'D Like To Do Something Like:

SmallDeer34 , and they still have the same colors when you maximize the graph?

4 years ago

0 Hi All, I'M New To Clearml, And Trying To Understand The Set_Metadata Method Of The Dataset Class. The Documentation Is Almost Non-Existent Does Anyone Have An Example Script? How Would I Add Data Using E.G. Pandas. I Assume One Column Would Relate To The

Hi @<1574931891478335488:profile|DizzyButterfly4> , I think if you have a pandas object pd then the usage would be something like ds.set_metadata(metadata=pd, metadata_name="my pandas object")

I think you would be referencing the entire thing using the metadata_name parameter

2 years ago

0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

UnevenDolphin73 , I think I might have skipped a beat. Are you running the autoscaler through the code example in the repo?

3 years ago

The metadata would relate to the entire dataset.

For your use case I think what's relevant is HyperDatasets

None

2 years ago

0 Hi, I Have A Question About

Do you have an example to play with?

3 years ago

0 Hi All, I Am Running A Self Hosting Clearml Server On An Ec2 Instance. I Am Able To Run Training And Log The Data Into A Separate S3 Bucket By Specifying The

Hi @<1523702547896864768:profile|FrightenedHippopotamus86> , debug samples are stored automatically on the files server. You can manipulate this by changing api.files_server in clearml.conf to connect to the bucket of your choice

2 years ago

0 Hi, I Would Like To Start Logging How Often My Users Uses Clearml. How Might I Query This Kind Of Information?

SubstantialElk6 , I don't think anything like this currently exists in the API. Maybe add a feature request to github?

3 years ago

0 Hi Everyone How Can I Pass Manual Input During Git Action When The Command I Use Asking Me To Input Clearml Configuration. I'M Running 'Clearml-Init' Command On Git Action, How To Put The Configuration When It Ask For "Paste Copied Configuration Here: ",

MoodyCentipede68 , I'm sorry. I meant inject a preconfigured ~/clearml.conf . Or as Jake mentioned, just use environment variables 🙂

3 years ago

0 Hey Guys, Running A Clearml Pipeline, We Keep Getting An 'Abort By User' Message:

You can see the version if you go to settings page. It is in the bottom right of the screen 🙂

2 years ago

Show more results