CostlyOstrich36

0 Questions, 4015 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4015

0 Hi All, While Training Some Models I Noticed That My Api Calls Are Going Through The Roof, Is There A Way To Control The Amount Of Api Calls? Is There A Way To Update All The Plots And Console Print On The App.Clear.Ml For Every Some Epoch? Or Aggregating

I think these are the configurations you are looking for:

sdk.development.worker.report_event_flush_threshold
sdk.development.worker.console_cr_flush_period

inside clearml.conf

2 years ago

0 Hello All, I Am New To Clearml, Need A Clarification. I Would Like To Enable Gpu-As-A-Service With Secure Multi-Tenancy And Real-Time Billing Per Tenant, Is This Feature Available In Open Source? Or Do We Need To Purchase The Enterprise Access For Multi-T

I would suggest the website 🙂

one month ago

0 [Pipeline] Am I Right In Saying A Pipeline Controller Can’T Include A Data-Dependent For-Loop? The Issue Is Not Spinning Up The Tasks, It’S Collecting The Results At The End. I Was Trying To Append The Outputs Of Each Iteration Of The For-Loop And Pass Th

Hi ReassuredOwl55 , can you please elaborate on your use case or exactly what you're trying to achieve?

2 years ago

0 Hi Folks, I Have A Question Related To The Storage Of Artifacts, As It Is Not Entirely Clear To Me Where To Configure It. If I Read The Documentation

Hi SarcasticSquirrel56 ,

You can use output_uri=<S3_BUCKET> in Task.init() to upload artifacts to s3. Is that what you're looking for?

2 years ago

UnevenDolphin73 , I've encountered a similar issue with s3. I believe it's going to be fixed in the next release 🙂

3 years ago

0 Hey Team! There'S Something Small Yet Annoying That I Would Like To Bring To Your Attention... When Reporting Plots / Tables, The Name Of The Series Doesn'T Get Saved, And Instead All Of The Tables Get The Same Name (The Title And The Iteration) Here'S An

Hi WhoppingMole85 , can you please provide a small code snippet to play with? How are you saving the tables?

2 years ago

0 Hi Everyone, I'M New To Clearml And I Want To Run A Task On A Remote Host Inside A Docker Container. The Python Interpreter I Need To Use Is Located At

2 different queues

one year ago

0 Monitoring Related Question

Hi @<1607909176359522304:profile|UnevenCow76> , I suggest you review the following video on serving - None

This also explains how to visualize different metrics in Grafana

one year ago

0 Does The Clearml Team Still Post Updates In This Channel When New Clearml Versions Come Out? If Not, What'S The Easiest Way To Keep Track Of Various Release Candidates Etc (Short Of Signing Up And Registering For Notifications On Pypi)

I think AnxiousSeal95 updates us when there is a new version or release 🙂

2 years ago

0 Hey Guys, In A Fresh Self-Hosted Clearml Server I Have The Issue That I Cannot See Any Preview Images Of The Files In A Dataset. It Seems Like A Bug, But Maybe I Am Doing Something Wrong?

Looping in @<1523703436166565888:profile|DeterminedCrab71> & @<1523701435869433856:profile|SmugDolphin23> for visibility

2 years ago

0 Hi All

Hi @<1546303293918023680:profile|MiniatureRobin9> , please take a look at add_pipeline_tags in
None

2 years ago

0 Hi Community, When I Configure A

Hi @<1523701132025663488:profile|SlimyElephant79> , to answer your questions:

Does ClearML store any dataset outside of this S3 storage (and local storage) for preview or compression purposes?Some preview data might be stored inside mongodb (if it's a table for example). This of course can be disabled so no data/previews are exposed to the ClearML backend.
Are any data packets related to model or data versioning routed through the API server? (We are pretty confident it shouldn't, but j...

one year ago

0 Hey Everyone! I’M Currently Trying To Set Up Hyperparameter Optimization With Clearml On A Base Experiment Using Hydra. I Got Everything Working From The Examples. However, The Child Experiments Started By The Optimization Don’T Seem To Actually Get The N

2 years ago

0 Hi Guys! Anyone Else Has Trouble Caching Virtual Environments In The Agent? I Manually Installed A Single Agent On A Virtual Machine, And I'M Using This Conf For Venv Caching :

@<1691620877822595072:profile|FlutteringMouse14> , can you try upgrading to the latest available? 1.8.1rc2

11 months ago

0 Hi, I'M Trying To Understand How To Add Kpis Artifact In A Way That Will Allow To Compare Them. Currently Clearml Presents Them As A File, Not Metrics. Please See My Code And Clearml "Compare Experiments" Screenshot Below.

Hi AttractiveShrimp45 , can you please elaborate on what you mean by KPIs artifact?

2 years ago

0 My Task Is In Pending State, After I Enqueued The Task Its In Pending State, Need Help!!

Hi @<1570583227918192640:profile|FloppySwallow46> , please don't @ the entire channel for help 🙂
If a task is in pending it means that no agent picked it up yet. Maybe the agent is unavailable or the process crashed. Check in that direction

one year ago

0 Hi, I'M Configuring The Clearml Agent On Top Of Kubernetes With The Helm Chart. I Need To Access Private Repositories In My Github Organization. Which User Should I Use For The Configuration? A Real User Or I Create One Just To Pull Repositories? And The

You can, but if it's a large organization having a dedicated account for this would probably be best

2 years ago

0 When Clearml Converts A

GiganticTurtle0 hi!

Do you have an example of your use case?

3 years ago

0 Hello, Friends! I'Ve Got A Problem. I Am Trying To Restore Clearml Server From Backup. I Did What Docs Tell: Archived "Config" And "Data" Folders, Moved Them To New System. I Copied Docker Compose File And Set Correct Paths. When I Try To Run This Apiserv

What are the Elasticsearch, Mongo and apiserver versions in the docker compose are? Backup will only work in this scenario when they are exactly the same between 2 systems.

8 months ago

0 Clearnl Failed To Detect Custom Packages

I think this is what you need:
None

one year ago

0 Hi, When Running A Clearml Agent With Services Mode, Is There A Way To Limit The Number Of Concurrent Services Crunning?

Is it the services docker that comes with the docker compose or did you run your own agent?

3 years ago

0 Hi, Got A Few Questions On Clearml Seasion With Vscode And Jupyter 1. Are Sessions Spawned Off Clearml-Sessions Persistent? How Can We Connect Back Easily? 2. In A Vscode Session, Can I Run Ui Related Operations, E.G. Run Imgview.

Hi @<1523701504827985920:profile|SubstantialElk6> , I think this is what you're looking for -
None
None

Regarding question 2. Can you elaborate please?

4 months ago

0 Hey All, I Have A Question That Might Have Been Asked Before But I Can'T Find An Answer On This Slack Channel Or The Github So I Hope Somebody Can Help Me. I Have Created A Dataset Via The Python Sdk With A Local Path As The Output Uri Like So:

Hi @<1655381985293504512:profile|LividGorilla28> , this is because your browser cannot show local files as it is a sandbox environment. Opening a new tab and going directly to a local file by pasting the path is the only way to view images that are saved locally.

The correct way is to store it on some storage solution such as s3/gcp/minio which can serve the data to the browser

one year ago

0 I'M Trying To Use The Aws Autoscaler And I'M Having Some Difficulties With The Ami Configuration. From What I Tested The Ami Should Include:

Hi @<1594863230964994048:profile|DangerousBee35> , this is pretty much it. I think the default one suggested is a good one

one year ago

0 Hi, Yesterday I Updated The Clearml Server, Now All My Tasks Disappeared, There Are Only The Demo Tasks On The Interface. But The Data Is Still In The /Opt/Clearml/Data Folder.

Let me see if I can find it

3 years ago

0 Hi! The Code

Hi @<1695969549783928832:profile|ObedientTurkey46> , do you have a code snippet that reproduces this behaviour?

8 months ago

0 Hey Guys, Hope You Missed Me

My guess other agents are sitting on different machines, did you verify that the credentials are the same between the different clearml.conf files? Maybe @<1523701087100473344:profile|SuccessfulKoala55> might have an idea

2 years ago

0 Hello, I Have A Question Regarding The Use Of Hydra For Config In Clearml Pipelines. I Have Setup A Pipeline Using The Pipeline Decorator (Based On The Example You Provided In Github), With The Config Values Hard-Coded In Code, And It Works Well. I Then T

YummyLion54 , Hi

What versions of clearml/clearml-agent are you using?

When running it without the agent, do the hydra configurations show up properly in the UI?

3 years ago

0 Hi! For

Hmmmm, fair point.

3 years ago

0 Aws Autoscaler Question: What Is Best Practices For Providing The Autoscaled Instances With Access To Credentials For Things Like S3? With Self-Hosted Agents I Can Add The Credentials To The Clearml Config As Part Of The Environment Variables.

You can provide it in the extra configurations sections

one year ago

Show more results