CostlyOstrich36

0 Questions, 4210 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4210

0 Hey All, I Have A Question That Might Have Been Asked Before But I Can'T Find An Answer On This Slack Channel Or The Github So I Hope Somebody Can Help Me. I Have Created A Dataset Via The Python Sdk With A Local Path As The Output Uri Like So:

Hi @<1655381985293504512:profile|LividGorilla28> , this is because your browser cannot show local files as it is a sandbox environment. Opening a new tab and going directly to a local file by pasting the path is the only way to view images that are saved locally.

The correct way is to store it on some storage solution such as s3/gcp/minio which can serve the data to the browser

one year ago

0 Im Trying To Run This Exmple :

It looks as it is running, did the status of the experiment change?

4 years ago

0 Hi Team! Is There A Way To Make Clearml’S Aws Autoscaler And Queues Resource-Aware Please? I.E. If We Can Say, As We Enqueue Our Job, How Much Ram Or Gpu-Ram Or Even Gpus It Needs, Have The Scheduler/Autoscaler Dispatch The Job To Instances That Are Of Th

Yep, although I'm quite sure you could build some logic on top of that to manage proper queueing

2 years ago

0 Hey Clearml, Pipeline From Tasks: Following This Example

Can you provide a self contained contained snippet that reproduces this behavior?

2 years ago

0 Im Trying To Run This Exmple :

Can you please provide a shareable link?

4 years ago

0 Hi, I'M Conceptually Struggling To Understand How To Get My Models To Be Saved Permanently By My Self-Hosted Clearml Server. As It Stands Now, When I Train A Model Using A Clearml-Agent, The Model Checkpoints Are Being Logged By Clearml In The Dashboard,

Try adding the following to your Task.init()

task = Task.init(project_name='<PROJECT_NAME>', task_name='<TASK_NAME>', output_uri=True)
Another option that will solve the issue as well is editing your ~/clearml.conf and changing the following section sdk.development.default_output_uri to point to your fileserver/hosting

3 years ago

0 Hi! While I'M At The Office, All Works Well, But At Home I Get A Lot Of Timeout Warnings While Trying To Download Or Save Data. I Dont Think It Is Related To The Connection Quality Because It Is Realy Good (Download 600 Upload 100). Can You Help Me Fig

The communication is done via HTTPS so relevant ports should be open.

Did you try with a hotspot connection from your phone?

one year ago

0 When I'M Looking At A Frames Of A Dataset Version That Is Stored In Private Blob Storage I Can'T See The Photos, It First Prompts Me To Enter A Sas Token. I Entered A Sas Token, But I Still Can'T See The Photos. I Assume This Is Because The Sas Token I En

Hi @<1727497172041076736:profile|TightSheep99> , you can change it in the settings -> configuration section

one year ago

0 Hi Everyone!! Is Clearml Multi Gpu Support. I Have 2 Machines. Each Machine Have 2 A100 Gpu. Do We Have Any Option To Run Workload In These Gpu. Same Time Like Virtually. Do We Have The Support??

None

one year ago

0 Hi, I Have A Question About The Model Registry. Here'S My Situation: I'M Using K8S_Example And Struggling With Uploading A Model. Should Models Be Uploaded To The Fileserver, Or Should I Create Another S3 Bucket As Mentioned In The Documentation?

So when you do torch.save() it doesn't save the model?

one year ago

0 Hi, I’M Running An Agent In K8S Using The Glue. I’M Trying To Set The Setup Shell Script To Install Some Packages Through Apt But I Don’T Think It Even Runs. I Dont See Anything In The Console Logs That Says It Does, At Least. Is There Anyway I Can Debug

Looks like it's not running in docker mode 🙂
Otherwise you'd have the 'docker run' command at the sttart

one year ago

0 If You Rely On Task To Automatically Upload Artifacts, It Seems You Cannot Retrieve Them Using

TrickyRaccoon92 , Hi!

Yes I believe this is the intended behavior. Since if you upload automatically you can upload many artifacts during a single run, whereas when you upload manually you create the object yourself.

4 years ago

0 Hi All! I Am Trying To Run The Notebook From The Remote Server Using Aws. It Seems Like I Successfully Installed Clearml Using !Pip Install Clearml Command, But When I Am Trying To Run !Clearml-Init I Got The Following Error: /Bin/Bash: Clearml-Init: Comm

or /home/<USER_NAME>/clearml.conf

3 years ago

0 Hi, Is There A Solution For User-Roles? I Want To Give Access To Clearml To A User Outside The Ds Team, But Only To View Experiment Results. I Don'T Want Them To Accidently Clone/Archive/Enqueue Anything. Is This An Option?

Hi @<1523701235335565312:profile|HugeArcticwolf77> , user roles & permissions are only available in the Scale & Enterprise versions

2 years ago

0 I Am Studying Using The「Pipeline From Tasks 」Pages.

None
None

11 months ago

0 Hi All

Hi @<1523704667563888640:profile|CooperativeOtter46> , I think this is what you're looking for:
None

2 years ago

0 Hello, Is There A Way To Check Whether The Experiment Was Run From Cli (E.G. Using Clearml-Task) Or By Clone+Enqueue From The Api, I Mean From The Code While The Experiment Is Running?

ResponsiveHedgehong88 , please look here:
https://clearml.slack.com/archives/CTK20V944/p1660142477652039
Is this what you're looking for?

3 years ago

0 Hi Team,I Am Doing Retraining Of The Model Once New Data

Can you please elaborate further or add some information on how you've reached this situation?

2 years ago

0 Hi, I Am Using Clearml On A New Server, And Task.Init() Crashes When I Run It From (Remote) Pycharm But Ok When I Run From A Commandline. Running On Remote Pycharm Is Ok For Me On Another Server. The Error That I Get Is:

Can you try deleting the cache folder? It should be somewhere around ~/.clearml

3 years ago

0 Hi Everyone. I’M Struggling To Setup Minio Storage. Below Is What I’M Adding In My Credentials And When I Try To Create A New Dataset Using Below Command; I Get Errors: Configs:

With what host config were you trying the last attempts?

one year ago

0 I Am Using Hydra. When Running Locally The Code Takes Into Consideration Any Hydra Override Arguments I Pass In The Command Line. But When I Run The Same Task In Remote (Using Clearml-Agent).... It Uses Only The Default Values. Is This Behaviour Reasonab

@<1546303277010784256:profile|LivelyBadger26> , it is Nathan Belmore's thread just above yours in the community channel 🙂

2 years ago

0 Hi, I Just Started Working With Clearml And I Have A Question About One Of My Plots. Fig 1 Is What It Looks Like In My Pycharm Output. Fig 2 Is What Is Logged In The Clearml Server. Why Does The Figure Change So Drastically? And How Can I Solve It? Sideno

TartSeagull57 , you said the problem was with automatic reporting. Can you give an example of how you solved the issue for yourself?

3 years ago

0 I Have The User/Pass Set Up On The

Can you also add a full log of the run that was showing the git pass in the startup print?

11 months ago

0 Hi All - I Have A Large Dataset And Have Preprocessed It And Saved Each Item In .Pt Files, Which Are Loaded Using

Hi @<1724960464275771392:profile|DepravedBee82> , you have the auto_connect_frameworks parameter in Task.init() , this way you can disable the auto connection to Pytorch
None

11 months ago

0 Hi Everyone! I'M Looking For A Way To Consolidate Multiple Workspaces Of 3 Users In My Company. Is It Possible? If Yes, How? The Objective Is To Have All The Data (Experiments, Models Metrics...) From All Users Into A Single User With Subscription.

I don't think there is any out of the box method for this. You can extract everything using the API from one workspace and repopulate it in another workspace also using the APIs.

6 months ago

0 Hi, I Configured An On-Prem File Server For Clearml Which Is Mounted On My Pc. I Am Trying Retrieve An Artifact From A Previous Run . Because This File Is Big I Want To Bring It To The Local Cache (On My Pc). However, When I Do The Following Artifact =Tas

Hi @<1546303277010784256:profile|LivelyBadger26> , can you provide a snippet that reproduces this?

2 years ago

0 I Have A Project Which Is Hidden, How Do I Unhide It?

The project should have a system tag called 'hidden'. If you remove the tag via the API ( None ) that should solve the issue.

How was the project turned to hidden?

one year ago

0 Hi I’M Trying Out Pipeline Controller From Tasks. I Was Not Able To Understand Why My Code Results In Just One Task(The First One) In The Pipeline.

Hi UpsetBlackbird87 ,
If you're in the pipelines UI, you can switch to the detailed view and you can see each step of the pipeline as a node 🙂
You can see an example here:
https://clear.ml/docs/latest/docs/pipelines/pipelines

3 years ago

0 I'Ve Had This Bug Where Every Few Weeks All My Current Running Experiments Are Stopped And Then Deleted. This Has Now Happend Like 3-4 Times. I Dont Understand What Is Causing It. Model Files, Debug Images Are Saved In Fileserver Folder, But The Task Itse

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , I'm guessing it's a self deployed server. What version are you on? Did you ever see any errors/issues in mongodb/elastic?

Do you mean that ALL experiments are being deleted from all projects?

one year ago

0 Another Question: How Can I Set The Fileserver Ip? E.G. I Want The Artifact Locations To Point To My Proxy Server, So That I Can Support Ssl

The cool thing is that you can also configure this from code as well 🙂
One example is:
https://clear.ml/docs/latest/docs/references/sdk/task#taskinit
Task.init(...,output_uri="<URL_TO_BUCKET>")

3 years ago

Show more results