CostlyOstrich36

0 Questions, 3782 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3782

0 Hi All, Is There An Easy Way To Ping The Server Programatically? I'M Just Trying To See What Is The Default Server That Is Set, And Is It Responsive

My bad, please use debug.ping instead of debug/ping

3 years ago

0 [Distributed Training] Hi, I Have A Clearml Setup With K8Sglue That Spins Up Pods Of 4 Gpus When Picking Tasks Off The Clearml Queue. We Would Now Want To Proceed With Multi-Node Training, And Some Of The Examples We Are Trying Are Here.

Hi SubstantialElk6 , maybe SuccessfulKoala55 might have more input on this 🙂

one year ago

0 Hey I Instantiate Clearml Task Within A Script, Called By Dvc. It Ends Up Creating Two Tasks Every Time. Know Why?

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , not sure what you mean. Can you please share the full log, a screenshot of the two experiments and some snippet that re-creates this for you?

one year ago

0 I Have A Question Regarding "Imitating" An Agent Pulling Some Task For Debugging Purposes I Am Trying To Do Something Like: Creating A Task On The Server

DepressedChimpanzee34 , and you're having problems at step 4 when you're trying to to override the connected configurations. Am I understanding you correctly?

3 years ago

0 I Have A Question Regarding "Imitating" An Agent Pulling Some Task For Debugging Purposes I Am Trying To Do Something Like: Creating A Task On The Server

DepressedChimpanzee34 , how are you trying to get the remote config values? Also, what which configurations are we talking about specifically?

3 years ago

0 Hi All, Is There An Easy Way To Ping The Server Programatically? I'M Just Trying To See What Is The Default Server That Is Set, And Is It Responsive

DepressedChimpanzee34 , Damn that's a shame. Then it means that to use the endpoint you'll need to implement some network communication in python (something like curl through python)
I found another one that might help:
client.session.get_clients()
This will return the clearm and server versions. This should be validation enough if server is up or not.

However I'd suggest implementing some sort of ability to send POST api calls via your script.

3 years ago

0 Hello ! I Am Wondering About How Pipelines Are Displayed In Projects View In Clear Ml Ui, Seems That There Is A Separate Folder For A Pipeline, But Its Invisible, How Can I Make Is Visible?

Hi @<1623491856241266688:profile|TenseCrab59> , you can go into settings (profile icon on the top right of the UI) -> Configuration - Enable 'Show Hidden Projects'

one year ago

0 Hello, What Are Mongodb Default Login Credentials For Self Hosted Clearml Server? We Are Moving Our Datasets To Another Place And So Far I Think Clearml Doesnt Support It. So I Would Like To Try Change The Database Entry (Im Guessing Its Stored Somewhere)

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , I don't think there are any login credentials for mongodb by default in the OS

9 months ago

0 Hey, So I Am Trying To Run A Script To Train A Model Using Yolov8 Ultralytics. When I Run It Locally On My Computer It Executes Without Any Errors, But When I Try And Run It Through A Clearml-Agent I Always Get An Error That Makes No Sense: The Model Is F

Hi @<1736919317200506880:profile|NastyStarfish19> , can you provide an example script that reproduces this behaviour? Also full log of the execution would be useful 🙂

4 months ago

0 Two Questions Today. First, Is There Some Way To Calculate The Number Of Gpu-Hours Used For A Project? Could I Select All Experiments And Count Up The Number Of Gpu-Hours/Gpu-Weeks? I Realize I Could Do This Manually By Looking At The Gpu Utilization Grap

You can do this quite easily with some code and the API 🙂

2 years ago

0 Hello! How Will Clearml React, If I Have Combine Two Datasets Into A New Dataset, And Both Contain A File “Ids.Txt”. Will One Be Overwritten, Will Both Files Be Merged, Will There Be Two Renamed Files? Thank You!

I think as long as they have different hashes you will have two different files

5 months ago

0 Im Having Difficuilty Understanding How To Handle Modified Files On S3

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , the reason for this is because each file is hashed and this is how the feature compares between versions. If you're looking to keep track of specific links then the HyperDatasets might be what you're looking for - None

5 months ago

0 Hi. I'M Using Clearml To Log My Experiments. During Training, I Load Files Using Torch.Load.Clearml Displays The Following Message:

SoreDragonfly16 You can disable this with the following argument in task.init() - auto_connect_frameworks=False for example:
task = Task.init(..., auto_connect_frameworks={'pytorch': False})You can refer to this documentation for further reading at this https://clear.ml/docs/latest/docs/references/sdk/task#taskinit 🙂

3 years ago

0 Hello, May I Ask If There Is A Means To Export Dataset In One Clearml Setup And Import To Another Clearml Setup?

Hi OddShrimp85 , you mean the dataset object itself?

2 years ago

0 Is There Anywhere In The Web Ui Where One Can See The Clearml Server Version Running? I Keep Getting "Version 1.1.1 Is Now Available" Even Though I'M Pretty Sure I Took All The Steps To Update To The Latest Version

UnevenDolphin73 , sorry for the delay 🙂
Please go to the profile page, hit F12 and do CTRL+F5

In 'Network' there should be a call to ' http://server.info '. Can you please copy paste the response here?

3 years ago

0 How Does Clearml Store Some Of The More Intrinsic Data (Scalars, Plots, Etc)? We Recently Recovered Mongo From A Backup And While The Projects And Tasks Are There, The Console, Info, Etc Of All Of Them Is Missing

Hmmm I would guess something would be possible but I'm not sure how to go about it. Maybe @<1523701087100473344:profile|SuccessfulKoala55> or @<1523701994743664640:profile|AppetizingMouse58> can give some more input.

one year ago

0 How Do I Create An Experiment Where I Can Set The Github Repository/Branch Name/Script Path Like This Example Shows?

Hi BoredHedgehog47 , You need to add
from clearml import Task task = Task.init(project_name='examples', task_name='hello world')to your code and run it once after you've ran clearml-init

2 years ago

Hi @<1523701083040387072:profile|UnevenDolphin73> , all the scalars plots etc are saved on Elastic

one year ago

0 How Do I Create An Experiment Where I Can Set The Github Repository/Branch Name/Script Path Like This Example Shows?

Yep, exactly 🙂

2 years ago

0 Does Clearml Have The Ability To Run A Single Experiment Across Multiple Nodes/Gpus In A K8 Cluster?

Maybe SuccessfulKoala55 might have more insight on setting K8s integration 🙂

2 years ago

0 How Do I Create An Experiment Where I Can Set The Github Repository/Branch Name/Script Path Like This Example Shows?

If you run inside a repository, then yes

2 years ago

UnevenDolphin73 , can you please provide a screenshot of the window, message and the URL in sight?

3 years ago

0 Automatic Logging For Generated Matplotlib Works Nicely, But For Some Reason It Names The Graphs As "00 Untitled" And Uses Series "Plot Image" In Clearml Ui -- Any Way To Circumvent This, Other Than Explicit Reporting?

Did you try what I added? Also the screenshot is too small, nothing is readable

3 years ago

0 Hi Everyone! I Built A Task That Processes Data And In The End Generates A Large Folder Containing Images (Aprox 10Gb). I Would Like To Be Able To Upload This Folder As An Artifact But When I Try To Do This With Task.Upload_Artifact I Get This Error. Is T

Also how are you uploading? Because if you don't zip the folder and upload with
task.upload_artifact('local folder', artifact_object=os.path('<PATH_TO_FOLDER>'))
This should work

3 years ago

0 Hi There I'M Trying Out Clearml. I Saw Mention That Clearml Can Capture Tensorboard Output So I Tried It With This Little Script (Image Below). The Events File Is Filled, The Clearml Task Is Created, And Marked Complete However There Is Nothing In The Sc

Strange, I'm not familiar with tensorboard_logger package. I see it's latest package on pypi is also 0.1.0 with latest supported python 3.5.

Scalers are usually reported and auto captured through SummaryWriter if I'm not mistaken. I found an example here:
https://github.com/allegroai/clearml/blob/master/examples/frameworks/pytorch/pytorch_tensorboard.py

Anyhow I'll take a look into it 🙂

2 years ago

0 I Just Found Out That I Have A Lot Of Data In /Opt/Clearml/Fileserver For Tasks That I Already Have Deleted. No Artifacts Are Displayed In The Webui. Anyway I Can Automatically Delete All Unused Data?

Hmmmm you can automate the cleanup. Iterate through folders, if such an experiment exists, skip, if no experiment exists, delete folder

2 years ago

0 Also, Just Curious - Does Clearml Restrict The Number Of Artefacts Recorded To Just One?

What do you mean? You can report as many artifacts as you want

one year ago

0 There Is Something Weird Going On With Console Log After Latest Updates Of Clearml Server. It Doesn'T Show The Latest Updates, Instead It Often Jumps To The Seemingly Random Parts Of The Console Output

Hi DilapidatedDucks58 , what is your server version?

one year ago

0 How To Make Sure That Clearml Agents Are Running Queue After Server Restart? Sometimes Our Worker Dies And We Manually Have To Run Settuping For Queue, We Run It In Docker Mode Too

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , you need add the agent command that you run into the bootup of your system

one year ago

0 Hello, How To Handle Clearml.Task.Add_Requirements("Requirements.Txt) Cases When We Have --Extra-Intex-Url In The File

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , you can just leave the packages as any other package and add the --extra-index-url in clearml.conf of the agent

5 months ago

Show more results