CostlyOstrich36

Hi @<1547390438648844288:profile|ScaryJellyfish75> , you have described the HyperDataset feature which is part of the Scale/Enterprise versions. I suggest you contact sales@clear.ml to get a quote for a license 🙂

2 years ago

0 Hello All, I'M Trying To Adapt Clearml With My Workflow. I Installed A Server At My Server, With Workers Attached To It. I'M Trying To Execute A Task From My Local Within One Of My Workers. Trying To Use Docker Mode And A Custom Image. I Also Have A Local

Can you also try specifying the branch/commit?

3 years ago

However, when I try to bind a volume and run the code, everything runs perfectly.

Can you please elaborate on what this means?

3 years ago

0 After Running My Pipeline On A Gcp Vm, I Am Getting The Following Error When Installing The Packages Successfully Installed Numpy-1.24.1 Torch Cuda 110 Index Page Found, Adding

Hi @<1610083503607648256:profile|DiminutiveToad80> , can you please add a full log of the run?

2 years ago

0 Trying To Access The Csv File Uploaded On The Clearml Dataset In My Local Device Is Giving Me Some Errors

What is the dataset URL you see in the UI? If you go to the dataset, there should be a view to the dataset link

3 years ago

0 Hi, I Have A Question Regarding Clearml Datasets. In The Web Ui, What Causes The "Content" Tab To Show A List Of The Files In The Dataset? It Used To Show Automatically, But Recently It Now Has "No Data To Show" Even Though All Files Are Definitely In The

Do any of these API calls have a "Dataset Content" field anywhere in the "configuration" section?

one year ago

0 Hi, I'M Trying To Setup The Storage (Aws S3) For All Components Of Clearml. I'M Deploying Clearml On Kubernetes With The Official Helm Charts. I Can'T Find A Way To Inject The Configuration File In The Webserver / Apiserver / Fileserver. With The Agent,

Not really, you can even point the files_server in clearml.conf to s3. the files server is there so there would be some basic storage solution attached.

one year ago

0 Hi, Is There A Way To Move Existing Pipelines Between Projects? Use Case: I Want To Utilize The New Pipeline Grouping Option And View Them By Project Name. Thing Is, I Accidently Named A Few Of Them Wrongly And It Messes Up The Grouping. Of Course I Can

Hi @<1523701235335565312:profile|HugeArcticwolf77> , looks like there is no such capability through the UI if I'm not wrong. You should, however be able to move everything via the API, I would however suggest making sure you move ALL parts of the pipeline and not just the controller.

Makes sense?

2 years ago

0 Hi, We Have Clearml Version Webapp: 1.3.0-165 • Server: 1.3.0-165 • Api: 2.17 Suddenly All Experiments Were Removed. After Checking Logs We See That Before 6 Days Elasticsearch Container Was Terminated Due To Out Of Memory And New One Was Created Instead

You can restore these tasks by copying or moving them from task__trash into task collection. But the events for these tasks cannot be restored. About the user who deleted them unfortunately ClearML does not record this info in Mongo and without logging to ES there is no place to retrieve it (I can suggest using Kibana to monitor ES). You can try to inspect the mongo collection url_to_delete. It contains all the links from the deleted tasks that should be removed from the fileserver. If you se...

2 years ago

0 Graph Is Drawn Quite Bad In Such Cases, Hard To Understand The Relations Red Line Shows The Actual Linking, But It Looks Like It Links To Another Dataset Along The Way Clearml==1.15.1

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , what is the version of your ClearML server?

one year ago

0 Hi, I'M Getting The Following Error When Running Docker Agent Using A Docker: Clearml_Agent: Error: [Errno 28] No Space Left On Device: '/Root/.Clearml/Venvs-Builds' Any Suggestion On How To Solve This Issue (The Host Has Enough Space On Disk)

Hi, what version of clearml-agent are you using? Does this always happen? Can you add your clearml.conf file here(Make sure to remove any credentials/personal data)?

2 years ago

0 I Have A Problem That Might Not Directly Be Clearml Related, But Maybe Someone Here Has An Idea: I Run A Clearml-Server On A Machine With 128Gb Ram, 32 Cores And 2 Gpus. On The Same Machine I Run 2 Clearml-Agent Each With Access To 1 Gpu, 12 Cores, An 48G

than maybe a process inside the container gets killed and the container will hang? Is this possible?

I'm not sure. Usually if Elastic is unresponsive/not working properly the API server will have issues raising/working and will print out errors

3 years ago

0 Hi, I Am Fine-Tuning Pretrained Models From Huggingface The Trainer Method. During The Training I Generate Checkpoints Which I Want To Access Via Clearml. It Correctly Uploads Trainig_Args.Bin,

Hi @<1582542029752111104:profile|GorgeousWoodpecker69> , I think you can also manually register them using Task.upload_artifact None

2 years ago

0 Hi! I Started Clearml Server On Ec2 Using Prebuilt Image. Everything Works Fine, Except One Small Thing: When Web App Shows Image That Stored On S3, It Asked Me For Aws Key/Secret Key. Then It Uses These Credentials To Provide Me With Signed Image Url, T

Hi @<1566959349153140736:profile|ShinyChicken29> , when you try to access the image on your browser, the browser tries access the S3 bucket directly - This is why you get the popup. Data never goes through ClearML backend. Makes sense?

2 years ago

0 How Do You Get Clearml Gpu Compute To Show Up Under Applications Or Autoscalers?

Hi @<1719524641879363584:profile|ThankfulClams64> , what do you mean regarding ClearML GPU Compute? Do you mean the Genesis autoscaler?

one year ago

0 Hello Everyone, Quick Question Regarding The Api - What Would Be The Best Way To Trigger A New Run Of An Existing Pipeline With An Api Call?

Hi @<1775332375794814976:profile|WhimsicalChimpanzee6> , the webUI uses the API under the hood. You can trigger and a pipeline via the webUI and see what happens in developer tools (F12)

11 months ago

0 Hi, I Was Trying Out The Clearml Pipelines From Task. I Had 2 Tasks That Have Run Successfully As Clearml Task. One Of The Tasks Has Dependency On External Python File. I.E. I Have Used From <External File> Import Methoda In My First Task. It Executed Fin

is the external package is in some private repo?

2 years ago

0 Does Anyone Know Why Uploading A Dataset From Your Local Machine Sets A

Hi @<1840924578885406720:profile|VictoriousFish46> , how are you uploading the dataset? Did you set output_uri? What is set as your files server in the api section of your clearml.conf ?

5 months ago

0 Hi, What Would Be The Best Way To Save A Pandas.Dataframe As An

Hi!
I think the example here should help you.
https://github.com/allegroai/clearml/blob/master/examples/reporting/pandas_reporting.py#L19
Together with this
https://github.com/allegroai/clearml/blob/master/examples/reporting/artifacts.py
Tell me if it helped 🙂

3 years ago

0 Hi All! I Am Trying To Run The Notebook From The Remote Server Using Aws. It Seems Like I Successfully Installed Clearml Using !Pip Install Clearml Command, But When I Am Trying To Run !Clearml-Init I Got The Following Error: /Bin/Bash: Clearml-Init: Comm

Can I assume that you've installed the latest version of ClearML?

3 years ago

0 Hey Everyone Looking To Get Some Input How Clearml Server Set Tasks Status How Does Server Differentiate Between Tasks In Different States:

Hi @<1523701842515595264:profile|PleasantOwl46> , what do you mean more details about the state? Usually in the INFO section of the task you have all history of actions

one month ago

0 Hi All, Two Questions:

Hi, regarding your questions:
If you create and finalize the dataset, it should upload the file contents to the fileserver (or any other storage you configure). The dataset is an object similar to a task - it has a unique ID You can add metric columns to the experiments table. You can do this by clicking the little cog wheel at the top right of the experiments table. You can also select multiple experiments and compare them (Bottom left on the bar that appears after selecting more than 1 expe...

3 years ago

Show more results