CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 I Guess One Experiment Is Running Backwards In Time

lol! Can you hit F12 and see what the server returns for the call projects.get_all_ex

3 years ago

0 Hi, Can I Provide A Direct Url For Pytorch Wheel Through Clearml.Conf File Or Somewhere Else? I'M Having A Following Issue.

Hi @<1664079296102141952:profile|DangerousStarfish38> , I think the issue is resolving the versions of torch. Are you using an older python version on the agent?

one year ago

0 Hi Everyone! I Have Started Using The

It's handled by a separate process, my guess that it will start downloading other chunks of the data or just wait for the original process.

7 months ago

0 Hi everyone, :wave: Is it possible to execute ML projects on one platform? Execute Ops part on the ClearML platform?

Hi @<1753589101044436992:profile|ThankfulSeaturtle1> , not sure I understand what you mean. Can you please elaborate?

one year ago

0 What Is The Proccess To Rerun Optimization Sub-Tasks That Failed? Also, Can You Add More Paramters Combinations To Optimization After It Was Completed?

I think you can simply reset and enqueue the task again for it to run. Question is, why did it fail?
Are you running the HPO example? What do you mean by adding more parameter combinations? If the optimizer task finished you either need a new one or to reset the previous and re-run it.
You can do various edits while in draft mode

3 years ago

0 Hi All, What Options Do I Have For Setting Up Autoscaling Queues On Azure? Anything Else Other Than Kubernetes? And If Going The Kubernetes Route Is Enterprise Needed Or Would The Pro Package Be Enough? Would Scaling To 0 Be Possible? Also, Any Way To Ea

The functionality is basically the same as the GCP/AWS ones but since it is only in the Scale/Enterprise I don't think there is any documentation externally

one year ago

0 Hi All, I Have Made A Pipeline Using Pipelinedecorator Which Runs Fine When I Run It Locally. When I Execute It Remotely, It Gets Stuck In The Queue Forever. Any Ideas? I Really Appreciate Your Help On That One

A worker can execute only a single job at a time

11 months ago

0 Hi, If I Work With Excel Files And I Add New Features In It How Can Clearml Can Help Me Track The Features? How Should I Store My Samples (500,000) To Maximize The Benefit?

One way that is, every new feature will be save as a new file and I will specify the parent.

I think that would be the best way 🙂

3 years ago

0 Hey Everyone, We'Re Running A Remote Execution (K8S Agent) Clearml Pipeline From Jupyterhub, But When The Agent Prepares The Environment, It Installs A Different Version Of The Packages Specified In Our

Hi @<1535793988726951936:profile|YummyElephant76> , did you use Task.add_requirements ?
None

2 years ago

0 Hey, I Am New With Clearml And Need Some Help

This is the env variable you're looking for - CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL

None

one year ago

0 Hi! While I'M At The Office, All Works Well, But At Home I Get A Lot Of Timeout Warnings While Trying To Download Or Save Data. I Dont Think It Is Related To The Connection Quality Because It Is Realy Good (Download 600 Upload 100). Can You Help Me Fig

Then indeed it looks like a network/provider issue

one year ago

0 Can Anybody Give A Code Example Of How To Do Runtime Changes To Taskscheduler?

Hi GloriousPenguin2 , have you tried the method you mentioned in the previous thread?

Like fetching the task of the scheduler and then changing the configuration json?

2 years ago

0 Hi, I'M Trying To Upload Data To Clearml Parallelly. Is It Impossible To Use

AbruptCow41 , can you please elaborate? You want to move around files to some common folder and then at the end just create the dataset using that folder?

3 years ago

0 Hey Everyone! First Post Here. My Issue Is The Python_Binary I Set In The .Conf File Doesn'T Seem To Get Used By The Task I'M Running. The Task'S Output Confirms

Is there any specific reason you're not running in docker mode? Running in docker would simplify things

2 years ago

0 Hello, Is It Possible To Migrate From A Domain Name To Another ? I Have Instanciated A Clearml Server With Domain Name Myclearml.Server Et A Data File Server With Domaine Name Myminio.Server And Some Data Scientists Used It. Now I Have Backuped The Data

Hi DepravedCoyote18 , as long as you have everything backed up (configurations and data) on /opt/clearml/ (I think this is the default folder for storing clearml related stuff) the server migration should work (Data is a different issue).

However, ClearML holds links internally for datasets/debug samples/artifacts and a few other outputs maybe. Everything currently logged in the system to a certain minio server will still be pointing to that minio server.

Does that make sense?

3 years ago

0 Hello! Is It Possible To Use S3 Backblaze With Clearml? Can I Use The Aws Section For That Settings? Or Another Section In Clearml.Conf Corresponding To Backblaze Would Work? Or There Is No Way To Use Backblaze In This Case At All?

Just to make sure, does Backblaze support the boto3 SDK?

10 months ago

0 Hi There, Maybe This Was Already Asked But I Don'T Remember: Would It Be Possible To Have The Clearml-Agent Switch Between Docker Mode And Virtualenv Mode At Runtime, Depending On The Experiment

Hi JitteryCoyote63 , I don't believe this is possible. Might want to open a GitHub feature request for this.

I'm curious, what is the use case? Why not use some default python docker image as default on agent level and then when you need a specific image put into the experiment configuration?

2 years ago

0 I Am Trying To Test And Show The Results On My Local Machine. ( Clearml-Server With

Hi, where did you get the instructions thay specify 'trains' ? Everything should be switched to 'clearml'

3 years ago

0 Hi There, Would It Be Possible For The Autoscaler To Support Stopping Instances Instead Of Terminating Them? My Use Case Is The Following: I Am Continuing My Journey With The Clearml-Session Tool, And In Case The Clearml-Session Is Running In A Ec2 Inst

Hi JitteryCoyote63 ,

Regarding Edit 2: This seems like a nice idea.

Regarding adding option to only stop them - Please open a feature request on GitHub 🙂

3 years ago

0 Hi Guys! What Is The Best Way To Access Artifacts From Other Step Of The Pipeline? I Have Step One Returning Dataframe And Step Two Takes It As An Input But When First Step Is Cached I Only Get An Artifact Url. So How Should I Read It From Artifacts Stora

@<1544853721739956224:profile|QuizzicalFox36> , are you running the steps from the machine who's config you checked?

2 years ago

0 Hi, We'Ve Been Trying To Run The Same Experiments As We Did At Previous Times But Have Been Getting Configuration Errors After Credentials Errors Over And Over. I'Ve Went Ahead And Replaced All Of Our Existing Credentials With New Ones, Went Through The

I've also suspected as much. I've asked the guys check out the credentials starting with TX4PW3O (What you provided). They managed to use the credentials successfully with errors.

Therefor it is a configuration issue.

one year ago

0 Hi Again! I'M Trying To Figure Out Why My Hpo Doesn'T Seem To Work For This Simple

Are the cloned tasks running? Can you add logs from the HPO and one of the child tasks?

3 months ago

0 Can I Somehow Change A Project Settings Via The Python Sdk?

I think you can do this only through the API, if at all possible since it's a system tag. Which project do you want to edit?

2 years ago

0 Hi, I'M Setting A

I played a bit with it and got to the value. OutrageousSheep60 , please tell me if this helps you 🙂

` >>> task.set_user_properties(x=5)
True

y=task.get_user_properties()
y
{'x': {'section': 'properties', 'name': 'x', 'value': '5'}}
y["x"]["value"]
'5' `

3 years ago

0 Hpo Question: I Created Hpo App In Clearml Ui, With Certain Parameter To Optimize, With Minumal Value=0.0, Max=1.0 And Step=1.0. So As Far As I Understand This Hpa Should Launch 10 Experiments. In Fact, It'S Launching Tens Of Experiments (>30 And Still

AttractiveShrimp45 , can you please open a GitHub issue to follow on this please?

2 years ago

0 Hi, Question Regarding

Did you wait 10-15~ mins for it to time out?

3 years ago

0 Automatic Logging For Generated Matplotlib Works Nicely, But For Some Reason It Names The Graphs As "00 Untitled" And Uses Series "Plot Image" In Clearml Ui -- Any Way To Circumvent This, Other Than Explicit Reporting?

What versions of ClearML/matplotlib are you using?

3 years ago

0 Hi All! When I Set A List As A Task Parameter And Later Try To Retrieve It, What I Get Is A String. Is This The Expected Behavior? I Have Prepared The Following Snippet So That You Can Reproduce It.

get_parameter returns the value of a parameter as documented:
https://clear.ml/docs/latest/docs/references/sdk/task#get_parameter

Maybe try https://clear.ml/docs/latest/docs/references/sdk/task#get_parameters

3 years ago

0 Hey, Is There A Way To Pass Docker Args For The Execution Of A Pipeline Controller Defined Through Decorator

Hi FierceHamster54 , you have docker_args in https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#pipelinedecoratorcomponent

3 years ago

0 Can You Please Tell Me How To Make The Agent Use The Docker Env By Default? Instead Of Creating Venv It Already Has All The Necessary Environment And Libraries Installed

Hi @<1523702932069945344:profile|CheerfulGorilla72> , I think you need to map out the relevant folders for the docker. You can add docker arguments to the task using Task.set_base_docker

2 years ago

Show more results