ClumsyChimpanzee54

2 Questions, 4 Answers

Active since 20 June 2024

Last activity 5 months ago

Reputation

Badges 1

2 × Eureka!

Questions 2
Answers 4

0 Votes

0 Answers

303 Views

0 Votes 0 Answers 303 Views

Hi, Having Issues Uploading A Large Dataset ~130 Gb. It Is A Single File, The Upload Gets Stuck On Compression For Hours Is There Anyway To Skip It? Smaller Dataset Uploads Work Fine.

Hi, having issues uploading a large dataset ~130 GB. It is a single file, the upload gets stuck on compression for hours is there anyway to skip it? Smaller ...

clearml

4 months ago

0 Votes

4 Answers

407 Views

0 Votes 4 Answers 407 Views

Hi All, What Options Do I Have For Setting Up Autoscaling Queues On Azure? Anything Else Other Than Kubernetes? And If Going The Kubernetes Route Is Enterprise Needed Or Would The Pro Package Be Enough? Would Scaling To 0 Be Possible? Also, Any Way To Ea

Hi all, What options do I have for setting up autoscaling queues on Azure? Anything else other than Kubernetes? And if going the kubernetes route is enterpri...

azure kubernetes

5 months ago

0 Hi All, What Options Do I Have For Setting Up Autoscaling Queues On Azure? Anything Else Other Than Kubernetes? And If Going The Kubernetes Route Is Enterprise Needed Or Would The Pro Package Be Enough? Would Scaling To 0 Be Possible? Also, Any Way To Ea

Ah ok thanks, is there any documentation anywhere? I could only see info on GCP/AWS

5 months ago

Ok fair enough, thanks would be nice to have it listed at least that it is available

5 months ago

0 Hi! To Make My Script Work Inside A Task, I Need To Add

Hey, having very similar issue where my pipeline requires imports from other files in my repository that require the root of the directory to be on the pythonpath.
e.g.
from src.pipelines.pipeline_function_dependencies import parse_total_dataset
src/pipelines/nested_cv_pipeline.py

So folder on level of src needs to be on pythonpath. Should I be using docker_args for this? Or maybe docker_bash_setup_script?

And how do I access the path to the working dir in the docker container so I ...

3 months ago

0 Hi! To Make My Script Work Inside A Task, I Need To Add

Thanks @<1523701435869433856:profile|SmugDolphin23> I will try the first one

3 months ago