I also ran it without $(pwd) on the Create Clearml task templates section, I added it because of CostlyOstrich36 's comments but it didn't help

anyway, my ultimate goal is to create templates for other tasks... Is that possible in any other way through the CLI?

Github actions allows to use self hosted runners

id did not help

SuccessfulKoala55 ⬆ sorry for the delay, was at a meeting

I can't specify the absolute path, it is dynamically created

I can try do an ls to see what it will print out

and I run these command manually

` name: XXXXXXXXXX

on:
workflow_dispatch

jobs:
test-monthly-predictions:
runs-on: self-hosted
env:
DATA_DIR: ${{ secrets.RUNNER_DATA_DIR }}
GOOGLE_APPLICATION_CREDENTIALS: ${{ secrets.RUNNER_CREDS }}
steps:
# Checkout
- name: Check out repository code
uses: actions/checkout@v2

  # Setup python environment
  - name: Setup up python environment using Poetry
    run: |
      /home/elior/.poetry/bin/poetry env use python3.9
  ...

SuccessfulKoala55 seems like you got it spot on, it contains the entire repo, but no .git directory

So what can we do about it? All I want is to create templates for some tasks, so I can later execute them through a Pipelinecontroller

but when it is executed through github actions, I get this error

it works without any problem

I executed it now with full path, using $(pwd)

to see if it contains the .git folder

even if it is so

I mean, I barely have 20 experiments

SuccessfulKoala55 AppetizingMouse58

[ec2-user@ip-10-0-0-95 ~]$ df -h Filesystem Size Used Avail Use% Mounted on devtmpfs 3.9G 0 3.9G 0% /dev tmpfs 3.9G 0 3.9G 0% /dev/shm tmpfs 3.9G 880K 3.9G 1% /run tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup /dev/nvme0n1p1 8.0G 6.5G 1.5G 82% / tmpfs 790M 0 790M 0% /run/user/1000

Increased to 20, lets see how long will it last 🙂

what should I paste here to diagnose it?

I guess the AMI auto updated

This error just keeps coming back... I already made the watermarks like 0.5gb

Now I see the watermarks are 2gb

(it works now, with 20 GB)

💪

Is there a way to do so without touching the config? directly through the Task object?