Reputation
Badges 1
533 × Eureka!` ClearML launch - launch any codebase on remote machine running clearml-agent
Creating new task
Error: requirements.txt not found [/home/elior/Dev/Projects/XXXXX/requirements.txt] Use --requirements or --packages `
I only want to save it as a template so I can later call it in a pipeline
Is tehre anything specific about the logs we're looking for? Because if I just dumop them it will take me a while to see no sensitive data and naming is there
First of all I wasn't aware that was an option - but I think it's preferable to be able to do it through the command line. Because I'm developing the pipeline to be executed remotely, but for debugging I run it locally.
Using what you showed I can obviously write it, and delete it once it is ready, and rewrite it when I'm debugging or adding features - but I think DX-wise it would be nicer to be able to trigger this functionality through the command line
I was trying out the pipeline controller for the first time and I felt a bit of a burden that just for the sake of trying I had to launch an agent
If this includes scheduling through pipelines, in my opinion there should be an option to execute a pipeline without an agent. Sometimes for development I just want to execute a pipeline on my local machine just as I would a task...
working directory is the same relative to the script, but the absolute path is different as the github action creates a new environment for it and deletes it after
I also ran it without $(pwd) on the Create Clearml task templates section, I added it because of CostlyOstrich36 's comments but it didn't help
anyway, my ultimate goal is to create templates for other tasks... Is that possible in any other way through the CLI?
` name: XXXXXXXXXX
on:
workflow_dispatch
jobs:
test-monthly-predictions:
runs-on: self-hosted
env:
DATA_DIR: ${{ secrets.RUNNER_DATA_DIR }}
GOOGLE_APPLICATION_CREDENTIALS: ${{ secrets.RUNNER_CREDS }}
steps:
# Checkout
- name: Check out repository code
uses: actions/checkout@v2
# Setup python environment
- name: Setup up python environment using Poetry
run: |
/home/elior/.poetry/bin/poetry env use python3.9
...
SuccessfulKoala55 seems like you got it spot on, it contains the entire repo, but no .git
directory
So what can we do about it? All I want is to create templates for some tasks, so I can later execute them through a Pipelinecontroller