Hi TrickySheep9 ,

The Task.init call will detect your repository as part of the automagic. You can disable it with
auto_connect_frameworks={'detect_repository': False}but I dont think this is the case.

Maybe clearml-task ? You can https://clear.ml/docs/latest/docs/guides/clearml-task/clearml_task_tutorial

TrickySheep9 you can also add the queue to execute this task:

task.execute_remotely(queue_name="default")So it will enqueue it too 🙂

Hi LethalCentipede31

You can report plotly with task.get_logger().report_plotly , like in https://github.com/allegroai/clearml/blob/master/examples/reporting/plotly_reporting.py
For seaborn, once you use plt.show it will be in the UI (example https://github.com/allegroai/clearml/blob/master/examples/frameworks/matplotlib/matplotlib_example.py#L48 )

Hi JitteryCoyote63 , which ec2 type and AMI are you using?

can you attach the full log of the instance? Did the aws scalar output any logs?

Hi NarrowLobster19 , Is this S3 bucket?

I guess not many people use the local file storage

I’m using it 🙂
How can I reproduce this issue? what should I have as cache_dir ? ~/.clearml ?

Can you check the running user has all the permissions?

let me try to reproduce this issue

UnevenDolphin73 I cant reproduce this issue on my side 😞 can you give me some hints how to?

👍 let me try to reproduce with it. can you write the change you edited in the docker-compose ?

Hi UnevenDolphin73 . try to archive it, you can delete archive tasks from the UI

Checking that for you

not sure about the Other , but maybe adding some metadata to the artifact can do the trick?

You can get all the artifacts with task.artifacts and you can go over it and filter with the metadata, wdyt?

Hi ConvolutedChicken69 , the Dataset.upload() will upload the data as an artifact to the task and will allow others to use the dataset (ClearML agents for example, running and using the data with Dataset.get() ).

ThickDove42 you can get the version with

clearml-agent --version

Hi SubstantialElk6 ,

You can use any docker image you have access too.
Can you attach the logs with the error? virtualenv should be install with the clearml-agent

https://hub.docker.com/r/nvidia/cuda/tags?page=1&ordering=last_updated&name=11.0-

Hi CheekyToad28 ,

None of the options https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server#deployment works for you?

Hi GiganticTurtle0 ,

You have all the tasks that are part of the pipeline in an execution table (with links) under plots section, does it helps?

and using https://github.com/allegroai/clearml-agent/blob/21c4857795e6392a848b296ceb5480aca5f98e4b/docs/clearml.conf#L140 for running scripts at docker startup

Hey SubstantialElk6 ,

You can try adding environment vars with that info:

os.environ["CLEARML_API_HOST"] = api_server os.environ["CLEARML_WEB_HOST"] = web_server os.environ["CLEARML_FILES_HOST"] = files_server os.environ["CLEARML_API_ACCESS_KEY"] = access_key os.environ["CLEARML_API_SECRET_KEY"] = secret_key

Hi CleanPigeon16 , yes it is.

You can just write the same as you do in your ~/clearml.conf file, for example:

agent.force_git_ssh_protocol = true

Hi HelpfulHare30

1). Great

🙂

2. As you can see from my screenshot,  Data Processing task is created but I don’t see Datasets tab as I see in 

This dataset tab is part of the enterprise solution, clearml-data is part of the open source ClearML

3. I see. So need to specify with every cli command/SDK method call

How do you use it with the SDK?

 thanks for the answer, so for example (to make sure I understand) with the example you gave above when I’ll print the config I’ll see the new edited parameters?

Correct

What about the second part of the question, would it be parsed according to the type hinting?

It should

Not sure getting that, if you are loading the last dataset task in your experiment task code, it should take the most updated one.

how do you load the data inside each task in PROJ_2?

pip install clearml works for me now, if you like to try…

Hi SubstantialElk6 .

ClearML with add you entire script to the uncommitted changes section if its a standalone script (not part of a git repository).
If you run a script that is part of a git repository, the uncommitted changes section will contain the git diff of you work, along with the git repository address, branch, commit id or tag.

In order to re run a clone of this task, the agent running it will need to have the credentials to the repository (in order to clone it)

Hi DeliciousBluewhale87 .

Which cloud provider are you using? If AWS, you can use the https://allegro.ai/clearml/docs/docs/examples/services/aws_autoscaler/aws_autoscaler.html#clearml-aws-autoscaler-service .

Can this do the trick?