Hi @<1762286410452176896:profile|ExcitedFrog68> , if you open dev tools (F12) do you see any console errors?

Hi @<1580367711848894464:profile|ApprehensiveRaven81> , I'm afraid this is only option for the open source version. In the Scale/Enterprise licenses there are SSO/LDAP integrations

Should work out of the box

connected_config = task.connect({})

Looks like you're connecting an empty config..

If you run inside a repository, then yes

The project should have a system tag called 'hidden'. If you remove the tag via the API ( None ) that should solve the issue.

How was the project turned to hidden?

Yes

Do you have an example to play with?

Hi @<1562610699555835904:profile|VirtuousHedgehong97> , I think you can mount some shared folder between the ec2 instances to use as cache. ClearML hashes data so it can know if what it has in it's cache is relevant or not.

Hi @<1853608151669018624:profile|ColossalSquid53> , if there is no connectivity to the clearml server, your python script will run regardless. clearml will cache all logs/events and then flush them once connectivity to the server is resumed.

Are you running the agent on the same machine as the server?

Hi @<1785479228557365248:profile|BewilderedDove91> , please provide a full log of the execution

GrievingTurkey78 , what framework are you working with? Can you provide some more information regarding your environment - linux/windows, pip/conda? Can you provide maybe a snippet of your code I can try to run to reproduce?

https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#get_processed_nodes

@<1556812486840160256:profile|SuccessfulRaven86> , what is the base docker image you mention? Did you check that this docker has python 3.9?

Yes

Hi @<1749965229388730368:profile|UnevenDeer21> , can you add the log of the job that failed?

Also, note that you can set these arguments from the webUI on the task level itself as well, Execution tab and then container section

Maybe SmugDolphin23 or AppetizingMouse58 might have some insight into this since behavior of Datasets changed in the last year I think

Also, how are you trying to download them?

Hi EcstaticMouse10 , what was your previous version?

Also, what if you try to specify id's instead of names?

Hi ScantCrab97 , please update it it worked 🙂

So does it mean you basically recreated your entire training environment just in production?
Regarding the questions:
I'm not sure I understand. If you don't expose code... What would be executed? I think this is something available only on the Scale/Enterprise level

Hi @<1576381444509405184:profile|ManiacalLizard2> , it feels like something related to the resources of the server or networking and it's having a hard time retrieving the data from ES. What resources have you allocated for the API server/ ES?

Hi @<1523707653782507520:profile|MelancholyElk85> , I assume you're running remotely?

VexedCat68 , that's a good question! I'm not sure that ClearML keeps track of that, I need to check on that.

However, I think a neat solution could be using the datasets as task configuration parameters. This way you can track which datasets were used and you can set up new runs with different datasets.

DepressedChimpanzee34 I see what you mean! Let me check regarding that 🙂

https://clear.ml/docs/latest/docs/references/sdk/dataset/#get_num_chunks
I think this might also be helpful. Gloss over the functions available in the documentation, I think you might find what you're looking for 🙂

Next release of clearml-serving , correct

You have the open source repository of the documents - None

I think you could generate a pdf from that with some code.

I think you can report these statistics manually to the Dataset