For example--packages "tqdm>=2.1" "scikit-learn"
Yes, this will cause the code to run inside the container.
if so it won't work as my environment is in the hist linux
Not sure I understand this part, can you please elaborate?
Hi @<1639799308809146368:profile|TritePigeon86> , you mean that in order to initialize machines in ec2 you need to provide some external ip or you need to pass the external ip as a parameter in order for the job to run?
BroadCoyote44 , Hi!
This is very strange indeed. Which version of clearml are you using? I'm guessing you tried with clearml-init ?
BoredPigeon26 , regarding 2, no I'm afraid not since the task ID is the unique task identifier
Hi JitteryParrot8 ,
ClearML DataOps doesn't track changes in specific files. You can simply store each "new" file as a new version and keep the lineage.
How should I store my samples (500,000) to maximize the benefit?
Can you elaborate please?
Hi ShortElephant92 , how are you adding files currently? Code or CLI? You can specify the storage in both cases.
Via CLI using the--output-uritag.
https://clear.ml/docs/latest/docs/clearml_data/clearml_data_cli#create
Via code use the output_url parameter during Dataset.create() call
https://clear.ml/docs/latest/docs/clearml_data/clearml_data_sdk#datasetcreate
It's the ~/clearml.conf on the side of the agent/clearml that runs the script 🙂
Hi DangerousDragonfly8 , I believe this is supported. You just need to have the object already with links embedded inside
You can actually publish models, this is a model state in ClearML. You can also use tags as an extra layer of filtering
Can you add a log?
TartSeagull57 , can you please open a github issue for tracking? 🙂
Hi PunyWoodpecker71 , I guess it means the task will never finish either
There are no role based access controls in the open source version. This feature exists only in the Scale/Enterprise licenses.
Are you self hosted or using the community?
Hi @<1528546301493383168:profile|ThoughtfulElephant4> , I'm afraid not
Hi SkinnyPanda43 , did you set poetry as your package manager or do you simply want to install it as part of the environment?
AbruptWorm50 , the guys tell me that it's under progress and we will be updated in the following minutes 🙂
Can you add a screenshot of how you see them currently?
WickedBee96 , I think basically you need to find a way to use docker commands without requiring sudo before
This is how I usually add visualization
#Report data preview
ds.get_logger().report_table(title="Data Sample", series="First Ten Rows", table_plot=data1[:10])
ds.upload()
ds.finalize()
I think you can do this only through the API, if at all possible since it's a system tag. Which project do you want to edit?
JitteryCoyote63 , well I'm happy to hear that everything worked out in the end 🙂
Hi CluelessFlamingo93 , I see the following traceback in your log:
`
1672308338689 bfm:0 DEBUG ━━━━━━━━━━━━━━╸ 0.7/1.8 GB 5.9 MB/s eta 0:03:16
ERROR: Exception:
Traceback (most recent call last):
File "/home/bat/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
yield
File "/home/bat/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 560, in read
...
If you want this to be applied to all jobs that run on that agent then yes. Otherwise you can set it up on the task level as well
Did the second run, run remotely or locally?
Hi @<1572757559406759936:profile|CrabbySquid74> , are you sure that the machine has all the drivers installed and is capable of running experiments regardless of ClearML?
@<1523701260895653888:profile|QuaintJellyfish58> , check cache_executed_step parameter in pipeline steps
Hi SuperiorPanda77 ,how are the tasks running? Locally or via agent? What does the log show?