Reputation
Badges 1
17 × Eureka!@<1523701087100473344:profile|SuccessfulKoala55> Yes there is no docker involved and I have nothing in the venvs-builds folder.
@<1523701070390366208:profile|CostlyOstrich36> If I want to create a new project and I want to use the already existing dataset created by others in clearml server.
[+] Building 2.2s (18/22)
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 32B 0.0s
=> [internal] load .dockerignore ...
Hi @<1523701205467926528:profile|AgitatedDove14> the above error got resolved but upon building the image I got this (Node.js version v12.21.0 detected.
The Angular CLI requires a minimum Node.js version of either v14.15, or v16.10. ) should I update nodejs in centos image ? can you provide some insights on this.
Hi @<1523701070390366208:profile|CostlyOstrich36> Clearml server is on aws, It created a dataset artifact when my colleague uploaded it then when I try to clone and enqueue, it fails.
Yeah
I was trying to rebuild docker image for clearml-server and I have attached the whole log.
Yes @<1523701087100473344:profile|SuccessfulKoala55> same configuration as you mentioned before.
@<1523701087100473344:profile|SuccessfulKoala55> this is execution section of task.
Execution log
from clearml import Dataset
ds = Dataset.create(dataset_project='Asteroid_Solution/.datasets/raw_asteroid_dataset', dataset_name='raw_asteroid_dataset', dataset_version='None')
ds.add_files(
path='/tmp/nasa.csv',
wildcard=None,
local_base_folder=None,
dataset_path=None,
recursive=True
)
ds.upload(
show_progress=True,
verbose=False,
output_url=None,
compression=None
)
ds.finalize()
I have to clone the dataset into a new project that other's have uploaded...what is the best way to do it?
Hi @<1523701070390366208:profile|CostlyOstrich36> here is the snippet
from clearml import Task,
Dataset import global_config
from data import database
task = Task.init( project_name=global_config.PROJECT_NAME, task_name='get data', task_type='data_processing', reuse_last_task_id=False )
config = { 'query_date': '2022-01-01' } task.connect(config)
# Get the data and a path to the file query = 'SELECT * FROM asteroids WHERE strftime("%Y-%m-%d", `date`) <= strftime("%Y-%m-%d", "{...