This is where I cloned from.

Yeah

I was trying to rebuild docker image for clearml-server and I have attached the whole log.

@<1523701087100473344:profile|SuccessfulKoala55> this is execution section of task.

Task console log

[+] Building 2.2s (18/22)
 => [internal] load build definition from Dockerfile                                                                                                               0.0s
 => => transferring dockerfile: 32B                                                                                                                                0.0s
 => [internal] load .dockerignore                                                                                               ...

Execution log

from clearml import Dataset

ds = Dataset.create(dataset_project='Asteroid_Solution/.datasets/raw_asteroid_dataset', dataset_name='raw_asteroid_dataset', dataset_version='None')
ds.add_files(
    path='/tmp/nasa.csv', 
    wildcard=None, 
    local_base_folder=None, 
    dataset_path=None, 
    recursive=True
)
ds.upload(
    show_progress=True, 
    verbose=False, 
    output_url=None, 
    compression=None
)
ds.finalize()

@<1523701070390366208:profile|CostlyOstrich36> If I want to create a new project and I want to use the already existing dataset created by others in clearml server.

This is the artifact URL.

Hi @<1523701070390366208:profile|CostlyOstrich36> here is the snippet

from clearml import Task, 
Dataset import global_config 
from data import database 

task = Task.init( project_name=global_config.PROJECT_NAME, task_name='get data', task_type='data_processing', reuse_last_task_id=False ) 

config = { 'query_date': '2022-01-01' } task.connect(config) 

# Get the data and a path to the file query = 'SELECT * FROM asteroids WHERE strftime("%Y-%m-%d", `date`) <= strftime("%Y-%m-%d", "{...

@<1523701087100473344:profile|SuccessfulKoala55> Yes there is no docker involved and I have nothing in the venvs-builds folder.

This is what I cloned.

Yes @<1523701087100473344:profile|SuccessfulKoala55> same configuration as you mentioned before.

I have to clone the dataset into a new project that other's have uploaded...what is the best way to do it?

Hi @<1523701205467926528:profile|AgitatedDove14> the above error got resolved but upon building the image I got this (Node.js version v12.21.0 detected.
The Angular CLI requires a minimum Node.js version of either v14.15, or v16.10. ) should I update nodejs in centos image ? can you provide some insights on this.

Hi @<1523701070390366208:profile|CostlyOstrich36> Clearml server is on aws, It created a dataset artifact when my colleague uploaded it then when I try to clone and enqueue, it fails.