SuccessfulKoala55 Sure. At https://github.com/allegroai/clearml/issues ?
Yeah, I see what you mean, probably because the output_uri
initialization is handled by the Task.init()
. Can you please open a GitHub issue?
SuccessfulKoala55 Without commented line files are uploaded to http://files.community.clear.ml instead of by S3 bucket
Hi SuccessfulKoala55 Here is code_snipet
` task = Task.init(project_name=PROJECT_NAME, task_name=section)
task.connect(params)
print('params', params)
dataset = Dataset.create(dataset_name=params['dataset'], dataset_project=PROJECT_NAME)
dataset_local_dir = dataset.get_local_copy()
dataset._task.output_uri = task.output_uri
KeywordProcessor(params['es_host'], params['es_port'], True, DOCS_ROOT)
dataset.add_files(DOCS_ROOT, wildcard='*.csv')
dataset.upload() `I add several files to a dataset and upload
Hi HelpfulHare30 , which files are you referring to?