Hi There, I Am Running Urbansounds Example, The First Step Is Download The Data In My Agent Machine Which Has Been Successed, But The Second Step "Preprocessing" Failed, Can Anyone Help? Thanks A Log, The Error Message: Traceback (Most Recent Call Last)

Answered

Hi there, I am running UrbanSounds example, the first step is download the data in my agent machine which has been successed, but the second step "preprocessing" failed, can anyone help? thanks a log, the error message: Traceback (most recent call last):
File "/root/.clearml/venvs-builds/3.10/task_repository/clearml-blogs/urbansounds8k/preprocessing.py", line 150, in <module>
datasetbuilder.build_dataset()
File "/root/.clearml/venvs-builds/3.10/task_repository/clearml-blogs/urbansounds8k/preprocessing.py", line 110, in build_dataset
for i, (_, data) in tqdm(enumerate(self.metadata.iterrows())):
AttributeError: 'PosixPath' object has no attribute 'iterrows'

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					DefeatedOstrich25
				
					0
					 × 1

Votes Newest

Answers 2

Hi @<1679299603003871232:profile|DefeatedOstrich25> , please add the full log of the run

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

1710471481099 wjl_worker_id0 INFO task 91973203d894427ea0fc01bc178b8d5d pulled from 3c2478a78e004f86b716c036ed555417 by worker wjl_worker_id0

1710471493594 wjl_worker_id0 DEBUG Current configuration (clearml_agent v1.7.0, location: /tmp/.clearml_agent.g2o20tn9.cfg):

api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.api_server = None
api.web_server = None
api.files_server = None
api.credentials.access_key = LMMY64I5UU8Y4IL4K5R7
api.host = None
sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.network.file_upload_retries = 3
sdk.aws.s3.key =
sdk.aws.s3.region =
sdk.aws.s3.use_credentials_chain = false
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.aws.boto3.multipart_threshold = 8388608
sdk.aws.boto3.multipart_chunksize = 8388608
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri =
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false
sdk.development.worker.report_event_flush_threshold = 100
sdk.development.worker.console_cr_flush_period = 10
sdk.apply_environment = false
sdk.apply_files = false
agent.worker_id = wjl_worker_id0
agent.worker_name = 9fad63f78381
agent.force_git_ssh_protocol = false
agent.python_binary =
agent.package_manager.type = pip
agent.package_manager.pip_version.0 = <20.2 ; python_version < '3.10'
agent.package_manager.pip_version.1 = <22.3 ; python_version >= '3.10'
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.priority_optional_packages.0 = pygobject
agent.package_manager.torch_nightly = false
agent.package_manager.poetry_files_from_repo_working_dir = false
agent.venvs_dir = /root/.clearml/venvs-builds
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.venvs_cache.path = ~/.clearml/venvs-cache
agent.vcs_cache.enabled = true
agent.vcs_cache.path = /root/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = /root/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = /root/.clearml/pip-cache
agent.docker_apt_cache = /root/.clearml/apt-cache
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:11.0.3-cudnn8-runtime-ubuntu20.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.abort_callback_max_timeout = 1800
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = ~/.ssh
agent.docker_internal_mounts.ssh_ro_folder = /.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = ~/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script =
agent.disable_task_docker_override = false
agent.git_user =
agent.git_host =
agent.default_python = 3.10
agent.cuda_version = 0
agent.cudnn_version = 0

Executing task id [91973203d894427ea0fc01bc178b8d5d]:
repository = None
branch = master
version_num = c0a10f52de341e7feedc1bd718ff0539f98fdced
tag =
docker_cmd = python:3.9-bullseye
entry_point = preprocessing.py
working_dir = urbansounds8k

1710471506352 wjl_worker_id0 DEBUG ::: Using Cached environment /root/.clearml/venvs-cache/331025850908b2a9818ea0106c8e0175.fbc249c6f37e3811ec84e796cc351244 :::
Using cached repository in "/root/.clearml/vcs-cache/clearml-blogs.5e9dc4f6c0a530e314104c9a413adf9d/clearml-blogs"
Note: checking out 'c0a10f52de341e7feedc1bd718ff0539f98fdced'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

git checkout -b <new-branch-name>

HEAD is now at c0a10f5 Merge pull request #31 from allegroai/dependabot/pip/the_hero_rises/pillow-10.2.0
type: git
url: None
branch: HEAD
commit: c0a10f52de341e7feedc1bd718ff0539f98fdced
root: /root/.clearml/venvs-builds/3.10/task_repository/clearml-blogs

1710471513018 wjl_worker_id0 DEBUG Adding venv into cache: /root/.clearml/venvs-builds/3.10
Running task id [91973203d894427ea0fc01bc178b8d5d]:
[urbansounds8k]$ /root/.clearml/venvs-builds/3.10/bin/python -u preprocessing.py
Summary - installed python packages:
pip:

absl-py==2.1.0
attrs==23.2.0
cachetools==5.3.3
certifi==2024.2.2
charset-normalizer==3.3.2
clearml==1.6.2
cycler==0.12.1
Cython==3.0.9
fonttools==4.49.0
furl==2.1.3
future==1.0.0
google-auth==2.28.2
google-auth-oauthlib==0.4.6
grpcio==1.62.1
idna==3.6
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
kiwisolver==1.4.5
Markdown==3.6
MarkupSafe==2.1.5
matplotlib==3.5.2
numpy==1.23.1
oauthlib==3.2.2
orderedmultidict==1.0.1
packaging==24.0
pathlib2==2.3.7.post1
pillow==10.2.0
protobuf==3.19.6
psutil==5.9.8
pyasn1==0.5.1
pyasn1-modules==0.3.0
PyJWT==2.4.0
pyparsing==3.1.2
python-dateutil==2.9.0.post0
PyYAML==6.0.1
referencing==0.33.0
requests==2.31.0
requests-oauthlib==1.4.0
rpds-py==0.18.0
rsa==4.9
six==1.16.0
tensorboard==2.9.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
torch @ file:///root/.clearml/pip-download-cache/cu0/torch-1.12.0%2Bcpu-cp310-cp310-linux_x86_64.whl
torchaudio @ file:///root/.clearml/pip-download-cache/cu0/torchaudio-0.12.0%2Bcpu-cp310-cp310-linux_x86_64.whl
tqdm==4.64.0
typing_extensions==4.10.0
urllib3==2.2.1
Werkzeug==3.0.1

Environment setup completed successfully

Starting Task Execution:

1710471519586 wjl_worker_id0 DEBUG ClearML results page: None

1710471526173 wjl_worker_id0 DEBUG ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring

1710471641376 wjl_worker_id0 DEBUG ClearML results page: None
ClearML dataset page: None

1710471647978 wjl_worker_id0 DEBUG Traceback (most recent call last):
File "/root/.clearml/venvs-builds/3.10/task_repository/clearml-blogs/urbansounds8k/preprocessing.py", line 150, in <module>
datasetbuilder.build_dataset()
File "/root/.clearml/venvs-builds/3.10/task_repository/clearml-blogs/urbansounds8k/preprocessing.py", line 110, in build_dataset
for i, (_, data) in tqdm(enumerate(self.metadata.iterrows())):
AttributeError: 'PosixPath' object has no attribute 'iterrows'

1710471654567 wjl_worker_id0 DEBUG Process failed, exit code 1

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					DefeatedOstrich25
				
					0
					 × 1

Write your answer

505 Views

2 Answers

8 months ago