Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Trying To Run Get_Tasks On Aws Lambda And Getting The Following Error. Any Suggestions On How To Overcome This? { "Errormessage": "[Errno 38] Function Not Implemented", "Errortype": "Oserror", "Requestid": "", "Stacktrace": [ " File \"/Var/L

Trying to run get_tasks on AWS Lambda and getting the following error. Any suggestions on how to overcome this?

{
"errorMessage": "[Errno 38] Function not implemented",
"errorType": "OSError",
"requestId": "",
"stackTrace": [
" File "/var/lang/lib/python3.9/importlib/init.py", line 127, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n",
" File "<frozen importlib._bootstrap>", line 1030, in _gcd_import\n",
" File "<frozen importlib._bootstrap>", line 1007, in _find_and_load\n",
" File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked\n",
" File "<frozen importlib._bootstrap>", line 680, in _load_unlocked\n",
" File "<frozen importlib._bootstrap_external>", line 850, in exec_module\n",
" File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed\n",
" File "/var/task/lambda_function.py", line 1, in <module>\n import deepmirror_metrics.transform_data as dmtd\n",
" File "/var/task/deepmirror_metrics/transform_data.py", line 7, in <module>\n from clearml import Task\n",
" File "/var/task/clearml/init.py", line 5, in <module>\n from .task import Task\n",
" File "/var/task/clearml/task.py", line 46, in <module>\n from .backend_interface.metrics import Metrics\n",
" File "/var/task/clearml/backend_interface/init.py", line 2, in <module>\n from .task import Task\n",
" File "/var/task/clearml/backend_interface/task/init.py", line 1, in <module>\n from .task import Task\n",
" File "/var/task/clearml/backend_interface/task/task.py", line 31, in <module>\n from ...binding.artifacts import Artifacts\n",
" File "/var/task/clearml/binding/artifacts.py", line 25, in <module>\n from ..backend_interface.metrics.events import UploadEvent\n",
" File "/var/task/clearml/backend_interface/metrics/init.py", line 2, in <module>\n from .interface import Metrics\n",
" File "/var/task/clearml/backend_interface/metrics/interface.py", line 15, in <module>\n from ...storage.helper import StorageHelper\n",
" File "/var/task/clearml/storage/init.py", line 2, in <module>\n from .manager import StorageManager\n",
" File "/var/task/clearml/storage/manager.py", line 12, in <module>\n from .cache import CacheManager\n",
" File "/var/task/clearml/storage/cache.py", line 12, in <module>\n from .helper import StorageHelper\n",
" File "/var/task/clearml/storage/helper.py", line 45, in <module>\n from .. utilities.process.mp import ForkSafeRLock, SafeEvent\n",
" File "/var/task/clearml/utilities/process/mp.py", line 36, in <module>\n class _ForkSafeThreadSyncObject(object):\n",
" File "/var/task/clearml/utilities/process/mp.py", line 37, in _ForkSafeThreadSyncObject\n __process_lock = get_context("fork" if sys.platform == "linux" else "spawn").Lock()\n",
" File "/var/lang/lib/python3.9/multiprocessing/context.py", line 68, in Lock\n return Lock(ctx=self.get_context())\n",
" File "/var/lang/lib/python3.9/multiprocessing/synchronize.py", line 162, in init\n SemLock.init(self, SEMAPHORE, 1, 1, ctx=ctx)\n",
" File "/var/lang/lib/python3.9/multiprocessing/synchronize.py", line 57, in init\n sl = self._semlock = _multiprocessing.SemLock(\n"
]
}

  
  
Posted one year ago
Votes Newest

Answers 3


I don't think there's really a way around this because AWS Lambda doesn't allow for multiprocessing.

Instead, I've resorted to using a clearml Scheduler which runs on a t3.micro instance for jobs which I want to run on a cron.

  
  
Posted one year ago

Yeah, Lambda's lack of support for multiprocessing is an issue 🙂

  
  
Posted one year ago

Ideally I could disable the usage of _ForkSafeThreadSyncObject as some higher level but I think threading is used by default

  
  
Posted one year ago
969 Views
3 Answers
one year ago
one year ago
Tags
Similar posts