Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
GiddyTurkey39
Moderator
12 Questions, 42 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

42 × Eureka!
0 Votes
7 Answers
911 Views
0 Votes 7 Answers 911 Views
How can I execute jupyter notebooks using trains-agent ? My notebook is committed to a git repo. I'm creating different tasks throughout the notebook and exe...
4 years ago
0 Votes
1 Answers
838 Views
0 Votes 1 Answers 838 Views
Is there any way to send an http request to trains server with a configuration string of some sort to be passed in as a parameter to a Pipeline or Task?
4 years ago
0 Votes
18 Answers
965 Views
0 Votes 18 Answers 965 Views
Hi, I'm configuring an agent. After pasting the credentials, I get: Error: could not verify credentials . I tried entering the user access key and secret key...
4 years ago
0 Votes
11 Answers
998 Views
0 Votes 11 Answers 998 Views
When launching a task to trains agent, I'm having trouble getting the imports from other files working correctly. For instance, if my task imports a function...
4 years ago
0 Votes
5 Answers
984 Views
0 Votes 5 Answers 984 Views
Hi, I'm trying to get an understanding of how Pipeline Controller works since there's currently no documentation for it as of now and it hasn't been released...
4 years ago
0 Votes
4 Answers
903 Views
0 Votes 4 Answers 903 Views
How do I delete artifacts? Do I have to delete the task in order to delete an artifact? Is there a way to independently delete artifacts without deleting the...
4 years ago
0 Votes
22 Answers
973 Views
0 Votes 22 Answers 973 Views
Is there any way to clear the installed packages of a task programmatically? (i.e. using the python sdk and not the UI)
3 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
I want to execute a script via trains-agent, but I want to be able to provide the location of a config file by specifying the path before trains-agent execut...
4 years ago
0 Votes
1 Answers
974 Views
0 Votes 1 Answers 974 Views
Hello, I have a question regarding custom modules- How can I successfully import my own modules(from other folders within the same root directory) in the ven...
4 years ago
0 Votes
13 Answers
976 Views
0 Votes 13 Answers 976 Views
How do I access the trains-server web UI on gcp? I followed the steps here: https://allegro.ai/docs/deploying_trains/trains_server_gcp/ and I go to the exter...
4 years ago
0 Votes
6 Answers
992 Views
0 Votes 6 Answers 992 Views
Can trains-server be deployed on GKE?
4 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Trying to make a pipeline through PipelineController but running into this error: ModuleNotFoundError: No module named 'trains.automation.controller'; has th...
4 years ago
0 Is There Any Way To Clear The Installed Packages Of A Task Programmatically? (I.E. Using The Python Sdk And Not The Ui)

AgitatedDove14 I tried your code snippet, something like this:
task = Task.init(...) if task.running_locally(): # wait for the repo detection and requirements update task._wait_for_repo_detection() # reset requirements task._update_requirements(None) task.execute_remotely(queue="default") ... rest of task here ...It’s able to create a draft successfully with no items in the installed packages section, but it only installed Cython and began the execution immediately....

3 years ago
0 How Can I Execute Jupyter Notebooks Using

AgitatedDove14 So I ran a cell to create the task and execute it remotely. The cell (after execution) shows up with an error that says NameError: name 'exit' is not defined . Trains does store the task as a draft, and when I try to execute the task via trains agent, it aborts in the middle of installing all of the dependencies.

4 years ago
0 How Can I Execute Jupyter Notebooks Using

The notebook is contained within a git repo. I have the jupyter notebook pulled up and am running the cell for creating the task and executing it remotely. In the draft task, there is a git repo and uncommitted changes(which contains all of the cells of the notebook) and installed packages.

4 years ago
0 Hi, I'M Configuring An Agent. After Pasting The Credentials, I Get:

Yeah, I’m trying to connect to my own server, and I installed trains-agent on a vm. How could I diagnose the issue?

4 years ago
0 Hi, I'M Configuring An Agent. After Pasting The Credentials, I Get:

i ran ping <IP HERE>:8008 , it returns
ping: <ip-here>:8008: Name or service not known

4 years ago
0 Hi, I'M Configuring An Agent. After Pasting The Credentials, I Get:

Let me look into that and I’ll let you know

4 years ago
0 When Launching A Task To Trains Agent, I'M Having Trouble Getting The Imports From Other Files Working Correctly. For Instance, If My Task Imports A Function From Another File Within The Same Git Repo [

If there a way to do this without manually editing installed packages? I'm trying to create a setup in which others can utilize the same repo and have their venvs be built similarly without having to do much work on their end (i.e. editing the installed packages). As for why it's failing to detect, I'm not sure.
from google.cloud import bigquery ImportError: cannot import name 'bigquery' from 'google.cloud' (unknown location)That's the error I get after the task makes use of the function ...

4 years ago
0 When Launching A Task To Trains Agent, I'M Having Trouble Getting The Imports From Other Files Working Correctly. For Instance, If My Task Imports A Function From Another File Within The Same Git Repo [

Since I'm running a pipeline, does this mean I have to execute each task of the pipeline individually and manually? Then uncomment task.execute_remotely() from each task and then run via trains-agent ?

4 years ago
0 Is There Any Way To Clear The Installed Packages Of A Task Programmatically? (I.E. Using The Python Sdk And Not The Ui)

This line: “if task.running_locally():” makes sure that when the code is executed by the agent it will not reset it’s own requirements (the agent updates the requirements/installed_packages after it installs them from the requiremenst.txt, so that later you know exactly which packages/versions were used)

got it! Thanks for explaining

3 years ago
0 Is There Any Way To Clear The Installed Packages Of A Task Programmatically? (I.E. Using The Python Sdk And Not The Ui)

Let me experiment with force_analyze_entire_repo and I’ll get back to you! It was missing google-cloud-bigquery , an import from a separate file in the repository. Hopefully that should resolve the problem. A flag would be really cool, just in case if theres any problem with the package analysis.

3 years ago
0 Is There Any Way To Clear The Installed Packages Of A Task Programmatically? (I.E. Using The Python Sdk And Not The Ui)

task = Task.init(...) if task.running_locally(): # wait for the repo detection and requirements update task._wait_for_repo_detection() # reset requirements task._update_requirements(None)Regarding this, does this work if the task is not running locally and is being executed by the trains agent?

3 years ago
0 Is There Any Way To Clear The Installed Packages Of A Task Programmatically? (I.E. Using The Python Sdk And Not The Ui)

If you have a few lines for resetting, I would love to have that as an option as well!

3 years ago
0 Is There Any Way To Clear The Installed Packages Of A Task Programmatically? (I.E. Using The Python Sdk And Not The Ui)

Since the package requirements vary from task to task, setting it up in trains.conf might be a little tedious to go back and change. Most of the time, the package analysis has worked very well, but in this particular use case it failed to detect. I think task.init flag would be great!

3 years ago
0 How Do I Delete Artifacts? Do I Have To Delete The Task In Order To Delete An Artifact? Is There A Way To Independently Delete Artifacts Without Deleting The Task?

I did see that, just wanted to confirm that there's no way of deleting artifacts without deleting the experiment as well

4 years ago
0 How Do I Access The Trains-Server Web Ui On Gcp? I Followed The Steps Here:

SuccessfulKoala55 I looked back into my configuration settings for the VM(I already created a VM instance from the custom image yesterday) and thats where I got my external IP from. I checked "Allow HTTP access" but it's giving me a gateway timeout error now and telling me that the server at the IP is unreachable at the moment.

4 years ago
0 How Do I Access The Trains-Server Web Ui On Gcp? I Followed The Steps Here:

SuccessfulKoala55 At the time, yes it was v0.15.1. How do I actually launch trains server from the custom image? Do I use the external IP associated with the VM or are there any other steps I have to take?

4 years ago
0 How Do I Access The Trains-Server Web Ui On Gcp? I Followed The Steps Here:

SuccessfulKoala55 Actually- just resolved this. I had to allow access from all ports(not secure but will fix that asap) but everything seems to be running now, thanks for the help!

4 years ago
0 How Do I Access The Trains-Server Web Ui On Gcp? I Followed The Steps Here:

Regarding the trains server SDK, the end of the documentation for GCP says 'Next step, configuring trains for trains server' where the first step is running trains-init setup wizard

4 years ago
0 Hi, I'M Configuring An Agent. After Pasting The Credentials, I Get:

The VM ip is 153.73.X.Y and the trains-server IP is 34.74.X.Y

4 years ago
0 Hi, I'M Configuring An Agent. After Pasting The Credentials, I Get:

Yeah, the command is executed and nothing is returned.

4 years ago
0 Can Trains-Server Be Deployed On Gke?

SuccessfulKoala55 Getting an error with mounting on a read-only file system(Error response from daemon: error while creating mount source path '/opt/trains/logs': mkdir /opt/trains: read-only file system: RunContainerError), is there any workaround for this?

4 years ago
0 When Launching A Task To Trains Agent, I'M Having Trouble Getting The Imports From Other Files Working Correctly. For Instance, If My Task Imports A Function From Another File Within The Same Git Repo [

AgitatedDove14 Yes, I understand that, but as I mentioned earlier, I don't want to have to edit installed_packages manually, as others will also be running the same scripts from their own local development machines. This is why I was inquiring about the requirements.txt file, so that this manual editing would not have to be done by each person running the same scripts.

Additionally, since I'm running a pipeline, would I have to execute each task in the pipeline locally(but still...

4 years ago
0 When Launching A Task To Trains Agent, I'M Having Trouble Getting The Imports From Other Files Working Correctly. For Instance, If My Task Imports A Function From Another File Within The Same Git Repo [

AgitatedDove14 Thanks! That resolved a lot of my questions.

Which would mean 

trains

` will update the installed packages, no?

Can you explain what is meant by this?
I think what you're trying to say is that in the UI the installed packages will be determined through the code via the imports as usual and the users will have to manually clear the installed packages so that the requirements.txt is used instead.

4 years ago
0 When Launching A Task To Trains Agent, I'M Having Trouble Getting The Imports From Other Files Working Correctly. For Instance, If My Task Imports A Function From Another File Within The Same Git Repo [

I didn't execute the code manually, I executed it from trains-agent to begin with. So to conclude: it has to be executed manually first, then with trains agent?

4 years ago
Show more results compactanswers