Change anndata_import memory for GTA

[pavanvidem]

I have a tiny input of less than 30MB (training data from the PBMC 3k tutorial). anndata_import is running normally on .eu and .org.eu servers and used around 350 MB.

The existing rule 2 + input_size * 10 should allocate some 2.x GB. But it is allocating only 277 MB on .org and failing.

Here is the history on .org with failing job: https://usegalaxy.org/u/videmp/h/anndata-import

[cat-bro]

I have tried this same job on usegalaxy.org.au with the same rule, and it gets 2.27GB of RAM for the job.

It looks like usegalaxy.org is using an old version the shared db file: https://github.com/galaxyproject/usegalaxy-playbook/blob/main/env/common/templates/galaxy/config/job_conf.yml.j2#L71C12-L71C130 in which the mem for anndata_import was set to input_size * 10 without the offset. Ping @natefoo

[pavanvidem]

Thanks @cat-bro That makes sense!

Then the existing 2 + input_size * 10 should be enough. We don't have to change if we use this file.

[pavanvidem]

@cat-bro @natefoo is there a quick fix before the upcoming GTA? Only this one step is failing from the tutorial.

[bgruening]

@pavanvidem do we still need this? ORG needs to be adopted, isn't it?

[pavanvidem]

Regardless of GTA, we still need this.