My apologies if this ticket comes as a surprise to you. In order to ensure WMCS can provide a stable, secure and supported platform, it’s important we migrate away from GridEngine. I want to assure you that while it is WMCS’s intention to shutdown GridEngine as outlined in the blog post https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/, a shutdown date for GridEngine has not yet been set. The goal of the migration is to migrate as many tools as possible onto kubernetes and ensure as smooth a transition as possible for everyone. Once the majority of tools have migrated, discussion on a shutdown date is more appropriate. See T314664: [infra] Decommission the Grid Engine infrastructure.

As noted in https://techblog.wikimedia.org/2022/03/16/toolforge-gridengine-debian-10-buster-migration/ some use cases are already supported by kubernetes and should be migrated. If your tool can migrate, please do plan a migration. Reach out if you need help or find you are blocked by missing features. Most of all, WMCS is here to support you.

However, it’s possible your tool needs a mixed runtime environment or some other features that aren't yet present in https://techblog.wikimedia.org/2022/03/18/toolforge-jobs-framework/. We’d love to hear of this or any other blocking issues so we can work with you once a migration path is ready. Thanks for your hard work as volunteers and help in this migration!

Done, all jobs migrated! Just three questions:

1. After toolforge commands, I get /usr/bin/toolforge-jobs:15: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html from pkg_resources import load_entry_point. Is this message relevant to me to fix?
2. When I configured my bot through grid engine and on this version, I created .bash_profile file with export PYTHONPATH=/data/project/shared/pywikibot/stable:/data/project/shared/pywikibot/stable/scripts. So, do we need this file anymore?
3. After the migration, are there any webservices through which we can view the necessary status and statistics of our Toolforge jobs?

Thanks!

In T319562#9494715, @Aram wrote:

Done, all jobs migrated! Just three questions:

1. After toolforge commands, I get /usr/bin/toolforge-jobs:15: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html from pkg_resources import load_entry_point. Is this message relevant to me to fix?

If this is coming from Pywikibot, it will be fixed in the next major release. (T340640)

1. When I configured my bot through grid engine and on this version, I created .bash_profile file with export PYTHONPATH=/data/project/shared/pywikibot/stable:/data/project/shared/pywikibot/stable/scripts. So, do we need this file anymore?

No

1. After the migration, are there any webservices through which we can view the necessary status and statistics of our Toolforge jobs?

I use k8s-status (https://k8s-status.toolforge.org/namespaces/tool-arambot/) and the linked Grafana dashboard.

@JJMC89 Great! And huge thanks to you!