[go: up one dir, main page]

Page MenuHomePhabricator

Migrate bub from Toolforge GridEngine to Toolforge Kubernetes
Closed, ResolvedPublic

Description

Kindly migrate your tool(https://grid-deprecation.toolforge.org/t/bub) from Toolforge GridEngine to Toolforge Kubernetes.

Toolforge GridEngine is getting deprecated.
See: https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/

Please note that a volunteer may perform this migration if this has not been done after some time.
If you have already migrated this tool, kindly mark this as resolved.

If you would rather shut down this tool, kindly do so and mark this as resolved.

Useful Resources:
Migrating Jobs from GridEngine to Kubernetes
https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Grid_Engine_migration
Migrating Web Services from GridEngine to Kubernetes
https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_a_grid_engine_webservice
Python
https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Rebuild_virtualenv_for_python_users

Event Timeline

My apologies if this ticket comes as a surprise to you. In order to ensure WMCS can provide a stable, secure and supported platform, it’s important we migrate away from GridEngine. I want to assure you that while it is WMCS’s intention to shutdown GridEngine as outlined in the blog post https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/, a shutdown date for GridEngine has not yet been set. The goal of the migration is to migrate as many tools as possible onto kubernetes and ensure as smooth a transition as possible for everyone. Once the majority of tools have migrated, discussion on a shutdown date is more appropriate. See T314664: [infra] Decommission the Grid Engine infrastructure.

As noted in https://techblog.wikimedia.org/2022/03/16/toolforge-gridengine-debian-10-buster-migration/ some use cases are already supported by kubernetes and should be migrated. If your tool can migrate, please do plan a migration. Reach out if you need help or find you are blocked by missing features. Most of all, WMCS is here to support you.

However, it’s possible your tool needs a mixed runtime environment or some other features that aren't yet present in https://techblog.wikimedia.org/2022/03/18/toolforge-jobs-framework/. We’d love to hear of this or any other blocking issues so we can work with you once a migration path is ready. Thanks for your hard work as volunteers and help in this migration!

Samwilson subscribed.

Removing myself as assignee as I don't maintain this project.

This webservice seems to be using lighttpd to run a Flask app as an fcgi process. It may be relatively simple to migrate this to using the Python3.9 container and modern standard for running Python WSGI apps. See https://wikitech.wikimedia.org/wiki/Help:Toolforge/My_first_Flask_OAuth_tool for a concrete example of the convention over configuration approach to running a Flask app.

You may want to remove yourself at https://toolsadmin.wikimedia.org/tools/id/bub if you are not actually a maintainer

Good point; done.

@Samwilson Is bub even running/actively maintained, aren't we focussing on bub2 ?

@Soda it shows it's running. If it is no longer in use, kindly disable it and mark this as closed.

@Soda it shows it's running. If it is no longer in use, kindly disable it and mark this as closed.

I don't have access to the tool, but https://bub.toolforge.org shows a 503 error indicating that it is not currently not really functional. If I can get access, I should be able to look at it sometime next week :)

@Soda it shows it's running. If it is no longer in use, kindly disable it and mark this as closed.

I don't have access to the tool, but https://bub.toolforge.org shows a 503 error indicating that it is not currently not really functional. If I can get access, I should be able to look at it sometime next week :)

It shows it is running here

@Soda it shows it's running. If it is no longer in use, kindly disable it and mark this as closed.

I don't have access to the tool, but https://bub.toolforge.org shows a 503 error indicating that it is not currently not really functional. If I can get access, I should be able to look at it sometime next week :)

It shows it is running here

Maybe @Nemo_bis can provide access (I think Rohit has left the project) ?

From the community's POV this tool is not used since it is not maintained and has mostly been superseded by https://bub2.toolforge.org

taavi claimed this task.