Request increased quota for metricsinfra Cloud VPS project
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	taavi
	Jun 15 2021, 5:32 AM

Description

Project Name: metricsinfra
Type of quota increase requested: 8 CPU / 16G ram available
Reason: The single Prometheus instance is using all of the projects RAM quota and half of the CPUs. This quota increase would be used to experiment with and build out related services required for more wide-spread use:

Local puppet master to manage secrets and patches still in development
Separate alertmanager instance for ease of scaling and HA
Experiment with Thanos and/or Cortex for scaling up Prometheus to support all Cloud VPS instances
Build tools to allow projects to self-manage their data sources and alerting rules

If possible I'd like to try out the Bullseye pre-releases too - these instances likely won't be permanent and being already able to use newer software versions in a fast-moving platform is useful.

Related Objects
Search...

Status	Assigned	Task
Resolved	fgiunchedi	T205862 Expand modern metrics infrastructure coverage (2018-19 Q2 goal)
Resolved	colewhite	T183454 Deprovision Diamond collectors no longer in use
Resolved	MoritzMuehlenhoff	T210993 Deprecate Diamond collectors in Cloud VPS
Resolved	taavi	T336774 Current status of cloudmetrics and its components
Resolved	taavi	T326266 Remove the WMCS statsd/Graphite service
Open	dcaro	T313444 Streamline WMCS Alerting and Paging
Resolved	taavi	T317032 Remove Diamond?
Resolved	taavi	T264920 Grafana "cloud-vps-project-board" needs to be migrated from Graphite to Prometheus
Open	None	T194333 [Epic] Provide logging/metrics/monitoring SaaS for Cloud VPS tenants
Resolved	taavi	T266050 Build Prometheus service for use by all Cloud VPS projects and their instances
Resolved	• nskaggs	T284973 Request increased quota for metricsinfra Cloud VPS project

Event Timeline

taavi created this task.Jun 15 2021, 5:32 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 15 2021, 5:32 AM

taavi added a parent task: T266050: Build Prometheus service for use by all Cloud VPS projects and their instances.Jun 15 2021, 5:32 AM

taavi updated the task description. (Show Details)Jun 15 2021, 5:50 AM

taavi updated the task description. (Show Details)Jun 15 2021, 1:20 PM

+1 from me. This is now complete.

New quota:
cores 16
RAM 41G

Mentioned in SAL (#wikimedia-cloud) [2021-06-15T16:12:58Z] <balloons> add 8 CPU/16G RAM to quota T284973

Request increased quota for metricsinfra Cloud VPS projectClosed, ResolvedPublicActions

Description

Related ObjectsSearch...

Event Timeline

Request increased quota for metricsinfra Cloud VPS project
Closed, ResolvedPublic
Actions

Related Objects
Search...