Change #1079506 had a related patch set uploaded (by Gmodena; author: Gmodena):

[wikimedia-event-utilities@master] WIP: flink version bump.

https://gerrit.wikimedia.org/r/1079506

F/up from a conversation in slack with @dcausse.

Last Friday, I time-boxed some grooming. What I found so far is that flink-connector-kafka does not compile yet against 1.20: https://issues.apache.org/jira/browse/FLINK-35109. For the time being, we have decided to target 1.19.

I took a stab at updating to 1.19 (see the CR linked to this task), and there’s no significant API change from what I can tell—only some minor refactoring of utility classes used in tests.

There's some classpath iffyness that I was not resolve yet:

[ERROR] Errors: 
[ERROR]   TestEventRowSerializer.testSchemaCompatibility:100 » NoSuchMethod org.apache.flink.api.common.typeutils.CompositeTypeSerializerUtil.constructIntermediateCompatibilityResult([Lorg/apache/flink/api/common/typeutils/TypeSerializer;[Lorg/apache/flink/api/common/typeutils/TypeSerializerSnapshot;)Lorg/apache/flink/api/common/typeutils/CompositeTypeSerializerUtil$IntermediateCompatibilityResult;
[ERROR]   TestJsonRowDeserializationSchema.testJsonParse(TestSpec) » NoSuchMethod org.junit.platform.commons.util.ClassLoaderUtils.getClassLoader(Ljava/lang/Class;)Ljava/lang/ClassLoader;
[INFO] 
[ERROR] Tests run: 95, Failures: 0, Errors: 2, Skipped: 1
`

@dcausse I'm not sure how you'd like to organize the work, but perhaps we can create a dedicated subtask for the wikimedia-event-utilities version bump?

In T376812#10225610, @gmodena wrote:

@dcausse I'm not sure how you'd like to organize the work, but perhaps we can create a dedicated subtask for the wikimedia-event-utilities version bump?

Agreed, might be clearer to have substasks for this, filed T377130 for this. Do you have some time to dig a bit more into this classpath issue? If not @pfischer or myself could possibly take a closer look this week?

In T376812#10225722, @dcausse wrote:

In T376812#10225610, @gmodena wrote:

@dcausse I'm not sure how you'd like to organize the work, but perhaps we can create a dedicated subtask for the wikimedia-event-utilities version bump?

Agreed, might be clearer to have substasks for this, filed T377130 for this. Do you have some time to dig a bit more into this classpath issue? If not @pfischer or myself could possibly take a closer look this week?

Sorry, I missed this comment! I was able to fix all classpath issues in the CR attached to {T377130: Bump eventutilities to support flink 1.20}

Last friday, flink-connector-kafka 3.3.0 was released with support to Flink 1.20. I think we should be able to target 1.20 instead of 1.19.
Some details in https://phabricator.wikimedia.org/T377130#10241164

In T376812#10249407, @gmodena wrote:

In T376812#10225722, @dcausse wrote:

In T376812#10225610, @gmodena wrote:

@dcausse I'm not sure how you'd like to organize the work, but perhaps we can create a dedicated subtask for the wikimedia-event-utilities version bump?

Agreed, might be clearer to have substasks for this, filed T377130 for this. Do you have some time to dig a bit more into this classpath issue? If not @pfischer or myself could possibly take a closer look this week?

Sorry, I missed this comment! I was able to fix all classpath issues in the CR attached to {T377130: Bump eventutilities to support flink 1.20}

thanks!

Last friday, flink-connector-kafka 3.3.0 was released with support to Flink 1.20. I think we should be able to target 1.20 instead of 1.19.
Some details in https://phabricator.wikimedia.org/T377130#10241164

this is great news, the k8s operator 1.10 is about to be released and has official support for 1.19 but seems to have some support for 1.20 (https://github.com/apache/flink-kubernetes-operator/pull/869) hopefully we should be able to run flink 1.20 "soonish", will update the task accordingly.

Change #1079506 merged by jenkins-bot:

[wikimedia-event-utilities@master] eventutilities-flink: version bump flink to 1.20

https://gerrit.wikimedia.org/r/1079506

Change #1090430 had a related patch set uploaded (by TChin; author: TChin):

[operations/deployment-charts@master] flink-app: Add default checkpointing config for Flink 1.20

https://gerrit.wikimedia.org/r/1090430