[Improvement]: Discontinue Hadoop 2 support #4451

Search before asking

• I have searched in the issues and found no similar issues.

What would you like to be improved?

The community voted to discontinue Hadoop 2 support in the next Amoro release:

https://lists.apache.org/thread/st8v4l80cwytmlj79cm7793xjyw8zf3q

The repository still includes the hadoop2 Maven profile, Hadoop 2 CI and distribution configurations, and installation instructions. The Flink optimizer image also installs a Hadoop 2 uber JAR independently of the Maven-selected Hadoop version.

This issue tracks implementing the vote outcome separately from the Iceberg upgrade in #4377 and #4378.

How should we improve?

• Remove the hadoop2 Maven profile and the dependency artifact selection used for Hadoop 2 builds.
• Remove Hadoop 2 CI, binary distribution and Docker image variants, and dependency inventories.
• Run Trino CI without the hadoop2 profile.
• Replace the Flink optimizer image's Hadoop 2 uber JAR with the Maven-selected Hadoop 3 client libraries.
• Update build, installation and release documentation while retaining historical release download links.

Verify that supported engine builds continue to work and that the Flink optimizer image loads Hadoop 3 and reads Parquet successfully.

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct.