[FLINK-39119] Package Native S3 FileSystem in Distribution

[Samrat002]

What is the purpose of the change

package the Native S3 FileSystem module into Flink's distribution assembly, making it available for users without requiring manual JAR placement. This completes the integration of the native S3 filesystem implementation into the Flink ecosystem by ensuring it is included in official distribution builds.

Brief change log

• Added native S3 FileSystem JAR (flink-s3-fs-native-${project.version}.jar) to the distribution assembly configuration
• The JAR is packaged in the opt/ directory alongside other optional filesystem plugins

Verifying this change

build and check the flink-dist

Does this pull request potentially affect one of the following parts:

• Dependencies (does it add or upgrade a dependency): no
• The public API, i.e., is any changed class annotated with @Public(Evolving): no
• The serializers: no
• The runtime per-record code paths (performance sensitive): no
• Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
• The S3 file system connector: yes - includes native S3 filesystem in distribution

Documentation

• Does this pull request introduce a new feature? no
• If yes, how is the feature documented? not applicable - documentation for the native S3 filesystem was provided separately

Additional Context

N/A

[Samrat002]

@gaborgsomogyi PTAL whenever time !

[flinkbot]

CI report:

• cc743f6 Azure: SUCCESS

Bot commands

The @flinkbot bot supports the following commands:

• @flinkbot run azure re-run the last Azure build

[Izeren]

@Samrat002, does it also need the update in Notice file?

[Samrat002]

@Samrat002, does it also need the update in Notice file?

I think no. There is no Notice file in flink-dist.
If it had been there, then the CI compile would have failed
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=73363&view=logs&s=ae4f8708-9994-57d3-c2d7-b892156e7812&j=52b61abe-a3cc-5bde-cc35-1bbe89bb7df5

[Izeren]

@Samrat002, does it also need the update in Notice file?

I think no. There is no Notice file in flink-dist. If it had been there, then the CI compile would have failed https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=73363&view=logs&s=ae4f8708-9994-57d3-c2d7-b892156e7812&j=52b61abe-a3cc-5bde-cc35-1bbe89bb7df5

What about this file?
https://github.com/apache/flink/blob/master/flink-dist/src/main/resources/META-INF/NOTICE

unless it is ignored by CI or it has so happened that no new dependencies were introduced.

Also, did we mark the feature as experimental anywhere?

[Samrat002]

unless it is ignored by CI or it has so happened that no new dependencies were introduced.

this change added in the current pr just copies the jar from its target path to /opt in the distribution, there is no need to add dependencies in Notice file. it is already added to its respective sub-project . this is why i think CI is green.

Also, did we mark the feature as experimental anywhere?

No not yet. plans to add it as part of next change which is related to docs and making the feature experimental
https://issues.apache.org/jira/browse/FLINK-39118