Skip to content

API: Deprecate duplicate MAX_FILE_GROUP_SIZE_BYTES in RewriteDataFiles#16298

Open
sachinnn99 wants to merge 1 commit into
apache:mainfrom
sachinnn99:deprecate-max-file-group-size-bytes
Open

API: Deprecate duplicate MAX_FILE_GROUP_SIZE_BYTES in RewriteDataFiles#16298
sachinnn99 wants to merge 1 commit into
apache:mainfrom
sachinnn99:deprecate-max-file-group-size-bytes

Conversation

@sachinnn99
Copy link
Copy Markdown
Contributor

Fixes #16248

Summary

  • Deprecate MAX_FILE_GROUP_SIZE_BYTES and MAX_FILE_GROUP_SIZE_BYTES_DEFAULT in RewriteDataFiles in favor of the canonical definitions in SizeBasedFileRewritePlanner
  • Update Spark actions and tests across all 4 Spark versions to reference the non-deprecated constants
  • Flink and core modules already reference SizeBasedFileRewritePlanner and require no changes

@sachinnn99 sachinnn99 force-pushed the deprecate-max-file-group-size-bytes branch from 5b74d47 to b6d0641 Compare May 12, 2026 07:06
Deprecate MAX_FILE_GROUP_SIZE_BYTES and MAX_FILE_GROUP_SIZE_BYTES_DEFAULT
in RewriteDataFiles in favor of the canonical definitions in
SizeBasedFileRewritePlanner. Update Spark actions and tests to reference
the non-deprecated constants.
@sachinnn99 sachinnn99 force-pushed the deprecate-max-file-group-size-bytes branch from b6d0641 to 620b0d5 Compare May 12, 2026 07:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Cleanup code for max-file-group-size-bytes in Iceberg rewrite files.

1 participant