6.0.10

Addax 6.0.10 has released! 🎉

We are pleased to announce version 6.0.10, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

highlights

• Add new Doris writer plugin(#1426)
• Add support for bloom filter configuration with hdfs writer plugin(#1428)

6.0.9

Addax 6.0.9 has released! 🎉

We are pleased to announce version 6.0.9, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.
Below are the key updates in this release:

Highlights

• Added YAML job configuration support (.yaml/.yml) alongside JSON, with a full set of YAML example job templates.
• HTTP Reader now supports authConfig token bootstrap for authenticated requests.
• ORC writer normalizes timestamp string output to a consistent yyyy-MM-dd HH:mm:ss format.

Bug Fixes

• RDBMS excludeColumn now works correctly with quoted column names; avoids redundant re-quoting.
• PostgreSQL forced column quoting fixed to use proper double-quote handling and safer fallbacks.

Docs & Examples

• HTTP Reader documentation expanded/updated.
• New project knowledge/conventions documentation added.
• Plugin job template updated for new HTTP auth options.

Operational / Maintenance

• Added logging for PK range SQL execution in SingleTableSplitUtil.
• Ensured mutable handling of allColumns in RDBMS config pretreatment.
• GitHub Actions updates (setup-java, cache) and minor POM/version alignment across modules.

📜 Changes

5c9309c (HEAD -> master, origin/master, origin/HEAD) [maven-release-plugin] prepare for next development iteration
1873049 (tag: 6.0.9) [maven-release-plugin] prepare release 6.0.9
424b62b [bugfix][lib][rdbms]: fix forced column quoting for PostgreSQL (#1417)
1c288ef [bugfix][lib][rdbms]: fixed excludeColumn config not working due to quoted column name mismatch (#1415)
86d24e6 [feat][plugin][httpreader] Add authConfig token bootstrap (#1414)
ad6b116 [chore][core]: Add YAML file support in job configuration
9de195e [feature][core]: Add YAML job config support (#1408)
35922d5 [chore][action] Bump setup-java action version to 5.2.0 in workflows
f476edb [chore][lib][rdbms] Add log for PK range SQL execution in SingleTableSplitUtil
ded60dd [chore][docs]: Add project-specific knowledge and conventions in SKILL.md
c459e23 [chore][lib][rdbms] Ensure allColumns is a mutable list in OriginalConfPretreatmentUtil
41737eb [feature][plugin][hdfswriter] Normalize timestamp string output in OrcWriter
bdd5c51 [update][action] Bump actions/setup-java from 5.0.0 to 5.1.0 (#1390)
c4554eb [update][action] Bump actions/cache from 4 to 5 (#1391)
0326ca8 [maven-release-plugin] prepare for next development iteration

6.0.8

For My Mother

Addax 6.0.8 has released! 🎉

We are pleased to announce version 6.0.8, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.
Below are the key updates in this release:

📜 Changes

ac8b7fc [bugfix][plugin][paimonwriter] Fix paimon writer truncate table failed (#1398)
330c2db [bugfix][plugin][paimonwriter] fix paimon data loss (#1396)
fb5530b [feature][lib][rdbms] Add unQuote method to DataBaseType for handling quoted identifiers
d9346e8 Merge branch 'master' of github.com:wgzhao/Addax
a55b19f [bugfix][lib][rdbms] fix null string comparison to be case-insensitive in DataBaseType.java
2071457 [improve][rdbms] Use shared BasicDataSource cache in DBUtil to enable real pooling and fix per-call DS teardown
29a140c [feature][rdbms] Enhance column name quoting with optional force quoting
8fc7116 [chore][dependencies] Bump commons.csv, log4j and zstd to updated version
02a9230 [chore][github][action] update actions/checkout to v6 across workflow files and
b419568 [chore][lib][rdbms] Remove redundant timezone configuration check for MySQL JDBC
a22d9f6 [bugfix][plugin][mysqlreader] Fix NPE when reading GEOMETRY columns with null or SRID-only WKB
2d881af [update][doc] enhance documentation for RDBMS writer configuration parameters and add ddl support
b49ccbf [chore][issue-template] Update default version options in NEW-ISSUE.yml

6.0.7

Addax 6.0.7 has released! 🎉

We are pleased to announce version 6.0.7, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.
Below are the key updates in this release:

📜 Changes

8618d02 [maven-release-plugin] prepare for next development iteration
6877e07 (tag: 6.0.7) [maven-release-plugin] prepare release 6.0.7
0d53b54 [bugfix][lib][rdbms] fix #1380 Operation not allowed after ResultSet closed failure observed in writer initialization
f6666f6 [chore][plugin][mysqlreader] Remove unused import statement from MysqlReader.java
efa6c62 [improve][plugin] Enhance job template configuration with additional parameters and improved formatting
5bd62aa [bugfix][plugin][elastcisearchreader] Fix ES query serialization and avoid adding type to search path (#1379)
58b9eae [chore][update][3rd] Update dependency versions in pom.xml
1adb9db [improve][plugin][mongodbwriter] add supports for wildcard column (#1377)
0e2134f [improve][plugin][mongodbreader] add supports for wildcard column (#1376)
544eefc [chore][github] add pull request template to standardize contributions
c70da5f [improve][plugin][mongodbwriter] implement nested field handling for better data structure support
b6972a4 [maven-release-plugin] prepare for next development iteration

6.0.6

Addax 6.0.6 has released! 🎉

We are pleased to announce version 6.0.6, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.
Below are the key updates in this release:

📜 Changes

b6972a4 (HEAD -> master) [maven-release-plugin] prepare for next development iteration
6928b57 (tag: 6.0.6) [maven-release-plugin] prepare release 6.0.6
bb9935c (origin/master, origin/HEAD) [bugfix][core] ensure proper validation when updating task group communication by checking for null previous value
7e93665 [improve][core] enhance thread safety and performance by using final maps and ThreadLocal for DecimalFormat
6529ac4 [chore][3rd] update CodeQL action to v4 and bump dependency versions in pom.xml
538b793 [chore][plugin][hdfswriter] suppress log4j warnings by using log4j-over-slf4j bridge
9c31179 [refactor][lib][rdbms] optimize SQL logging, bytes handling, object creation, and record building
9dcf8cb [feature][plugin][streamwriter] add hex preview formatting for binary columns and improve console output
b54b542 [feature][plugin][mongodbreader] Support Nested Field Extraction in MongoDBReader Plugin via Dot Notation (#1360)
345df81 [chore][3rd] update json-smart to version 2.6.0 and fastjson2 to version 2.0.59
12e8389 [bugfix][plugin][hdfswriter] set scale before precision for ORC decimal to avoid invalid precision/scale error
f530037 [improve][core] improve date compatibility for BSD/macOS and support custom log file name in addax.sh
b675390 [maven-release-plugin] prepare for next development iteration

6.0.5

Addax 6.0.5 has released! 🎉

We are pleased to announce version 6.0.5, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.
Below are the key updates in this release:

Highlight

The new Server module provides HTTP interfaces for submitting and managing data collection tasks. Users can submit JSON job configurations via POST, and the server executes tasks asynchronously, returning a unique task ID. Progress and results can be queried using this ID.

Features

• RESTful API for task submission and status query
• Configurable maximum concurrent tasks (default: 30)
• Integrated with Addax core Engine for direct job execution
• Supports command-line and environment variable concurrency settings
• Startup/shutdown script with background mode support

📜 Changes

482146c [maven-release-plugin] prepare for next development iteration
6f6a2f7 [maven-release-plugin] prepare release 6.0.5
e97f70c [improve][server] Refactor AddaxServer and TaskService for improved readability and maintainability
a0d6b9a [feature][add][server] add minimal HTTP server module for job submission and status query (#1359)
fab780e [chore][docs] add related projects section to README files
a6a7ca8 [feature][plugin][hdfswriter] add automatic path creation option in HDFS writer configuration
667b22c [bugfix][plugin][streamwriter] resolve console log output inconsistency between terminal and log files
7aef269 [improve][core] Enhance exception handling by including JDBC URL and query SQL in error messages
64d5378 [chore][3rd] update dependencies to updated version
ada7ebc [chore][core] remove deprecated methods
668e8fb [chore][maven] remove unnecessary excludes from package.xml dependencies
d1571b3 [chore][core] Add 'RANK' keyword to SQL constant definitions
00b18c0 [improve][lib][rdbms] Add support for column name quoting in rdbms writer
158c184 [bugfix][plugin][s3writer] fix #1344, handle null columns in record2String with continue to prevent duplicate and assertion errors
a3efd3b [chore][core] add totalBytes to job statistics and update documentation
380cbe7 [bugfix][plugin][hivereader] add hadoop-shaded-protobuf dependency for enhanced compatibility
357a855 [improve][core][script] enable Java security to support JDK 21+
6047869 [improve][plugin][mongodbreader] use MongoRowConverter for BSON document processing
5704a3e [improve][plugin][excelwriter] Improved Excel write performance by generating XML files directly (#1341)
4a09681 [chore][plugin][datareader] replace deprecated RandomStringUtils.randomAlphanumeric with insecure variant
a02defe [chore][github][action]: update actions/setup-java and actions/upload-pages-artifact to latest versions
e5816e8 [maven-release-plugin] prepare for next development iteration

6.0.4

Addax 6.0.4 has released! 🎉

We are pleased to announce version 6.0.4, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

📜 Changes

c402a61 [chore][docs] update mkdocs navigation for improved readability and localization
e3a1390 [refactor][lib][storage] enhance FileHelper and StorageWriterUtil with improved error handling, validation, and documentation
a4c6ed6 [chore][lib][rdbms] enhance JavaDoc comments across multiple classes for improved clarity and understanding
e621b75 [chore][core] improve comments and formatting in FilterTransformer and RetryUtil
d1ac643 [chore][core] improve Communication class with deep-copy constructor and message cloning
f772a62 [chore][lib][rdbms] refactor SQL query formatting for SQLite and Sybase cases
e65ff3f [chore][core][doc] enhance JavaDoc comments for better clarity and understanding
6bd212b [chore][lib][rdbms] replace List with Set for numeric JDBC types in GetPrimaryKeyUtil
9f939b5 [chore][github][action] Bump actions/checkout from 4 to 5 (#1332)
5b5bb62 [chore][3rd] update dependency versions in pom.xml
c6f5317 [chore][github][issue] update default version in NEW-ISSUE.yml to 6.0.3
3b2bcf2 [maven-release-plugin] prepare for next development iteration

6.0.3

Addax 6.0.3 has released! 🎉

We are pleased to announce version 6.0.3, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.
Below are the key updates in this release:

📜 Changes

35ad873 (origin/master, origin/HEAD) [chore][docs] chanege the default directory
82414b0 [feature][lib][rdbms] support reading SQL from external files in querySql configuration (#1331)
2d5a780 [chore][docs] restore deleted docs
87c0215 [bugfix][plugin][cassandrareader] fix missing netty dependencies , fix #1329
2de7f97 [chore][github][issue-template] update version references and improve log output instructions in NEW-ISSUE.yml
240418f [refactor][doc][json] streamline JSON configuration by consolidating connection parameters and enhancing readability
4487de3 Merge branch 'master' of github.com:wgzhao/Addax
700acee [bugfix][lib][rdbms] SingleTableSplitUtil#buildStringSplitPointQuery should distinguish oracle and other rdbms to generate statement
110361e [chore][github][action] update GitHub Actions to latest versions for improved performance and security
e97928a [chore][docs] update plugin development and transformer documentation for clarity and consistency
a32b6b3 [chore][docs] update language links in mkdocs.yml for correct routing
8af9790 Add bilingual documentation support with English as default language (#1321)
95e04e4 Merge branch 'master' of github.com:wgzhao/Addax
368297b [chore][plugin][starrockswriter] improve logging format and enhance error handling
d0296c3 [chore][core] correct capitalization in job format upgrade comment in ConfigParser.java
9b24e6d [chore][core] simplify a switch statement in LoadUtil.java for improved readability
0ff7383 [feature][core] add common date constants and parameters to addax.sh for enhanced job configuration
dccc07c [chore][update][3rd]: update dependency versions in pom.xml
9c9b370 [chore][plugin][kuduwriter] simplify KuduHelper constructors and enhance KuduWriterTask with modern switch expressions
4e0852e [maven-release-plugin] prepare for next development iteration

6.0.2

Addax 6.0.2 has released! 🎉

We are pleased to announce version 6.0.2, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

Highlight

• update Hadoop version to 3.3.6 (#1306)
• migrate from Apache HttpClient to Java 11 HttpClient (#1305)
• add hidden file filter to listStatus method in DFSUtil

📜 Changes

46ef26e (origin/master, origin/HEAD) [feat][plugin][hdfsreader] add hidden file filter to listStatus method in DFSUtil
d3afd05 [chore][docs][hivereader] add version compatibility information for HiveReader
dfb77d6 [bugfix][core][build] increase pom.xml read limit to capture a project version correctly
0539fbe [upgrade][dependencies] update Hadoop version to 3.3.6 (#1306)
02304c5 [chore][license][update] add Apache License 2.0 header to missing files
e33e74b [chore][plugin][dependencies] update log4j and zstd versions in pom.xml
0d343c6 [improve][plugin][httpreader] improve JSON body handling in POST requests
55b9198 [refactor][core] simplify job resource handling by removing HTTP request logic
d0dbbc3 [bugfix][core] fixed job file URL parsing to support case-insensitive protocols
32d42c5 [chore][plugin][icebergwriter] clean up pom.xml by removing unused dependencies and properties
bbb3e64 [chore][plugin][hdfsreader] fix indentation in pom.xml
56678f4 [chore][plugin][hivereader] remove unnecessary whitespace in pom.xml
ab24da9 [chore][plugin][dependencies] update Avro to 1.12.0 and ORC to 1.9.5
a9a6322 [chore][plugin][icebergwriter] update error message for unsupported file format
0647617 [bugfix][plugin][icebergwriter] fix error when write orc format table (#1304)
fdc8934 [chore][plugin][httpreader] remove unused commons-net dependency from pom.xml
2657f08 [refactor][plugin][httpreader] migrate from Apache HttpClient to Java 11 HttpClient (#1305)
5349776 [refactor][core] switch garbage collector from G1GC to ZGC for improved performance
fbaab28 [refactor][core] replace Apache HttpClient with Java 11 HttpClient for improved HTTP handling
50fd555 [maven-release-plugin] prepare for next development iteration

6.0.1

Addax 6.0.1 has released! 🎉

We are pleased to announce version 6.0.1, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

1. Add support for range data type for PostgreSQL (#1283)
2. Add support for kerberos with kudu (#1290, #1292)
3. Add support for geometry data type for MySQL (#1298, #1299)

📜 Changes

2405b5c [bugfix][plugin][elasticsearchreader] adds missing Apache HttpClient dependency
57bb867 [chore][dependencies] update jackson, redis.replicator, woodstox, and sqlite JDBC versions
682dd90 [feature][plugin][mysqlwriter] Add support for GEOMETRY data type handling (#1299)
f1e4d31 [feature][plugin][mysqlreader] Add support for GEOMETRY data type handling (#1298)
ab65c64 [chore][dependencies] update versions for druid, jansi, jsch, ngdbc, and iceberg
3b01026 [feature][plugin][kudureader] Add support for kerberos with kudu (#1292)
9a7a25a [improve][plugin][writer] enhances conflict handling by filtering out conflict columns in an update statement
b1f993f [chore][plugin][kuduwriter] simplify KuduHelper initialization and improve code comments
b0caf7a [feature][writer][kuduwriter] Add support for kerberos with kudu (#1290)
5fbada0 [refactor][plugin][postgresql] clean up error handling and improve code readability
6f95151 [add][plugin][postgresql] Add support for the range data type (#1283)
fc5128f [chore][update][dependencies] bump versions for paimon, gson, httpclient, clickhouse, and databend
f3111d7 [bugfix][plugin][hdfs] add exclusion for hadoop-client-api in protobuf-java dependency
545aa24 [chore][docker] update build script to use correct addax version directory
8fad050 [maven-release-plugin] prepare for next development iteration