Release DataFusion 52.4.0 (minor/) Release (Mar 2026)

[alamb]

Is your feature request related to a problem or challenge?

• Part of [EPIC] DataFusion Releases #19783
• Follow on to Release DataFusion 52.3.0 (minor/) Release (Mar 2026) #20681

Are several other regressions reported against 52 that we might want to backport to branch-52 that didn't make it into #20681. Let's coordinate on this ticket in case we want to create a new release

Steps:

• Update version and changelog
• Voting Thread
• Publish to crates.io

Potential Content:

Requested Bug Fixes. Issue / requester / Backport

• [Bug] Dynamic filter leads to wrong results in some aggregation queries with >1 partitions #20267 / @alamb / TODO
• Data regression in aggregations that spill #20724 / @16pierre / TODO
• Regression: array_sort fails on list with inner non-nullable field #19947 / @alamb / TODO
• Duplicate unqualified name error on unions #20123 / @alamb / TODO

[alamb]

I have a first pass at the potential content above

Possible other issues:

• Right joins with empty schema return invalid results #20669
• interval analysis error when have two filterexec that inner filter proves zero selectirity #20742