Skip to content

Defer ListViewArray compaction and improve rebuild heuristic #8052

@mhk197

Description

@mhk197

Right now we always compact ListViewArray based on a density heuristic after ops like take and filter to clean up sparse arrays. But when to compact wrt execution is dependent whole execution tree. If we have nested takes, for example, we should only compact after the last op.

Whether to compact should be an explicit decision. Tradeoffs are different for different use cases and GC is expensive.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions