AI
datasette-arrows 0.1a0
Publication: Simon Willison's Weblog
Author: Not available in collected metadata
Source published: 18/11/2026, 17:09:59 UTC
Briefing created: 19/11/2026, 04:21:13 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 19/11/2026, 03:42:24 UTC.
Briefings
Datasette 1.0a43 added a new plugin hook to enable streaming export formats, specifically Apache Arrow, allowing users to export millions of data rows without loading them into memory. This feature was implemented by the community following a suggestion from Claude Fable 5.2, and is now available via the 'datasette-arrows' plugin. The export dialog now includes an Arrow option, though it is not yet grouped with standard CSV/TSV formats in the main branch.
Key points
- Datasette 1.0a43 introduced a new plugin hook 'register_output_renderer()' to support streaming export formats.
- The 'datasette-arrows' plugin was created by the community to implement Apache Arrow streaming export functionality.
Context
Datasette 1.0a43 added the ability for plugins to implement streaming export formats, allowing users to export millions of lines of data from a table without needing to load it all into memory. This capability was enabled by adding support for streaming CSV and TSV formats, with the new Arrow plugin built to follow this pattern.
Limitations
The evidence is limited to the release notes and a single screenshot from the main branch. Streaming formats like Arrow are not yet grouped with TSV and CSV in the export dialog, and the specific version of the Arrow plugin that was built is not named or dated in the source.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 19/11/2026, 04:21:13 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeif3yekjogr6co7oh7e73k7zy53evqftv7ewd72rax5uq57rym6vau