Thursday, November 19, 2026Thu, Nov 19 AboutRSSSubscribe

GDS

Design tools and creative technology

Code & Web

datasette-arrows 0.1a0

Datasette has released the datasette-arrows plugin, which enables streaming exports using Arrow IPC. This plugin is a significant addition to Datasette's capabilities, allowing for more efficient data export.

Original reporting · simonwillison.net

Read “datasette-arrows 0.1a0” at Simon Willison →
datasette-arrows 0.1a0
Image: Simon Willison

How this was written. GDS wrote this article with a language model from Simon Willison’s reporting (model: @cf/meta/llama-3.3-70b-instruct-fp8-fast); it describes that reporting rather than adding to it. The original, linked above, is the full story.

Key points from Simon Willison’s report

  • Datasette has released the datasette-arrows plugin, which enables streaming exports using Arrow IPC.
  • The plugin is built on top of Datasette 1.0a43 and uses the register_output_renderer() plugin hook.
  • The plugin can be installed using the command datasette install datasette-arrows and adds a new Arrow option to the export dialog.
  • Datasette is committed to providing a robust and flexible platform for data analysis.
  • The next alpha release of Datasette will include changes to the export dialog to group streaming formats together.

Datasette, a data platform, has announced the release of datasette-arrows 0.1a0, a plugin that enables streaming exports for Datasette using Arrow IPC, according to Simon Willison. This release is sponsored by Dynatrace, a company that specializes in helping developers understand how their code runs in production. The plugin is a significant addition to Datasette's capabilities, allowing for more efficient data export.

The release of datasette-arrows 0.1a0 is built on top of Datasette 1.0a43, which added the ability for plugins to implement streaming export formats. Datasette core already supports streaming CSV and TSV, allowing users to export large amounts of data without loading it all into memory. The new plugin hook, register_output_renderer(), enables developers to implement the same pattern for other formats.

The idea for the datasette-arrows plugin came from Claude Fable 5.2, which suggested the Apache Arrow streaming format as a good option. The plugin was built quickly, with Claude Fable 5.2 creating it in almost a single shot. The plugin can be installed using the command datasette install datasette-arrows, and it adds a new Arrow option to the export dialog.

The addition of the datasette-arrows plugin is a significant improvement to Datasette's export capabilities. With this plugin, users can export data in the Apache Arrow format, which is a popular format for data exchange. The plugin also demonstrates the power of Datasette's plugin architecture, which allows developers to extend the platform's capabilities.

The release of datasette-arrows 0.1a0 is also notable because it shows how Datasette is committed to providing a robust and flexible platform for data analysis. By providing a plugin that implements streaming export formats, Datasette is making it easier for users to work with large datasets. This is particularly important for users who need to export millions of lines of data from a table.

The next alpha release of Datasette is expected to include changes to the export dialog, which will group streaming formats such as Arrow with TSV and CSV in the 'All rows in this table' section. This change will make it easier for users to find and use the new Arrow option. With the release of datasette-arrows 0.1a0, Datasette is continuing to improve its capabilities and provide a better experience for its users.

The datasette-arrows plugin is a significant addition to the Datasette ecosystem, and it demonstrates the platform's commitment to providing a robust and flexible data analysis platform. With its ability to implement streaming export formats, the plugin is a valuable tool for users who need to work with large datasets. As Datasette continues to evolve and improve, it is likely that we will see more plugins and features that enhance its capabilities.

Questions and answers

What is the datasette-arrows plugin?

The datasette-arrows plugin is a plugin for Datasette that enables streaming exports using Arrow IPC.

How do I install the datasette-arrows plugin?

The plugin can be installed using the command datasette install datasette-arrows.

What changes can we expect in the next alpha release of Datasette?

The next alpha release of Datasette will include changes to the export dialog to group streaming formats such as Arrow with TSV and CSV in the 'All rows in this table' section.

Read the full story at Simon Willison More from Thursday, November 19, 2026’s edition