Compressed Apache Arrow Tables Over HTTP

Returning Arrow tables over HTTP is relatively straightforward. The Arrow IPC streaming format is repurposed to the HTTP use case and you can return each serialized IPC batch as a chunk of the HTTP response — Transfer-Encoding: chunked — to enable streaming clients. Arrow IPC streams have a MIME type registered with IANA so you can also set the appropriate Content-Type header on your HTTP…