Benchmarking JSON BinPack · HackerPapers discussions

Benchmarking JSON BinPack — mentioned by jviotti

Tue, 08 Oct 2024 13:10:33 GMT

Great stuff! I'm starting to work a lot on the satellite space (https://www.sourcemeta.com), building a binary serialization format around JSON called JSON BinPack (https://jsonbinpack.sourcemeta.com) that is extremely space-efficient to pack more documents in the same Iridium uplink/downlink operation (up to 74% more compact than Protocol Buffers. See reproducible benchmark here: https://arxiv.org/abs/2211.12799). It is still a heavy work in progress, but if anybody here is suffering from expensive Iridium bills, I would love to connect and discuss to make sure JSON BinPack is built the…

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — mentioned by jviotti

Mon, 30 Sep 2024 13:47:52 GMT

I'm working on JSON BinPack (https://jsonbinpack.sourcemeta.com), a binary serialization format for JSON (think of it as a Protobuf alternative) with a strong focus on space-efficiency for reducing costs when transferring structured data over 5G and satellite transceivers for robotics, IoT, automotive, etc. If you work at any of those industries and pay a lot for data transfer, please reach out! I'm trying to talk to as many people as possible to make sure JSON BinPack fits their use case well (I'm trying to build a business around it). It was originally designed during my (award-winning!)…

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — mentioned by jviotti

Tue, 20 Aug 2024 14:21:35 GMT

We do! See https://benchmark.sourcemeta.com for a live benchmark and https://arxiv.org/abs/2211.12799 for a more detailed academic benchmark. The TLDR is that is that if you use JSON BinPack on schema-less mode, its still more space-efficient than MessagePack but not by a huge margin (depends on the type of data of course). But if you start passing a JSON Schema along with your data, the results become way smaller. Please reach out to jv@jviotti.com. I would love to discuss your use case more.

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — mentioned by jviotti

Mon, 19 Aug 2024 21:02:17 GMT

CBOR is a schema-less binary format. JSON BinPack supports both schema-less (like CBOR) and schema-driven (with JSON Schema) modes. Even on the schema-less mode, JSON BinPack is more space-efficient than CBOR. See https://benchmark.sourcemeta.com for a live benchmark and https://arxiv.org/abs/2211.12799 for a more detailed academic benchmark

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — mentioned by jviotti

Mon, 19 Aug 2024 18:08:51 GMT

Very cool! How are the balloons transferring telemetry back to earth for analysis, etc? Asking because my research at the University of Oxford was around hyper space-efficient data transfer from remote locations for a fraction of the price. The result was an award-winning technology (https://jsonbinpack.sourcemeta.com) to serialise plain JSON that was proven to be more space-efficient than every tested alternative (including Protocol Buffers, Apache Avro, ASN.1, etc) in every tested case (https://arxiv.org/abs/2211.12799). If it's interesting, I'd love to connect and discuss (jv@jviotti.com)…

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — mentioned by jviotti

Fri, 17 May 2024 15:31:59 GMT

I'm currently building a Protocol Buffers alternative that uses JSON Schema instead: https://jsonbinpack.sourcemeta.com/. It was proven on research to be as or more space-efficient than any considered alternative (https://arxiv.org/abs/2211.12799). However, it is still heavily under development and not ready for production use. Definitely looking for GitHub Sponsors or other type of funding to support it :)

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — mentioned by jviotti

Sun, 30 Jul 2023 16:00:37 GMT

If you are interested in learning more about binary serialization (for Cap'n Proto and others), I wrote two free-to-read papers extensively looking at the scene from a space-efficiency point of view that people here might be interested in: - https://arxiv.org/abs/2201.02089 - https://arxiv.org/abs/2201.03051 Not something that aims to compete with Cap'n Proto (different use cases), but I've been also working on a binary serialization format that is pure JSON-compatible with a focus on space-efficiency: https://www.jsonbinpack.org. Benchmarks here: https://arxiv.org/abs/2211.12799

Paper and discussion history. A mention is not an endorsement.

Benchmarking JSON BinPack — HN submission

Fri, 25 Nov 2022 19:01:37 GMT

Benchmarking JSON BinPack

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.