Low Latency Privacy Preserving Inference — mentioned by osaariki

Tue, 26 Nov 2019 17:09:32 GMT

You're right, CryptoNets used a data layout optimized for throughput with a batch size 4096. Since then we've done a lot of work on low latency inference with our CHET compiler [1] and my colleagues with LoLa [2]. It all comes down to the data layouts you use. [1]: https://www.cs.utexas.edu/~roshan/CHET.pdf [2]: https://arxiv.org/pdf/1812.10659.pdf

Paper and discussion history. A mention is not an endorsement.

Low Latency Privacy Preserving Inference · HackerPapers discussions

Low Latency Privacy Preserving Inference — mentioned by osaariki