HackerPapers

arXiv:2308.01074cs.CR

A Practical Deep Learning-Based Acoustic Side Channel Attack on Keyboards

Joshua Harrison, Ehsan Toreini, Maryam Mehrnezhad

Abstract

With recent developments in deep learning, the ubiquity of micro-phones and the rise in online services via personal devices, acoustic side channel attacks present a greater threat to keyboards than ever. This paper presents a practical implementation of a state-of-the-art deep learning model in order to classify laptop keystrokes, using a smartphone integrated microphone. When trained on keystrokes recorded by a nearby phone, the classifier achieved an accuracy of 95%, the highest accuracy seen without the use of a language model. When trained on keystrokes recorded using the video-conferencing software Zoom, an accuracy of 93% was achieved, a new best for the medium. Our results prove the practicality of these side channel attacks via off-the-shelf equipment and algorithms. We discuss a series of mitigation methods to protect users against these series of attacks.

arXiv comments
This paper was already accepted in 2023 IEEE European Symposium on Security and Privacy Workshop, SiLM'23 (EuroS&PW)
Journal reference
DOI
doi:10.1109/EuroSPW59978.2023.00034
Subjects
cs.CRCryptography and Security cs.LGMachine Learning

On Hacker News

Linked by 5 identifiable commenters in 5 comments across 5 threads, from Aug 2023 to Mar 2026. Found in 9 HN submissions from Aug 2023 to Jan 2026. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments5 threads

    • 93% - 95% accuracy and it wasn't even a good quality recording > When trained on keystrokes recorded by a nearby phone, the classifier achieved an accuracy of 95%, the highest accuracy seen without the use of a language model. When trained on keystrokes recorded using the…

      vova_hn2View on HNParent context

    • > Passwords Which reminds me, to strengthen your point, it doesn't have 100% keystroke recognition, but there are works[1] on keylogging via audio, and 93% via Zoom-quality audio streams is concerning enough for me. [1] https://arxiv.org/abs/2308.01074

      schroedingView on HNParent context

    • No details about what specific study they are referring to. These attacks are possible for several years now. 2016 - "Don't Skype & Type! Acoustic Eavesdropping in Voice-Over-IP" - https://arxiv.org/abs/1609.09359 2020 - "Behavioral Acoustic Emanations: Attack and Verification…

      belterView on HNParent context

    • Keystroke timing attacks have been known for quite a while - heres a highly cited paper from over 20 years ago: https://www.usenix.org/conference/10th-usenix-security-sympo... Recently there has been some work on using audio of keypresses to determine what's been typed…

      sophaclesView on HNParent context

    • Another reason for using a password manager is the fact of keyboard-related attacks getting more widespread. Case in point: A Practical Deep Learning-Based Acoustic Side Channel Attack on Keyboards (https://arxiv.org/pdf/2308.01074.pdf)

      baal80spamView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.