Understanding HTML with Large Language Models · HackerPapers discussions

Understanding HTML with Large Language Models — mentioned by jackblemming

Wed, 01 Mar 2023 03:07:49 GMT

Hooking ChatGPT (and similar architectures) into applications is going to be the next big thing. It just takes time to hook up various systems. Eventually a vision module will be integrated and it will probably be able to "figure out" most systems. There's a lot of money to be made in hooking up these "brains" into apps. I hope people get on it, since it will be quite convenient. See: Act-1: https://news.ycombinator.com/item?id=32842860 Open-Assistant: https://github.com/LAION-AI/Open-Assistant Toolformer: https://arxiv.org/abs/2302.04761 Understanding HTML with LLMs…

Paper and discussion history. A mention is not an endorsement.

Understanding HTML with Large Language Models — mentioned by PaulHoule

Sun, 12 Feb 2023 14:12:23 GMT

I found these papers: https://arxiv.org/abs/2210.03945 https://arxiv.org/abs/2202.00217 https://arxiv.org/abs/2201.10608 My take is that fine-tuning a language model to parse HTML shouldn't be terribly difficult but you probably do need a computer with a good GPU. The one problem that current LLMs have is that they all have a limited attention window. BERT has a 512 token window and ChatGPT has a 4096 token window, where typically a token is less than a word. There are models with much longer windows (reformer) but those don't work as well as the state-of-the-art models, at least not yet.…

Paper and discussion history. A mention is not an endorsement.

Understanding HTML with Large Language Models — HN submission

Tue, 11 Oct 2022 19:26:31 GMT

Understanding HTML with Large Language Models

63 points; 11 discussion replies on HN. Paper and source history. A submission is not an endorsement.