Show, Attend and Tell: Neural Image Caption Generation with Visual Attention · HackerPapers discussions

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — mentioned by ahartman00

Sat, 03 Feb 2018 08:52:51 GMT

Not sure why you were downvoted, I'm assuming this was a good faith question. I'm going to try to answer your question, but I'm still learning, so take this with a grain of salt. Some models have attention, but it is not a requirement. In models that do have attention, it may or may not be simple. In image captioning for example, you can do just that. See [1] for some pictures of this happening. But in this example, they are stepping through a caption, and seeing where the attention is focused for each word. Works fine for a short caption. Videos are just many images and sound, but already…

Paper and discussion history. A mention is not an endorsement.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — mentioned by hiddencost

Sun, 05 Feb 2017 00:19:44 GMT

https://arxiv.org/abs/1311.2901 Check out figure 2. The network learns composition from fundamental shapes and gradients to compositional ones. It's kinda awe inspiring. Not NN specific, but some more work on explanations: https://homes.cs.washington.edu/~marcotcr/blog/lime/ Visualization of attention mechanisms is pretty cool for explanations: https://arxiv.org/pdf/1502.03044.pdf http://torch.ch/blog/2015/09/21/rmva.html

Paper and discussion history. A mention is not an endorsement.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — mentioned by kastnerkyle

Mon, 10 Oct 2016 22:35:15 GMT

There are a number of papers tackling a similar task [0][1][2] for anyone who is interested. There isn't enough information to tell exactly what is going on with Deepgram, but one way to approach this would be to construct a shared embedding space for words/phrases and speech. These types of embedding spaces are powerful [3][4][5], but not magic. Cool demo, looking forward to seeing more detail about what is going on. However I would quibble with the STT WER quoted above. Maybe in noisy environments with unknown speakers (and no voice normalization) this is accurate, but the kinds of clean…

Paper and discussion history. A mention is not an endorsement.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — mentioned by larakerns

Thu, 10 Mar 2016 17:08:55 GMT

It might look something like attention detailed in Show, Attend, Tell: http://arxiv.org/abs/1502.03044 Which attempts to visualize machine areas of attention that look like: http://www.wildml.com/wp-content/uploads/2015/12/Screen-Shot...

Paper and discussion history. A mention is not an endorsement.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — mentioned by waterlesscloud

Mon, 05 Oct 2015 11:55:32 GMT

Looks like it's the home page of Ryan Kiros at the University of Toronto. Here's a paper with his name on it with some related work, though I suspect this particular output is from a later project. http://arxiv.org/abs/1502.03044

Paper and discussion history. A mention is not an endorsement.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — mentioned by kastnerkyle

Thu, 06 Aug 2015 21:31:02 GMT

The literature is mostly image based, but as other users have said voice, text, and video have also seen substantial gains. It has also been used to great effect for taxi destination prediction (heterogenous information) [1], drug discovery [2], and general operations on graphs [3]. There are also lots of examples beyond classification - structured prediction such as image segmentation [4], predicting depth, surface normals, and pixels from only RGB [5], text to text translation [6], image captioning [7], Turing machines [8], speech synthesis [9], question answering (Q/A) [10][11]…

Paper and discussion history. A mention is not an endorsement.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention — HN submission

Sat, 14 Feb 2015 15:21:29 GMT

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention [pdf]

15 points; 3 discussion replies on HN. Paper and source history. A submission is not an endorsement.