Transformer: Attention is all you need

对标：recurrent neural networks, long short-term memory, gated recurrent neural networks

attention mechanism

encoder-decoder architectures

Multi-Head Attention

stacked self-attention and point-wise

Untitled

Q: Queries, K: Key, V: Value

Untitled

\[Attention(Q,K,V)=softmax(\frac{QK^T}{\sqrt{d_k}})V\]

QUASTION

sequence transduction是什么

有哪些query

哪里输出的是翻译结果，输出的概率是什么