KKTinkojitanaka.hashnode.dev·Jul 4, 2023 · 3 min readThe Magic of Softmax and Attention Mechanisms in Neural Machine TranslationNeural machine translation has seen significant strides with the introduction of sequence-to-sequence models. However, these models initially struggled with long sentences, often resulting in loss of information and context. The game changer? Attenti...00
KKTinkojitanaka.hashnode.dev·Jul 3, 2023 · 2 min readExploring the Attention Mechanism in "Neural Machine Translation by Jointly Learning to Align and Translate"In the world of machine translation and sequence-to-sequence models, there have been few innovations as impactful as the introduction of the attention mechanism. This technique was first proposed by Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio ...00
KKTinkojitanaka.hashnode.dev·Jul 2, 2023 · 3 min readBeam Search in Recurrent Neural Networks (RNNs)If you're interested in natural language processing or sequence prediction tasks, you may already be familiar with Recurrent Neural Networks (RNNs) and their capabilities. One of the techniques that make RNNs so powerful in these applications is beam...00
KKTinkojitanaka.hashnode.dev·Jun 29, 2023 · 3 min readHow Word Vectors Align with Softmax and Negative Sampling Parameters in Word2VecIf you've dabbled in natural language processing (NLP), you've probably heard about Word2Vec, a powerful algorithm that revolutionized the field by learning vector representations of words. You may also know that the parameters of the softmax functio...00
KKTinkojitanaka.hashnode.dev·Jun 11, 2023 · 2 min readWords in Space: An Overview of Word EmbeddingsWord embeddings. If you're involved in the world of Natural Language Processing (NLP) or Machine Learning, you've undoubtedly heard of them. But what are they, and why are they so crucial to the ways in which our technologies understand human languag...00
