#nlp

Coisas que escrevi sobre #nlp

#backend(11)
#github(10)
#django(8)
#api(8)
#serializers(8)
#machine-learning(7)
#deep-learning(5)
#ai(4)
#python(4)
#machinelearning(3)
#opensource(3)
#transformers(3)
#code(2)
#attention(2)
#blockchain(2)
#btc(2)
#deployment(2)
#c(2)
#nlp(2)
#optimization(2)
#libs(1)
#lstms(1)
#rnns(1)
#ml(1)
#keras(1)
#images(1)
#jupyter(1)
#process(1)
#domain(1)
#git(1)
#version(1)
#control(1)
#nestjs(1)
#file-api(1)
#graphql(1)
#nodejs(1)
#bert(1)
#cnns(1)
#visão-computacional(1)
#clustering(1)
#hierarchical-clustering(1)
#data-analysis(1)
#uml(1)
#diagramas(1)
#engenharia-de-software(1)
#modelagem(1)
#clean-code(1)
#software-engineering(1)
#best-practices(1)
#mysql(1)
#gradient-descent(1)
#operations-research(1)
#math(1)
#regularization(1)
#overfitting(1)
#vscode(1)
#settings(1)
#keybindings(1)

Attention Mechanism

The attention mechanism allows neural networks to selectively focus on relevant parts of the input when producing each output — the core idea behind Transformers and modern LLMs.

BERT

Bidirectional Encoder Representations from Transformers.