#deep-learning

Coisas que escrevi sobre #deep-learning

#backend(11)
#github(10)
#django(8)
#api(8)
#serializers(8)
#machine-learning(7)
#deep-learning(5)
#ai(4)
#python(4)
#machinelearning(3)
#opensource(3)
#transformers(3)
#code(2)
#attention(2)
#blockchain(2)
#btc(2)
#deployment(2)
#c(2)
#nlp(2)
#optimization(2)
#libs(1)
#lstms(1)
#rnns(1)
#ml(1)
#keras(1)
#images(1)
#jupyter(1)
#process(1)
#domain(1)
#git(1)
#version(1)
#control(1)
#nestjs(1)
#file-api(1)
#graphql(1)
#nodejs(1)
#bert(1)
#cnns(1)
#visão-computacional(1)
#clustering(1)
#hierarchical-clustering(1)
#data-analysis(1)
#uml(1)
#diagramas(1)
#engenharia-de-software(1)
#modelagem(1)
#clean-code(1)
#software-engineering(1)
#best-practices(1)
#mysql(1)
#gradient-descent(1)
#operations-research(1)
#math(1)
#regularization(1)
#overfitting(1)
#vscode(1)
#settings(1)
#keybindings(1)

Attention Mechanism

The attention mechanism allows neural networks to selectively focus on relevant parts of the input when producing each output — the core idea behind Transformers and modern LLMs.

Gradient Descent

Gradient descent is the backbone of training neural networks. This note covers the core algorithm, its variants (SGD, Mini-batch, Adam), and practical tips for using them effectively.

Regularization in ML

Regularization techniques prevent overfitting by constraining model complexity. This note covers L1, L2, Dropout, Batch Normalization, and early stopping with practical code examples.

CNNs: Uncovering Visual Patterns

Entenda como as Redes Neurais Convolucionais (CNNs) revolucionaram a visão computacional ao aprender hierarquias de características visuais.

BERT

Bidirectional Encoder Representations from Transformers.