Understanding Transformer Attention
A deep dive into the self-attention mechanism that powers modern language models. From theory to implementation.
Exploring the frontier of artificial intelligence. Turning complex models into elegant solutions.
Read my writing"The question of whether a computer can think is no more interesting than the question of whether a submarine can swim."— Edsger W. Dijkstra
A deep dive into the self-attention mechanism that powers modern language models. From theory to implementation.
Everything I learned about LoRA, QLoRA, and efficient fine-tuning techniques for large language models.
Comparing retrieval-augmented generation with fine-tuning. Practical considerations for real-world AI applications.
Working on something interesting. Stay tuned for updates.
Exploring new ideas in the AI space.
Building tools for the future.
More projects on the way.
AI enthusiast exploring the boundaries of machine intelligence. Interested in LLMs, deep learning, and building practical AI applications. Always learning, always experimenting.