karpathy
Andrej Karpathy — AI researcher, former OpenAI and Tesla AI lead
Andrej Karpathy, AI researcher, on machine learning and neural networks.
karpathy.bearblog.devLLMs are humanity's 'first contact' with non-animal intelligence. Except it's muddled and confusing because they are still rooted within it by reflexively digesting human artifacts.
Andrej Karpathy's personal blog, where one of AI's most recognized researchers thinks out loud about machine learning, intelligence, and the tools we use every day. His posts range from sweeping essays on the nature of non-human intelligence to practical takes on sleep trackers and digital hygiene — all written with the clarity you'd expect from someone who taught Stanford's deep learning course.
Written by Andrej Karpathy since 2025.
Occasional
Publishes a few times per month
5
Independent Blog
English
How this blog's content is accessed through Blogs Are Back.
Full Content
RSS feed includes complete post content for reading in-app
Proxy Required
Feed is fetched through our proxy for browser compatibility
Proxy Post Links
Post pages are loaded through our proxy for compatibility
Embeddable
Posts can be displayed inline in the reader view
This blog appears in the following curated collections.
Recent posts from karpathy's RSS feed.
2025 LLM Year in Review
2025 has been a strong and eventful year of progress in LLMs. The following is a list of personally notable and mildly surprising "paradigm changes" - things that altered the landscape and stood out to me conceptually. 1. Reinforcement Learning from Verifiable Rewards (RLVR)At the start of 2025, the LLM production stack in all labs looked something like this: Pretraining (GPT-2/3 of ~2020) Supervised Finetuning (InstructGPT ~2022) and Reinforcement Learning from Human Feedback (RLHF ~2022) Thi...
Chemical hygiene
Following up on digital hygiene, I wanted to write up my (evolving, opinionated) guide to chemical hygiene. I keep ranting about this topic to all of my friends recently (you can tell I'm really fun at parties), so I thought it would be worth writing it up to have it all in one place/url: Water Starting out with controlling your water system, which is the easiest in terms of concrete, high confidence recommendations that in my experience still only All your drinking water should come from Reve...
Auto-grading decade-old Hacker News discussions with hindsight
TLDR: https://karpathy.ai/hncapsule/ Yesterday I stumbled on this HN thread Show HN: Gemini Pro 3 hallucinates the HN front page 10 years from now, where Gemini 3 was hallucinating the frontpage of 10 years from now. One of the comments struck me a bit more though - Bjartr linked to the HN frontpage from exactly 10 years ago, i.e. December 2015. I was reading through the discussions of 10 years ago and mentally grading them for prescience when I realized that an LLM might actually be a lot bett...
The space of minds
The space of intelligences is large and animal intelligence (the only kind we've ever known) is only a single point (or a little cloud), arising from a very specific kind of optimization that is fundamentally distinct from that of our technology. Above: humorous portrayals of human vs. AI intelligences can be found on X/Twitter, this one is among my favorites. Animal intelligence optimization pressure: innate and continuous stream of consciousness of an embodied "self", a drive for homeostasis...
Verifiability
AI has been compared to various historical precedents: electricity, industrial revolution, etc., I think the strongest analogy is that of AI as a new computing paradigm because both are fundamentally about the automation of digital information processing. If you were to forecast the impact of computing on the job market in ~1980s, the most predictive feature of a task/job you'd look at is specifiability, i.e. are you just mechanically transforming information according to rote, easy to specify a...
If you enjoy karpathy, you might also like these blogs.
Simon Willison's Weblog
simonwillison.netOpen source developer building tools to help journalists, archivists, librarians and others analyze, explore and publish their data
Armin Ronacher's Thoughts and Writings
lucumr.pocoo.orgPersonal blog of the Flask creator on Python, tooling, and software design.
antirez
antirez.comSalvatore Sanfilippo, creator of Redis. Deep thoughts on programming, systems design, and software craft.
Pierce Freeman
pierce.devSoftware engineer and writer
Follow karpathy
One of the clearest thinkers in AI, writing accessibly about where the technology actually is — not where the hype says it is.