The failures are where the lessons live.
- Tried to fine-tune Llama on Google Colab's free tier. Lost all checkpoints. Learned the hard way about resource limits.
- Built a RAG system for a simple CRM. Answers were great, but latency killed it. Later realised not everything requires AI; some tasks can use regex and get the job done.
- Entered a hackathon with a complete project, and it failed to run on their environment. Library compatibility across operating systems is a real pain.