Back
AI Engineer
AI Deep Explorer | f...Ā ā¢Ā 3m
The best way to learn about LLMs is to read the actual papers that highlight the fundamental ideas behinds LLMs. I'd prob first start off by learning about the attention mechanism which can be detailed in the following paper and try to implement a vanilla transformer: https://lnkd.in/eV6NcXx8 Once you have that down I would probably aim to learn about earlier models and try to implement them. Here are a couple models that are good examples to try to implement from scratch (Karpathy and Umar has good videos for them if you get stuck or just want general overview): ābert: https://lnkd.in/eU7F324a āgpt: https://lnkd.in/eAzaDsP5 āgpt2: https://lnkd.in/ehjhXveV After you gone through all of these, you should have a decent foundation for the very basics and start reading papers in the areas you are interested in. If you don't know where to start these are some suggestions for papers I think that are interesting and worth considering reading: āScaling laws: https://lnkd.in/gdWbBH8i āLora: https://lnkd.in/eW-V4Dcq āMixture of experts: https://lnkd.in/eM5ngGSj āReinforcement Learning from Human Feedback : https://rlhfbook.com/
Replies (1)
More like this
Recommendations from Medial
AI Engineer
AI Deep Explorer | f...Ā ā¢Ā 4m
Day 1/100 : FREE AI Resource Sharing Topic of Day: History Of Artificial Intelligence(AI) Books ā³"Artificial Intelligence: A Modern Approach" by Stuart Russell and Peter Norvig https://lnkd.in/gzSCYnf9 ā³ "The Master Algorithm: How the Quest for t
See More
Three Commas Gang
Building BharatĀ ā¢Ā 11m
Top websites to find a remote wfh job: Remote.co: https://remote.co/ Remote OK: https://remoteok.io/ We Work Remotely: https://lnkd.in/dZNfFuwd FlexJobs: https://www.flexjobs.com/ Remote Jobs Club: https://lnkd.in/dwCD97YV Jobspresso: https://j
See MoreAI Engineer
AI Deep Explorer | f...Ā ā¢Ā 3m
Give me 2 minutes, I will tell you How to Learn Reinforcement Learning for LLMs A humorous analogy for reinforcement learning uses cake as an example.Ā Reinforcement learning, much like baking a cake, involves trial and error to achieve a desired ou
See MoreAI Engineer
AI Deep Explorer | f...Ā ā¢Ā 3m
If I were learning RAG from scratch in 2025... here's exactly how I'd do it. But here I bring you the ultimate resource list for absolutely no cost. RAG is one of the most practical, production-ready LLM patterns today. Here's All you need to get s
See MoreAI Engineer
AI Deep Explorer | f...Ā ā¢Ā 3m
šŖš®š»š šš¼ šÆš²š°š¼šŗš² š®š» šš šŗš®ššš²šæ š¶š» 2025? Learn AI from the ground up with these šš„šš YouTube channels that make it all crystal clear Letās be honestāYouTube can teach you more about AI than a lot of university degrees, From
See More
Parshya Bora
Founder @stealthĀ ā¢Ā 10m
As an AI researcher, I've seen the power and pitfalls of open-source LLMs in enterprises. My latest deep dive explores who stands out the mosts. Read more in our newsletter. Link: https://lnkd.in/gkUKUDqn For more such articles subscribe to our new
See More
Vrishank
Startups/VC/techĀ ā¢Ā 1y
Listing some recent opportunities/openings that can help you break into the Indian VC ecosystem. š 1) Investment Analyst / Associate at pi Ventures šhttps://lnkd.in/dC-zgC5x 2) Marketing manager at Ā Matrix Partners IndiaĀ š https://lnkd.in/dJYT
See More
Download the medial app to read full posts, comements and news.