Skip to main content
Advanced LLM Projects Bootcamp
0%
Previous
Course data
Introduction
ZOOM for Remote Access
Three of your best AI predictions for 2024
Great textbooks in the field
Web resources
QUIZZES
Summer 2024: Top 3 AI predictions
CO-STAR framework for systematic prompting
Quiz: Simulacra
Quiz: Chain of thought
Quiz: Tree of Thought
Day 0: First steps with prompt engineering
Winning a prompt engineering competition
Prompting Guide
Day 1: Advanced Prompt Engineering
Prompt Engineering with Old Faithful Geyser
Starter code for the Children's Textbook Generation
Instructor Framework
Instructor: Cookbook & Examples
DSPy
AutoGen Studio
Awesome Prompt Engineering Collection
Generative Agents: Interactive Simulacra of Human Behavior
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Question Answers
Multiple Choice Quiz
Question Answers
Multiple Choice Quiz
Day 2: Tools for Prompting
Paper reading session video: Tree of thoughts
Video session: Instructor framework
Autogen
LangChain
LiteLLM
Lmsys Chatbot Arena
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
ReAct: Synergizing Reasoning and Acting in Language Models
Day 3: Advanced RAG Methods
Session video recording: RAG techniques
Ollama
Qdrant Vector Database
Llama-Index Portal
Awesome-LLM-RAG Github
Ragas: Evaluating RAG
A quick introduction to using Ollama
YouTube: LlamaIndex
Day 4: PyTorch: Building models from scratch
Session Video Recording: Pytorch
Pytorch website
PyTorch internals
PyTorch YouTube Channel
Homework: Pytorch Models from Scratch
Day 4: BERT family of models
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
RoBERTa: A Robustly Optimized BERT Pretraining Approach
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DeBERTa: Decoding-enhanced BERT with Disentangled Attention
Text classification with Roberta using PyTorch
Day 5: InstructGPT Paper Reading
Training language models to follow instructions with human feedback
Youtube: one of the authors explains the paper
Day 5: Textbook Builder Sample Solution
Sample solution: Textbook builder with prompts
Day 5: Solutions to the PyTorch Homework
Solution to the PyTorch homework
Day 5: Fine Tuning with HuggingFace
Fine-tuning models with HuggingFace API
Day 5: Fine Tuning LLMs Course from DeepLearning.ai
Complete the course on Fine-tuning
Session recording of our introduction to Instruction fine-tuning of LLM
xLLM
Axolotl
Oobabooga
TheBloke
Training language models to follow instructions with human feedback
Instruction Tuning for Large Language Models: A Survey
"Awesome" LLM fine-tuning github
Day 6: LLaVA: Visual Instruction Tuning
LLaVA Assignment
Llava Github
Visual Instruction Tuning
Improved Baselines with Visual Instruction Tuning
Llava-Next
Llava-RLHF
Llava-med
How to Fine-Tune LLaVA on a Custom Dataset
Day 6: LLM Fine-tuning continued...
Unsloth LLM Fine-tuning
[Paper] LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
LlamaFactory Github
[Notebook ]Fine-tuning llms for story telling
[Dataset] Tiny Stories
Unsloth and LlamaFactory Assignments
Day 6: Parameter-Efficient Fine-Tuning
Huggingface portal on PEFT
The Power of Scale for Parameter-Efficient Prompt Tuning
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
PEFT Assignment
Day 6: Lora Family
Image classification with LoRA
Fine tuning computer vision models from TIMM
LoRA: Low-Rank Adaptation of Large Language Models
QLoRA: Efficient Finetuning of Quantized LLMs
LoRAX: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning
Navigating Text-To-Image Customization: From LyCORIS Fine-Tuning to Model Evaluation
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning
Day 6: GaLore - LLM (Pre-)training
GaLore: Advancing Large Model Training on Consumer-grade Hardware
GaLore Github
[Arxiv] GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
GaLore Assignment
Direct Preference Optimization
DPO Assignment
DPO Quiz
Peter Bloem: Transformers from scratch
Jay Alammar: The Illustrated Transformer
Day 7: Quiet-STaR
Quiet-star code sample
[Arxiv] Quiet-STaR paper
Quiet-STaR Github
Day 7: Agents
The AI Weekly Newsletter
Collaborative Discussions on AI Agents for the Newsletter Project
Database: AI News Sources
Github "Awesome" AI agents
[Portal] Gorilla: Large Language Model Connected with Massive APIs
Dspy: Programming -- not prompting -- Foundation Models
OpenAI Assistants
Autogen
CrewAI
Ollama
LM Studio
Exploring Top AI Autonomous Agent Projects
Research agent 3.0 -- Building a group of AI researchers
Autonomous AI Agents - why YOU should be building them... and HOW.
Self-Refine: Iterative Refinement with Self-Feedback
Reflexion: Language Agents with Verbal Reinforcement Learning
Gorilla: Large Language Model Connected with Massive APIs
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Communicative Agents for Software Development
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Day 8:Survey of AI Agents
The universe of AI agent frameworks
Github "Awesome" AI agents
A Survey on Large Language Model based Autonomous Agents
SWE Agent
Day 10:LLM for Code Generation
Talking to the FoodMart database
Vanna: Chat with your database
Data Herald
SqlCoder
Day 10: Diffusion Models
Denoising Diffusion Probabilistic Models
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
High-Resolution Image Synthesis with Latent Diffusion Models
SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis
"Awesome" Diffusion Models (Curated List)
Coding Stable Diffusion from scratch in PyTorch
Huggingface Diffusers
Complex Networks
Network Science
Complex Network Analysis in Python
Networks
A First Course in Network Science
NetworkX
Gravis
Pyvis
ipysigma
Graph Neural Networks: Unleashing the Power of Structured Data
Network Embedding: Theories, Methods, and Applications
Graph Representation Learning
Hands-on Graph Neural Networks with Python
Graph Neural Networks in Action
[Stanford] CS224W: Machine Learning with Graphs
Understanding Convolutions on Graphs
A Gentle Introduction to Graph Neural Networks
Semi-Supervised Classification with Graph Convolutional Networks
How Powerful are Graph Neural Networks?
Relational inductive biases, deep learning, and graph networks
Foundational Papers
Attention is all you need
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Sentence Bert
(CLIP): Learning Transferable Visual Models From Natural Language Supervision
[VIT]: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Next
Side panel
Categories
All categories
Data Science
Home
Log in
Username
Username
Password
Password
Forgot your password?
Log in
Categories
Collapse
Expand
All categories
Data Science
Home
Course info
Advanced LLM Projects Bootcamp
Lead Instructor:
Asif Qamar
Skill Level
:
Beginner