Duration
4 weeksWeekly study
5 hours100% online
How it works
Applied Local Large Language Models
Gain practical skills in Large Language Models (LLMs)
On this four-week course, you’ll use hands-on exercises to develop your practical skills in deploying and interacting with Large Language Models (LLMs).
You’ll create local environments for running LLMs, produce code for integrating LLMs via APIs, discover prompt engineering techniques, and more.
By the end, you’ll have the knowledge and skills that are highly sought after in the tech industry.
Learn how to use cutting-edge tools for local deployment of LLMs
The course focuses on the local deployment of LLMs, giving you the skills to use tools such as Hugging Face Candle and Mozilla LIamafile.
Using a combination of theoretical knowledge and practical implementation, you’ll gain the skills to use in real-world contexts.
Develop essential AI skills
Next, you’ll gain invaluable knowledge of the rapidly growing field of AI.
Using your skills in local LLM deployment, you’ll be able to develop privacy-preserving AI applications and customise language models for specific uses – essential for today’s AI-driven landscape.
Gain the skills to create powerful, customised AI applications
By the end of the course, you’ll be empowered with the knowledge and practical skills needed to effectively deploy, interact with, and leverage LLMs.
This will enable you to create powerful, customised AI applications. You’ll also finish the course with a portfolio of practical LLM projects.
Syllabus
Week 1
Getting Started with Open Source Ecosystem
About this Course
About this course
Introduction to Open Source models and ecosystem
Introduction to Open Source models and ecosystem
Using Large Language Model for data augmentation
Using Large Language Model for data augmentation
Building real-world solutions
Building real-world solutions
Week 2
Using Local LLMs from LLamafile to Whisper.cpp
Key Components of Llamafile
Key Components of Llamafile
Running Llamafile
Running Llamafile
Using Whisper.cpp
Using Whisper.cpp
Week 3
Applied Projects
Using Models in the browser
Using Models in the browser
Developing Portable CLI with Cosmopolitan
Developing Portable CLI with Cosmopolitan
Applied Projects - Test Your Knowledge
Applied Projects - Test Your Knowledge
Week 4
Recap and Final Challenges
Final Challenges
Final Challenges
Recap
Recap
When would you like to start?
Start straight away and join a global classroom of learners. If the course hasn’t started yet you’ll see the future date listed below.
Available now
Learning on this course
On every step of the course you can meet other learners, share your ideas and join in with active discussions in the comments.
What will you achieve?
By the end of the course, you‘ll be able to...
- Deploy and run large language models on local hardware
- Apply fine-tuning techniques to customize large language models for specific tasks or domains
- Utilize open-source generative AI tools and frameworks in practical applications
Who is the course for?
This course is designed for software developers, data scientists, and AI enthusiasts with a basic understanding of machine learning concepts who want to gain practical skills in deploying and utilising Large Language Models (LLMs) locally.
It’s ideal for professionals in tech industries, researchers, and hobbyists who seek to leverage the power of LLMs without relying on cloud services.
The course caters to those interested in privacy-preserving AI applications, edge computing, and customising language models for specific use cases. While primarily aimed at those with some programming experience, it’s also suitable for tech-savvy individuals eager to explore cutting-edge AI technologies hands-on.
Who will you learn with?
Former Olympic high jumper with 15 years of Software Engineering. He teaches ML, Rust, and Python at Duke University and is an expert in MLOps, Azure, and automation
Founder of Pragmatic AI Labs & Executive in Residence at Duke MIDS and Duke AIPI. Former Bay Area CTO and author of multiple O'Reilly books.
Who developed the course?
Ways to learn | Buy this course | Subscribe & save | Limited access |
---|---|---|---|
Choose the best way to learn for you! | $79/one-off payment | $244.99 for a whole year Automatically renews | Free |
Fulfill your current learning need | Develop skills to further your career | Sample the course materials | |
Access to this course | tick | tick | Access expires 12 Mar 2025 |
Access to 1,000+ courses | cross | tick | cross |
Learn at your own pace | tick | tick | cross |
Discuss your learning in comments | tick | tick | tick |
Tests to check your learning | tick | tick | cross |
Certificate when you're eligible | Printed and digital | Digital only | cross |
Cancel for free anytime |
Ways to learn
Choose the best way to learn for you!
Subscribe & save
$244.99 for a whole year
Automatically renews
Develop skills to further your career
- Access to this course
- Access to 1,000+ courses
- Learn at your own pace
- Discuss your learning in comments
- Tests to boost your learning
- Digital certificate when you're eligible
Cancel for free anytime
Buy this course
$79/one-off payment
Fulfill your current learning need
- Access to this course
- Learn at your own pace
- Discuss your learning in comments
- Tests to boost your learning
- Printed and digital certificate when you’re eligible
Limited access
Free
Sample the course materials
- Access expires 12 Mar 2025
Find out more about certificates, Unlimited or buying a course (Upgrades) Sale price available until 3 March 2025 at 23:59 (UTC). T&Cs apply. |
Find out more about certificates, Unlimited or buying a course (Upgrades)
Sale price available until 3 March 2025 at 23:59 (UTC). T&Cs apply.
Learning on FutureLearn
Your learning, your rules
- Courses are split into weeks, activities, and steps to help you keep track of your learning
- Learn through a mix of bite-sized videos, long- and short-form articles, audio, and practical activities
- Stay motivated by using the Progress page to keep track of your step completion and assessment scores
Join a global classroom
- Experience the power of social learning, and get inspired by an international network of learners
- Share ideas with your peers and course educators on every step of the course
- Join the conversation by reading, @ing, liking, bookmarking, and replying to comments from others
Map your progress
- As you work through the course, use notifications and the Progress page to guide your learning
- Whenever you’re ready, mark each step as complete, you’re in control
- Complete 90% of course steps and all of the assessments to earn your certificate
Want to know more about learning on FutureLearn? Using FutureLearn
Do you know someone who'd love this course? Tell them about it...
More courses you might like
Learners who joined this course have also enjoyed these courses.
Browse more in IT & Computer Science and Science, Engineering & Maths