• png logo

Applied Local Large Language Models

Understand how to deploy and interact with Large Language Models (LLMs) as you gain in-demand skills for the AI and tech industry.

LLM, AI Large Language Model concept. Businessman working on laptop with LLM icons on virtual screen

Applied Local Large Language Models

  • 4 weeks

  • 5 hours per week

  • Digital certificate when eligible

  • Introductory level

Find out more about how to join this course

  • Duration

    4 weeks
  • Weekly study

    5 hours
  • 100% online

    How it works
  • Unlimited subscription

    $244.99 for a whole yearLearn more

Gain practical skills in Large Language Models (LLMs)

On this four-week course, you’ll use hands-on exercises to develop your practical skills in deploying and interacting with Large Language Models (LLMs).

You’ll create local environments for running LLMs, produce code for integrating LLMs via APIs, discover prompt engineering techniques, and more.

By the end, you’ll have the knowledge and skills that are highly sought after in the tech industry.

Learn how to use cutting-edge tools for local deployment of LLMs

The course focuses on the local deployment of LLMs, giving you the skills to use tools such as Hugging Face Candle and Mozilla LIamafile.

Using a combination of theoretical knowledge and practical implementation, you’ll gain the skills to use in real-world contexts.

Develop essential AI skills

Next, you’ll gain invaluable knowledge of the rapidly growing field of AI.

Using your skills in local LLM deployment, you’ll be able to develop privacy-preserving AI applications and customise language models for specific uses – essential for today’s AI-driven landscape.

Gain the skills to create powerful, customised AI applications

By the end of the course, you’ll be empowered with the knowledge and practical skills needed to effectively deploy, interact with, and leverage LLMs.

This will enable you to create powerful, customised AI applications. You’ll also finish the course with a portfolio of practical LLM projects.

Syllabus

  • Week 1

    Getting Started with Open Source Ecosystem

    • About this Course

      About this course

    • Introduction to Open Source models and ecosystem

      Introduction to Open Source models and ecosystem

    • Using Large Language Model for data augmentation

      Using Large Language Model for data augmentation

    • Building real-world solutions

      Building real-world solutions

  • Week 2

    Using Local LLMs from LLamafile to Whisper.cpp

    • Key Components of Llamafile

      Key Components of Llamafile

    • Running Llamafile

      Running Llamafile

    • Using Whisper.cpp

      Using Whisper.cpp

  • Week 3

    Applied Projects

    • Using Models in the browser

      Using Models in the browser

    • Developing Portable CLI with Cosmopolitan

      Developing Portable CLI with Cosmopolitan

    • Applied Projects - Test Your Knowledge

      Applied Projects - Test Your Knowledge

  • Week 4

    Recap and Final Challenges

    • Final Challenges

      Final Challenges

    • Recap

      Recap

When would you like to start?

Start straight away and join a global classroom of learners. If the course hasn’t started yet you’ll see the future date listed below.

  • Available now

Learning on this course

On every step of the course you can meet other learners, share your ideas and join in with active discussions in the comments.

What will you achieve?

By the end of the course, you‘ll be able to...

  • Deploy and run large language models on local hardware
  • Apply fine-tuning techniques to customize large language models for specific tasks or domains
  • Utilize open-source generative AI tools and frameworks in practical applications

Who is the course for?

This course is designed for software developers, data scientists, and AI enthusiasts with a basic understanding of machine learning concepts who want to gain practical skills in deploying and utilising Large Language Models (LLMs) locally.

It’s ideal for professionals in tech industries, researchers, and hobbyists who seek to leverage the power of LLMs without relying on cloud services.

The course caters to those interested in privacy-preserving AI applications, edge computing, and customising language models for specific use cases. While primarily aimed at those with some programming experience, it’s also suitable for tech-savvy individuals eager to explore cutting-edge AI technologies hands-on.

Who will you learn with?

Alfredo Deza

Former Olympic high jumper with 15 years of Software Engineering. He teaches ML, Rust, and Python at Duke University and is an expert in MLOps, Azure, and automation

Noah Gift

Founder of Pragmatic AI Labs & Executive in Residence at Duke MIDS and Duke AIPI. Former Bay Area CTO and author of multiple O'Reilly books.

Who developed the course?

svg logo

Pragmatic AI Labs

Learn from leading instructors from top universities with real-world industry experience.

Achieve your goals with practical courses designed with a vocational focus. Our engaging programs provide you with the knowledge and tools to succeed in your career and have a positive impact.

Ways to learn

Buy this course

Subscribe & save

Limited access

Choose the best way to learn for you!

$79/one-off payment

$244.99 for a whole year

Automatically renews

Free

Fulfill your current learning needDevelop skills to further your careerSample the course materials
Access to this courseticktick

Access expires 12 Mar 2025

Access to 1,000+ coursescrosstickcross
Learn at your own paceticktickcross
Discuss your learning in commentstickticktick
Tests to check your learningticktickcross
Certificate when you're eligiblePrinted and digitalDigital onlycross
Continue & Upgrade

Cancel for free anytime

Ways to learn

Choose the best way to learn for you!

Subscribe & save

$244.99 for a whole year

Automatically renews

Develop skills to further your career

  • Access to this course
  • Access to 1,000+ courses
  • Learn at your own pace
  • Discuss your learning in comments
  • Tests to boost your learning
  • Digital certificate when you're eligible

Cancel for free anytime

Buy this course

$79/one-off payment

Fulfill your current learning need

  • Access to this course
  • Learn at your own pace
  • Discuss your learning in comments
  • Tests to boost your learning
  • Printed and digital certificate when you’re eligible

Limited access

Free

Sample the course materials

  • Access expires 12 Mar 2025

Find out more about certificates, Unlimited or buying a course (Upgrades)

Sale price available until 3 March 2025 at 23:59 (UTC). T&Cs apply.

Find out more about certificates, Unlimited or buying a course (Upgrades)

Sale price available until 3 March 2025 at 23:59 (UTC). T&Cs apply.

Learning on FutureLearn

Your learning, your rules

  • Courses are split into weeks, activities, and steps to help you keep track of your learning
  • Learn through a mix of bite-sized videos, long- and short-form articles, audio, and practical activities
  • Stay motivated by using the Progress page to keep track of your step completion and assessment scores

Join a global classroom

  • Experience the power of social learning, and get inspired by an international network of learners
  • Share ideas with your peers and course educators on every step of the course
  • Join the conversation by reading, @ing, liking, bookmarking, and replying to comments from others

Map your progress

  • As you work through the course, use notifications and the Progress page to guide your learning
  • Whenever you’re ready, mark each step as complete, you’re in control
  • Complete 90% of course steps and all of the assessments to earn your certificate

Want to know more about learning on FutureLearn? Using FutureLearn

Do you know someone who'd love this course? Tell them about it...