AI School Pakistan

Membership course · Intermediate

AI Infrastructure & Local LLMs

Try a local model, test a bounded API client, and practise hardware, memory, cost and access decisions using supplied measurements.

24 lessons8 modulesAbout 9 hours including practice

Comfort reading basic code and using a terminal. Check the course-specific tool access and setup below.

Tum saath le jaoge

A tested local client, model manifest and review packet. Fixture checks run without a model; actual inference and production service controls have separate evidence requirements.

01

Choose local, cloud, or hybrid inference from task quality, privacy, reliability, and full cost evidence

02

Follow a local model setup and record the resolved model identity, actual result and any unmet prerequisites

03

Interpret supplied latency, throughput, quality, memory and thermal measurements

04

Diagnose CUDA, context, concurrency, offload and memory cases; execute local cache checks

05

Test a bounded local inference client and plan the access and recovery checks needed before network use

Syllabus

24 lessons, in order

Module 1

Why Run Models Locally

1.1 Local LLMs vs. Cloud APIs: A Practical Decision Framework15m →1.2 Installing Ollama and Running Your First Local Model20m →1.3 Understanding Model Sizes and Quantization in Plain English35m →

Module 2

Hardware Fundamentals

2.1 CPU vs. GPU Inference: Where the Bottleneck Really Is20m →2.2 VRAM Explained: Why It Decides What You Can Run20m →2.3 Budget-Building a Rig for Local AI in Pakistan20m →

Module 3

GPU Benchmarking

3.1 Benchmarking Tokens per Second Across Models20m →3.2 Comparing Quantization Levels: Speed vs. Quality Trade-Offs20m →3.3 Interpret a Local Load Test and Set Safe Limits20m →

Module 4

CUDA and the GPU Software Stack

4.1 CUDA Basics: What It Does and Why Drivers Matter20m →4.2 Troubleshooting Common CUDA and Driver Conflicts20m →4.3 Monitoring GPU Utilization and Temperature Safely15m →

Module 5

Local Inference Optimization

5.1 Context Length and Memory Trade-Offs35m →5.2 Batching Requests for Higher Throughput20m →5.3 Caching Strategies for Repeated Prompts20m →

Module 6

Choosing and Running Models

6.1 Open-Weight Model Landscape in 202620m →6.2 Fine-Tuning vs. Prompting a Local Model25m →6.3 Build a Validated Client for a Local Model API25m →

Module 7

VRAM Optimization

7.1 Offloading Layers Between GPU and CPU20m →7.2 Multi-GPU Setups for Budget-Constrained Builders25m →7.3 Diagnosing Out-of-Memory Errors and Fixing Them20m →

Module 8

Prepare Local AI for Operational Review

8.1 Design Safe Network Access for a Local Model20m →8.2 Cost Comparison: Local Infrastructure vs. Cloud API Spend20m →8.3 Capstone: Test a Local Inference Client and Prepare Its Review45m →

Completion certificate

Mark every lesson complete and save your progress to your account. Generate a certificate with a unique verification ID. It records learner-reported completion, not a graded exam or reviewed project.

Your certificates →

Tools & preparation

Ollama · CUDA · Local LLMs

Comfort reading basic code and using a terminal. Check the course-specific tool access and setup below.

Third-party tools may have separate charges or limits. Check before paying.

Allow optional Google Analytics to help improve lessons? We measure page types and learning actions without names, answers or account details. You can change this choice here. Privacy policy