AI Infrastructure & Local LLMs
0/24 complete

Module 02 · Hardware Fundamentals

Budget-Building a Rig for Local AI in Pakistan

20 minfocused lesson1copyable prompts3completion checks4source links
Open lesson + course map

On this lesson

Course outline

Build a local-AI rig backward from a tested workload and total ownership cost. The “best GPU under a budget” changes with prices, availability, warranty, electricity, runtime support, and the model. This lesson gives a procurement process, not a current shopping list or universal PKR price.

// concept

Write the Acceptance Test

Before contacting sellers, define:

  • model/revision and allowed quantization;
  • context and concurrent requests;
  • minimum quality rubric;
  • p50/p95 latency or batch completion target;
  • maximum power/noise/temperature conditions;
  • required uptime and recovery time;
  • software stack and operating system;
  • total budget including protection and repairs.

Run the acceptance test on borrowed, rented, cloud, or seller-demonstrated hardware where possible. This prevents buying capacity for a model that fails the actual task.

// concept

Build the Complete Parts List

The GPU is only one line. Check CPU/platform compatibility, motherboard slot spacing and lane behavior, system RAM, storage capacity/endurance, quality PSU wattage and native connectors, case clearance, airflow, network, monitor/display use, UPS/inverter behavior, and safe earthing.

For local model work, sufficient system RAM and fast storage help with model loading and CPU offload. A low-end CPU may bottleneck preprocessing or offloaded layers. Multiple GPUs may require more PCIe slots, power, airflow, and software complexity than the board or case supports.

Do not buy a larger PSU by advertised wattage alone. Use reputable manufacturer specifications, required connectors, efficiency, protections, and a safe load calculation. Electrical design should be reviewed by a qualified person when backup power or wiring changes are involved.

// concept

Compare New, Used, and Cloud Pilots

For every quote, record date, city/seller, exact model and VRAM, condition, serial/receipt, warranty owner and duration, return window, included accessories, tax/shipping, and payment terms. Verify the card under sustained load: reported identity, VRAM, errors, clock behavior, temperature, fan noise, ports, and benchmark consistency.

A used card can be good value, but price the risk of immediate fan, thermal-pad, memory, or board failure. A new card may offer better warranty and power efficiency. A short cloud rental may be cheapest for validation but is not the same long-term operational model.

// concept

Calculate Total Cost

Use dated assumptions:

// prompt — copy me4 lines
upfront = components + shipping/tax + UPS/power + setup
monthly energy = measured average kW × hours/month × applicable PKR/kWh
monthly ownership = financing + energy + cooling + maintenance + internet + staff
effective monthly cost = monthly ownership + upfront / chosen useful-life months

Use the applicable current tariff and include taxes/adjustments as advised by the bill or qualified accountant. Do not claim a national electricity rate from one household bill. Show low/base/high utilization scenarios and residual value separately.

// worked_example

Worked Example

Two rigs both meet the quality test. Rig A costs less upfront but draws more measured power, has a seven-day checking warranty, and needs a PSU upgrade. Rig B costs more but includes a longer local warranty and fits the existing power/thermal envelope. The decision sheet compares full cost and downtime risk rather than declaring A cheaper from GPU price.

// pakistan_angle

Pakistan Angle

Collect at least three dated local quotes and verify whether they are cash, card, installment, tax-inclusive, or online-only. Exchange-rate movement and import availability can invalidate a quotation quickly, so label the date and do not reuse it as a market benchmark.

Plan for heat, dust, power interruption, repair access, and replacement lead time. Use suitable surge protection, UPS/inverter configuration, ventilation, and maintenance. Never run a high-load rig from unsafe wiring or overload a backup system.

// hands_on

Hands-On Exercise

Prepare three builds—reuse existing hardware, used GPU build, and new/warrantied build—for one acceptance test. Gather dated quotes, compatibility evidence, measured/rated power assumptions, risk register, 24-month scenario model, and seller test checklist. Recommend one pilot and define a return/stop condition.

// completion_rubric

Completion Rubric

3 grading bands

  • Complete

    the build fits a tested workload and includes full compatibility, safety, warranty, energy, downtime, and scenario costs.

  • Needs revision

    component prices exist but acceptance tests, power protection, or warranty risk is weak.

  • Not complete

    a GPU is selected from hype, fabricated prices, or an unsafe electrical plan.

// sources

Sources