AI Prediction Markets
0/15 complete

Module 05 · Risk and Responsible Research

Loss Budgets and No-Trade Rules in Paper Simulation

A paper loss budget is a simulation control for measuring whether a method stops under adverse conditions. It is never a statement about money someone can afford to lose. Personal finances, legal eligibility, consumer protections, and suitability cannot be determined by this course.

// concept

Separate Three Budgets

Forecast-error budget: maximum tolerable calibration/critical-error rate before the method pauses for review.

Operational-error budget: limits for stale data, parser failures, missing resolution records, rule violations, or incorrect source status.

Fictional point-loss budget: a fixed paper-only threshold across event, cluster, day/week, and full study period.

Any one can stop the simulation. A method should pause after a critical factual or compliance error even if fictional points look positive.

// concept

Define Stop Rules Before the Study

Examples:

  • two resolution-source misunderstandings;
  • any use of post-cutoff evidence;
  • any attempt to add credentials/order code;
  • stale/missing data above a fixed percentage;
  • three process-rule violations;
  • cluster paper loss limit reached;
  • emotional chasing, sleep disruption, secrecy, borrowing thought, or inability to follow stop time;
  • new legal/terms uncertainty.

The stop action is: freeze new decisions, preserve data, notify the reviewer, investigate, and decide whether to retire or version the method. It is not “double the next position.”

// concept

Stress the Paper Ledger

Run scenarios:

  • all correlated markets resolve against the thesis;
  • wide spread and poor hypothetical exit depth;
  • delayed or disputed resolution;
  • source feed outage during a breaking event;
  • model summary reverses a key date;
  • platform terms or availability change;
  • a method performs worse in Urdu/local-event slices;
  • operator changes rules after losses.

Measure whether caps, stale markers, and no-action gates contain the damage. Paper simulations often omit the worst operational conditions, making them artificially smooth.

// worked_example

Worked Example

A method has positive paper points after 30 decisions, but review finds three post-cutoff citations caused by a timestamp bug. The operational budget is breached. The team invalidates the affected evaluation, fixes/tests time filtering, and starts a new version on a held-out set. It does not keep the flattering score.

// concept

Recognize When to Stop Entirely

Stop if the activity encourages real-money urgency, interferes with obligations, creates distress, prompts concealment, or cannot remain read-only. Seek support from trusted people and qualified professionals when gambling-like behavior or financial harm is a concern. Software controls are not treatment.

Do not build engagement loops, streaks, leaderboards, loss-chasing notifications, or “almost won” messaging around paper forecasting.

// pakistan_angle

Pakistan Angle

No salary, savings, emergency fund, loan, remittance, tuition, rent, zakat/charity, or household money should be mapped to this simulation. Paper points deliberately have no PKR value.

Check current PVARA/SECP/platform terms if the research changes. Never offer signals, managed accounts, wallet setup, or virtual-asset services without appropriate authorization and qualified advice.

// hands_on

Hands-On Exercise

Write all three budgets, ten stop rules, escalation owner, and restart/retirement criteria. Apply eight stress scenarios to a synthetic ledger. Demonstrate that one critical operational error freezes the method even when fictional performance is positive.

// completion_rubric

Completion Rubric

3 grading bands

  • Complete

    error, operational, and fictional budgets are independent; critical/compliance stops override performance; wellbeing and retirement rules exist.

  • Needs revision

    paper caps exist but source, operations, or behavior stops are incomplete.

  • Not complete

    any budget maps to real funds or encourages recovering losses.

// sources

Sources