Production Value Measurement, SLAs and Operations Handover
You can turn one frozen month of production logs into a shop net in SEK, a downtime credit on the 40,000 fee, a drift alert that respects a 100-reply floor, and a cutover that moves the live model id only when the contract tests pass twice.
- Level
- Navigator
- Time
- 24 h

Jump to
After this course you can
The student can compute SLA uptime credits, drift alerts, and net productivity gains from production telemetry logs and execute an automated model-migration cutover without breaking contract tests.
Eighty hours and a 37,600 shop net
You already priced the replies and marked the agreement. This page reads the production log for the same delivery replies. Freeze two windows of 800 replies each. The pre-deployment window is the four weeks before drafts went to a clerk. The post-deployment window is the four weeks after. Before, the clerk wrote the delivery week: 9 minutes a reply, 7,200 minutes, 120 hours. After, the clerk reviews a draft: 3 minutes a reply, 2,400 minutes, 40 hours. Those 40 hours are the human review time. Time saved is 80 hours. The clerk rate on this page is 450 SEK an hour, so the time value saved is 80 × 450 = 36,000 SEK.
The defect rate counts escaped wrong weeks, replies that left the shop. Before, 40 of 800 escaped, and 40/800 = 0.05. After, 16 of 800 escaped, and the rate is 0.02. Review caught 24 wrong drafts, and 24 + 16 = 40, so the draft rate before review is 0.05 as well. One escaped wrong week costs 400 SEK on this page. Defect cost falls from 40 × 400 = 16,000 SEK to 16 × 400 = 6,400 SEK, a saving of 9,600. The supplier token line uses the rates already on the statement of work, 20 SEK per million input tokens and 40 SEK per million output tokens. The log mean is 25,000 input tokens and 6,250 output tokens: 25,000 × 20 / 1,000,000 = 0.50, and 6,250 × 40 / 1,000,000 = 0.25, so 0.75 SEK a reply, and 800 × 0.75 = 600 SEK. The operations retainer is 8,000 SEK before any overage. Shop net before overage is 36,000 + 9,600 − 8,000 = 37,600 SEK. That 600 sits inside the 40,000 agreement fee, and the shop net leaves it there. The shop net is the clerk's figure. The supplier margin stays on the page where you already computed it.
Credit from the minute caps
The service fee stays 40,000 SEK a month, the fee already written on the agreement. An SLA credit, the uptime rebate on that fee, is a percent of the 40,000. The retainer sits outside the percent. Every contract month has 30 × 24 × 60 = 43,200 minutes, and February on this page uses the same 43,200. Uptime is (43,200 − downtime minutes) / 43,200. At or above 99.5 percent the credit is 0. At or above 99.0 percent and below 99.5 percent the credit is 10 percent, which is 4,000 SEK. At or above 95.0 percent and below 99.0 percent the credit is 25 percent, which is 10,000 SEK. Below 95.0 percent the credit is 50 percent, which is 20,000 SEK.
Bill from downtime caps, so a rounded percent has no room to slide a month across a line. Half a percent of 43,200 is 216. Downtime of 216 minutes is uptime 99.5 percent, and the credit stays 0. The 10 percent band runs from 217 minutes through 432, because 1 percent of 43,200 is 432 and that month is 99.0 percent. The 25 percent band runs from 433 minutes through 2,160, because 5 percent of 43,200 is 2,160 and that month is 95.0 percent. Downtime of 2,161 minutes or more takes the 50 percent band. A measured 300 minutes sits in the 10 percent band: 300/43,200 = 1/144, about 0.006944 down, and uptime is 143/144, about 0.993056, or 99.3056 percent. The credit is 4,000 SEK. The service line on the invoice is 40,000 − 4,000 = 36,000 SEK. The retainer line keeps its own hours.
The floor of 100 replies
A drift alert compares one week with the frozen post-deployment window, the baseline. The escaped-rate baseline is 0.02, and the alert line is 1.5 × 0.02 = 0.03. The review baseline is 3 minutes, and the review line is 1.5 × 3.0 = 4.5 minutes. A week can fire a line only when it holds at least 100 replies. Under 100 replies you write the rate on the Monday note and you send nothing to the inbox.
Week A has 200 replies, 5 escaped, rate 5/200 = 0.025, and a mean review of 3.2 minutes. Both measures sit under their lines, so the week stays quiet. Week B has 200 replies, 8 escaped, rate 8/200 = 0.04, and a mean review of 4.8 minutes. Both lines are crossed, 200 is at least 100, and both alerts go to the inbox named drift-watch. Week C has 80 replies, 4 escaped, rate 4/80 = 0.05, and a mean review of 5.5 minutes. Both measures cross their lines, and the floor blocks both alerts. The Monday note reads 0.05, 5.5 minutes, and the reason: under 100 replies.
Eight hours, three tests, four lines
The operations retainer, a förvaltningsavtal, is 8,000 SEK for 8.0 hours in that month. Time past 8.0 hours costs 1,000 SEK an hour, billed in tenths, so 0.1 hour is 100 SEK. Hours still unused when the month ends expire. Add three lines: drift review, cutover work, and the literacy hour, the hour a named clerk spends running this page on one real week. Literacy here means the clerk can compute the page alone. The worked lines are 3.5, 3.0, and 2.0, and the sum is 8.5. Overage is 0.5 × 1,000 = 500 SEK. The retainer invoice is 8,500 SEK. The 37,600 figure had subtracted the included 8,000 only. Subtract the 500 next: 37,600 − 500 = 37,100 SEK.
Deprecation means the host stops serving that model id. The live id is M-14, and M-14 stops being served on 31 December 2026. The script may point the live id at a candidate only when three tests pass on a dry run and again on one live rerun. T1 requires 20 of 20 fixed prompts to match the marked delivery week. T2 sorts the 20 latencies in milliseconds and reads position 19, because 0.95 × 20 = 19, and position 19 must be at or under 2,000. T3 requires the mean SEK a reply times 1,000 to be at or under 800. A dry run that misses any test leaves the pointer where it is. A live rerun that misses any test writes the previous live id back. On OPS-30 that previous id is M-14. M-20 misses the dry run: 19 of 20, the sorted tail is 2,200 then 2,400 then 2,800 so position 19 is 2,400, and 0.90 × 1,000 = 900. M-21 passes the dry run: 20 of 20, the sorted tail is 1,700 then 1,800 then 3,200 so position 19 is 1,800, and 0.70 × 1,000 = 700. The 3,200 tail stays inside a rule that reads position 19. The live rerun of M-21 is 20 of 20, position 19 is 1,760, and 0.72 × 1,000 = 720. The pointer stays on M-21.
Handover is four lines the clerk can run without you in the room. H1 writes 43,200 minutes, the caps 216, 432, and 2,160, and that the percent multiplies 40,000 only. H2 writes the lines 0.03 and 4.5 minutes, the floor of 100, and the inbox drift-watch. H3 writes 20 of 20, position 19, the 800 SEK ceiling, and the write-back to the previous live id. H4 names the clerk, the week, the escaped count, whether an alert fired, and the date. On OPS-30, H4 reads S. Berg, the week of 2 November 2026, 200 replies, 5 escaped, quiet week, dated 6 November 2026. That week is week A, and the 2.0 literacy hours are that sitting. Four of four lines are filled, so the handover is complete. H1 through H3 with a blank H4 leave the handover open.
OPS-30, counted through
Pre-deployment: 800 replies, 9 minutes, 120 hours, 40 escaped, rate 0.05, defect cost 16,000 SEK. Post-deployment: 3 minutes, 40 hours of review, 16 escaped, rate 0.02, defect cost 6,400 SEK. Time value saved is 36,000. Defect saving is 9,600. Tokens: 0.50 + 0.25 = 0.75, and 0.75 × 800 = 600, left inside the 40,000 fee. Included retainer 8,000. Shop net before overage is 37,600. Hours 3.5 + 3.0 + 2.0 = 8.5, overage 500, retainer invoice 8,500, shop net 37,100 SEK.
Downtime 300 minutes. Caps: 0 through 216 gives credit 0; 217 through 432 gives 4,000; 433 through 2,160 gives 10,000; 2,161 or more gives 20,000. The 300 minutes give 4,000, and the service line is 36,000. Uptime is about 99.3056 percent. Week A, rate 0.025 and 3.2 minutes, stays quiet. Week B, rate 0.04 and 4.8 minutes, sends both alerts. Week C, rate 0.05 and 5.5 minutes on 80 replies, stays quiet because of the floor.
M-20 stays off the pointer. M-21 passes the dry run at position 19 of 1,800 and at 700 SEK per 1,000 replies, and the rerun passes at 1,760 and 720. A rerun at 2,050 would fail T2 and write M-14 back. H4 names S. Berg on 6 November 2026. The handover is 4 of 4.
Check it on paper
Keep the frozen before window: 120 hours, 40 escaped, 16,000 SEK of defect cost, and the 36,000 SEK of time value, since the after window is still 3 minutes on 800 replies. Score a December page with 28 escaped and the same token mean, 0.75 SEK a reply. Retainer lines: 4.0, 2.5, and 1.0 hours. Downtime: 500 minutes. Week D: 160 replies, 8 escaped, mean review 5.0 minutes. Dry run of M-22: 20 of 20, position 19 equals 2,000, mean 0.80 SEK a reply. Live rerun: 20 of 20, position 19 equals 2,050, mean 0.80 SEK. The live id before this attempt is M-21. H4 is blank. Write the escaped rate, the defect saving, the shop net, the token line, the retainer invoice, the credit, the service line, whether week D alerts, where the pointer ends, and how many handover lines pass.
The escaped rate is 28/800 = 0.035. Defect cost is 28 × 400 = 11,200, and the saving against 16,000 is 4,800. Time value saved stays 36,000. The token line is 0.75 × 800 = 600 and stays inside the fee. The hours sum to 7.5, the overage is 0, and the retainer invoice is 8,000. Shop net is 36,000 + 4,800 − 8,000 = 32,800 SEK. Downtime 500 sits in the band from 433 through 2,160, so the credit is 10,000 and the service line is 30,000. Week D alerts on both measures: 8/160 = 0.05 and a review of 5.0 minutes, with 160 replies. M-22 passes the dry run, because 2,000 is at the T2 ceiling and 0.80 × 1,000 = 800 is at the T3 ceiling. The rerun fails T2 at 2,050, and the pointer returns to M-21. With H4 blank, 3 of 4 lines pass and the handover stays open.
Check questions
On OPS-30, how many hours are saved, what are the escaped rates before and after, what is the shop net in SEK before overage, and what is the supplier token line?
80 hours. The rates are 0.05 before and 0.02 after. The shop net before overage is 37,600 SEK. The token line is 600 SEK, and it stays inside the 40,000 fee.
Which downtime, in minutes, marks the top of the 0 credit band, the top of the 10 percent band, and the top of the 25 percent band, and what credit does 300 minutes earn?
216, 432, and 2,160 minutes. A downtime of 300 minutes earns a credit of 4,000 SEK, and the service line is 36,000 SEK.
Week C has 80 replies, an escaped rate of 0.05, and a mean review of 5.5 minutes. Does a drift alert fire, and why?
No alert fires. Both measures are past their lines, and the week has fewer than 100 replies, so the floor blocks it.
Which candidate passes the OPS-30 dry run, what is position 19 on that dry run, and which id would a live rerun at position 19 of 2,050 write back?
M-21 passes, and position 19 is 1,800. A rerun at 2,050 fails T2, and the script writes M-14, the id that was live before the attempt.
Shop net is the time value saved plus the drop in escaped-defect cost, minus the retainer invoice, with the token line left inside the 40,000 fee. Credit follows the downtime caps 216, 432, and 2,160. An alert needs at least 100 replies and a measure at or above 1.5 times the frozen baseline. The pointer moves only when the dry run and the live rerun both pass 20 of 20, position 19 at or under 2,000 milliseconds, and 1,000 replies at or under 800 SEK.
Final task
Complete a keyed SLA and ROI audit over 90 days of frozen production logs and submit a model-deprecation migration script that switches providers while passing 100% of fixed contract, latency, and cost-ceiling tests. (Optional Portfolio item: real client project via /arbeta or own network).
Terms in this course
This course has no terms of its own in the glossary yet. Terms from earlier courses are used here too.
The first lesson is open to read. The rest of the course is being written, and tests and diplomas come later. Join the waitlist