Business: Technology · Lesson N.tec.3

Choreography: the backlog that triages itself

AI sweeps through a volume of tickets the team would never cover by hand and lights up the suspects: duplicates, severity outside the curve, wrong team in the queue. You're still the one who confirms the ambiguous cases and decides the action.

Examples for

Monday morning, and the Jira queue woke up with 340 new tickets, a mix of bugs, feature requests, and customer complaints forwarded by support. Among them, two tickets opened through different channels describe the same checkout error with different words, one of them marked "low" because whoever opened it didn't know the size of the damage. Nobody's going to read all 340 descriptions line by line before the 9 AM daily. This lesson's question is: who sweeps through that volume for you, and who confirms what shows up before it becomes this week's priority?

Whoa, anyone who's ever owned a ticket queue knows the feeling: the inbox never empties, and every day more arrives faster than any team can read. So, in practice, the team does what it can: looks at the most recent tickets, the loudest ones, the ones someone chased down in the hallway. The rest sits in the queue, waiting. Think with me: what if you could sweep through the whole queue, and the team only had to look closely at the cases that really call for judgment? That's exactly this lesson's choreography.

The core idea of this lesson. AI isn't the one who decides what matters in your backlog. It's the first triage: it groups duplicates, suggests severity, and points to which team something should go to, at a volume no team would cover reading ticket by ticket. But confirming the real severity, resolving the dispute over who owns the problem, and deciding the action, that stays with the team. And there's a real cost when the suggestion is wrong: wrong severity becomes wrong priority, and wrong route becomes lost trust between teams.

01What AI does well: dedupe, suggested severity, routing

Let's call it what it is. Any backlog's bottleneck was never a lack of intelligence, it was volume. Nobody has time to read 340 tickets line by line every Monday, so what's left is triage by sampling: the most recent ones, the loudest ones, the ones someone remembered to chase.

AI flips that math. You point it at the whole queue and ask it to do three things at once:

The real gain here is reach. You go from "we looked at the twenty most recent tickets" to "we went through all 340, and we have a short list of cases that need a human eye". Fair?

How the triage works, in practice:

the queue AI sweeps dedupe, severity, suggested route the short list for the team checkout bug, high, billing 2 duplicate tickets divergent severity AI decides nothing: it only delivers a suggestion with a reason a few items to confirm, instead of 340 to ignore

02What stays the team's: confirm, resolve, and decide

Here's the part AI doesn't do, and it's the heart of triage. It grouped, suggested severity, and pointed to a route. And now? Now the team's work begins, and it's all judgment.

Notice the design: AI narrows your search field, it doesn't replace the judgment of whoever knows the system. It turns "read everything" into "confirm what matters".

03The cost to name: wrong severity or route

Now the part I can't let slide, because it's where this choreography goes wrong if accepted without checking. AI suggests, and not every suggestion is right. That has a cost, and the cost has two faces.

The first face is the critical ticket labeled low priority. It happened in the vulnerability example: a "medium" suggested severity, accepted without checking, leaves a serious flaw waiting in the common queue for days, while the real problem stays exposed. The second face is the opposite: an alarm treated as urgent that actually wasn't, consuming the wrong team at the expense of a real priority left waiting.

Neither is the tool's fault. It's the cost of treating a suggestion as a verdict. That's why this choreography's rule: the team confirms before any severity or route becomes an action. The suggestion lights up the candidate; confirming is what turns a candidate into a real priority.

AI suggests severity, route team confirms the ambiguous ones becomes action in the right sprint no suggestion becomes a priority without passing through confirmation
Learn more: why severity "sounds" wrong more often than it seems

AI calibrates severity mainly by the tone and vocabulary of the text: urgency words, mentions of critical systems, repeated terms. The problem is that people who open serious tickets don't always write with urgency, sometimes they write cautiously, especially when the subject is sensitive (security, customer data, an account the person isn't even sure how big it is). And people who open small tickets sometimes write in all caps. The result is that the text misleads in both directions, up and down. That's not a reason to discard the suggestion, it's a reason to know where it tends to be wrong: severity calibrated by tone alone needs a second read whenever the subject is sensitive by nature (security, personal data, a big customer), because that's exactly where cautious text looks most like routine.

04The choreography, step by step

Put it all together and it becomes a simple system, running every sprint turnover or even every day, depending on your queue's volume.

  1. AI triages. You feed it the whole queue and ask for dedupe, suggested severity with the reason written out, and a suggested route by the component mentioned. Output: a short list of cases needing a human eye, the rest follows the standard flow.
  2. The team confirms the ambiguous ones. Take the short list and look case by case: is the dedupe right, does the severity match the real impact, is the route the right team.
  3. The team decides the action. Once confirmed, the ticket becomes a sprint priority, an escalation, or a customer response. AI doesn't close anything on its own.
  4. The team logs the pattern. Every time the suggestion was wrong (merged what shouldn't be merged, underestimated severity, routed wrong), that becomes a note to calibrate the next triage, the same kind of source as the visible technical debt you'll see in the next lesson.

Notice that AI shows up in just one step, at the beginning. It expands the reach of whoever triages, it doesn't decide in place of whoever knows the system. Shall we?

05Where this fits

This choreography is the same quality gate logic you already saw in lesson 6.1, just applied to the backlog's entry point, not the code's exit point. There, the gate decided what passed before the deploy; here, human confirmation decides what becomes priority before entering the sprint. Same principle: AI operates the conveyor belt, the criteria that decides stays yours.

Do it now

Do it yourself

Pick a real batch of tickets from your backlog, your real task or the last 30 opened in your queue. Ask AI to do the first sweep:

Now do your part, which is the part that matters: take the first five items on the list and classify each one as right route, right severity, or needed human correction. Count how many needed correction. That number is your calibration: it shows you how much the automatic triage gets right the first time, and why the team's confirmation isn't optional.

Practice

1. In the backlog triage choreography with AI, what's the correct role for AI?

2. AI suggested 'medium' severity for a technical vulnerability report, but investigating, the team discovers it exposes another customer's data. What does this show?

3. Why does the backlog triage choreography resemble the quality gate from lesson 6.1?

For the board

On the queuewith no scanning the team looks at whatever arrived last and whatever shouted loudest. The rest waits in the dark.
On the AI's roleit goes through the entire queue and returns a short list with a suggestion and a reason, ready for confirmation.
On severitycalibrated by the tone of the text it misleads in both directions. A sensitive subject always calls for a second read.
What did you think of this page?
Would you recommend this page to someone on your team?