How Far Should You Trust an AI PM's "Done"?

Don't trust the word "done" — trust the evidence sitting next to it and the list of what's still outstanding. Following a single deadline-change request from start to finish, here's how to run an AI PM by tracing its reports back to their proof.
← 목록으로
온
온틀 리서치
2026년 10월 05일 Updated 2026.10.16 33 min read views 2

It's 11 p.m. and a single line pops up in your messenger: "The sales data you asked for is cleaned up and done." You breathe easier. The next morning you open the spreadsheet and paste it into the deck for your meeting. But the totals look off somewhere. An entire month's figures are missing. "Done" wasn't a lie. The AI really had finished the job. It's just that finished and finished correctly turned out to be two different things.

The first wall you hit when you bring an AI project manager onto your team is exactly this. (By AI project manager — AI PM from here on — I mean an automated handler that takes your requests, sorts them, carries them out, and reports back.) This handler reports well. The tone is polite, and it uses the word "done" without hesitation. But when a human coworker says "I finished it," they've usually laid eyes on the result at least once first. An AI can skip that check and still say the exact same thing. So the thing to trust in an AI PM's report isn't the word "done" — it's the evidence noted beside it and the list of what still isn't.

"I did it" and "it works" are not the same sentence

Work has two kinds of endings. One is that the action finished. The other is that the result is correct. If you can't tell these apart, every one of your AI PM's reports slides into the realm of faith.

Take a report that says, "I sent the notice email to all ten client companies." That's action-complete. It means the send button got pressed. But what actually matters is whether all ten were in a state to receive that email. If one address had a typo or one company had unsubscribed, the send happened but the delivery didn't. A human would glance at a bounce notice and immediately realize, "Ah, two of them didn't go through." An AI, unless you tell it to check the bounce folder, will see only the "accepted" response returned by the send API (the automated pipe that hands "deliver this to this address" off to the mail server) and record all ten as complete.

The gap is even sharper in technical work. Fix a single web page and the server returns a "200" signal. That means a normal response. A lot of automation stops right here. Got a 200, so it's done. But a 200 only means "the request reached the server and the server returned something" — it says nothing about whether that screen actually looks right to a human eye. The text could be garbled; a button could be pushed off the edge of the screen. The numbers show a green light while the actual screen is a mess — that happens all the time in practice.

This is where the first difference between a trustworthy AI PM and an untrustworthy one shows up. The former, after sending email, checks for bounces; after fixing a page, it captures an actual screenshot and confirms it with its own eyes before writing "done." The latter writes "done" the moment the action finishes. On the surface both say "it's done," but the evidence attached behind the word is completely different.

A report you can trust has three parts

A good report doesn't need to be long. It just needs three parts: what was done, how it was confirmed to be correct, and what still isn't finished.

First, what was done. Most reports do this part well. Something like, "Updated the price table in file A to Q2 figures." The problem is how many reports stop right here.

Second, how it was confirmed. This is the core, and it's where good reports and bad ones part ways. "After updating, I checked the table's total against the sales team's original grand total; there was a gap of 12,000 won, so I matched the rounding rule and brought it to zero." When the verification method is written out like this, you don't have to re-examine the result from scratch — you only have to judge whether that method was sufficient.

That said, merely stating a verification method doesn't make it proof. It's a starting point for gauging how far to trust the result, not a guarantee that the result is correct. So evidence shouldn't just be described in words; it should point all the way to a place a person can open and retrace for themselves.

This item gets dangerous because the lie an AI tells most often isn't malice — it's confidence. An AI has a tendency to talk about things it doesn't know as smoothly as things it does, so "a fact I verified myself" and "a guess that it's probably so" get mixed together in the same flat, declarative sentence. Take "I fixed the payment module, and card payments now work correctly." The first clause is likely true — fixing the code is something the AI just did. The second clause may be a guess. If it actually ran a card through and watched it get approved, it's a fact; if it wrote that because the code looks like it should work, it's a guess. Yet the sentence binds both into the same assertive form.

A well-trained AI PM separates these two by tone. "I fixed the payment module (verified). I haven't been able to run a test payment yet, so whether a real charge is approved is unverified." It looks less tidy. But it lets a person issue the next instruction: "Then run a test payment." A report that asserts everything blocks the next move. If everything's done, what more would you assign? So when you see an assertive sentence, just ask once: "Did you actually see that?" If the answer is specific — "I saw this, with this value" — it's close to a fact you can retrace yourself. If it comes back as "that's what the code implies," it was a guess. A guess isn't bad in itself. Dressing a guess up as a fact is what's bad.

One trap: when the AI verifies its own work

There's one more layer to watch here: when the AI verifies the very work it did. If it read a number wrong while doing the work, it's prone to verify against that same wrong standard. So the more important the check, the safer it is to do it with a different set of eyes than the ones that did the work. This is called cross-verification. For example, if the AI cleaned up the sales data, don't have the verification re-add the same sales data — have it compare against a different source, like the shipment quantities in the inventory data. But sales amounts and shipment quantities differ in units to begin with, and even if you align them by units sold, revenue-recognition timing, returns, and free shipments will produce differences that are perfectly normal. So don't jump straight to "if they don't match, one of them is wrong." First align the basis of comparison, strip out these normal differences, and only then treat whatever mismatch remains as a signal.

Third, what still isn't finished. Jobs rarely end flawlessly. Yet many AIs are biased by default toward pleasing people, so unless you ask, only the good news comes up. A report like "it works, but one spot is a concern" doesn't readily surface unless you've required it to be reported. That's why a trustworthy report sets the unfinished items apart at the very end of the completion report. It doesn't bury them in small print under a big "DONE."

The way to do this is to fix the report format. Make every completion report split into a "Done" column and an "Outstanding" column, and if there's nothing outstanding, require it to state "Outstanding: none" explicitly. Not allowing a blank is the key. If the outstanding column can't be left empty, the AI will scan its own work once more to see whether there really is nothing. Of course, scanning once more is no guarantee that nothing was missed. But it beats passing over it with a blank. And require four things to accompany each outstanding item: what isn't done, why it isn't done, what impact that has, and what's needed to resolve it. Stopping at "I couldn't add the year-over-year growth rate" means a person has to probe again. You want it to reach "I couldn't add the year-over-year growth rate (why: last year's data isn't in the system / impact: one trend graph looks empty / needed: one 2024 ledger file from the finance team)." Only then does a person know that requesting a single file from finance is all it takes, and can move immediately. A completion report that hides what's outstanding is a time bomb. It looks tidy for now, but the unfinished part doesn't disappear — it usually goes off in front of the client.

A sample beats a description. When an AI PM that has all three parts handles a situation where a client asks to move the deadline up by two weeks, the report looks like this:

[Request to Shorten Deadline by 2 Weeks — Interim Report] - Work done: Received the client's request to move the deadline up 2 weeks; reviewed the internal production schedule. - Confirmed facts: There's 2 weeks of slack in the current production schedule (checked against the production schedule sheet). - Conditional judgment: If materials arrive on time, moving up 2 weeks is possible — but material inbound itself is still unconfirmed, so this is conditional. - Evidence: Internal production schedule, Q2 sheet (can be opened and retraced). - Outstanding: (1) Whether material inbound can be moved up 2 weeks — needs supplier confirmation (AI has no permission to contact them). (2) Possible staffing conflict with the Company B delivery in the same week.

Two things set this report apart from an ordinary "done" report. First, fact and guess live in different columns. "There's 2 weeks of slack" is a fact confirmed directly against the schedule sheet; "moving up 2 weeks is possible" is a conditional guess resting on the premise that materials come through. Second, this report never uses the word "done" at all. Not all the conditions have been met yet.

Following a single deadline-change request all the way through

Let me trace how this sample came about, starting from the moment the request arrived. At ONTLE, this is how we design the AI PM to solve this problem. Picture a small business with no dedicated PM, and a request to move a deadline up by two weeks comes in while the owner is busy with something else.

The bad handling ends like this. It receives the request, moves the deadline date in the internal schedule up by two weeks, and reports, "Moved the deadline up and reflected it — done." The action is complete. The date definitely changed. But this only changed a number written on a calendar; it confirmed nothing about whether the goods can actually ship on that date. Two weeks later the delivery blows up, and the client is furious: "I thought it was going to work."

So ONTLE's AI PM is designed to take five steps.

First, read the real intent of the request. This isn't "change the date" — it's "judge whether we can move it up two weeks." What the client wants isn't a number on a calendar; it's to receive the goods two weeks early.

Second, gather the facts needed to make that judgment. Is there two weeks of slack in the production schedule? When is the material inbound date? Does it collide with another delivery? Here a task comes up that the AI can't do. "Whether material inbound can be moved up two weeks" is an external fact that only the supplier can answer. The AI must not make it up. What it doesn't know, it marks as unknown and separates out as an item that needs confirmation.

Third, report judgment and unconfirmed items separately. The result is exactly the sample above. It places confirmed facts and the conditional judgment in different columns, and sets the supplier confirmation and the Company B staffing conflict apart as outstanding. Instead of using "done," this report shows the owner at a glance the points where a decision is needed.

Fourth, stop here and get approval. Replying to the client with "We'll move it up two weeks" is a promise going outside the company. It's hard to take back, and if it's wrong, trust breaks. So this step is handed to a person. "I'd like to reply to the client as follows: (draft). Since it's before supplier confirmation, going out with 'We'll review and send a firm reply tomorrow' looks safer. May I send it?" Outbound messages are held until a person approves.

Fifth, follow through on the wrap-up after approval. Once the owner approves the draft, the AI PM first sends the client "We'll review and send a firm reply tomorrow." Then it gets the supplier's answer and confirms whether material inbound can move up two weeks, while the owner resolves the staffing overlap with Company B by adjusting the schedule. Only after all conditions are met does it send the firm reply — and only then, for the first time, does it write "done." And even then with evidence attached: "Deadline shortened by 2 weeks, firm reply sent to client, both materials and staffing confirmed secured."

In this one case, the AI PM did far more than change a single date field. The more trustworthy an AI PM is, the more sparingly it uses the word "done." It won't write it until all the evidence is in.

Five questions to ask when you receive a report

You can't re-verify everything every time you read a report. That would mean doing twice the work. Instead, if you drill just five questions — using the sample above as your yardstick — into your habits, you can single out only the risky reports to focus on.

  1. Does this mean "pressed," or does it mean "saw"? The question that separates action-complete from result-confirmed.
  2. Can I open and retrace the evidence myself? If there's only a claim that it was confirmed and no place to open and look, it's safest to treat that report as unverified.
  3. Is a conditional judgment slipping in disguised as a confirmed fact? State assertions like "it now works correctly" are especially prone to this.
  4. Is there an outstanding column, and does it say "none"? A report with no mention of outstanding items at all is the most dangerous — often not because there's nothing left undone, but because no one looked.
  5. Was there anything going outside or hard to reverse? If so, check whether the AI stopped there and asked, or barreled ahead on its own.

These five aren't a guarantee of "definitely correct." In particular, if the AI did the verification alone, one more layer of cross-verification is needed. Still, they're enough to pick out the risk points instead of inspecting everything. If even one trips, you just probe back on that one part specifically.

So, can you trust an AI PM?

You can. But you have to fix the object of your trust. It's not the word "done" — it's the evidence attached behind the word. Once the operating habit of demanding evidence takes hold, an AI PM's reports are actually easier to trace than a human handler's, because what was confirmed and how is left in writing. A person can get away with "I just looked and it seemed fine," but an AI PM with a format has to spell out that "just" in writing.

So in the end this isn't a story about the AI's performance. The core lies in the manager's ability to design a "trust but verify" system. Which columns to force in a report, where to stop and require approval, whose eyes do the confirming. This isn't a matter of bringing in one tool — it's a matter of changing the very way an organization handles the word "done."

That's why ONTLE aims for an AI PM that knows the weight of the word "done." Not just a tool that runs a small-business owner's repetitive tasks, but a collaboration partner that sorts and organizes the requests that came in overnight while leaving those results traceable all the way back to their evidence. The point where results diverge even among people using the same AI comes down, in the end, to the reading eye that looks at what's written next to "done."

Worth reading alongside

How often should reports come in?

Event-based works better than time-based. If you make it report every hour, reports come in even when there's nothing to say, and in the genuinely urgent moment the matter stays buried until the next cycle. Instead, tie reporting to three moments: when a task finishes, when it's stuck and can't go further, and right before something goes outside. That fits practice better. For long tasks, leave a progress note at each point where the stage changes.

If a report is too long, I end up not reading it.

It's often a structure problem rather than a length one. Fix the format so the conclusion (done/on hold) sits in a single line at the top, with the verification method and outstanding items attached briefly below — then when you're busy you read only the top line and drop down only when you need to. Reports that go unread are usually the ones where the conclusion is buried in the middle.