Three months after the demo, the automation breaks. The agency that built it has moved on to its next client, and you are staring at an error nobody warned you about. That is the part of AI automation no one puts in the pitch.
There are dozens of agencies selling AI automation in Australia right now, and from the outside they are hard to tell apart. Same language, the same blurred-logo case studies, the same confident timeline. Pick the wrong one and you usually find out the slow way, around the time the person who built your system stops replying to emails. So before you sign anything, here are the five questions that separate the operators from the talkers.
Who runs it after go-live?
Start here, because the answer tells you almost everything else. Plenty of agencies can stand up an automation in a fortnight and hand you a login. Far fewer will say who fixes it when a supplier changes their invoice layout, or when an API quietly falls over at 6pm on a Friday. Automations are not set-and-forget. They sit on top of other people’s systems, and those systems move. If the answer here is vague, the real answer is you.
Is the scope fixed, with a real price?
Watch for the open-ended discovery journey that bills by the hour and never quite ends. A good agency can look at your problem, give you a number, and stand behind it. We quote fixed prices because the alternative makes the client pay for our uncertainty. If nobody will commit to a figure until after a paid discovery phase, ask yourself whose learning curve you are funding.
Can they show you something running?
Slide decks are free. Anyone can draw a workflow with six neat phases and a tasteful colour palette. Ask to see a real automation doing real work, even a small one, then listen to how they talk about the dull parts: error handling, odd edge cases, what happens when the data turns up messy. People who have shipped this before get specific fast. People who have not retreat into strategy.
Who owns the build if you leave?
Some agencies build on a platform you can never actually leave, so the day you stop paying, the automation stops with it. Before you sign, ask where the work lives, whether you get real access to it, and what happens if the two of you part ways. You paid for it. You should own it outright, or at least be able to pick it up and walk.
Are they on your side of the world?
An offshore team eight hours behind is fine for building a website. For something wired into your quoting, your billing, or your customer records, the timezone gap and the data questions stop being minor. Someone on Australian time, accountable under Australian rules, is worth a small premium once real money and personal information are in play.
The short version
The agency worth hiring is the one that stays straight with you about the unglamorous parts: who keeps it running, and what you walk away owning. Inverto is a Melbourne based IT services company that builds and runs Claude automations for small businesses, so I will own the bias. It is also why I think the first question on this list matters more than any demo. If you want to see how we handle the run-it-afterwards side, take a look at our AI Cowork service, or start at the Inverto homepage.