Website chat after hours: what an AI agent answers, and what it hands to a person

Key takeaways

• It answers only from what your business wrote down and checked.
• It shows options as buttons, because many visitors tap instead of type.
• Every booking goes to a person, with the whole chat attached.
• Test it with fake visitors first. Real visitors will still find new things.

Website chat with an AI agent can answer your customers at night, when nobody is in the office. It needs two things to work: answers your business has checked, and a quick way to reach a real person. We built one for a heli-ski operator, and here is what we learned.

What should an AI agent in my website chat actually do?

It should answer the questions your team answers every week, at any hour, and pass every booking to a person.

That comes down to four jobs:

• Answer from what you know. Your products, your rules, your way of saying things. No guessing.
• Show what fits. If a visitor asks about options, show them right in the chat.
• Speak the visitor’s language. If you sell abroad, questions come in more than one language.
• Hand over to a person. When the visitor is ready, or the question is too hard, someone on your team takes over.

Most chatbots on websites get the last job wrong. A chat that cannot reach a person is a dead end.

Why did a heli-ski operator want a chat that answers after hours?

Because its guests look at trips at all hours. A question that waits until morning is often a booking made somewhere else.

The operator sells multi-day trips to guests from all over the world, with a small office team. So questions often arrive while the office is asleep. Our report for the operator showed that most people the agent talked to came outside office hours.

During the day, the team answered the same questions again and again. Which trip suits my level? What is included? Is there space that week? The agent was built to take those repeat questions. The team kept the bookings and the decisions. Read the full case study.

How is an AI agent different from a chatbot on my website?

An AI agent understands the question the visitor typed and answers in plain words. An old-style chatbot only follows fixed menus.

What matters to your visitor: can it deal with the question they asked, and does it get them to a person when needed?

What did the agent need to know first?

It needed the operator’s own knowledge, written down and checked by the operator, before any visitor could talk to it.

Together with the operator, we wrote down the trips, the lodges, safety and how to prepare, plus answers to the most common questions. The operator read it all and made changes. Then the team gave feedback three more times.

This is the slow part, and it should be. An AI agent is like a new employee. It gets better because you keep adjusting it to what visitors really ask.

The chat also had to feel like the operator’s own website. Visitors can open and compare the trips, the lodges and the weather right inside the chat. Many visitors never typed a question at all. They just tapped the buttons.

What should an AI agent hand to a person?

Every booking, every request to talk to a person, and every question it cannot answer well.

When a visitor wants to book or asks for a person, the agent opens a short contact form. The team gets an email with the request and the whole chat, and the visitor gets one too.

Visitors asked most about dates and open places. Showing open dates inside the chat is the next thing to build. If you want this for your own business, see how we build booking agents.

How do you test an AI agent before real customers use it?

You let AI pretend to be different visitors, score every chat, and fix what you find before launch.

Pick a test visitor below to see how they talked to the agent and what the testing found.

Before launch · made-up visitors

Pick a test visitor. None of them were real.

Before a real guest typed a word, AI played four kinds of visitor, and every chat was scored on six things.

BeginnerNever done it beforeExpertKnows the terrain alreadyOrganiserA group of eight to twelveCompetitorBooks like a customer, digs like a rival

Beginner

Asks whether this trip is even for someone like them.

Pushes hardest on Tone and Helpful.

What this visitor checksChecks that the answers stay plain and friendly, and that a person is offered when the agent is unsure.

The chart is the average of ten test chats, a month before launch. Out of 5.

The agent vs ten test chats10 of 10 passedNo security breach

We also added simple safety checks, so nobody can talk the agent into saying something it should not. Personal details are removed before chats are saved. And the chat only works on the operator’s own website.

What did real visitors show us that testing did not?

That launch day is the start of the work. Real visitors find things no test will.

On launch day, our own checks found a bug that would have stopped the booking button from working. We fixed it the same afternoon, before any visitor saw it.

Within days, real visitors showed us two more: a greeting that appeared twice, and a form that could be sent twice. We fixed both.

Adding it to the website was the easy part: one line of code on the operator’s WordPress site.

The agent went live in the last weeks of the 2025/26 season, so we saw a short launch window, not a full season. Nobody used the thumbs up or thumbs down buttons, so we read nothing into them.

A month after the season ended, the agent was still passing new enquiries to the team.

What should you check before adding website chat with an AI agent?

Check that the same questions keep coming in, that someone owns the answers, and that a person is ready to take over.

Before you put an AI agent on your websiteTick off what is already true for your business.

0

/8 done

• Customers contact you outside office hours, or from other time zones
• Your team answers the same few questions every week
• Someone can write down, and check, what the agent should know
• You have decided what it must never share
• Every booking or order still goes to a named person
• A visitor who asks for a person gets one, straight away
• You will test it with difficult visitors before a real one arrives
• Someone will read what visitors ask and keep improving it

If most of these are true, an agent will probably save your team real time. If your answers are not written down yet, start there. Not sure where AI fits in your business at all? Read where to start with AI in your business, or book a free call.

Questions people ask about AI agents on websites

Written by

RomAIxAn AI agency

RomAIx builds AI systems for businesses and writes up the work as it happens.