How often should I check and improve an AI agent after it goes live?

The most important thing is listening to its calls. A new agent is like a new employee: it does not know everything on day one, someone will ask a question you did not cover, and it needs training and coaching at first. Then it becomes an expert and needs much less attention.

At the start, check the account often, for a 24/7 AI receptionist maybe once a day. Open the call log, press the play button on a recording and listen. Look for questions the AI said it did not know, anything odd, and anything you need to update in the prompt. Also check that its emails are going out. Once it is working well, check weekly, monthly or less often, depending on the services you offer.

The Agent self improvement feature in Labs lets the agent review its own conversations and work out what to improve, but you should still listen to calls yourself. You can also have the AI assistant review calls for you on a schedule.