Writing
Be deliberate about data and trust when you adopt AI
Turning on AI is one click. Being responsible is the real work.
Turning on AI features is a one-click decision. Being responsible about what data those features touch is the actual work, and it is the part most teams skip. Especially when customers are trusting you with sensitive information, the question is not just “what can this AI do for us,” but “what is it allowed to learn from, and is that okay with the people whose data it is.”
I made a specific, deliberate call about this, and it is the kind of call every team adopting AI now has to make.
The setting I almost left on
We were using a tool with AI features, and like a lot of these tools, it had an option to train its model on the content we fed it. That setting is easy to leave on without thinking, because the feature works either way and nobody is forcing you to look.
I looked, and I turned it off. As I noted at the time, I turned off the content training so it would not use any of our team’s files to train the AI model, while leaving the actual AI features on. The reasoning was straightforward. We could get the benefit of the AI features without handing our and our customers’ content over to train someone else’s model. That tradeoff was worth making, and it was not the default.
Why this is the real work of adopting AI
Anybody can switch on an AI feature. The valuable judgment is in the boundaries. What data does it see? What does it retain? What does it train on? Who would be upset if they knew?
When your customers are trusting you with sensitive information, those questions are not optional or paranoid. They are the difference between adopting AI responsibly and quietly creating a problem you will have to explain later. A single careless default, content training left on, could mean customer data flowing somewhere it should never go. The feature still works. The trust quietly erodes, and you might not find out until it is a headline.
So the discipline is to treat every AI integration as a data decision, not just a feature decision. Read the settings. Find the training toggle. Decide on purpose what your data and your customers’ data are allowed to be used for.
Trust is the asset you are protecting
This connects to something I believe about products in general. Especially early, you are not just selling features, you are earning trust. AI raises the stakes on that, because the tools are hungry for data and the defaults are usually set in the vendor’s favor, not your customer’s.
Being deliberate here is how you keep the trust you worked hard to build. It is unglamorous. Nobody sees the training toggle you turned off. But it is exactly the kind of quiet, responsible decision that separates a team that respects its customers from one that just ships fast and hopes nobody asks.
Adopting AI is easy. Adopting it responsibly is a series of small, deliberate decisions about data that nobody will praise you for and everybody would blame you for getting wrong.
So when you turn on the next AI feature, do not stop at “does it work.” Ask what it touches and what it learns from, and decide on purpose. What is the default setting in your AI tools that you have never actually checked?
July 2024