As we create new AI enabled experiences systems will know more about a person using the system then someone knows about themselves, we need to be mindful to not craft “creepy” experiences rather we need caring experiences.
Some consideration when creating an AI enabled product or service experience:
• Set expectations, let people know how deeply they will be known.
• Have an intent, don’t share/show information just because you can.
• Show limits of the system to reduce the “false god effect.”
• Focus on people’s interaction, not just the data a system has.
People want to be known, yet it’s important to remember that people want to be known because it makes them feel cared for.
The result or experience of using an AI enabled system is not to make someone feel known but cared for.