Assembling documentation about an AI model’s important features, such as its purpose, performance, datasets, characteristics, and more, can help drive trust in the technology. This is why in 2018, IBM Research proposed the concept of AI FactSheets.
Today, IBM is announcing plans to commercialize key automated documentation capabilities from IBM Research’s AI FactSheets methodology into Watson Studio in Cloud Pak for Data throughout 2021. The capabilities will provide businesses with tools to define how their AI should be used, capture key facts automatically on a model’s performance, and generate reports, or FactSheets, designed to support their internal and external transparency and compliance with regulations.
AI
FactSheets will offer:
Policy creation – FactSheet template:
Defines what information is collected about models and tracked through the FactSheet, the model facts, such as how an AI service was created, tested, trained, deployed, and evaluated, data use, what regulations or company policies an organization is accounting for, who can use the model and for what purpose, and how it should operate.
Automated data capture – model facts:
Helps to continuously and automatically capture the model facts set forth by the FactSheet template, across the entirety of the AI lifecycle.
Automated reporting – FactSheet:
Provides a FactSheet, compiled in a sharable, comprehensive location that offers knowledge about the AI model in multiple formats, depending on the needs and preferences of different team members and external audiences. The FactSheet tracks the facts as the model is built, updated, and running in production, providing up-to-date insights.
Learn more about trustworthy AI:
ibm.com/Watson/trustworthy-ai