Accenture has launched new services for testing artificial intelligence (AI) systems, powered by a unique “Teach and Test” methodology designed to help companies build, monitor and measure reliable AI systems within their own infrastructure or in the cloud.
Accenture’s “Teach and Test” methodology ensures that AI systems are producing the right decisions in two phases. The “Teach” phase focuses on the choice of data, models and algorithms that are used to train machine learning. This phase experiments and statistically evaluates different models to select the best performing model to be deployed into production, while avoiding gender, ethnic and other biases, as well as ethical and compliance risks.
During the “Test” phase, AI system outputs are compared to key performance indicators, and assessed for whether the system can explain how a decision or outcome was determined. It uses innovative techniques and cloud-based tools to monitor the system on an ongoing basis for sustained performance. For instance, a patent-pending normalization technique uses a unique algorithm to test object recognition more quickly.
According the Accenture Technology Vision 2018, AI systems require addressing many of the same challenges faced in human education and growth: fostering an understanding of right and wrong, and what it means to behave responsibly; imparting knowledge without bias; and building self-reliance while emphasizing the importance of collaborating and communicating with others.
Accenture used its “Teach and Test” methodology to train a conversational virtual agent for a financial services company’s website, so that it could engage in accurate, unbiased conversations and know when to refer conversations to a human. The agent was trained 80 percent faster than previously possible and achieved an 85 percent accuracy rate on customer recommendations.
The methodology was also used to teach a sentiment analysis solution to evaluate a brand’s service performance by analyzing social media, news and other sources in real time. Having the right training data enabled the solution to correctly interpret sentiments in different contexts and domains. The training time for models was cut in half, enabling faster analysis and business results.
Accenture AI Testing is part of a complete range of testing services that helps quality engineering professionals be a catalyst for speed, agility and business performance while achieving radical productivity. Accenture serves over 1,000 testing clients across more than 40 industries and is recognized as an industry leader in testing innovation.