Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Feb 28:5:779799.
doi: 10.3389/frai.2022.779799. eCollection 2022.

Financial Risk Management and Explainable, Trustworthy, Responsible AI

Affiliations

Financial Risk Management and Explainable, Trustworthy, Responsible AI

Sebastian Fritz-Morgenthal et al. Front Artif Intell. .

Abstract

This perspective paper is based on several sessions by the members of the Round Table AI at FIRM, with input from a number of external and international speakers. Its particular focus lies on the management of the model risk of productive models in banks and other financial institutions. The models in view range from simple rules-based approaches to Artificial Intelligence (AI) or Machine learning (ML) models with a high level of sophistication. The typical applications of those models are related to predictions and decision making around the value chain of credit risk (including accounting side under IFRS9 or related national GAAP approaches), insurance risk or other financial risk types. We expect more models of higher complexity in the space of anti-money laundering, fraud detection and transaction monitoring as well as a rise of AI/ML models as alternatives to current methods in solving some of the more intricate stochastic differential equations needed for the pricing and/or valuation of derivatives. The same type of model is also successful in areas unrelated to risk management, such as sales optimization, customer lifetime value considerations, robo-advisory, and other fields of applications. The paper refers to recent related publications from central banks, financial supervisors and regulators as well as other relevant sources and working groups. It aims to give practical advice for establishing a risk-based governance and testing framework for the mentioned model types and discusses the use of recent technologies, approaches, and platforms to support the establishment of responsible, trustworthy, explainable, auditable, and manageable AI/ML in production. In view of the recent EU publication on AI, also referred to as the EU Artificial Intelligence Act (AIA), we also see a certain added value for this paper as an instigator of further thinking outside of the financial services sector, in particular where "High Risk" models according to the mentioned EU consultation are concerned.

Keywords: EU AI act; artificial intelligence; explainable AI; financial regulation and compliance; machine learning; risk management.

PubMed Disclaimer

Conflict of interest statement

SF-M was employed by Bain & Company. BH was employed by Ernst & Young. JP was employed by NVIDIA GmbH.

Figures

Figure 1
Figure 1
Simplified flowchart for a model development, application and validation cycle.
Figure 2
Figure 2
Description of the end-to-end workflow for an application to interactively analyse post-hoc explainable AI information. The dashboards have been produced with Plotly.

References

    1. AIRS (Artificial Intelligence/Machine Learning Risk Security Working Group) (2020). Artificial Intelligence Risk and Governance. Retrieved from: https://ai.wharton.upenn.edu/artificial-intelligence-risk-governance/
    1. Batarseh F. A., Freeman L., Huang C. H. (2021). A survey on artificial intelligence assurance. J. Big Data 8:60. 10.1186/s40537-021-00445-7 - DOI
    1. Bracke P., Datta A., Jung C., Sen S. (2019). Machine Learning Explainability in Finance: an Application to Default Risk Analysis. Bank England staff working paper no. 816. 10.2139/ssrn.3435104 - DOI
    1. Bruno G., Hiren J., Rafael S., Bruno T. (2020). Computing Platforms for Big Data Analytics and Artificial Intelligence. IFC Reports 11. Bank for International Settlements. Retrieved from: https://ideas.repec.org/p/bis/bisifr/11.html
    1. Bussmann N., Giudici P., Marinelli D., Papenbrock J. (2020). Explainable machine learning in credit risk management. Comput. Econ. 57, 203–216. 10.1007/s10614-020-10042-0 - DOI

LinkOut - more resources