%0 Journal Article
%T Transformer Self-Attention Network for Forecasting Mortality Rates
%J Journal of the Iranian Statistical Society
%I Iranian Statistical Society
%Z 1726-4057
%A Roshani, Amin
%A Izadi, Muhyiddin
%A Khaledi, Baha-Eldin
%D 2022
%\ 06/01/2022
%V 21
%N 1
%P 81-103
%! Transformer Self-Attention Network for Forecasting Mortality Rates
%K Auto-Regressive Integrated Moving Average
%K Human Mortality Database
%K Long Short-Term Memory
%K Mean Absolute Percentage Error
%K Poisson-Lee-Carter Mortality Model
%K Recurrent Neural Network
%K Simple Exponential Smoothing
%K Time Series Prediction
%R 10.22034/jirss.2022.704621
%X The transformer network is a deep learning architecture that uses self-attention mechanisms tocapture the long-term dependencies of a sequential data. The Poisson-Lee-Carter model, introduced to predict mortality rate, includes the factors of age and the calendar year, which is a time-dependent component. In this paper, we use the transformer to predict the time-dependent component in the Poisson-Lee-Carter model. We use the real mortality data set of some countries to compare the mortality rate prediction performance of the transformer with that of the long short-term memory (LSTM) neural network, the classic ARIMA time series model and simple exponential smoothing method. The results show that the transformer dominates or is comparable to the LSTM, ARIMA and simple exponential smoothing method.
%U https://jirss.irstat.ir/article_704621_e9ae6dc9cf19b1a0d8aed06800f9aaaf.pdf