Abstract: Pre-stack seismic inversion is an effective way to investigate the characteristics of hydrocarbon-bearing reservoirs. Multi-parameter application is the key to identifying reservoir lithology and fluid in pre-stack inversion. However, multi-parameter inversion may bring coupling effects on the parameters and destabilize the inversion. In addition, the lateral recognition accuracy of geological structures receives great attention. To address these challenges, a multi-task learning network considering the angle-gather difference is proposed in this work. The deep learning network is usually assumed as a black box and it is unclear what it can learn. However, the introduction of angle-gather difference can force the deep learning network to focus on the lateral differences, thus improving the lateral accuracy of the prediction profile. The proposed deep learning network includes input and output blocks. First, angle gathers and the angle-gather difference are fed into two separate input blocks with ResNet architecture and Unet architecture, respectively. Then, three elastic parameters, including P- and S-wave velocities and density, are simultaneously predicted based on the idea of multi-task learning by using three separate output blocks with the same convolutional network layers. Experimental and field data tests demonstrate the effectiveness of the proposed method in improving the prediction accuracy of seismic elastic parameters.