ISSN 1004-4140
CN 11-3017/P
CAI Y Q, YU Z Y, WANG W T, et al. Bi-directional Pre-trained Network for Single-station Seismic Waveform Analysis[J]. CT Theory and Applications, 2025, 34(1): 111-116. DOI: 10.15953/j.ctta.2024.162. (in Chinese).
Citation: CAI Y Q, YU Z Y, WANG W T, et al. Bi-directional Pre-trained Network for Single-station Seismic Waveform Analysis[J]. CT Theory and Applications, 2025, 34(1): 111-116. DOI: 10.15953/j.ctta.2024.162. (in Chinese).

Bi-directional Pre-trained Network for Single-station Seismic Waveform Analysis

More Information
  • Received Date: July 29, 2024
  • Revised Date: July 30, 2024
  • Accepted Date: July 31, 2024
  • Available Online: August 01, 2024
  • The application of machine learning, particularly deep learning methods, is becoming increasingly widespread in seismology, achieving near-human accuracy in tasks such as phase detection and event classification. However, most neural network models in seismology currently focus on single tasks. Based on the CSNCD dataset released by the China Earthquake Networks Center, we have developed a bi-directional neural network pre-trained model for single-station data analysis. This model uses three-component seismic waveform data as input and employs convolutional neural networks and bi-directional Transformer models for feature extraction and processing. It not only performs routine tasks such as Pg, Sg, Pn and Sn phase detection, P-wave first-motion direction determination, and event type classification but can also be adapted to other seismic waveform data analysis tasks through transfer learning.

  • [1]
    BEROZA G C, SEGOU M, Mostafa Mousavi S. Machine learning and earthquake forecasting: Next steps[J]. Nature communications, 2021, 12(1): 4761.

    BEROZA G C, SEGOU M, Mostafa Mousavi S. Machine learning and earthquake forecasting: Next steps[J]. Nature communications, 2021, 12(1): 4761.
    [2]
    MOUSAVI S M, BEROZA G C. Deep-learning seismology[J]. Science, 2022, 377(6607): eabm4470.

    MOUSAVI S M, BEROZA G C. Deep-learning seismology[J]. Science, 2022, 377(6607): eabm4470.
    [3]
    ZHU W, BEROZA G C. PhaseNet: A deep-neural-network-based seismic arrival-time picking method[J]. Geophysical Journal International, 2019, 216(1): 261-273.

    ZHU W, BEROZA G C. PhaseNet: A deep-neural-network-based seismic arrival-time picking method[J]. Geophysical Journal International, 2019, 216(1): 261-273.
    [4]
    ROSS Z E, MEIER M A, HAUKSSON E, et al. Generalized seismic phase detection with deep learning[J]. Bulletin of the Seismological Society of America, 2018, 108(5A): 2894-2901.

    ROSS Z E, MEIER M A, HAUKSSON E, et al. Generalized seismic phase detection with deep learning[J]. Bulletin of the Seismological Society of America, 2018, 108(5A): 2894-2901.
    [5]
    WANG J, XIAO Z, LIU C, et al. Deep learning for picking seismic arrival times[J]. Journal of Geophysical Research: Solid Earth, 2019, 124(7): 6612-6624.

    WANG J, XIAO Z, LIU C, et al. Deep learning for picking seismic arrival times[J]. Journal of Geophysical Research: Solid Earth, 2019, 124(7): 6612-6624.
    [6]
    MOUSAVI S M, ELLSWORTH W L, ZHU W, et al. Earthquake transformer: An attentive deep-learning model for simultaneous earthquake detection and phase picking[J]. Nature Communications, 2020, 11(1): 3952.

    MOUSAVI S M, ELLSWORTH W L, ZHU W, et al. Earthquake transformer: An attentive deep-learning model for simultaneous earthquake detection and phase picking[J]. Nature Communications, 2020, 11(1): 3952.
    [7]
    XIAO Z, WANG J, LIU C, et al. Siamese earthquake transformer: A pair-input deep-learning model for earthquake detection and phase picking on a seismic array[J]. Journal of Geophysical Research: Solid Earth, 2021, 126(5): e2020JB021444.

    XIAO Z, WANG J, LIU C, et al. Siamese earthquake transformer: A pair-input deep-learning model for earthquake detection and phase picking on a seismic array[J]. Journal of Geophysical Research: Solid Earth, 2021, 126(5): e2020JB021444.
    [8]
    YU Z, WANG W. LPPN: A lightweight network for fast phase picking[J]. Seismological Research Letters, 2022, 93(5): 2834-2846.

    YU Z, WANG W. LPPN: A lightweight network for fast phase picking[J]. Seismological Research Letters, 2022, 93(5): 2834-2846.
    [9]
    YANG S, HU J, ZHANG H, et al. Simultaneous earthquake detection on multiple stations via a convolutional neural network[J]. Seismological Research Letters, 2021, 92(1): 246-260.

    YANG S, HU J, ZHANG H, et al. Simultaneous earthquake detection on multiple stations via a convolutional neural network[J]. Seismological Research Letters, 2021, 92(1): 246-260.
    [10]
    YANO K, SHIINA T, KURATA S, et al. Graph-partitioning based convolutional neural network for earthquake detection using a seismic array[J]. Journal of Geophysical Research: Solid Earth, 2021, 126(5): e2020JB020269.

    YANO K, SHIINA T, KURATA S, et al. Graph-partitioning based convolutional neural network for earthquake detection using a seismic array[J]. Journal of Geophysical Research: Solid Earth, 2021, 126(5): e2020JB020269.
    [11]
    ROSS Z E, MEIER M A, HAUKSSON E. P wave arrival picking and first-motion polarity determination with deep learning[J]. Journal of Geophysical Research: Solid Earth, 2018, 123(6): 5120-5129.

    ROSS Z E, MEIER M A, HAUKSSON E. P wave arrival picking and first-motion polarity determination with deep learning[J]. Journal of Geophysical Research: Solid Earth, 2018, 123(6): 5120-5129.
    [12]
    HARA S, FUKAHATA Y, IIO Y. P-wave first-motion polarity determination of waveform data in western Japan using deep learning[J]. Earth, Planets and Space, 2019, 71(1): 127.

    HARA S, FUKAHATA Y, IIO Y. P-wave first-motion polarity determination of waveform data in western Japan using deep learning[J]. Earth, Planets and Space, 2019, 71(1): 127.
    [13]
    TIAN X, ZHANG W, ZHANG X, et al. Comparison of single-trace and multiple-trace polarity determination for surface microseismic data using deep learning[J]. Seismological Research Letters, 2020, 91(3): 1794-1803.

    TIAN X, ZHANG W, ZHANG X, et al. Comparison of single-trace and multiple-trace polarity determination for surface microseismic data using deep learning[J]. Seismological Research Letters, 2020, 91(3): 1794-1803.
    [14]
    ZHAO M, XIAO Z, ZHANG M, et al. DiTing Motion: A deep-learning first-motion-polarity classifier and its application to focal mechanism inversion[J]. Frontiers in Earth Science, 2023, 11: 1103914.

    ZHAO M, XIAO Z, ZHANG M, et al. DiTing Motion: A deep-learning first-motion-polarity classifier and its application to focal mechanism inversion[J]. Frontiers in Earth Science, 2023, 11: 1103914.
    [15]
    KUANG W, YUAN C, ZHANG J. Real-time determination of earthquake focal mechanism via deep learning[J]. Nature Communications, 2021, 12(1): 1432.

    KUANG W, YUAN C, ZHANG J. Real-time determination of earthquake focal mechanism via deep learning[J]. Nature Communications, 2021, 12(1): 1432.
    [16]
    LI S, FANG L, XIAO Z, et al. Focmech-flow: Auto-matic determination of P-wave first-motion polarity and focal mechanism inversion and application to the 2021 yangbi earthquake sequence[J]. Applied Sciences, 2023, 13(4): 2233.

    LI S, FANG L, XIAO Z, et al. Focmech-flow: Auto-matic determination of P-wave first-motion polarity and focal mechanism inversion and application to the 2021 yangbi earthquake sequence[J]. Applied Sciences, 2023, 13(4): 2233.
    [17]
    ZHU W, MOUSAVI S M, BEROZA G C. Seismic signal denoising and decomposition using deep neural networks[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(11): 9476-9488.

    ZHU W, MOUSAVI S M, BEROZA G C. Seismic signal denoising and decomposition using deep neural networks[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(11): 9476-9488.
    [18]
    WANG T, TRUGMAN D, LIN Y. SeismoGen: Seismic waveform synthesis using GAN with application to seismic data augmentation[J]. Journal of Geophysical Research: Solid Earth, 2021, 126(4): e2020JB020077.

    WANG T, TRUGMAN D, LIN Y. SeismoGen: Seismic waveform synthesis using GAN with application to seismic data augmentation[J]. Journal of Geophysical Research: Solid Earth, 2021, 126(4): e2020JB020077.
    [19]
    YANG L, LIU X, ZHU W, et al. Toward improved urban earthquake monitoring through deep-learning-based noise suppression[J]. Science advances, 2022, 8(15): eabl3564.

    YANG L, LIU X, ZHU W, et al. Toward improved urban earthquake monitoring through deep-learning-based noise suppression[J]. Science advances, 2022, 8(15): eabl3564.
    [20]
    NOVOSELOV A, BALAZS P, BOKELMANN G. SEDENOSS: SEparating and DENOising Seismic Signals with dual-path recurrent neural network architecture[J]. Journal of Geophysical Research: Solid Earth, 2022, 127(3): e2021JB023183.

    NOVOSELOV A, BALAZS P, BOKELMANN G. SEDENOSS: SEparating and DENOising Seismic Signals with dual-path recurrent neural network architecture[J]. Journal of Geophysical Research: Solid Earth, 2022, 127(3): e2021JB023183.
    [21]
    ROSS Z E, YUE Y, MEIER M A, et al. PhaseLink: A deep learning approach to seismic phase association[J]. Journal of Geophysical Research: Solid Earth, 2019, 124(1): 856-869.

    ROSS Z E, YUE Y, MEIER M A, et al. PhaseLink: A deep learning approach to seismic phase association[J]. Journal of Geophysical Research: Solid Earth, 2019, 124(1): 856-869.
    [22]
    MCBREARTY I W, DELOREY A A, JOHNSON P A. Pairwise association of seismic arrivals with convolutional neural networks[J]. Seismological Research Letters, 2019, 90(2A): 503-509.

    MCBREARTY I W, DELOREY A A, JOHNSON P A. Pairwise association of seismic arrivals with convolutional neural networks[J]. Seismological Research Letters, 2019, 90(2A): 503-509.
    [23]
    MCBREARTY I W, GOMBERG J, DELOREY A A, et al. Earthquake arrival association with backprojection and graph theory[J]. Bulletin of the Seismological Society of America, 2019, 109(6): 2510-2531.

    MCBREARTY I W, GOMBERG J, DELOREY A A, et al. Earthquake arrival association with backprojection and graph theory[J]. Bulletin of the Seismological Society of America, 2019, 109(6): 2510-2531.
    [24]
    YU Z, WANG W. FastLink: A machine learning and GPU-based fast phase association method and its application to Yangbi Ms6.4 aftershock sequences[J]. Geophysical Journal International, 2022, 230(1): 673-683.

    YU Z, WANG W. FastLink: A machine learning and GPU-based fast phase association method and its application to Yangbi Ms6.4 aftershock sequences[J]. Geophysical Journal International, 2022, 230(1): 673-683.
    [25]
    DEVRIES P M R, VIÉGAS F, WATTENBERG M, et al. Deep learning of aftershock patterns following large earthquakes[J]. Nature, 2018, 560(7720): 632-634.

    DEVRIES P M R, VIÉGAS F, WATTENBERG M, et al. Deep learning of aftershock patterns following large earthquakes[J]. Nature, 2018, 560(7720): 632-634.
    [26]
    LOMAX A, MICHELINI A, JOZINOVIć D. An investigation of rapid earthquake characterization using single-station waveforms and a convolutional neural network[J]. Seismological Resear Letters, 90(2A): 517-529.

    LOMAX A, MICHELINI A, JOZINOVIć D. An investigation of rapid earthquake characterization using single-station waveforms and a convolutional neural network[J]. Seismological Resear Letters, 90(2A): 517-529.
    [27]
    MOUSAVI S M, BEROZA G C. Bayesian-deep-learning estimation of earthquake location from single-station observations[J]. arXiv preprint arXiv: 1912.01144, 2019.

    MOUSAVI S M, BEROZA G C. Bayesian-deep-learning estimation of earthquake location from single-station observations[J]. arXiv preprint arXiv: 1912.01144, 2019.
    [28]
    ZHANG X, ZHANG J, YUAN C, et al. Locating induced earthquakes with a network of seismic stations in Oklahoma via a deep learning method[J]. Scientific reports, 2020, 10(1): 1941.

    ZHANG X, ZHANG J, YUAN C, et al. Locating induced earthquakes with a network of seismic stations in Oklahoma via a deep learning method[J]. Scientific reports, 2020, 10(1): 1941.
    [29]
    ZHANG X, REICHARD-FLYNN W, ZHANG M, et al. Spatiotemporal graph convolutional networks for earthquake source characterization[J]. Journal of Geophysical Research: Solid Earth, 2022, 127(11): e2022JB024401.

    ZHANG X, REICHARD-FLYNN W, ZHANG M, et al. Spatiotemporal graph convolutional networks for earthquake source characterization[J]. Journal of Geophysical Research: Solid Earth, 2022, 127(11): e2022JB024401.
    [30]
    MCBREARTY I W, BEROZA G C. Earthquake phase association with graph neural networks[J]. Bulletin of the Seismological Society of America, 2023, 113(2): 524-547.

    MCBREARTY I W, BEROZA G C. Earthquake phase association with graph neural networks[J]. Bulletin of the Seismological Society of America, 2023, 113(2): 524-547.
    [31]
    LINVILLE L, PANKOW K, DRAELOS T. Deep learning models augment analyst decisions for event discrimination[J]. Geophysical Research Letters, 2019, 46(7): 3643-3651.

    LINVILLE L, PANKOW K, DRAELOS T. Deep learning models augment analyst decisions for event discrimination[J]. Geophysical Research Letters, 2019, 46(7): 3643-3651.
    [32]
    KIM G, KU B, AHN J K, et al. Graph convolution networks for seismic events classification using raw waveform data from multiple stations[J]. IEEE Geoscience and Remote Sensing Letters, 2021, 19: 1-5.

    KIM G, KU B, AHN J K, et al. Graph convolution networks for seismic events classification using raw waveform data from multiple stations[J]. IEEE Geoscience and Remote Sensing Letters, 2021, 19: 1-5.
    [33]
    BREGMAN Y, LINDENBAUM O, RABIN N. Array based earthquakes-explosion discrimination using diffusion maps[J]. Pure and Applied Geophysics, 2021, 178: 2403-2418.

    BREGMAN Y, LINDENBAUM O, RABIN N. Array based earthquakes-explosion discrimination using diffusion maps[J]. Pure and Applied Geophysics, 2021, 178: 2403-2418.
    [34]
    KONG Q, WANG R, WALTER W R, et al. Combining deep learning with physics based features in explosion-earthquake discrimination[J]. Geophysical Research Letters, 2022, 49(13): e2022GL098645.

    KONG Q, WANG R, WALTER W R, et al. Combining deep learning with physics based features in explosion-earthquake discrimination[J]. Geophysical Research Letters, 2022, 49(13): e2022GL098645.
    [35]
    MÜNCHMEYER J, BINDI D, LESER U, et al. Earthquake magnitude and location estimation from real time seismic waveforms with a transformer network[J]. Geophysical Journal International, 2021, 226(2): 1086-1104.

    MÜNCHMEYER J, BINDI D, LESER U, et al. Earthquake magnitude and location estimation from real time seismic waveforms with a transformer network[J]. Geophysical Journal International, 2021, 226(2): 1086-1104.
    [36]
    SI X, WU X, SHENG H, et al. SeisCLIP: A seismology foundation model pre-trained by multi-modal data for multi-purpose seismic feature extraction[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024.

    SI X, WU X, SHENG H, et al. SeisCLIP: A seismology foundation model pre-trained by multi-modal data for multi-purpose seismic feature extraction[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024.
    [37]
    AN Y. Introduction to a recently released dataset entitled CSNCD: A comprehensive dataset of chinese seismic network[J]. Earthquake Research Advances, 2024, 4: 100255.

    AN Y. Introduction to a recently released dataset entitled CSNCD: A comprehensive dataset of chinese seismic network[J]. Earthquake Research Advances, 2024, 4: 100255.
    [38]
    YU Z, WANG W, Chen Y. Benchmark on the accuracy and efficiency of several neural network based phase pickers using datasets from China Seismic Network[J]. Earthquake Science, 2023, 36(2): 113-131.

    YU Z, WANG W, Chen Y. Benchmark on the accuracy and efficiency of several neural network based phase pickers using datasets from China Seismic Network[J]. Earthquake Science, 2023, 36(2): 113-131.
    [39]
    YUAN C, ZHANG J. Applying deep learning to teleseismic phase detection and picking: PcP and PKiKP cases[J]. arXiv preprint arXiv: 1910.09049, 2019.

    YUAN C, ZHANG J. Applying deep learning to teleseismic phase detection and picking: PcP and PKiKP cases[J]. arXiv preprint arXiv: 1910.09049, 2019.
    [40]
    DING W, LI T, YANG X, et al. Deep neural networks for creating reliable PmP database with a case study in southern California[J]. Journal of Geophysical Research: Solid Earth, 2022, 127(4): e2021JB023830.

    DING W, LI T, YANG X, et al. Deep neural networks for creating reliable PmP database with a case study in southern California[J]. Journal of Geophysical Research: Solid Earth, 2022, 127(4): e2021JB023830.
  • Related Articles

    [1]YOU Long-ting, SONG Jian-guo, YU Hui-zhen, WANG Yue-lei. Analysis of the Influence Factors on the Time-Frequency Spectrum Obtained by Synchrosqueezing Wavelet Transform based on Reconstruction of Analytic Signal[J]. CT Theory and Applications, 2017, 26(3): 267-278. DOI: 10.15953/j.1004-4140.2017.26.03.02
    [2]ZHANG Xue-song, ZHAO Bo-shan. Cupping Artifacts Calibration in CT Image Based on Radon Transform[J]. CT Theory and Applications, 2016, 25(5): 539-546. DOI: 10.15953/j.1004-4140.2016.25.05.05
    [3]LIU Hai-yan, TIAN Gang, SHI Zhan-jie. The Comparison of Time-frequency Analysis Methods and Their Applications[J]. CT Theory and Applications, 2015, 24(2): 199-208. DOI: 10.15953/j.1004-4140.2015.24.02.06
    [4]FAN Hua, ZHAO Guo-chun, HAN Yan-jie, LIU Ming-jun, LI Xiao-qin, SUN Yong-jun. Image Fusion in Combination of the Improved IHS Transform and Wavelet Transform[J]. CT Theory and Applications, 2014, 23(5): 761-770.
    [5]FENG Xia, SHI Chao, DING Wen-bo, FENG Yan, HAO Zhen-ping. The Complication of Spectral Analysis Based on Fourier Transform in the Tire X-ray Detection[J]. CT Theory and Applications, 2014, 23(3): 453-458.
    [6]ZHANG Xi-le, HUANG Jing, LIU Nan, LU Li-jun, MA Jian-hua, CHEN Wu-fan. Wavelet-Transform Based Low-Dose CT Projection Filtering[J]. CT Theory and Applications, 2011, 20(2): 163-171.
    [7]DONG Fang, HU Liang, LI Bo-lin, LI Ming, CHEN Hao, WANG Yuan, ZHANG Cheng-xin, XU Zhou. Contour Data Denoise Based on Inter-Scale Correlations of Contourlet Transform[J]. CT Theory and Applications, 2008, 17(4): 62-66.
    [8]SUN Cun-jie, ZHANG Hong. The Study on Methods of CT Image Enhancement[J]. CT Theory and Applications, 2005, 14(4): 17-20.
    [9]HAN Yu-sheng, LU Wei, LIU Han, LI Cong-li. Enhancement processing on Security Inspection Image Based on Db Wavelet Transform and median Filtering[J]. CT Theory and Applications, 2005, 14(1): 7-10.
    [10]ZHONG Shi-hang. Examining Quality of Retaining Wall Made of Mortar and Stones by Means of Comparing Spectrum of Elastic Reflection Wave Frequncy[J]. CT Theory and Applications, 2002, 11(1): 1-5.
  • Cited by

    Periodical cited type(1)

    1. 张明霞,李玲,高兰,王玉华,孙莹,孙磊,霍萌,张春燕,王仁贵. 不同预后的抗MDA5抗体阳性IIMs患者肺部HRCT定量指标与临床研究. CT理论与应用研究. 2024(03): 351-358 . 本站查看

    Other cited types(0)

Catalog

    Article views (170) PDF downloads (35) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return