Abstract

The hidden Markov models are statistical models used in many real-world applications and communities. The use of hidden Markov models has become predominan

+More

Keywords

hidden markov models realworld applications

Cite this article

Bhavya Mor,Sunita Garhwal,Ajay Kumar,.A Systematic Review of Hidden Markov Models and Their Applications. (),1-20.

Bhavya Mor,Sunita Garhwal,Ajay Kumar,"A Systematic Review of Hidden Markov Models and Their Applications"

Bhavya Mor,Sunita Garhwal,Ajay Kumar,"A Systematic Review of Hidden Markov Models and Their Applications"

References

Liu Z, Wang S (2017) Decoding Chinese stock market returns: three-state hidden semi-markov model. Pac Basin Finance J 44:127–149

Fine S, Singer Y, Tishby N (1998) The hierarchical hidden Markov model: analysis and applications. Mach Learn 32(1):41–62

Altuve M, Carrault G, Beuchee A, Pladys P, Hernandez AI (2015) Online apnea-bradycardia detection based on hidden semi-Markov models. Med Biol Eng Comput 53(1):1–13

Zhang D, Gatica-Perez D, Bengio S, McCowan I (2006) Modeling individual and group actions in meetings with layered HMMs. IEEE Trans Multimed 8(3):509–520

Zhou YH, Brooks P, Wang X (2018) A two-stage hidden Markov Model design for biomarker detection, with application to microbiome research. Stat Biosci 10:1–18

Wu YC, Chen HS, Tsai WJ, Lee SY, Yu JY (2008) Human action recognition based on layered-HMM. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Hanover, Germany, 23–26 June, pp 1453–1456

Chen Z, Qiu RC (2010) Prediction of channel state for cognitive radio using higher-order hidden Markov model. In: Proceedings of the IEEE southeast conference (SoutheastCon), ConCord, North Carolina, 18–21 March, pp 276–282

Xu C, Du C, Zhao GF, Yu S (2013) A novel model for user clicks identification based on hidden semi-Markov. J Netw Comput Appl 36(2):791–798

Alghamdi R (2016) Hidden Markov models (HMMs) and security applications. Int J Adv Comput Sci Appl 7(2):39–47

Oliver N, Horvitz E, Garg A (2002) Layered representations for human activity recognition. In: Proceedings of 4th IEEE international conference on multimodal interfaces, Pittsburgh, USA, 14–16 October, pp 3–8

Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286

Khorasani A, Daliri MR, Pooyan M (2016) Recognition of amyotrophic lateral sclerosis disease using factorial hidden Markov model. Biomed Eng 61(1):119–126

Quan C, Ren F (2016) Weighted high-order hidden Markov models for compound emotions recognition in text. Inf Sci 329:581–596

Oliver N, Garg A, Horvitz E (2004) Layered representations for learning and inferring office activity from multiple sensory channels. Comput Vis Image Underst 96(2):163–180

Senturk S, Chordia P (2011) Modeling melodic improvisation in Turkish folk music using variable-length Markov models. In: Proceedings of 12th international society for music information retrieval conference (ISMIR), Miami, Florida, USA, 24–28 October, pp 269–274

Habayeb M, Murtaza SS, Miranskyy A, Bener AB (2018) On the use of hidden Markov model to predict the time to fix bugs. IEEE Trans Softw Eng 44(12):1224–1244

Juang BH, Rabiner LR (1991) Hidden Markov models for speech recognition. Technometrics 33(3):251–272

Lee YS, Cho SB (2016) Layered hidden Markov models to recognize activity with built-in sensors on Android smartphone. Pattern Anal Appl 19(4):1181–1193

Perdikis S, Dimitrios T, Strintzis MG (2008) Recognition of humans actions using layered hidden Markov models. In: Proceedings of 1st IAPR workshop on cognitive information processing, Santorini, Greece, 9–10 June, pp 114–119

Hierarchal hidden Markov model. https://wikivisually.com/wiki/Hierarchical_ hidden_Markov_model, Accessed on 5 May 5 2019

Hidden Markov model. https://en.wikipedia.org/wiki/Hidden_Markov_model. Accessed 5 May 5 2019

Chen R, Shen W, Srinivasamurthy A, Chordia P (2012) Chord recognition using Duration-explicit hidden Markov models. In: Proceedings of 13th international society for music information retrieval conference (ISMIR 2012), Porto, Portugal, 8–12 October, pp 445–450

Seifert M, Abou-El-Ardat K, Friedrich B, Klink B, Deutsch A (2014) Autoregressive higher-order hidden Markov models: exploiting local chromosomal dependencies in the analysis of tumor expression profiles. PLOS ONE 9(6):1–15

Zhang C, Qiu J, Zheng S, Yang X (2012) Cross-layered Hidden Markov Modeling for surveillance event recognition. In: Proceedings of IEEE international conference on multimedia and expo workshop (ICMEW), Melbourne, Australia, 9–13 July, pp 175–180

Xie Y, Hu J, Tang S, Huang X (2012) A forward-backward algorithm for nested hidden semi-Markov model and application to network traffic. Comput J 56(2):229–238

Bryan JD, Levinson SE (2015) Autoregressive hidden Markov model and the speech signal. Procedia Comput Sci 61:328–333

Tanwani AK, Calinon S (2016) Learning robot manipulation tasks with task-parameterized semitied hidden semi-Markov model. IEEE Robot Autom Lett 1(1):235–242

Liang YM, Shih SW, Shih ACC, Liao HYM, Lin CC (2009) Learning atomic human actions using variable-length Markov models. IEEE Trans Syst Man Cybern Part B (Cybern) 39(1):268–280

Lee LM, Lee JC (2006) A study on high-order hidden Markov models and applications to speech recognition. In: Proceedings of 19th international conference on industrial, engineering and other applications of applied intelligent systems (IEA/AIE 2006), Annecy, France, 27–30 June, Lecture Notes in Computer Science, vol 4031, pp 682–690

Calinon S, Pistillo A, Caldwell DG (2011) Encoding the time and space constraints of a task in explicit-duration hidden Markov model. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IEEEIROS), San Francisco, CA, USA, 25–30 September, pp 3413–3418

Hoffman MD, Cook PR, Blei DM (2008) Data-driven recomposition using the Hierarchical Dirichlet process hidden Markov model. In: Proceedings of 32nd international computer music conference (ICMC), Belfast, Ireland, UK, 24–29 August, pp 1–7

Aarno D, Kragic D (2006) Layered HMM for motion intention recognition. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, Beijing, China, 9–15 October, pp 5130–5135

Cao H, Jiang D, Pei J, Chen E, Li H (2009) Towards context-aware search by learning a very large variable length hidden Markov model from search logs. In: Proceedings of the 18th international conference on world wide web (IW3C2), Madrid, Spain, 20–24 April, pp 191–200

Husmeier D (2005) Discriminating between rate heterogeneity and interspecific recombination in DNA sequence alignments with phylogenetic factorial hidden Markov models. Bioinformatics 21(2):166–172

Othman H, Aboulnasr T (2001) A simplified second-order HMM with application to face recognition. In: Proceedings of IEEE international symposium on circuits and systems (ISCAS), Sydney, Australia, May 6–9, pp 161–164

Xu R, Chen X, Zhang F (2019) Green technology innovation ecosystem based on hidden Markov model. Ekoloji 28(107):1729–1736

Groves R (2013) Automatic harmonization using a hidden semi-Markov model. In: Proceedings of 9th artificial intelligence and interactive digital entertainment conference (AIIDE), Boston, Massachusetts, USA, 14–18 October, pp 48–54

Bang JH, Cho YJ, Kang K (2017) Anomaly detection of network-initiated LTE signaling traffic in wireless sensor and actuator networks based on a Hidden semi-Markov Model. Comput Secur 65:108–120

Yip CF, Ng WL, Yau CY (2018) A hidden Markov model for earthquake prediction. Stoch Environ Res Risk Assess 32(5):1415–1434

Ozerov A, Fevotte C, Charbit M (2009) Factorial scaled hidden Markov model for polyphonic audio representation and source separation. In: Proceedings of IEEE workshop on applications of signal processing to audio and acoustics (WASPAA), Mohonk, New York, United States, 18–21 October, pp 121–124

Yue W, Hong GS, Wong YS (2010) HMM with explicit state duration for prognostics in face milling. In: Proceedings of IEEE conference on robotics, automation and mechatronics (RAM), Singapore, 28–30 June, pp 218–223

Xin G, Hamzaoui N, Antoni J (2018) Semi-automated diagnosis of bearing faults based on a hidden Markov model of the vibration signals. Measurement 127:141–166

Chen Y, Shen K, Shan SO, Kou SC (2016) Analyzing single-molecule protein transportation experiments via hierarchical hidden Markov models. J Am Stat Assoc 111(515):951–966

JingHui X, BingQuan L, XiaoLong W (2005) Principles of non-stationary hidden Markov model and its applications to sequence labeling task. In: Proceedings of international conference on natural language processing, Kanpur, India, 18–20 December lecture notes in computer science, vol 3651. Springer, Berlin, pp 827–837

Tang H, Dong C (2019) Detection of malicious domain names based on an improved hidden Markov model. Int J Wirel Mob Comput 16(1):58–65

Boussemart Y, Cummings ML (2011) Predictive models of human supervisory control behavioral patterns using hidden semi-Markov models. Eng Appl Artif Intell 24(7):1252–1262

Chen MY, Kundu A, Srihari SN (1995) Variable duration hidden Markov model and morphological segmentation for handwritten word recognition. IEEE Trans Image Process 4(12):1675–1687

Ingels P (1996) Connected text recognition using layered HMMs and token passing. Arxiv, arXiv preprint cmp-lg/9607036

Liang Y, Liu X, Lou Y, Shan B (2011) An improved noise-robust voice activity detector based on hidden semi-Markov models. Pattern Recogn Lett 32(7):1044–1053

Betkowska A, Shinoda K, Furui S (2007) Robust speech recognition using factorial HMMs for home environments. EURASIP J Adv Signal Process 2007(1):1–9

Sung-Hyun Y, Thapa K, Kabir MH, Hee-Chan L (2018) Log-viterbi algorithm applied on second-order hidden Markov Model for human activity recognition. Int J Distrib Sens Netw 14(4):1–11

Votsi I, Limnios N, Tsaklidis G, Papadimitriou E (2014) Hidden semi-Markov modeling for the estimation of earthquake occurrence rates. Commun Stat Theory Methods 43(7):1484–1502

Runsewe O, Samaan N (2017) Cloud resource scaling for big data streaming applications using a layered multi-dimensional hidden Markov model. In: Proceeding of 17th IEEE/ACM international symposium on cluster, cloud and grid computing (CCGRID), Madrid, Spain, 14–17 May, pp 848–857

Asahara A, Maruyama K, Shibasaki R (2012) A mixed autoregressive hidden-Markov-chain model applied to people’s movements. In: Proceedings of the 20th international conference on advances in geographic information systems, Redondo Beach, California, 6–9 November, pp 414–417

Zhuo Z, Zhang Y, Zhang ZL, Zhang X, Zhang J (2018) Website fingerprinting attack on anonymity networks based on profile hidden Markov model. IEEE Trans Inf Forensics Secur 13(5):1081–1095

Benetos E, Weyde T (2013) Explicit duration hidden Markov Models for multiple-instrument polyphonic music transcription. In: Proceedings of 14th international society for music information retrieval conference (ISMIR), Curitiba, Brazil, 4–8 November, pp 269–274

Yao L, Wang J, Chen A, Wang Y (2018) V2X routing in a VANET based on the hidden Markov model. IEEE Trans Intell Transp Syst 19(3):889–899

Liu AA, Li K, Kanade T (2012) A semi-Markov model for mitosis segmentation in time-lapse phase contrast microscopy image sequences of stem cell populations. IEEE Trans Med Imaging 31(2):359–369

Pertsinidou CE, Tsaklidis G, Papadimitriou E, Limnios N (2017) Application of hidden semi-Markov models for the seismic hazard assessment of the North and South Aegean Sea, Greece. J Appl Stat 44(6):1064–1085

Lu S, Lin G, Liu H, Ye C, Que H, Ding Y (2019) A weekly load data mining approach based on hidden Markov model. IEEE Access 7:34609–34619

Poritz A (1982) Linear predictive hidden Markov models and the speech signal. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP’82), Paris, France, 3–5 May, pp 1291–1294

Putland RL, Ranjard L, Constantine R, Radford CA (2018) A hidden Markov model approach to indicate Bryde’s whale acoustics. Ecol Indic 84:479–487

Martindale CF, Hoenig F, Strohrmann C, Eskofier BM (2017) Smart annotation of cyclic data using hierarchical hidden Markov Models. Sensors 17(10):1–16

Rabiner LR, Levinson SE, Sondhi MM (1983) On the application of vector quantization and hidden Markov models to speaker-independent, isolated word recognition. Bell Syst Tech J 62(4):1075–1105

Ghahramani Z, Jordan MI (1996) Factorial hidden Markov models. Adv Neural Inf Process Syst 9:472–478

Liu S, Zheng K, Zhao L, Fan P (2019) A driving intention prediction method based on hidden Markov model for autonomous driving. ArXiv preprint arXiv:1902.09068

Kabir MH, Hoque MR, Thapa K, Yang SH (2016) Two-layer hidden Markov model for human activity recognition in home environments. Int J Distrib Sens Netw 12(1):1–12

Joo T, Seo M, Shin D (2019) An adaptive approach for determining batch sizes using the hidden Markov model. J Intell Manuf 30(2):917–932

Rose RC, Paul DB (1990) A hidden Markov model based keyword recognition system. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Albuquerque, New Mexico, USA, 3–6 April, pp 129–132

Narimatsu H, Kasai H (2017) State duration and interval modeling in hidden semi-Markov model for sequential data analysis. Ann Math Artif Intell 81(3–4):377–403

Ai B, Fan Z, Gao RX (2014) Occupancy estimation for smart buildings by an auto-regressive hidden Markov model. In: Proceedings of American control conference (ACC), Portland, Oregon, USA, 4–6 June, pp 2234–2239

Zhao J, Zhoub J, Su W, Liu F (2017) Online outlier detection for time-varying time series on improved ARHMM in geological mineral grade analysis process. Earth Sci Res J 21(3):135–139

Yue SG, Jiao P, Zha YB, Yin QJ (2015) A logical hierarchical hidden semi-Markov model for team intention recognition. Discrete Dyn Nat Soc 2015:1–20

Duan C, Makis V, Deng C (2019) Optimal Bayesian early fault detection for CNC equipment using hidden semi-Markov process. Mech Syst Signal Process 122:290–306

Solaimanpour S, Doshi P (2017) A layered HMM for predicting motion of a leader in multi-robot settings. In: Proceedings of IEEE international conference on robotics and automation (ICRA), Singapore, 29 May–3 June, pp 788–793

Xiong H, Mamon R (2016) A self-updating model driven by a higher-order hidden Markov chain for temperature dynamics. J Comput Sci 17(1):47–61

Stanculescu I, Williams CKI, Freer Y (2014) Autoregressive hidden Markov models for the early detection of neonatal sepsis. IEEE J Biomed Health Inform 18(5):1560–1570

Zhu DM, Lu J, Ching WK, Siu TK (2017) Discrete-time optimal asset allocation under higher-order hidden Markov model. Econ Model 66:223–232

Zhu K, Liu T (2018) Online tool wear monitoring via hidden semi-Markov model with dependent durations. IEEE Trans Ind Inform 14(1):69–78

Zhang M, Jiang X, Fang Z, Zeng Y, Xu K (2019) High-order Hidden Markov Model for trend prediction in financial time series. Physica A Stat Mech Appl 517:1–12

Barnard M, Odobez JM (2005) Sports event recognition using layered HMMs. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Amsterdam, Netherlands, 6–8 July, pp 1150–1153

Sasou A, Goto M, Hayamizu S, Tanaka K (2005) An auto-regressive, non-stationary excited signal parameter estimation method and an evaluation of a singing-voice recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Philadelphia, Pennsylvania, USA, 18–23 March, pp 237–240

Sonnhammer EL, Heijne GV, Krogh A (1998) A hidden Markov model for predicting transmembrane helices in protein sequences. In: Proceeding of 6th international conference on intelligent systems for molecular biology (ISMB), Montreal, Canada, 28 June–1 July, pp 175–182

Liu J, Zhu L, Wang Y, Liang X, Hyyppa J, Chu T, Liu K, Chen R (2015) Reciprocal estimation of pedestrian location and motion state toward a smartphone geo-context computing solution. Micromachines 6(6):699–717

Liu T, Zhu K, Zeng L (2018) Diagnosis and prognosis of degradation process via hidden semi-Markov model. IEEE/ASME Trans Mechatron 23(3):1456–1466

Lin HP, Tseng MC (2009) Modelling fading properties for mobile satellite link channels using non-stationary hidden Markov model. IET Microw, Antennas Propag 3(1):171–180

Xiao S, Dong M (2015) Hidden semi-Markov model-based reputation management system for online to offline (O2O) e-commerce markets. Decis Supp Syst 77:87–99

Chordia P, Sastry A, entrk S (2011) Predictive Tabla modelling using variable-length Markov and hidden Markov models. J New Music Res 40(2):105–118

Petersen BK, Mayhew MB, Ogbuefi KO, Greene JD, Liu VX, Ray P (2018) Modeling sepsis progression using hidden markov models. ArXiv preprint arXiv:1801.02736

Pikrakis A, Theodoridis S, Kamarotos D (2006) Classification of musical patterns using variable duration hidden Markov models. IEEE Trans Audio Speech Lang Process 14(5):1795–1807

Bianne-Bernard AL, Menasri F, Likforman-Sulem L, Mokbel C, Kermorvant C (2012) Variable length and context-dependent HMM letter form models for Arabic handwritten word recognition. In: Proceedings of document recognition and retrieval conference, international society for optics and photonics, Burlingame, California, USA, 22–26 January, pp 1–8

Wei H, He J, Tan J (2011) Layered hidden Markov models for real-time daily activity monitoring using body sensor networks. Knowl Inf Syst 29(2):479–494

Chatzis SP, Demiris Y (2012) A reservoir-driven non-stationary hidden Markov model. Pattern Recognit 45(11):3985–3996

Soruri M, Zahiri SH, Sadri J (2013) A new approach of training Hidden Markov Model by PSO algorithm for gene sequence modeling. In: Proceeding of 1st Iranian conference on pattern recognition and image analysis (PRIA), Birjand, Iran, 6–8 March, pp 1–4

Bahl LR, Brown PF, De Souza PV, Mercer RL (1986) Maximum mutual information estimation of hidden Markov model parameters for speech recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP’86), Tokyo, Japan, 7–11 April, pp 49–52

Quillen C (2012) Autoregressive HMM speech synthesis. In: Proceedings of IEEE international conference on acoustics, speech and signal processing (ICASSP), Kyoto, Japan, 25–30 March, pp 4021–4024

Marco E, Meuleman W, Huang J, Glass K, Pinello L, Wang J, Kellis M, Yuan GC (2017) Multi-scale chromatin state annotation using a hierarchical hidden Markov model. Nat Commun 8:1–9

Wu H, Yu Z, Wang Y (2017) Real-time FDM machine condition monitoring and diagnosis based on acoustic emission and hidden semi-Markov model. Int J Adv Manuf Technol 90(5–8):2027–2036

Roman-Galvez R, Roman-Roldan R, Martinez-Aroza J, Gomez-Lopera JF (2015) Semi-hidden Markov models for generation and analysis of sequences. Math Comput Simul 118:320–328

Senturk S (2011) Computational modeling of improvisation in Turkish folk music using variable-length Markov models. Master of Science in Music Technology dissertation, Georgia Institute of Technology, Atlanta, Georgia, 1st edn

Bonfigli R, Principi E, Fagiani M, Severini M, Squartini S, Piazza F (2017) Non-intrusive load monitoring by using active and reactive power in additive Factorial Hidden Markov Models. Appl Energy 208:1590–1607

Malesevic N, Markovic D, Kanitz G, Controzzi M, Cipriani C, Antfolk C (2018) Vector Autoregressive Hierarchical Hidden Markov Models for extracting finger movements using multichannel surface EMG signals. Complexity 2018:1–12

Lee LM, Jean FR (2016) High-order hidden Markov model for piecewise linear processes and applications to speech recognition. J Acoust Soc Am 140(2):204–210

Yanchenko AK (2017) Classical music composition using hidden Markov models. Master’s Thesis, Duke University, Durham, North Carolina, 1st edn

Liang W, Zhang Y, Tan J, Li Y (2014) A novel approach to ECG classification based upon two-layered HMMs in body sensor networks. Sensors 14(4):5994–6011

Patel M, Miro JV, Kragic D, Ek CH, Dissanayake G (2014) Learning object, grasping and manipulation activities using hierarchical HMMs. Auton Robots 37(3):317–331

Mari JF, Fohr D, Junqua JC (1996) A second-order HMM for high Performance word and phoneme-based continuous speech recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Atlanta, Georgia, USA, 7–10 May, pp 435–438

Mari JF, Haton JP, Kriouile A (1997) Automatic word recognition based on second-order hidden Markov models. IEEE Trans Speech Audio Process 5(1):22–25

Yang WJ, Lee JC, Chang YC, Wang HC (1998) Hidden Markov model for Mandarin lexical tone recognition. IEEE Trans Acoust Speech Signal Process 36(7):988–992

Xiong C, Yang D, Zhang L (2018) A high-order hidden Markov model and its applications for dynamic car ownership analysis. Transp Sci 52(6):1365–1375

Yamato J, Ohya J, Ishii K (1992) Recognizing human action in time-sequential images using hidden Markov model. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, Champaign, Illinois, USA, 15–18 June, pp 379–385

Kolter JZ, Jaakkola T (2012) Approximate inference in additive factorial HMMs with application to energy disaggregation. In: Proceedings of the 15th international conference on artificial intelligence and statistics (AISTATS), La Palma, Canary Islands, 21–23 April, pp 1472–1482

Varga AP, Moore RK (1990) Hidden Markov model decomposition of speech and noise. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Albuquerque, New Mexico, USA, 3–6 April, pp 845–848

Jiang J, Chen R, Chen M, Wang W, Zhang C (2019) Dynamic fault prediction of power transformers based on hidden Markov model of dissolved gases analysis. IEEE Trans Power Deliv 34(4):1393–1400

Kerk MVD, Onorato DP, Criffield MA, Bolker BM, Augustine BC, McKinley SA, Oli MK (2015) Hidden semi-Markov models reveal multiphasic movement of the endangered Florida panther. J Anim Ecol 84(2):576–585

Glodek M, Layher G, Schwenker F, Palm G Recognizing human activities using a layered HMM architecture. In: Proceedings of international conference on artificial neural networks (ICANN 2012), Lausanne, Switzerland, September 11–14, pp 677–684

Alshamaa D, Chkeir A, Mourad-Chehade F, Honeine P (2019) A hidden Markov model for indoor trajectory tracking of elderly people. In: Proceedings of IEEE sensors applications symposium (SAS), Sophia Antipolis, France, 11–13 March, pp 1–7

Dumont T (2014) Context tree estimation in variable length hidden Markov models. IEEE Trans Inf Theory 60(6):3196–3208

Manogaran G, Vijayakumar V, Varatharajan R, Kumar PM, Sundarasekar R, Hsu CH (2018) Machine learning based big data processing framework for cancer diagnosis using hidden Markov model and GM clustering. Wirel Pers Commun 102(3):2099–2116

Seifert M, Gohr A, Strickert M, Grosse I (2012) Parsimonious higher-order hidden Markov models for improved array-CGH analysis with applications to Arabidopsis thaliana. PLOS Comput Biol 8(1):1–15

Durrieu JL, Thiran JP (2013) Source/filter factorial hidden Markov model, with application to pitch and formant tracking. IEEE Trans Audio Speech Lang Process 21(12):2541–2553

Nakamura E, Cuvillier P, Cont A, Ono N, Sagayama S (2015) Autoregressive hidden semi-Markov model of symbolic music performance for score following. In: Proceedings of 16th international society for music information retrieval conference (ISMIR), Malaga, Spain, 26–30 October

Xiao Q, Fang Y, Liu Q, Zhou S (2018) Online machine health prognostics based on modified duration-dependent hidden semi-Markov model and high-order particle filtering. Int J Adv Manuf Technol 94(1–4):1283–1297

Krogh AS (1994) Hidden Markov models for labeled sequences. In: Proceedings of the 12th IAPR international conference on pattern recognition (ICPR), conference C: signal processing, Jerusalem, Israel, 9–13 October, pp 140–144

Cai J, Luo JZ, Lei F (2016) Analyzing network protocols of application layer using hidden Semi-Markov model. In: Mathematical Problems in Engineering, pp 1–15

Weiland M, Smaill A, Nelson P (2005) Learning musical pitch structures with Hierarchical Hidden Markov model, 1st edn. University of Edinburgh, Scotland

Churchill GA (1992) Hidden Markov chains and the analysis of genome structure. Comput Chem 16(2):107–115

Hidden Semi-Markov model. https://en.wikipedia.org/wiki/Hidden_semi-Markov_model, Accessed on 5 May 5 2019

Dong M (2008) A novel approach to equipment health management based on auto-regressive hidden semi-Markov model (AR-HSMM). Sci China Ser F Inf Sci 51(9):1291–1304

Raman N, Maybank SJ (2016) Activity recognition using a supervised non-parametric hierarchical HMM. Neurocomputing 199:163–177

Chen X, Zhang H, MacKenzie AB, Matinmikko M (2014) Predicting spectrum occupancies using a non-stationary hidden Markov model. IEEE Wirel Commun Lett 3(4):333–336

Kerr R (2011) Melodic analysis using Hierarchical Hidden Markov models, Doctoral dissertation, School of Informatics, The University of Edinburgh, Scotland, 1st edn

Karaman S, Benois-Pineau J, Dovgalecs V, Megret R, Pinquier J, Andre-Obrecht R, Gaestel Y, Dartigues JF (2014) Hierarchical Hidden Markov Model in detecting activities of daily living in wearable videos for studies of dementia. Multimed Tools Appl 69(3):743–771

Levinson SE, Rabiner LR, Sondhi MM (1983) Speaker independent isolated digit recognition using hidden Markov models. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Boston, Massachusetts, USA, 14–16 April, pp 1049–1052

Kong D, Chen Y, Li N (2017) Hidden semi-markov model-based method for tool-wear estimation in milling process. Int J Adv Manuf Technol 92(9–12):3467–3657

Liu Q, Dong M, Lv W, Geng X, Li Y (2015) A novel method using adaptive hidden semi-Markov model for multi-sensor monitoring equipment health prognosis. Mech Syst Signal Process 64–65:217–232

Barber C, Bockhorst J, Roebber P (2010) Auto-regressive HMM inference with incomplete data for short-horizon wind forecasting. In: Proceedings of 24th Advances in neural information processing systems conference, Vancouver, British Columbia, Canada, 6–9 December, pp 136–144

Razin YS, Pluckter K, Ueda J, Feigh K (2017) Predicting task intent from surface electromyography using layered hidden Markov models. IEEE Robot Autom Lett 2(2):1180–1185

Thede SM, Harper MP (1997) A second-order hidden Markov model for part-of-speech tagging. In: Proceedings of the 37th annual meeting of the Association for Computational Linguistics, California, USA, 6–9 July, pp 175–182

Dang S, Chaudhury S, Lall B, Roy PK (2017) Learning effective connectivity from fMRI using autoregressive hidden Markov model with missing data. J Neurosci Methods 278(8):87–100

Lee KF, Hon HW (1989) Speaker-independent phone recognition using hidden Markov models. IEEE Trans Acoust Speech Signal Process 37(11):1641–1648

Dong M, Peng Y (2011) Equipment PHM using non-stationary segmental hidden semi-Markov model. Robot Comput Integr Manuf 27(3):581–590

Karg M, Seiberl W, Kreuzpointner F, Haas JP, Kulic D (2015) Clinical gait analysis: comparing explicit state duration HMMs using a reference-based index. IEEE Trans Neural Syst Rehabil Eng 23(2):319–331

Benouareth A, Ennaji A, Sellami M (2008) Semi-continuous HMMs with explicit state duration for unconstrained Arabic word modeling and recognition. Pattern Recognit Lett 29(12):1742–1752

Glodek M, Bigalke L, Schels M, Schwenker F (2011) Incorporating uncertainty in a layered HMM architecture for human activity recognition. In: Proceedings of joint ACM workshop on Human gesture and behavior understanding, Scottsdale, Arizona, USA, 1 December, pp 33–34

Schwartz R, Chow Y, Roucos S, Krasner M, Makhoul J (1984) Improved hidden Markov modeling of phonemes for continuous speech recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP’84), San Diego, California, USA, 19–21 March, pp 21–24

Guan X, Raich R, Wong WK (2016) Efficient multi-instance learning for activity recognition from time series data using an auto-regressive hidden Markov model. In: Proceedings of 33rd international conference on machine learning, New York, USA, 19–24 June, pp 2330–2339

Juang BH (1984) On the hidden Markov model and dynamic time warping for speech recognition—a unified view. AT&T Bell Lab Tech J 63(7):1213–1243

Li X, Makis V, Zuo H, Cai J (2018) Optimal Bayesian control policy for gear shaft fault detection using hidden semi-Markov model. Comput Ind Eng 119:21–35

Chen C, Liang J, Zhao H, Hu H, Tian J (2009) Factorial HMM and parallel HMM for gait recognition. IEEE Trans Syst Man Cybern Part C (Appl Rev) 39(1):114–123

Pastell M, Frondelius L (2018) A hidden Markov model to estimate the time dairy cows spend in feeder based on indoor positioning data. Comput Electron Agric 152:182–185

Du Y, Murani E, Ponsuksili S, Wimmers K (2014) BiomvRhsmm: genomic segmentation with hidden semi-Markov model. BioMed Res Int 2014:1–12

Coast DA, Stern RM, Cano CG, Briller SA (1990) An approach to cardiac arrhythmia analysis using hidden Markov models. IEEE Trans Biomed Eng 37(9):826–836

Sin B, Kim JH (1995) Nonstationary hidden Markov model. Signal Process 46(1):31–46

Li Z, He Y, Chu F, Han J, Hao W (2006) Fault recognition method for speed-up and speed-down process of rotating machinery based on independent component analysis and Factorial Hidden Markov Model. J Sound Vib 291(1–2):60–71

Ullah I, Ahmad R, Kim D (2018) A prediction mechanism of energy consumption in residential buildings using hidden Markov model. Energies 11(2):1–20