From Harmony to Probability: The Problem of Identifiability and a Bayesian Inference Perspective on Greek Nominal Stress
Source abstract
Abstract
Maximum Entropy and Gradient Harmonic Grammar are well-established grammatical models for the analysis of linguistic phenomena, but we demonstrate that their probabilistic versions are inherently unidentifiable, employing parameters that cannot be uniquely determined from empirical data. Through examining Greek nominal stress patterns, we propose a reparameterization approach that introduces two identifiable, phonologically interpretable, parameters. We employ both point estimation and Bayesian inference to calculate their values. The latter approach yields reliable parameter estimates with quantified uncertainty that point estimation cannot offer. Our findings shed light on lesser-known aspects of Greek stress and offer a robust methodological framework for probabilistic phonological modeling across languages.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Phonetics and Phonology Research · Syntax, Semantics, Linguistic Variation · Language Development and Disorders
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Physics, Aristotle University of Thessaloniki, University Campus, 54124 Thessaloniki, Greece
Department of Mediterranean Studies, University of the Aegean, 85132 Rhodes, Greece
School of Philology, Department of Linguistics, Aristotle University of Thessaloniki, University Campus, 54124 Thessaloniki, Greece
Funding
European Union—NextGenerationEU
References (67)
Show source-provided references
1. Legendre, G., Miyata, Y., and Smolensky, P. (1990, January 25–28). Harmonic Grammar—A formal multi-level connectionist theory of linguistic well-formedness: Theoretical foundations. Proceedings of the 12th Conference of the Cognitive Science Society, Cambridge, MA, USA.
2. Smolensky, P., and Legendre, G. (2006). The Harmonic Mind: From Neural Computation to Optimality-Theoretic Grammar, MIT Press.
3. Prince, A., and Smolensky, P. (2004). Optimality Theory: Constraint Interaction in Generative Grammar, Blackwell. Originally published 1993.10.1002/9780470759400 ↗
4. Kiparsky, P. (1993). An OT perspective on phonological variation. Rutgers Optimality Workshop 1, Rutgers University. Also presented at NWAVE 1994, Stanford University.
5. Hinskens, F., van Hout, R., and Wetzels, L. (1997). Deriving variation from grammar. Variation, Change and Phonological Theory, John Benjamins.10.1075/cilt.146 ↗
6. Chambers, J.K., Trudgill, P., and Schilling-Estes, N. (2002). Variation and phonological theory. The Handbook of Language Variation and Change, Blackwell.10.1111/b.9781405116923.2003.00001.x ↗
7. Coetzee, A.W. (2004). What It Means to Be a Loser: Non-Optimal Candidates in Optimality Theory. [Ph.D. Thesis, University of Massachusetts Amherst].
8. Variation as accessing ‘non-optimal’ candidates10.1017/S0952675706000984 ↗
9. Boersma, P. (1998). Functional Phonology: Formalizing the Interactions Between Articulatory and Perceptual Drives, Holland Academic Graphics.
10. Empirical tests of the Gradual Learning Algorithm10.1162/002438901554586 ↗
11. Rumelhart, D.E., McClelland, J.L., and The PDP Research Group (1986). Information processing in dynamical systems: Foundations of Harmony Theory. Parallel Distributed Processing, Volume 1: Explorations in the Microstructure of Cognition, MIT Press/Bradford Books.
12. Spenader, J., Eriksson, A., and Dahl, Ö. (2003, January 26–27). Learning OT constraint rankings using a maximum entropy model. Proceedings of the Stockholm Workshop on Variation Within Optimality Theory, Stockholm, Sweden.
13. Learning phonology with substantive bias: An experimental and computational study of velar palatalization10.1207/s15516709cog0000_89 ↗
14. Zaenen, A., Simpson, J., King, T.H., Grimshaw, J., Maling, J., and Manning, C. (2007). Maximum entropy models and stochastic Optimality Theory. Architectures, Rules, and Preferences: Variations on Themes by Joan W. Bresnan, CSLI Publications.
15. A maximum entropy model of phonotactics and phonotactic learning10.1162/ling.2008.39.3.379 ↗
16. Jesney, K. (2007, January 6–8). The locus of variation in weighted constraint grammars. Presented at the Workshop on Variation, Gradience and Frequency in Phonology, Stanford University, Stanford, CA, USA.
17. Goldsmith, J., Riggle, J., and Yu, A.C.L. (2011). The place of variation in phonological theory. Handbook of Phonological Theory, Blackwell. [2nd ed.].10.1002/9781444343069 ↗
18. McCarthy, J.J., and Pater, J. (2016). Convergence properties of a gradual learning algorithm for Harmonic Grammar. Harmonic Grammar and Harmonic Serialism, Equinox.
19. Jesney, K., O’Hara, C., Smith, C., and Walker, R. (2016, January 21–26). Varieties of Noisy Harmonic Grammar. Proceedings of the 2016 Annual Meeting in Phonology, Los Angeles, CA, USA.
20. Comparing MaxEnt and Noisy Harmonic Grammar
21. On structural identifiability10.1016/0025-5564(70)90132-X ↗
22. Walter, É., and Pronzato, L. (1997). Identification of Parametric Models from Experimental Data, Springer.
23. Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood10.1093/bioinformatics/btp358 ↗
24. DiStefano, J. (2015). Dynamic Systems Biology Modeling and Simulation, Academic Press.
25. Wiese, R. (2000). The Phonology of German, Oxford University Press.
26. Smolensky, P., and Goldrick, M. (2025, July 07). Gradient Symbolic Representations in Grammar: The Case of French Liaison. Ms., Microsoft Research AI and Johns Hopkins University & Northwestern University. Rutgers Optimality Archive 1286. Available online: http://roa.rutgers.edu.
27. Clem, E., Dawson, V., Shen, A., Skilton, A.H., Bacon, G., Cheng, A., and Maier, E.H. (2016). Predicting the unpredictable: Capturing the apparent semi-regularity of rendaku voicing in Japanese through harmonic grammar. Proceedings of BLS 42, Berkeley Linguistic Society.
28. Faust, N., and Smolensky, P. (2025, December 23). Activity as an Alternative to Autosegmental Association. Available online: https://noamfaust.wordpress.com/wp-content/uploads/2017/02/activity-as-an-alternative-to-autosegmental-association.pdf.
29. Changing shape according to strength: Evidence from root allomorphy in Greek10.1515/tlr-2019-2029 ↗
30. Hucklebridge, S., and Nelson, M. (2018). Symbolic Representations in the Output: A case study from Moses Columbian Salishan stress. Proceedings of NELS 48, GLSA.
31. Faded copies: Reduplication as distribution of activity
32. Gradient symbolic representations in Harmonic Grammar10.1111/lnc3.12473 ↗
33. On identifiability of nonlinear ODE models and applications in viral dynamics10.1137/090757009 ↗
34. Walter, E. (1987). Identifiability of model parameters. Identifiability of Parametric Models, Pergamon Press.
35. Chapter 19—Identifiability10.1016/S1043-4526(08)60036-4 ↗
36. Τονισμός στα ελληνικά [Stress in Greek]
37. Υπολογιστική επεξεργασία του τονισμού της Νέας Ελληνικής [Computational processing of Modern Greek stress]
38. Hulst, H.V. (1999). Greek word accent. Word Prosodic Systems in the Languages of Europe, Mouton de Gruyter.10.1515/9783110197082.1.3 ↗
39. Revithiadou, A. (1999). Headmost Accent Wins: Head Dominance and Ideal Prosodic Form in Lexical Accent Systems, Holland Academic Graphics.
40. Blaho, S., Bye, P., and Krämer, M. (2007). Colored turbid accents and containment: A case study from lexical stress. Freedom of Analysis?, De Gruyter.10.1515/9783110198591 ↗
41. Athanasopoulou, E.M. (2003). Irregular accent patterns in Correspondence Theory. Selected Papers on Theoretical and Applied Linguistics from ISTAL 15, Aristotle University of Thessaloniki.
42. Modern Greek accent and faithfulness constraints in OT10.1016/j.lingua.2006.05.008 ↗
43. Stress at the interface: Phases, accents and dominance
44. Apostolouda, V. (2018). Πειραματικές Διερευνήσεις στον Τονισμό της Ελληνικής [Experimental Investigations on Greek Stress]. [Ph.D. Thesis, Aristotle University of Thessaloniki].
45. Heinz, J., Goedemans, R., and Hulst, H.V. (2016). One or many? In search of the default stress in Greek. Dimensions of Stress, Cambridge University Press.
46. Kyparissiadis, A., van Heuven, W.J.B., Pitchford, N.J., and Ledgeway, T. (2017). GreekLex 2: A comprehensive lexical database with part-of-speech, syllabic, phonological, and stress information. PLoS ONE, 12.10.1371/journal.pone.0172493 ↗
47. IPLR: An online resource for Greek word-level and sublexical information10.1007/s10579-010-9130-z ↗
48. Anastassiadis-Symeonidis, A. (2002). Aντίστροφο λεξικό της Νέας Ελληνικής [Reverse Dictionary of Modern Greek], Institute of Modern Greek Studies, Manolis Triantafyllidis Foundation.
49. Phadnis, S., Spellerberg, C., and Wilkinson, B. (2024). Beyond unpredictability: A GHG analysis of Greek noun stress. Proceedings of NELS 54, Volume Two, GLSA.
50. Apostolouda, V. (2012). O Τονισμός των Oυσιαστικών της Ελληνικής: Μια Πειραματική Προσέγγιση [The Stress of Greek Nouns: An Experimental Approach]. [Master’s Thesis, Aristotle University of Thessaloniki].
51. Bernardo, J.M., and Smith, A.F.M. (2000). Bayesian Theory, Wiley.
52. Bolstad, W.M. (2007). Introduction to Bayesian Statistics, Wiley. [2nd ed.].10.1002/9780470181188 ↗
53. Lee, P.M. (2012). Bayesian Statistics: An Introduction, Wiley. [4th ed.].
54. Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A., and Rubin, D.B. (2013). Bayesian Data Analysis, Chapman and Hall/CRC. [3rd ed.].10.1201/b16018 ↗
55. Kruschke, J.K. (2015). Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan, Academic Press. [2nd ed.].10.1016/B978-0-12-405888-0.00008-8 ↗
56. Goldwater, S., and Johnson, M. (2004, January 26). Priors in Bayesian learning of phonological rules. Proceedings of the Seventh Meeting of the ACL Special Interest Group in Computational Phonology, Barcelona, Spain.10.3115/1622153.1622158 ↗
57. Lin, Y. (2005). Learning Features and Segments from Waveforms: A Statistical Model of Early Phonological Acquisition. [Ph.D. Thesis, UCLA].
58. Shortlist B: A Bayesian model of continuous speech recognition10.1037/0033-295X.115.2.357 ↗
59. Automated reconstruction of ancient languages using probabilistic models of sound change10.1073/pnas.1204678110 ↗
60. Kan, S., Moore-Cantwell, C., and Staubs, R. (2013). Bayesian analysis of non-native cluster production. Proceedings of NELS 40, Volume Two, GLSA.
61. PyMC: Bayesian stochastic modelling in Python10.18637/jss.v035.i04 ↗
62. Probabilistic programming in Python using PyMC310.7717/peerj-cs.55 ↗
63. PyMC: A modern, and comprehensive probabilistic programming framework in Python10.7717/peerj-cs.1516 ↗
64. Frequency bias in phonological variation10.1007/s11049-012-9179-z ↗
65. When grammar gets noisy: A comparative study of register-driven variation
66. A Gradient Harmonic Grammar account of nasals in extended phonological words10.5565/rev/catjl.330 ↗
67. Extraction from NP, frequency, and Minimalist Gradient Harmonic Grammar10.1515/ling-2020-0049 ↗