Universiteit Leiden

nl en

Lezing

Discontinuous Constituency and BERT: Two Case Studies of Dutch

Datum
dinsdag 24 januari 2023
Tijd
Bezoekadres
Snellius
Niels Bohrweg 1
2333 CA Leiden
Zaal
176

Or attend via Zoom

Zoom link

In this talk, I discuss two recent case studies in which we set out to quantify the syntactic capacity of BERT in the evaluation regime of non-context free patterns, as occurring in Dutch. We devised test suites based on a mildly context-sensitive formalism, from which we derive grammars that capture the linguistic phenomena of control verb nesting and verb raising, and other verb cluster formations. The grammars, paired with a small lexicon, provide us with a large collection of naturalistic utterances annotated with verb-subject pairings, that serve as the evaluation test bed for an attention-based span selection probe. Our results, backed by extensive analysis, suggest that the models investigated fail in the implicit acquisition of the dependencies examined. If time permits, we compare the two different strategies for generating test cases, and look into future extensions of this work.

Deze website maakt gebruik van cookies.  Meer informatie.