University of Cambridge > Talks.cam > NLIP Seminar Series > MultiBLiMP: A Multilingual Benchmark of Linguistic Minimal Pairs

  Browse A-Z

Log in

Googledetails Microsoftdetails

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

MultiBLiMP: A Multilingual Benchmark of Linguistic Minimal Pairs

Download to your calendar using vCal

If you have a question about this talk, please contact Suchir Salhan .

We introduce MultiBLiMP, a massively multilingual benchmark of linguistic minimal pairs, covering 101 languages, 6 linguistic phenomena and containing more than 120.000 minimal pairs. Our minimal pairs are created using a fully automated pipeline, leveraging the large-scale linguistic resources of Universal Dependencies and UniMorph. MultiBLiMP evaluates linguistic abilities of LLMs at an unprecedented multilingual scale, and highlights the shortcomings of the current state-of-the-art in modelling low-resource languages.

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Alison Richard Building, Sidgwick Site, Room SG2 7 West Road, Cambridge, CB3 9DT Online, Zoom, Register at https://tinyurl.com/22y5m2st WiSETI

Other talks

Group Work Title to be confirmed Title to be confirmed Title TBC Teams Announced Why people with schizophrenia die earlier? Mortality and accelerated ageing
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity