On AI-assisted writing in graduate school
What is the proper role of AI 'assistance' in graduate student writing? It depends on what you mean by 'graduate'.
Hacking semantics
A Natural Language Processing blog: research findings, methodology squibs, and thoughts on peer review.
Latest posts
AI ‘News’ Content Farms Are Easy to Make and Hard to Detect
AI 'news' produced by LLM-powered content farms are flooding the web. They are currently very cheap and easy to produce, even beyond English, and currently we have no technical means for detecting them 'in the wild'.
A Sanity Check on ‘Emergent Properties’ in Large Language Models
One of the often-repeated claims about LLMs is that they have 'emergent properties'. Unfortunately, in most cases the speaker/writer does not clarify what they mean by 'emergence'. But misunderstandings on this issue can have big implications for the research agenda, as well as public policy.
I am joining ACL Rolling Review
It's official: I joined the ACL Rolling Review team as an editor-in-chief, and I'd like to share some brief thoughts on this.
[ACL 2023] Peer Review Report
This post (at ACL conference website) summarizes the analysis of ACL’23 peer review process: https://2023.aclweb.org/blog/review-report/. The full analysis is available in this huge report that is up on ACL Anthology:
Closed AI Models Make Bad Baselines
Will GPT-4 become a universally expected baseline in NLP research, like BERT in its time? Basic scientific methodology demands otherwise.
[ACL 2023] Paper-Reviewer Matching
As a program chair of ACL’23, I was the lead author for this blog post on the conference website that summarized our approach to peer-review matching: https://2023.aclweb.org/blog/reviewer-assignment/ I was also the lead developer of this approach to matching. Post-mortem analysis of how it worked is available in this report:
[ACL 2023] Generative AI Policy
This blog post (on the conference website) summarized our approach to the use of generative AI in ACL conference submissions and reviewing: https://2023.aclweb.org/blog/reviewer-assignment/. I was its lead author.
The attribution problem with generative AI
Some argue that any publicly available text/art data is fair game for commercial models because human text/art also has sources. But unlike models, we know when attribution is due...
Field Notes on Hybrid Conferences (EMNLP 2021)
Field notes from EMNLP 2021, the first hybrid *ACL conference.