Sumanth's Personal Website · May 1, 2023
Integrating $(IA)^3$ with HuggingFace's PEFT
0Sign in to vote or save
This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.
This was a simple course project for the CSE 256: Natural Language Processing course, Spring 2023 at UCSD. Parameter-efficient fine tuning (PEFT) methods are all the rage now, given that they enable you to finetune large models like Falcon-7B on just Google Colab ! A new state-of-the-art method called $(IA)^3$ ( Infused Adapter by Inhibiting and Amplifying Inner Activations ) was proposed…
Comments
Nothing yet. Say the first thing.
Sign in to join the conversation.