movinghoon · GitHub

scheme

torchrun --nproc_per_node 8 train.py \
    --arch deit-small \
    --data-dir $DATA_DIR \
    --name $NAME \
    --entity $ENTITY \
    --project $PROJECT
@inproceedings{
    lee2024dtem,
    title={Learning to Merge Tokens via Decoupled Embedding for Efficient Vision Transformers},
    author={Dong Hoon Lee and Seunghoon Hong},
    booktitle={Conference on Neural Information Processing Systems},
    year={2024},
}

Read the original on github.com ↗