TAN Without a Burn: Scaling Laws of DP-SGD

This repository hosts python code for the paper: TAN Without a Burn: Scaling Laws of DP-SGD.

Installation

Via pip and anaconda

conda create -n "tan" python=3.9
conda activate tan
pip install -r ./requirements.txt

Quick Start

For all commands, set max_physical_batch_size to something that fits your GPU memory.

WideResNet on CIFAR-10

First imitate training with