And what should I stop?

Another benefit of documenting your priorities is you can share the list with others. When they ask you to do something new, you can point to your list and ask them which item gets bumped. Your priority list is also your opportunity cost list.