Do LLM's Learn Transferable Skills?

When an LLM is trained to be good at one task, will it also get better at other tasks? For example, if an LLM is trained to be good at formal logic, will it also be good at making informal logical arguments? I investigate these questions by studying correlations in eval performance.