- A neural network is first trained on a large general-purpose dataset using significant amounts of computational resources, and then fine-tuned for the task at hand using a much smaller amount of data and compute resources.
- The use of pre-trained networks has exploded in recent years as the industrialization of machine learning has taken over many fields and data has increased.
