# Types of Fine Tuning

### <mark style="color:purple;">Supervised Fine-Tuning</mark>

Supervised is when <mark style="color:yellow;">you tell the model what the answer is</mark> - the most basic type

* **Definition**: Supervised fine-tuning involves training a model on a <mark style="color:yellow;">labeled dataset,</mark> where each piece of data (like a sentence or image) is paired with a correct answer or label.
* **Process**: The model learns by comparing its predictions to these correct answers and adjusting itself to improve accuracy.
* **Example**: Training a language model to translate sentences by using a dataset where each English sentence is paired with its French translation.

### <mark style="color:purple;">Unsupervised Fine-Tuning</mark>

* **Definition**: Unsupervised fine-tuning does not use labeled data. Instead, the <mark style="color:yellow;">model learns patterns or features from the data itself</mark> without explicit guidance on what is correct.
* **Process**: The model tries to find structure in the data, like grouping similar things together or predicting parts of the data based on other parts.
* **Example**: Training a model to group news articles into topics without knowing in advance what the topics are.

### <mark style="color:purple;">Self-Supervised Fine-Tuning</mark>

The answer comes naturally from the task

* **Definition**: Self-supervised learning is a <mark style="color:yellow;">hybrid approach that falls between supervised and unsupervised learning</mark>. It involves creating a <mark style="color:yellow;">pseudo-labeled dataset from the unlabeled data.</mark>
* **Process**: The model itself generates labels from the data (hence "self-supervised") and then trains on these labels. Often, this involves masking parts of the data and training the model to predict them.
* **Example**: A language model is given sentences with some words missing and learns to predict the missing words.

### <mark style="color:purple;">Summary</mark>

* **Supervised**: Needs labeled data and learns to predict correct answers.
* **Unsupervised**: No labels are involved, and the model learns patterns or structures from the data itself.
* **Self-Supervised**: Generates its own labels from the data and learns like in supervised learning, but without needing external labels.

Each of these methods has its own strengths and is suitable for different types of problems and datasets.&#x20;

Supervised learning is very direct and effective when labeled data is available, unsupervised learning is useful for uncovering hidden structures in data, and self-supervised learning offers a balance by exploiting unlabeled data in a structured way.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://training.continuumlabs.ai/data/datasets/types-of-fine-tuning.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.