Fine-tuning of LLM using QLoRA

Fine-tuned a Falcon-7B large language model using the QLoRA PEFT technique on a custom mental health conversational dataset. Achieved a training loss of 0.42 and achieved a ROUGE-1 score of 0.37 on the conversational test dataset.