marvinscham/masterthesis-playground
1
0
Fork 0
mirror of https://github.com/marvinscham/masterthesis-playground.git synced 2026-03-22 08:22:43 +01:00
Code Issues Packages Projects Releases Wiki Activity

RAG cleanup

Browse Source
This commit is contained in:
Marvin Scham
2026-02-21 15:24:21 +01:00
parent 04cc3f8e77
commit 49c622db08
4 changed files with 71 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
raft/README.md
View File

@@ -26,14 +26,16 @@ python train_mistral_raft.py --train_jsonl out/raft_train.jsonl --out_dir out/mi
## Inferenz
### Per Baseline Mistral 7B + PEFT-Adapter
```bash
python rag_chat.py --lora_dir out/mistral_balitwin_lora
```
### Pre-Merged Modell + Adapter
```bash
python rag_chat_merged.py --model_dir /path/to/model_folder --out_dir out
```
### Per Baseline Mistral 7B + PEFT-Adapter
Hinweis: das Skript wurde nach wenigen oberflächlichen Evaluationsrunden nicht weiter verwendet, da der beste Kandidat durch einen Merge des Basismodells und seiner PEFT-Adapter beschleunigt werden konnte und dieses Skript nicht länger relevant war.
```bash
python deprecated_rag_chat.py --lora_dir out/mistral_balitwin_lora
```