fix a crash in NER model training

Aethor · Aethor · commit f703acb5211d · 2026-04-12T18:35:48.000+08:00
diff --git a/renard/ner_utils.py b/renard/ner_utils.py
@@ -375,7 +375,6 @@ def train_ner_model(
         train_dataset=dataset[train_split],
         eval_dataset=dataset[valid_split],
         data_collator=DataCollatorForTokenClassification(tokenizer),
-        tokenizer=tokenizer,
     )
     trainer.train()
 

Original file line number	Diff line number	Diff line change
`@@ -375,7 +375,6 @@ def train_ner_model(`
`375`	`375`	`train_dataset=dataset[train_split],`
`376`	`376`	`eval_dataset=dataset[valid_split],`
`377`	`377`	`data_collator=DataCollatorForTokenClassification(tokenizer),`
`378`		`- tokenizer=tokenizer,`
`379`	`378`	`)`
`380`	`379`	`trainer.train()`
`381`	`380`