Full refactor of the library#16

Merged

micedre merged 69 commits into

mainfrom

Nov 20, 2025

Commits on Oct 22, 2025

Commits on Oct 31, 2025

Commits on Nov 3, 2025

Commits on Nov 4, 2025

feat!(components): first working example with full modularity
meilame-tayebjee
committed

Commits on Nov 5, 2025

Commits on Nov 7, 2025

Commits on Nov 10, 2025

fix: typo in trainer_params max_epochs

meilame-tayebjee
and
micedre
authored
feat!(tokenizer): ensure output is consistent across al tokenizers
meilame-tayebjee
committed
fix: move hf-dep to optional dependencies
meilame-tayebjee
committed
Merge branch 'main' into hf_tokenizer
meilame-tayebjee
authored
feat!(attention): enable attention logic
meilame-tayebjee
committed
fix: check if categorical var are present before checking their arrays

meilame-tayebjee
and
micedre
committed
fix: no persistent_workers if num_workers=0

meilame-tayebjee
and
micedre
authored

Commits on Nov 12, 2025

Commits on Nov 17, 2025

refactor: replace cpu_run with accelerator in TrainingConfig
meilame-tayebjee
committed

Commits on Nov 18, 2025

feat!(tokenizer-ngram): add very fast ngram tokenizer
meilame-tayebjee
committed

Commits on Nov 19, 2025

Commits on Nov 20, 2025