Skip to content

@bitextor Bitextor Team

Change the repository type filter

All

    Repositories list

    30 repositories

    • warc2text

      Public
      Extracts plain text, language identification and more metadata from WARC records
      C++
      •
      MIT License
      •6•23•8•3•Updated Apr 16, 2026Apr 16, 2026

    • cyhunspell-build

      Public
      Cython wrapper on Hunspell Dictionary
      Python
      •
      Other
      •28•0•0•0•Updated Apr 10, 2026Apr 10, 2026

    • bicleaner-ai

      Public
      Bicleaner fork that uses neural networks
      Python
      •
      GNU General Public License v3.0
      •4•40•1•0•Updated Feb 23, 2026Feb 23, 2026

    • bicleaner-hardrules

      Public
      Pre-filtering step for bicleaner
      Python
      •
      GNU General Public License v3.0
      •3•5•1•0•Updated Jan 16, 2026Jan 16, 2026

    • monocleaner

      Public
      Python
      •
      GNU General Public License v3.0
      •1•7•1•0•Updated Nov 3, 2025Nov 3, 2025

    • bifixer

      Public
      Tool to fix bitexts and tag near-duplicates for removal
      Python
      •
      GNU General Public License v3.0
      •3•35•0•0•Updated Sep 4, 2025Sep 4, 2025

    • biroamer

      Public
      Utility that will help you to ROAM (Random Omit Anonymize and Mix) your parallel corpus.
      Python
      •
      GNU General Public License v3.0
      •2•11•0•1•Updated Mar 3, 2025Mar 3, 2025

    • cld2

      Public
      Compact Language Detector 2
      C++
      •
      Apache License 2.0
      •143•0•0•0•Updated Feb 4, 2025Feb 4, 2025

    • monocleaner-data

      Public
      Monocleaner models repository
      GNU General Public License v3.0
      •0•1•0•0•Updated Jan 8, 2025Jan 8, 2025

    • scrawl

      Public
      Playwright-based web crawler
      Python
      •
      GNU General Public License v3.0
      •0•1•0•0•Updated Nov 14, 2024Nov 14, 2024

    • bitextor

      Public
      Bitextor generates translation memories from multilingual websites
      crawlerdictionariestokenizer
      crawlerdictionariestokenizermachine-translationwgetapertiumneural-machine-translationwarctmxstatistical-machine-translation
      Python
      •
      GNU General Public License v3.0
      •40•299•3•4•Updated Nov 11, 2024Nov 11, 2024

    • pdf-extract

      Public
      PDF parser and converter to HTML
      Java
      •
      GNU General Public License v3.0
      •13•93•4•1•Updated Oct 3, 2024Oct 3, 2024

    • bicleaner

      Public
      Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
      Python
      •
      GNU General Public License v3.0
      •22•160•1•1•Updated Jun 18, 2024Jun 18, 2024

    • monotextor

      Public
      Python
      •
      GNU General Public License v3.0
      •1•7•0•0•Updated May 31, 2023May 31, 2023

    • bitextor-testing-output

      Public
      Repository for storing testing outputs from Bitextor
      GNU General Public License v3.0
      •0•0•0•0•Updated May 29, 2023May 29, 2023

    • prevertical2text

      Public
      Extracts plain text, language identification and more metadata from Spiderling prevertical files
      C++
      •
      MIT License
      •0•2•0•0•Updated May 17, 2023May 17, 2023

    • fastText

      Public
      Library for fast text representation and classification.
      HTML
      •
      MIT License
      •4.8k•0•0•0•Updated May 4, 2023May 4, 2023

    • deferred-crawling

      Public
      Reconstructs sentences using deferred crawling standoff annotations from Bitextor
      Python
      •
      MIT License
      •0•0•0•0•Updated May 4, 2023May 4, 2023

    • bicleaner-ai-data

      Public
      Repository of Bicleaner AI models
      Other
      •0•5•0•0•Updated Mar 28, 2023Mar 28, 2023

    • bleualign-cpp

      Public
      C++
      •
      GNU General Public License v3.0
      •2•9•2•0•Updated Mar 10, 2023Mar 10, 2023

    • bicleaner-data

      Public
      Repository for data models, dictionaries and more resources for Bicleaner
      GNU General Public License v3.0
      •0•6•0•0•Updated Dec 15, 2022Dec 15, 2022

    • vecalign

      Public
      Improved Sentence Alignment in Linear Time and Space
      Python
      •
      Apache License 2.0
      •35•2•0•0•Updated Dec 4, 2022Dec 4, 2022

    • python-apachetika

      Public
      Python interface to Apache Tika, HTML extraction from PDF
      Python
      •
      Other
      •139•0•0•0•Updated Nov 30, 2022Nov 30, 2022

    • loomchild-segment-py

      Public
      Python module to interface with Java Loomchild sentence segmenter
      Python
      •
      GNU General Public License v3.0
      •1•1•1•0•Updated Nov 28, 2022Nov 28, 2022

    • bicleaner-ai-glove

      Public
      Fork of glove-python to distribute binary builds
      Python
      •
      Apache License 2.0
      •319•0•0•0•Updated Aug 12, 2022Aug 12, 2022

    • neural-document-aligner

      Public
      Document aligner which uses neural technologies to search matches across bilingual documents
      Python
      •
      GNU General Public License v3.0
      •4•8•0•0•Updated Jun 9, 2022Jun 9, 2022

    • bitextor-neural

      Public archive
      Bitextor Neural generates translation memories from multilingual websites using state-of-the-art Machine Learning tools
      Python
      •
      GNU General Public License v3.0
      •0•3•0•0•Updated Jun 3, 2022Jun 3, 2022

    • hunalign

      Public
      Sentence aligner
      C++
      •
      GNU Lesser General Public License v3.0
      •43•0•0•0•Updated May 21, 2021May 21, 2021

    • python-pdfextract

      Public
      Python interface to pdf-extract, HTML extraction from PDF
      Python
      •
      Other
      •139•6•0•0•Updated Sep 3, 2020Sep 3, 2020

    • bitextor-data

      Public
      Repository for data models, dictionaries and more resources for Bitextor
      GNU General Public License v3.0
      •0•6•0•0•Updated Feb 7, 2020Feb 7, 2020
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.