repositories Search Results · repo:Mecanik/Tiny-BPE-Trainer language:C++

Filter by

• • Code... (...)results
  • Issues
    results
  • Pull requests
    results
  • Discussions
    results
  • Commits
    results
  • Packages
    results
  • Wikis
    results

• Advanced

  • Owner
  • Size
  • Number of followers
  • Number of forks
  • Number of stars
  • Date created
  • Date pushed
  • Topic
  • License
  • Archived
  • Public
  • Private
• Advanced search

Code... (...)

0 files

 (86 ms)

0 files

inMecanik/Tiny-BPE-Trainer (press backspace or delete to remove)

Sort by: Best match

Filter

Mecanik/Tiny-BPE-Trainer

Lightweight, header-only Byte Pair Encoding (BPE) trainer in modern C++17. Produces HuggingFace-compatible vocabularies for transformers …

nlp

machine-learning

natural-language-processing

deep-learning

tokenizer

• C++
·
• 3
·
• Updated
  on Aug 8

Star

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! 

Press the

/

key to activate the search input again and adjust your query.

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! 

Press the

/

key to activate the search input again and adjust your query.