Packages for keyword “tokenization”
These packages are available as a package collection, usable in Xcode or SwiftPM.
swift-casification
Package for tokenizing and case swapping for free strings
swift-sentencepiece
Use SentencePiece in Swift for tokenization and detokenization.
2 packages.