[renovate]

This PR contains the following updates:

Package	Change	Age	Confidence
tokenizers	==0.23.2 → ==0.23.3

---

Release Notes

huggingface/tokenizers (tokenizers)

v0.23.3: (python only)

Compare Source

Release v0.23.3

Python package release, other packages are unchanged

🚨 Fixs a breaking change introduced in v0.23.1

What's changed

Patch for the python package with three fixes:

• Loosen the huggingface_hub requirements to allow huggingface_hub v2 #​2486 (comment) - Unblocks transformers installs
• Fix type hints not resolving for pyright: #​2456
• Fix a breaking change from 0.23.1 regarding truncation and overflowing: #​2091

Full Changelog: huggingface/tokenizers@v0.23.2...v0.23.3

---

Configuration

📅 Schedule: (UTC)

• Branch creation
  • At any time (no schedule defined)
• Automerge
  • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.

[coderabbitai]

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

• Configuration used: defaults
• Review profile: CHILL
• Plan: Advanced
• Run ID: 03375264-ce40-4f93-b5a9-4b0b394de24e

---

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

• Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

---

_{Comment @coderabbitai help to get the list of available commands.}