Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,13 @@ version: 2
updates:
- package-ecosystem: pip
directory: "/"
exclude-paths:
- "requirements-dev.txt"
- "setup.py"
schedule:
interval: weekly
time: "01:30"
open-pull-requests-limit: 10
open-pull-requests-limit: 5
target-branch: dev
assignees:
- "sadrasabouri"
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,9 +34,9 @@ jobs:
run: |
python -m pip install --upgrade pip
pip install .
- name: Test requirements installation
- name: Dev requirements installation
run: |
pip install -r dev-requirements.txt
pip install -r requirements-dev.txt
- name: Test with pytest
run: |
python -m pytest . --cov=tocount --cov-report=term
Expand Down
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
- `TocountValidationError` class
### Changed
- `setup.py` updated
- Dependencies structure modified
## [0.5] - 2026-01-02
### Added
- `DEEPSEEK_R1.LINEAR_ALL` model
Expand Down
File renamed without changes.
Empty file removed requirements.txt
Empty file.
13 changes: 3 additions & 10 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,6 @@
"""Setup module."""
from setuptools import setup, find_packages


def get_requires() -> list:
"""Read requirements.txt."""
requirements = open("requirements.txt", "r").read()
return list(filter(lambda x: x != "", requirements.split()))


def read_description() -> str:
"""Read README.md and CHANGELOG.md."""
try:
Expand All @@ -27,7 +20,7 @@ def read_description() -> str:

setup(
name='tocount',
packages=find_packages(include=["tocount*"]),
packages=find_packages(include=['tocount*']),
version='0.5',
description='ToCount: Lightweight Token Estimator',
long_description=read_description(),
Expand All @@ -36,11 +29,11 @@ def read_description() -> str:
author_email='tocount@openscilab.com',
url='https://github.com/openscilab/tocount',
download_url='https://github.com/openscilab/tocount/tarball/v0.5',
keywords="token tokenizer estimation llm ml nlp",
keywords='token tokenizer estimation llm ml nlp',
project_urls={
'Source': 'https://github.com/openscilab/tocount',
},
install_requires=get_requires(),
install_requires=[],
python_requires='>=3.7',
classifiers=[
'Development Status :: 3 - Alpha',
Expand Down
Loading