Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix __repr__ to output all fields #149

Open
wants to merge 10 commits into
base: development
Choose a base branch
from
Open

Fix __repr__ to output all fields #149

wants to merge 10 commits into from

Conversation

shreyashnigam
Copy link
Collaborator

Fix chunker repr functions to output all user defined fields.

Copy link

codecov bot commented Jan 17, 2025

Codecov Report

Attention: Patch coverage is 60.00000% with 24 lines in your changes missing coverage. Please review.

✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
src/chonkie/chunker/sentence.py 27.27% 5 Missing and 3 partials ⚠️
src/chonkie/chunker/recursive.py 28.57% 4 Missing and 1 partial ⚠️
src/chonkie/embeddings/model2vec.py 66.66% 2 Missing and 1 partial ⚠️
src/chonkie/embeddings/openai.py 75.00% 1 Missing and 2 partials ⚠️
src/chonkie/chunker/late.py 50.00% 1 Missing ⚠️
src/chonkie/chunker/semantic.py 80.00% 0 Missing and 1 partial ⚠️
src/chonkie/embeddings/base.py 66.66% 0 Missing and 1 partial ⚠️
src/chonkie/embeddings/sentence_transformer.py 80.00% 0 Missing and 1 partial ⚠️
src/chonkie/types.py 66.66% 1 Missing ⚠️
Flag Coverage Δ
python-3.10 66.01% <60.00%> (-0.63%) ⬇️
python-3.11 66.01% <60.00%> (-0.63%) ⬇️
python-3.12 66.01% <60.00%> (-0.63%) ⬇️
python-3.13 66.01% <60.00%> (-0.63%) ⬇️
python-3.9 65.93% <60.00%> (-0.63%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
src/chonkie/chunker/sdpm.py 74.46% <100.00%> (ø)
src/chonkie/chunker/token.py 74.07% <100.00%> (ø)
src/chonkie/chunker/word.py 60.52% <100.00%> (ø)
src/chonkie/chunker/late.py 72.89% <50.00%> (-0.28%) ⬇️
src/chonkie/chunker/semantic.py 58.54% <80.00%> (-0.08%) ⬇️
src/chonkie/embeddings/base.py 58.97% <66.66%> (-0.49%) ⬇️
src/chonkie/embeddings/sentence_transformer.py 82.35% <80.00%> (-0.73%) ⬇️
src/chonkie/types.py 69.74% <66.66%> (+0.89%) ⬆️
src/chonkie/embeddings/model2vec.py 79.54% <66.66%> (-2.96%) ⬇️
src/chonkie/embeddings/openai.py 41.89% <75.00%> (-1.78%) ⬇️
... and 2 more

bhavnicksm and others added 2 commits February 2, 2025 04:26
…` in Chunkers (#158)

* [DOCS] Benchmarking update (#145)

* Add wiki 500k benchmark results

* Update benchmarks

* bahut tej hai chonkie bhai

* blah blah

---------

Co-authored-by: Bhavnick Minhas <[email protected]>

* Update benchmarks with corrected memory usage and size metrics

* [fix] Update SentenceChunker's docstring

* [chore] ruff linting

* [fix] Remove numpy base dependency that creeped in

* [Feat] Add `include_delim='next'` as an optional argument in SentenceChunker and RecursiveChunker (#157)

* Add `include_delim` in SentenceChunker

* Add `include_delim` in RecursiveChunker

* Add shreyash as a default assignee

---------

Co-authored-by: Shreyash Nigam <[email protected]>
@bhavnicksm bhavnicksm changed the base branch from main to development February 3, 2025 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants