Skip to content

Comments

Feat: more cores for loading#4427

Merged
themisvaltinos merged 18 commits intomainfrom
toby/core
May 26, 2025
Merged

Feat: more cores for loading#4427
themisvaltinos merged 18 commits intomainfrom
toby/core

Conversation

@themisvaltinos
Copy link
Contributor

This update adds a ProcessPoolExecutor for parallel loading of a project's models. It also adds a mock executor for single-process scenarios, such as when the system doesn’t support fork. Also, it refactors optimized_query_cache_pool to use this unified execution logic, eliminating the need for separate sequential and parallel code paths.

@themisvaltinos themisvaltinos requested review from a team, izeigerman and tobymao May 16, 2025 18:18
@themisvaltinos themisvaltinos force-pushed the toby/core branch 2 times, most recently from b5bd762 to 08ba90c Compare May 19, 2025 14:14
Copy link
Member

@izeigerman izeigerman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks much cleaner, thank you!

Copy link
Contributor

@VaggelisD VaggelisD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Anything that touches mp code both scares and excites me :D Left a few comments to better understand the changes

@themisvaltinos themisvaltinos force-pushed the toby/core branch 2 times, most recently from a0965f5 to 35d7b04 Compare May 23, 2025 11:35
@themisvaltinos
Copy link
Contributor Author

thank you addressed the latest round of comments when you have a moment to have another look @izeigerman

@themisvaltinos themisvaltinos merged commit 66b4252 into main May 26, 2025
23 checks passed
@themisvaltinos themisvaltinos deleted the toby/core branch May 26, 2025 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants