Skip to content

Add batch job insertion functionality to job queue - #29

Merged
nicnocquee merged 4 commits into
mainfrom
batch-add-jobs
Feb 23, 2026
Merged

nicnocquee merged 4 commits into
mainfrom
batch-add-jobs

Conversation

@nicnocquee

Copy link
Copy Markdown
Owner
  • Introduced the addJobs method to allow users to enqueue multiple jobs in a single operation, improving efficiency by batching inserts into a single database round-trip for PostgreSQL or a single atomic Lua script for Redis.
  • Updated documentation to include detailed usage examples for the new addJobs method, highlighting its benefits such as handling idempotency keys and supporting transactional inserts.
  • Enhanced existing tests to cover the new batch insertion feature, ensuring correct functionality and behavior across different scenarios.

These changes enhance the job queue's performance and usability, providing users with a more efficient way to manage job enqueuing.

- Updated the job queue configuration to allow users to provide either a `databaseConfig` or a `pool` for PostgreSQL, and similarly for Redis with `redisConfig` or `client`.
- Introduced the `AddJobOptions` interface to support transactional job creation by allowing an external database client to be passed, ensuring atomic job insertion within existing transactions.
- Enhanced documentation to clarify the usage of the new options and provide examples for both PostgreSQL and Redis backends.
- Improved error handling to prevent misuse of the `db` option with the Redis backend.

These changes improve flexibility and usability for users managing job queues in DataQueue.
- Introduced the `addJobs` method to allow users to enqueue multiple jobs in a single operation, improving efficiency by batching inserts into a single database round-trip for PostgreSQL or a single atomic Lua script for Redis.
- Updated documentation to include detailed usage examples for the new `addJobs` method, highlighting its benefits such as handling idempotency keys and supporting transactional inserts.
- Enhanced existing tests to cover the new batch insertion feature, ensuring correct functionality and behavior across different scenarios.

These changes enhance the job queue's performance and usability, providing users with a more efficient way to manage job enqueuing.
@netlify

netlify Bot commented Feb 23, 2026 •

Copy link
Copy Markdown

✅ Deploy Preview for dataqueue-demo ready!

Name Link
🔨 Latest commit eff5390
🔍 Latest deploy log https://app.netlify.com/projects/dataqueue-demo/deploys/699cac48f1877f0008fd4180
😎 Deploy Preview https://deploy-preview-29--dataqueue-demo.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@netlify

netlify Bot commented Feb 23, 2026 •

Copy link
Copy Markdown

✅ Deploy Preview for docsdataqueuedev ready!

Name Link
🔨 Latest commit eff5390
🔍 Latest deploy log https://app.netlify.com/projects/docsdataqueuedev/deploys/699cac482def3700080db448
😎 Deploy Preview https://deploy-preview-29--docsdataqueuedev.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@nicnocquee
nicnocquee merged commit 198df44 into main Feb 23, 2026
10 checks passed
@nicnocquee
nicnocquee deleted the batch-add-jobs branch February 23, 2026 19:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant