The ultimate library to perform background processing on the JVM.
Dead simple API. Extensible. Reliable.
Distributed and backed by persistent storage.
Open and free for commercial use.
Overview
BackgroundJob.enqueue(() -> System.out.println("This is all you need for distributed jobs!"));
Incredibly easy way to perform fire-and-forget, delayed, scheduled and recurring jobs inside Java applications using only Java 8 lambda's. CPU and I/O intensive, long-running and short-running jobs are supported. Persistent storage is done via either RDBMS (e.g. Postgres, MariaDB/MySQL and Oracle) or NoSQL (ElasticSearch, MongoDB and Redis).
JobRunr provides a unified programming model to handle background tasks in a reliable way and runs them on shared hosting, dedicated hosting or in the cloud (hello Kubernetes) within a JVM instance.
Feedback
Thanks for building JobRunr, I like it a lot! Before that I used similar libraries in Ruby and Golang and JobRunr so far is the most pleasant one to use. I especially like the dashboard, it’s awesome! Alex Denisov
View more feedback on jobrunr.io.
Features
- Simple: just use Java 8 lambda's to create a background job.
- Distributed & cluster-friendly: guarantees execution by single scheduler instance using optimistic locking.
- Persistent jobs: using either a RDMBS (four tables and a view) or a noSQL data store.
- Embeddable: built to be embedded in existing applications.
- Minimal dependencies: (ASM, slf4j and either jackson and jackson-datatype-jsr310, gson or a JSON-B compliant library).
Usage scenarios
Some scenarios where it may be a good fit:
- within a REST api return response to client immediately and perform long-running job in the background
- mass notifications/newsletters
- calculations of wages and the creation of the resulting documents
- batch import from xml, csv or json
- creation of archives
- firing off web hooks
- image/video processing
- purging temporary files
- recurring automated reports
- database maintenance
- updating elasticsearch/solr after data changes
- …and so on
You can start small and process jobs within your web app or scale horizontally and add as many background job servers as you want to handle a peak of jobs. JobRunr will distribute the load over all the servers for you. JobRunr is also fault-tolerant - is an external web service down? No worries, the job is automatically retried 10-times with a smart back-off policy.
JobRunr is a Java alternative to HangFire, Resque, Sidekiq, delayed_job, Celery and is similar to Quartz and Spring Task Scheduler.
Screenshots
Usage
Dedicated worker pool threads execute queued background jobs as soon as possible, shortening your request's processing time.
BackgroundJob.enqueue(() -> System.out.println("Simple!"));
Scheduled background jobs are executed only after a given amount of time.
BackgroundJob.schedule(() -> System.out.println("Reliable!"), Instant.now().plusHours(5));
Recurring jobs have never been simpler; just call the following method to perform any kind of recurring task using the CRON expressions.
BackgroundJob.scheduleRecurringly("my-recurring-job", () -> service.doWork(), Cron.daily());
Process background tasks inside a web application…
You can process background tasks in any web application and we have thorough support for Spring - JobRunr is reliable to process your background jobs within a web application.
… or anywhere else
Like a Spring Console Application, wrapped in a docker container, that keeps running forever and polls for new background jobs.
See https://www.jobrunr.io for more info.
Installation
Using Maven?
JobRunr is available in Maven Central - all you need to do is add the following dependency:
<dependency>
<groupId>org.jobrunr</groupId>
<artifactId>jobrunr</artifactId>
<version>1.2.2</version>
</dependency>
Using Gradle?
Just add the dependency to JobRunr:
implementation 'org.jobrunr:jobrunr:1.2.2'
Configuration
Do you like to work Spring based?
Add the jobrunr-spring-boot-starter to your dependencies and you're almost ready to go! Just set up your application.properties:
# the job-scheduler is enabled by default
# the background-job-server and dashboard are disabled by default
org.jobrunr.job-scheduler.enabled=true
org.jobrunr.background-job-server.enabled=true
org.jobrunr.dashboard.enabled=true
Or do you prefer a fluent API?
Define a javax.sql.DataSource and put the following code on startup:
@SpringBootApplication
public class JobRunrApplication {
public static void main(String[] args) {
SpringApplication.run(JobRunrApplication.class, args);
}
@Bean
public JobScheduler initJobRunr(DataSource dataSource, JobActivator jobActivator) {
return JobRunr.configure()
.useStorageProvider(SqlStorageProviderFactory
.using(dataSource))
.useJobActivator(jobActivator)
.useDefaultBackgroundJobServer()
.useDashboard()
.initialize();
}
}
Contributing
See CONTRIBUTING for details on submitting patches and the contribution workflow.
How can I contribute?
- Take a look at issues with tag called
Good first issue - Join the discussion on gitter.
- Answer questions on issues.
- Fix bugs reported on issues, and send us pull request.
![[BUG] Jobrunr Skipping Recurring Jobs](https://avatars.githubusercontent.com/u/30267535?v=4)
![[BUG] Database migration don't run when executing spring-boot jar](https://avatars.githubusercontent.com/u/1726078?v=4)
![[BUG] Not all the recurring jobs are getting scheduled](https://avatars.githubusercontent.com/u/104053820?v=4)
![[BUG] Jobs are scheduled with the same parameters even though different parameters are provided](https://avatars.githubusercontent.com/u/25184957?v=4)
![[BUG] Dockerized Jobrunr Inside JHipster Project Is Not Starting](https://avatars.githubusercontent.com/u/2001424?v=4)
![[BUG] Scheduled jobs are not getting enqueued](https://avatars.githubusercontent.com/u/100258269?v=4)
![[BUG] Jobs fail with](https://avatars.githubusercontent.com/u/559192?v=4)
![[Feature] - Change job schedule at runtime](https://avatars.githubusercontent.com/u/62439949?v=4)
![[Feature] Allow poll interval to be less than 5 seconds for InMemoryStorageProvider](https://avatars.githubusercontent.com/u/187029?v=4)
![[Feature] Provide Liquibase and Flyway scripts](https://avatars.githubusercontent.com/u/24761580?v=4)
105 Dec 31, 2022
965 Dec 30, 2022
571 Dec 29, 2022
4.6k Dec 30, 2022
4 Jun 8, 2022
9.1k Dec 31, 2022
5.1k Jan 3, 2023
2.5k Jan 4, 2023
1.6k Dec 29, 2022
4 Jul 17, 2022
17 Jan 7, 2023
59 Sep 17, 2022
238 Dec 22, 2022
3 Nov 19, 2022
70 Nov 30, 2022
65 Nov 29, 2022
367 Oct 11, 2022
10 Oct 19, 2022
1.4k Jan 6, 2023