What's the equivalent of Python's Celery p

Question

I am trying to find an equivalent of Celery project for Java environment, I have looked at Spring Batch, but are there any better alternatives for distributed task queues.

Thanks.

Answer 1

Quartz has worked for me in the past. It's integrated with Terracotta now, so it should be easy to distribute. http://quartz-scheduler.org/

Answer 2

The closest thing I've found is Octobot: https://github.com/cscotta/Octobot Not so much documentation though... there used to be a website for it at octobot.taco.cat, but I haven't seen that load lately. I haven't personally used Octobot, but I've often seen it recommended as a Celery for Java.

Answer 3

I haven't been able to find anything as easy to use as Celery for Java. Most of the solutions recommended to use a message queue. But Celery sits one level of abstraction higher than the queue. Instead of messages and consumers, you can think in terms of tasks and workers, results, retries etc.

I also needed to implement some bridge for a company using both Java and Python so I started this project:

celery-java - Celery client and worker in Java, compatible with their Python counterparts.

Beware, it's very immature as of now.

Answer 4

Celery is primarily based on Erlang/RabbitMQ. RabbitMQ has a Java client library that might be useful. Also, there is octobot which has a RabbitMQ backend.

Answer 5

What Celery is doing is very much akin to EIP, and SEDA with convenient task scheduling... (all you have left to do is add some DB, and async HTTP networking and you have got a complete enterprise quality stack).

Basically in Java there is the Spring way, the Java EE way, and the Hadoop way:

• Spring: Spring Integration + Spring Batch + RabbitMQ
• Java EE: Mule + Quartz or EJB Scheduling + HornetMQ
• Hadoop: Capacity + ZooKeeper

Those are roughly in order of ease of setting up.

Answer 6

Distributed Java tasks scheduling and execution https://redisson.org/