What's the equivalent of Python's Celery p

问题:

I am trying to find an equivalent of Celery project for Java environment, I have looked at Spring Batch, but are there any better alternatives for distributed task queues.

Thanks.

回答1:

What Celery is doing is very much akin to EIP, and SEDA with convenient task scheduling... (all you have left to do is add some DB, and async HTTP networking and you have got a complete enterprise quality stack).

Basically in Java there is the Spring way, the Java EE way, and the Hadoop way:

• Spring: Spring Integration + Spring Batch + RabbitMQ
• Java EE: Mule + Quartz or EJB Scheduling + HornetMQ
• Hadoop: Capacity + ZooKeeper

Those are roughly in order of ease of setting up.

回答2:

Jesque (https://github.com/gresrun/jesque) is a Java distributed task queue library. It is a Java port of the Resque library (https://github.com/defunkt/resque), which is described like this on its GitHub page:

Resque (pronounced like "rescue") is a Redis-backed library for creating background jobs, placing those jobs on multiple queues, and processing them later."

回答3:

Quartz has worked for me in the past. It's integrated with Terracotta now, so it should be easy to distribute. http://quartz-scheduler.org/

回答4:

Celery is primarily based on Erlang/RabbitMQ. RabbitMQ has a Java client library that might be useful. Also, there is octobot which has a RabbitMQ backend.

回答5:

The closest thing I've found is Octobot: https://github.com/cscotta/Octobot Not so much documentation though... there used to be a website for it at octobot.taco.cat, but I haven't seen that load lately. I haven't personally used Octobot, but I've often seen it recommended as a Celery for Java.

回答6:

I haven't been able to find anything as easy to use as Celery for Java. Most of the solutions recommended to use a message queue. But Celery sits one level of abstraction higher than the queue. Instead of messages and consumers, you can think in terms of tasks and workers, results, retries etc.

I also needed to implement some bridge for a company using both Java and Python so I started this project:

celery-java - Celery client and worker in Java, compatible with their Python counterparts.

Beware, it's very immature as of now.

回答7:

Distributed Java tasks scheduling and execution https://redisson.org/

回答8:

Apache ActiveMQ http://activemq.apache.org/

Apache Kafka http://kafka.apache.org/