Help celery 5 to choose a better trio/async based alternative of python multiprocessing

The multiprocessing module has a huge feature set, that tries to provide every kind of IPC primitive and support every possible IPC pattern. Arguably it’s too huge, and promises more than it (or anyone) can deliver… and most people I know have only used, like, 5% of its features :slight_smile:

If you really need all the features of multiprocessing, at the same level of abstraction, then that suggests one kind of advice. If you really have a more specific use case in mind, and would be happy with a library that targets that use case more specifically (or even happier, since a library that’s not trying to be all things to all people can often make better trade-offs), then my advice would be very different. But I need to know which :slight_smile:

What features in billiard/multiprocessing does celery currently use?

2 Likes