Generic replication framework architecture

Version 1.2 by Thomas Mortagne on 2022/06/23 12:23

A message is given to the sender which serialize it before putting it in a queue. The messages are picked from the queue and sent to the target instance through HTTP.

The received message is serialized on target instance side, and the serialized message is added to an handling memory queue and the HTTP response is sent. The messages are picked from the handling queue and provided to the receivers associated with the message type.

If the target instance fail to serialize the message or is not reachable, the message to send is put back on the queue to be tried again later. Otherwise the message is removed from the filesystem. If the sending instance crash or is stopped before all the message are full sent, they are loaded from the filesystem store during next init and reinjected in the send queue.

If the receiving instance crash or is stopped before all the received message have been handled by receivers, they are loaded from the filesystem store during next init and reinjected in the receive queue.

Tags:
    

Get Connected