Parallel binlog processing with data consistency #2
Description
We are trying to catch up some specific table events from the master and then we will compose the data based on the binlog event, then we store it on the cutom table in another one database instance, here the problem statement is we will get around 15k binlog events with in a seconds, so if we go with the single thread for read, processing and write it will cause the huge delay, So we should go with the parallel read and write but in the same time we should ensure the data consistency, because before run the insert statement we should not run the update statement in any case, is there any option to achive it or improve the performance?