目錄

讀取數(shù)據(jù)的格式不同? ?(CDC是自定義的數(shù)據(jù)類型? 在這里就不進(jìn)行展示了，主要是展示一下Maxwell和Canal的區(qū)別)

1.添加的區(qū)別? ? ? ??

1.1 Canal

1.2 Maxwell

2.修改的區(qū)別

2.1Canal

2,2Maxwell

3.刪除的區(qū)別

3.1 Canal

3.2 Maxwell

Flink CDC :

? ? ? ? DataStream:

? ? ? ? ? ? ? ? 優(yōu)點(diǎn)：多庫(kù)多表

? ? ? ? ? ? ? ? 缺點(diǎn)：需要自定義反序列化

? ? ? ? FlinkSQL:

? ? ? ? ? ? ? ? 優(yōu)點(diǎn)：不需要自定義反序列化

? ? ? ? ? ? ? ? 缺點(diǎn)：?jiǎn)伪聿樵?/p>

? ? ? ? ? ? ? ? ? ? ? ? ????????FlinkCDC? ? ? ? ? ? ? ? ? ? Maxwell? ? ? ? ? ? ? ? Canal

斷點(diǎn)續(xù)傳? ? ? ? ? ? ? ? ?CK? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? MySQL? ? ? ? ? ? ? ? 本地磁盤

SQL->數(shù)據(jù)? ? ? ? ? ? ? 無(wú)? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?無(wú)? ? ? ? ? ? ? ? ? ? ? ? ?一對(duì)一(炸開(kāi))

初始化功能? ? ? ? ? ? ? 有(多庫(kù)多表)? ? ? ? ? ? ? ? 有(單表)? ? ? ? ? ? ? ? 無(wú)

封裝格式? ? ? ? ? ? ? ? ?自定義? ? ? ? ? ? ? ? ? ? ? ? ? JSON? ? ? ? ? ? ? ? ? ? JSON(c/s自定義)

高可用? ? ? ? ? ? ? ? ? ? ?運(yùn)行集群高可用? ? ? ? ? ?無(wú)? ? ? ? ? ? ? ? ? ? ? ? ?集群(ZK)

讀取數(shù)據(jù)的格式不同? ?(CDC是自定義的數(shù)據(jù)類型? 在這里就不進(jìn)行展示了，主要是展示一下Maxwell和Canal的區(qū)別)

1.添加的區(qū)別? ? ? ??

INSERT INTO z_user_info VALUES(30,'zhang3','13810001010'),(31,'li4','1389999999');?

1.1 Canal

{"data":[{"id":"30","user_name":"zhang3","tel":"13810001010"},{"id":"31","user_name":"li4","tel":"1389999999"}],"database":"jdmall-2020-04","es":1589385314000,"id":2,"isDdl":false,"mysqlType":{"id":"bigint(20)","user_name":"varchar(20)","tel":"varchar(20)"},"old":null,"pkNames":["id"],"sql":"","sqlType":{"id":-5,"user_name":12,"tel":12},"table":"z_user_info","ts":1589385314116,"type":"INSERT"}

1.2 Maxwell

{"database":"jdmall-2020-04","table":"z_user_info","type":"insert","ts":1589385314,"xid":82982,"xoffset":0,"data":{"id":30,"user_name":"zhang3","tel":"13810001010"}}

{"database":"jdmall-2020-04","table":"z_user_info","type":"insert","ts":1589385314,"xid":82982,"commit":true,"data":{"id":31,"user_name":"li4","tel":"1389999999"}}

2.修改的區(qū)別

UPDATE z_user_info SET user_name='wang55' WHERE id IN(30,31)

2.1Canal

{"data":[{"id":"30","user_name":"wang55","tel":"13810001010"},{"id":"31","user_name":"wang55","tel":"1389999999"}],"database":"jdmall-2020-04","es":1589385508000,"id":3,"isDdl":false,"mysqlType":{"id":"bigint(20)","user_name":"varchar(20)","tel":"varchar(20)"},"old":[{"user_name":"zhang3"},{"user_name":"li4"}],"pkNames":["id"],"sql":"","sqlType":{"id":-5,"user_name":12,"tel":12},"table":"z_user_info","ts":1589385508676,"type":"UPDATE"}

2,2Maxwell

{"database":"jdmall-2020-04","table":"z_user_info","type":"update","ts":1589385508,"xid":83206,"xoffset":0,"data":{"id":30,"user_name":"wang55","tel":"13810001010"},"old":{"user_name":"zhang3"}}

{"database":"jdmall-2020-04","table":"z_user_info","type":"update","ts":1589385508,"xid":83206,"commit":true,"data":{"id":31,"user_name":"wang55","tel":"1389999999"},"old":{"user_name":"li4"}}

3.刪除的區(qū)別

DELETE ?FROM z_user_info ??WHERE id IN(30,31)

3.1 Canal

{"data":[{"id":"30","user_name":"wang55","tel":"13810001010"},{"id":"31","user_name":"wang55","tel":"1389999999"}],"database":"jdmall-2020-04","es":1589385644000,"id":4,"isDdl":false,"mysqlType":{"id":"bigint(20)","user_name":"varchar(20)","tel":"varchar(20)"},"old":null,"pkNames":["id"],"sql":"","sqlType":{"id":-5,"user_name":12,"tel":12},"table":"z_user_info","ts":1589385644829,"type":"DELETE"}

3.2 Maxwell

{"database":"jdmall-2020-04","table":"z_user_info","type":"delete","ts":1589385644,"xid":83367,"xoffset":0,"data":{"id":30,"user_name":"wang55","tel":"13810001010"}}

{"database":"jdmall-2020-04","table":"z_user_info","type":"delete","ts":1589385644,"xid":83367,"commit":true,"data":{"id":31,"user_name":"wang55","tel":"1389999999"}}

以上是Canal和Maxwell的數(shù)據(jù)格式區(qū)別文章來(lái)源地址http://www.zghlxwxcb.cn/news/detail-416308.html

到了這里，關(guān)于flink cdc 、 canal 、maxwell 的區(qū)別的文章就介紹完了。如果您還想了解更多內(nèi)容，請(qǐng)?jiān)谟疑辖撬阉鱐OY模板網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章，希望大家以后多多支持TOY模板網(wǎng)！