PulsarConnectors消息处理(Processingguarantee)at-most-onceat-least-onceeffectively-once操作流程(JDBCsink)添加配置文件。创建schema。上传schema到atopic.CreateaJDBCsinkStopaJDBCsinkRestartaJDBCsinkUpdateaJDBCsink内建连接器(Built-inconnector)SourceconnectorCanalFileFlumeKafkaRabbitMQSinkconnectorElasticSearch/SolrFlumeHBaseHDFS2/HDFS3InfluxDBJDBCClickHouse/MariaDB/PostgreSQLKafkaMongoDBRabbitMQRedisClickHouseSink创建表CREATEDATABASEIFNOTEXISTSmonitor;CREATETABLEIFNOTEXISTSmonitor.pulsar_clickhouse_jdbc_sink(idUInt32,nameString)ENGINE=TinyLog;INSERTINTOmonitor.pulsar_clickhouse_jdbc_sink(id,name)VALUES(1,'tmp');SELECT*FROMmonitor.pulsar_clickhouse_jdbc_sink;创建配置$vi$PULSAR_HOME/connectors/pulsar-clickhouse-jdbc-sink.yaml{"userName":"sysop","password":"123456","jdbcUrl":"jdbc:clickhouse://server-101:8123/monitor","tableName":"pulsar_clickhouse_jdbc_sink"}创建schema$vi$PULSAR_HOME/connectors/json-schema.json{"name":"","schema":{"type“:“记录”,“名称”:“SeedEvent”,“命名空间”:“com.cloudwise.quickstart.model”,“字段”:[{“名称”:“id”,“类型”:[“空”,"int"]},{"name":"name","type":["null","string"]}]},"type":"JSON","properties":{"__alwaysAllowNull":"true","__jsr310ConversionEnabled":"false"}}上传schema$$PULSAR_HOME/bin/pulsar-adminschemasupload\pulsar-postgres-jdbc-sink-topic\-f$PULSAR_HOME/connectors/json-schema.json运行$$PULSAR_HOME/bin/pulsar-adminsinkscreate\--tenantpublic\--namespacedefault\--namepulsar-clickhouse-jdbc-sink\--inputspulsar-clickhouse-jdbc-sink-topic\--sink-config-file$PULSAR_HOME/connectors/pulsar-clickhouse-jdbc-sink.yaml\--archive$PULSAR_HOME/connectors/pulsar-io-jdbc-clickhouse-2.6。2.nar\--processing-guaranteesEFFECTIVELY_ONCE\--parallelism1写在最后近年来,在AIOps领域快速发展的背景下,IT工具、平台能力、解决方案、AI场景的迫切需求并且可用的数据集在各种不同的基础上,云智慧于2021年8月发布了AIOps社区,旨在竖起开源大旗,为各行业的客户、用户、研究人员和开发人员打造一个活跃的用户和开发人员社区,以及共同贡献和解决行业问题,促进该领域的技术发展。社区先后开源了数据可视化与编排平台——FlyFish、运维管理平台OMP、云服务管理平台——Moore平台、Hours算法等产品。视觉编排平台-FlyFish:项目介绍:https://www.cloudwise.ai/flyF...Github地址:https://github.com/CloudWise-...Gitee地址:https://gitee.com/CloudWise/f...行业案例:https://www.bilibili.com/vide...部分大屏案例:可添加小助手(xiaoyuerwie)注:飞鱼。加入开发者交流群,与行业大咖1V1交流!您还可以通过小助手获取云智慧AIOps信息,了解飞鱼的最新进展!系列阅读ApachePulsar(一):PulsarvsKafkaApachePulsar(二):Pulsar消息机制ApachePulsar(三):PulsarSchemaApachePulsar(四)PulsarFunctions
