专利、论文、临床、药物数据读取 卡夫卡写es
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

18 lines
713 B

  1. #### Kafka Tool Parameters
  2. crawl.kfk.metadata.broker.list=node-01:19092,node-02:19092,node-03:19092
  3. crawl.kfk.connectionTimeOut=50000
  4. crawl.kfk.zk.sessiontimeout.ms=50000
  5. crawl.kfk.kafka.serializer=kafka.serializer.StringEncoder
  6. crawl.kfk.producer.acks=all
  7. crawl.kfk.producer.retries=0
  8. crawl.kfk.producer.batch.size=16384
  9. crawl.kfk.producer.linger.ms=1
  10. crawl.kfk.producer.buffer.memory=33554432
  11. crawl.kfk.producer.max.request.size=10485760
  12. crawl.kfk.consumer.enable.auto.commit=true
  13. crawl.kfk.consumer.auto.commit.interval.ms=1000
  14. crawl.kfk.consumer.session.timeout.ms=30000
  15. crawl.kfk.consumer.auto.offset.reset=latest
  16. crawl.kfk.consumer.thread.core.pool.size=100
  17. crawl.kfk.consumer.thread.maximum.pool.size=100