专利、论文、临床、药物数据读取 卡夫卡写es
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

20 lines
858 B

  1. #### Kafka Tool Parameters
  2. #crawl.kfk.metadata.broker.list= 10.18.0.18:9092,10.18.0.6:9092,10.18.0.26:9092
  3. crawl.kfk.metadata.broker.list=35.208.0.204:19092,35.209.211.105:19092,35.208.174.139:19092
  4. crawl.kfk.connectionTimeOut=50000
  5. crawl.kfk.zk.sessiontimeout.ms=50000
  6. crawl.kfk.kafka.serializer=kafka.serializer.StringEncoder
  7. crawl.kfk.producer.acks=all
  8. crawl.kfk.producer.retries=0
  9. crawl.kfk.producer.batch.size=16384
  10. crawl.kfk.producer.linger.ms=1
  11. crawl.kfk.producer.request.timeout.ms=90000
  12. crawl.kfk.producer.buffer.memory=33554432
  13. crawl.kfk.producer.max.request.size=10485760
  14. crawl.kfk.consumer.enable.auto.commit=true
  15. crawl.kfk.consumer.auto.commit.interval.ms=6000
  16. crawl.kfk.consumer.session.timeout.ms=30000
  17. crawl.kfk.consumer.auto.offset.reset=earliest
  18. crawl.kfk.consumer.thread.core.pool.size=100
  19. crawl.kfk.consumer.thread.maximum.pool.size=100