背景
pyspark streaming 處理Kafka生產的數據時報錯:
Spark Streaming’s Kafka libraries not found in class path. Try one of the following.
reason
缺少 <spark-streaming-kafka-0-8-assembly.jar> 包
solution
包下載鏈接
將下載的jar包放在
/opt/anaconda3/envs/python37/lib/python3.7/site-packages/pyspark/jars
目錄下