Flink開發五步之第一步:執行環境設定

一、設定ExecutionEnvironment:批量數據處理環境的三種方式

(1)設定Flink運行環境,如果在本地啓動則創建本地執行環境,如果在集羣啓動則創建集羣執行環境
val env1: ExecutionEnvironment = ExecutionEnvironment.getExecutionEnvironment
(2)指定並行度並創建本地執行環境
val env2: ExecutionEnvironment = ExecutionEnvironment.createLocalEnvironment(5)
(3)指定遠程JobmanagerIP、RPC端口、並行度、jar包及其依賴包
val env3: ExecutionEnvironment = ExecutionEnvironment.createRemoteEnvironment(“JobmanagerHost”,6021,5,"/user/application.jar")

二、StreamExecutionEnvironment:流式數據處理環境

(1)設定Flink運行環境,如果在本地啓動則創建本地執行環境,如果在集羣啓動則創建集羣執行環境
val environment1: StreamExecutionEnvironment = StreamExecutionEnvironment.getExecutionEnvironment
(2)指定並行度並創建本地執行環境
val environment2: StreamExecutionEnvironment = StreamExecutionEnvironment.createLocalEnvironment(5)
(3)指定遠程JobmanagerIP、RPC端口、並行度、jar包及其依賴包
val environment3: StreamExecutionEnvironment = StreamExecutionEnvironment.createRemoteEnvironment(“JobmanagerHost”,6021,5,"/user/application.jar")

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章