一、設定ExecutionEnvironment:批量數據處理環境的三種方式
(1)設定Flink運行環境,如果在本地啓動則創建本地執行環境,如果在集羣啓動則創建集羣執行環境
val env1: ExecutionEnvironment = ExecutionEnvironment.getExecutionEnvironment
(2)指定並行度並創建本地執行環境
val env2: ExecutionEnvironment = ExecutionEnvironment.createLocalEnvironment(5)
(3)指定遠程JobmanagerIP、RPC端口、並行度、jar包及其依賴包
val env3: ExecutionEnvironment = ExecutionEnvironment.createRemoteEnvironment(“JobmanagerHost”,6021,5,"/user/application.jar")
二、StreamExecutionEnvironment:流式數據處理環境
(1)設定Flink運行環境,如果在本地啓動則創建本地執行環境,如果在集羣啓動則創建集羣執行環境
val environment1: StreamExecutionEnvironment = StreamExecutionEnvironment.getExecutionEnvironment
(2)指定並行度並創建本地執行環境
val environment2: StreamExecutionEnvironment = StreamExecutionEnvironment.createLocalEnvironment(5)
(3)指定遠程JobmanagerIP、RPC端口、並行度、jar包及其依賴包
val environment3: StreamExecutionEnvironment = StreamExecutionEnvironment.createRemoteEnvironment(“JobmanagerHost”,6021,5,"/user/application.jar")