StreamSets 下載安裝教程

本教程以 StreamSet 3.4.0 爲例

StreamSet有多種安裝方式，最簡單的一種就是下載壓縮包，直接解壓即可使用

 

1、下載StringSet壓縮包

• StringSet下載地址：https://streamsets.com/opensource/

• 執行以下語句

$ tar xvzf streamsets-datacollector-core-3.4.0.tgz

2、運行StreamSet

• 切換到解壓到目錄下，執行：

$ streamsets-datacollector-3.4.0/bin/streamset dc

• 本地瀏覽器打開：http://localhost:18630/    默認端口爲18630

• 登錄，默認的用戶名和密碼均爲admin

注：啓動的時候可能會報open file limit 的問題，解決辦法如下：

• Mac系統：

$ sudo vim /Library/LaunchDaemons/limit.maxfiles.plist

然後添加如下內容，並重啓即可

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
  <plist version="1.0">
    <dict>
      <key>Label</key>
        <string>limit.maxfiles</string>
      <key>ProgramArguments</key>
        <array>
          <string>launchctl</string>
          <string>limit</string>
          <string>maxfiles</string>
          <string>65536</string>
          <string>65536</string>
        </array>
      <key>RunAtLoad</key>
        <true/>
      <key>ServiceIPC</key>
        <false/>
    </dict>
  </plist>

• Linux系統

（1）暫時性修改，只對當前終端有效

$ ulimit -HSn 65536

（2）將ulimit -HSn 65536 寫到/etc/profile中，因爲每次登錄終端時，都會自動執行/etc/profile

（3）永久生效

修改配置文件：/etc/security/limits.conf ，在文件後添加如下內容，並重啓

* soft nofile 65536
* hard nofile 65536

3、主界面介紹

• 登錄界面

• 主界面

 

Number	Name	Description
1	Pipeline Creation Help Bar	Indicates that the origin is missing and offers a list of origins to choose from. If the Pipeline Creation Help Bar does not display, you might have disabled it. To enable it, in the top right corner of the Data Collector window, click the Help > Settings. Clear the Hide Pipeline Creation Help Bar option.
2	Issues icon	Click to display the list of pipeline issues found by implicit validation.
3	Stage library panel	Displays a list of available origins by default.
4	Stage menu	Changes the stages that display in the stage library. Displays all stages by default.
5	Properties panel / Preview panel / Monitor panel	When you configure a pipeline, the Properties panel displays the properties of the pipeline or selected stage. You can resize, minimize and maximize the panel. When you preview data, the Preview panel displays the input and output data for the selected stage or group of stages. When you monitor a running pipeline, the Monitor panel displays real-time metrics and statistics. Note: Some icons and options might not display in the UI. The items that display are based on the task that you are performing and roles assigned to your user account.
	Stage Library icon	Toggles the display of the Stage Library panel.

 

參考:：

1： https://streamsets.com/documentation/datacollector/latest/help/index.html#datacollector/UserGuide/Installation/Installing_the_DC.html#task_bt1_zcp_kq

2：https://streamsets.com/opensource/