【Flume】org.apache.flume.Context.getSubProperties(Ljava/lang/String;)

【問題描述】

       今天在CDH集羣中使用Flume的時候報瞭如下的錯誤：

2020-04-10 11:02:33,627 (conf-file-poller-0) [ERROR - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:154)] Unhandled error
java.lang.NoSuchMethodError: org.apache.flume.Context.getSubProperties(Ljava/lang/String;)Lcom/google/common/collect/ImmutableMap;
	at org.keedio.flume.source.HibernateHelper.<init>(HibernateHelper.java:46)
	at org.keedio.flume.source.SQLSource.configure(SQLSource.java:72)
	at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
	at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:325)
	at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:105)
	at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:145)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

【問題原因】

       根據報錯內容，可以發現原因是因爲Flume中getSubProperties的返回類型不匹配。org.apache.flume.context類在flume-ng-configuration-1.9.0-cdh6.3.1.jar、flume-ng-configuration.jar包裏面，查看這個兩個jar包，裏面都是有方法：public Map<String, String> getSubProperties(String prefix)：

  public Map<String, String> getSubProperties(String prefix)
  {
    Preconditions.checkArgument(prefix.endsWith("."), "The given prefix does not end with a period (" + prefix + ")");
    
    Map<String, String> result = Maps.newHashMap();
    synchronized (this.parameters)
    {
      for (Map.Entry<String, String> entry : this.parameters.entrySet())
      {
        String key = (String)entry.getKey();
        if (key.startsWith(prefix))
        {
          String name = key.substring(prefix.length());
          result.put(name, entry.getValue());
        }
      }
    }
    return ImmutableMap.copyOf(result);
  }

       而添加的flume-ng-sql-source jar包雖然也有這個方法，但是返回值類型不一樣，這個jar包裏面的方法返回值類型是ImmutableMap。

【解決辦法】

       更換flume-ng-sql-source jar包，jar包可以點這裏（鏈接：https://pan.baidu.com/s/13TcC4uyLtNLeFKAheA0Jqw 提取碼：xnij）下載，此處的jar包返回值類型爲Map。