Twitter Storm開篇之作

Storm介紹

Twitter將Storm正式開源了,這是一個分佈式的、容錯的實時計算系統,它被託管在GitHub上,遵循 Eclipse Public License 1.0。Storm是由BackType開發的實時處理系統,BackType現在已在Twitter麾下。GitHub上的最新版本是Storm 0.5.2,基本是用Clojure寫的。

Storm爲分佈式實時計算提供了一組通用原語,可被用於“流處理”之中,實時處理消息並更新數據庫。這是管理隊列及工作者集羣的另一種方式。 Storm也可被用於“連續計算”(continuous computation),對數據流做連續查詢,在計算時就將結果以流的形式輸出給用戶。它還可被用於“分佈式RPC”,以並行的方式運行昂貴的運算。 Storm的主工程師Nathan Marz表示:

Storm可以方便地在一個計算機集羣中編寫與擴展複雜的實時計算,Storm之於實時處理,就好比 Hadoop之於批處理。Storm保證每個消息都會得到處理,而且它很快——在一個小集羣中,每秒可以處理數以百萬計的消息。更棒的是你可以使用任意編程語言來做開發。

Storm的主要特點如下:

  1. 簡單的編程模型。類似於MapReduce降低了並行批處理複雜性,Storm降低了進行實時處理的複雜性。
  2. 可以使用各種編程語言。你可以在Storm之上使用各種編程語言。默認支持Clojure、Java、Ruby和Python。要增加對其他語言的支持,只需實現一個簡單的Storm通信協議即可。
  3. 容錯性。Storm會管理工作進程和節點的故障。
  4. 水平擴展。計算是在多個線程、進程和服務器之間並行進行的。
  5. 可靠的消息處理。Storm保證每個消息至少能得到一次完整處理。任務失敗時,它會負責從消息源重試消息。
  6. 快速。系統的設計保證了消息能得到快速的處理,使用ØMQ作爲其底層消息隊列。
  7. 本地模式。Storm有一個“本地模式”,可以在處理過程中完全模擬Storm集羣。這讓你可以快速進行開發和單元測試。

Storm集羣由一個主節點和多個工作節點組成。主節點運行了一個名爲“Nimbus”的守護進程,用於分配代碼、佈置任務及故障檢測。每個工作節 點都運行了一個名爲“Supervisor”的守護進程,用於監聽工作,開始並終止工作進程。Nimbus和Supervisor都能快速失敗,而且是無 狀態的,這樣一來它們就變得十分健壯,兩者的協調工作是由Apache ZooKeeper來完成的。

Storm的術語包括Stream、Spout、Bolt、Task、Worker、Stream Grouping和Topology。Stream是被處理的數據。Sprout是數據源。Bolt處理數據。Task是運行於Spout或Bolt中的 線程。Worker是運行這些線程的進程。Stream Grouping規定了Bolt接收什麼東西作爲輸入數據。數據可以隨機分配(術語爲Shuffle),或者根據字段值分配(術語爲Fields),或者 廣播(術語爲All),或者總是發給一個Task(術語爲Global),也可以不關心該數據(術語爲None),或者由自定義邏輯來決定(術語爲 Direct)。Topology是由Stream Grouping連接起來的Spout和Bolt節點網絡。在Storm Concepts頁面裏對這些術語有更詳細的描述。

可以和Storm相提並論的系統有Esper、Streambase、HStreaming和Yahoo S4。其中和Storm最接近的就是S4。兩者最大的區別在於Storm會保證消息得到處理。這些系統中有的擁有內建數據存儲層,這是Storm所沒有的,如果需要持久化,可以使用一個類似於Cassandra或Riak這樣的外部數據庫。

入門的最佳途徑是閱讀GitHub上的官方《Storm Tutorial》。 其中討論了多種Storm概念和抽象,提供了範例代碼以便你可以運行一個Storm Topology。開發過程中,可以用本地模式來運行Storm,這樣就能在本地開發,在進程中測試Topology。一切就緒後,以遠程模式運行 Storm,提交用於在集羣中運行的Topology。Maven用戶可以使用clojars.org提供的Storm依賴,地址是 http://clojars.org/repo。

要運行Storm集羣,你需要Apache Zookeeper、ØMQ、JZMQ、Java 6和Python 2.6.6。ZooKeeper用於管理集羣中的不同組件,ØMQ是內部消息系統,JZMQ是ØMQ的Java Binding。有個名爲storm-deploy的子項目,可以在AWS上一鍵部署Storm集羣。關於詳細的步驟,可以閱讀Storm Wiki上的《Setting up a Storm cluster》。

本軟件介紹內容來自 InfoQ

 Storm學習途徑

作者:量子恆道          網址:http://blog.linezing.com/

Storm簡單例子

通過閱讀以上兩位高人的文章,就試着寫了一個簡單demo

通過demo主要來掌握storm的運行流程是怎樣的

首先新建一個Person 對象,主要是用來將其封裝爲數據源進行傳輸

/**
 * Person.java
 * 版權所有(C) 2013 
 * 創建:cuiran 2013-01-15 15:49:25
 */
package com.stormdemo.demo;

import java.io.Serializable;

/**
 * TODO
 * @author cuiran
 * @version TODO
 */
public class Person implements Serializable {

	/**
	 * 
	 */
	private static final long serialVersionUID = -2279602642375811203L;
	private Long id;
	private String name;
	private Integer age;
	/**
	 * @return the id
	 */
	public Long getId() {
		return id;
	}
	/**
	 * @param id the id to set
	 */
	public void setId(Long id) {
		this.id = id;
	}
	/**
	 * @return the name
	 */
	public String getName() {
		return name;
	}
	/**
	 * @param name the name to set
	 */
	public void setName(String name) {
		this.name = name;
	}
	/**
	 * @return the age
	 */
	public Integer getAge() {
		return age;
	}
	/**
	 * @param age the age to set
	 */
	public void setAge(Integer age) {
		this.age = age;
	}
	
	public String toString(){
		return "[Person id="+id+" name="+name+" age="+age+"]";
	}
}


然後設置數據源實現接口IRichSpout,在這個類中首先是需要設置輸出字段,然後是在open方法中將存放有Person對象的集合進行迭代然後放入queue隊列中,在nextTuple方法中從隊列中取出Person對象並emit發送給Bolt處理。

 

/**
 * DemoSpout.java
 * 版權所有(C) 2013 
 * 創建:cuiran 2013-01-15 15:43:26
 */
package com.stormdemo.demo;

import java.util.Iterator;
import java.util.LinkedList;
import java.util.List;
import java.util.Map;
import java.util.Queue;

import org.apache.commons.logging.Log;
import org.apache.commons.logging.LogFactory;



import backtype.storm.spout.SpoutOutputCollector;
import backtype.storm.task.TopologyContext;
import backtype.storm.topology.IRichSpout;
import backtype.storm.topology.OutputFieldsDeclarer;
import backtype.storm.tuple.Fields;
import backtype.storm.tuple.Values;

/**
 * TODO
 * @author cuiran
 * @version TODO
 */
public class DemoSpout implements IRichSpout {

	/**
	 * 
	 */
	private static final long serialVersionUID = 3980242432526476937L;
	private static Log log = LogFactory.getLog(DemoSpout.class.getName());
	Queue<Person> queues = new LinkedList<Person>();
	List<Person> list=null;
	
	private SpoutOutputCollector collector;
	private Map conf;
	private TopologyContext context;


	/* (non-Javadoc)
	 * @see backtype.storm.topology.IRichSpout#isDistributed()
	 */


	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#ack(java.lang.Object)
	 */
	@Override
	public void ack(Object arg0) {
		// TODO Auto-generated method stub
		log.debug("ack-----> "+arg0);
	}

	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#close()
	 */
	@Override
	public void close() {
		// TODO Auto-generated method stub
		log.debug("close-----> ");
	}

	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#fail(java.lang.Object)
	 */
	@Override
	public void fail(Object arg0) {
		// TODO Auto-generated method stub
		log.debug("fail-----> "+arg0);
	}

	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#nextTuple()
	 */
	@Override
	public void nextTuple() {
		// TODO Auto-generated method stub
		Person p= queues.poll();
		if(p!=null){
			log.debug("nextTuple----> 發送數據,用戶ID="+p.getId());
			collector.emit(new Values(p), p);
		}
		
	}

	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#open(java.util.Map, backtype.storm.task.TopologyContext, backtype.storm.spout.SpoutOutputCollector)
	 */
	@Override
	public void open(Map map, TopologyContext context, SpoutOutputCollector collector) {
		// TODO Auto-generated method stub
		log.debug("spout-----> 將集合數據轉換至隊列中");
		this.collector = collector;
		this.conf = conf;
		this.context = context;
		
		Iterator<Person> it= list.iterator();
		while(it.hasNext()){
			Person p=it.next();
			queues.add(p);
		}
	}

	/* (non-Javadoc)
	 * @see backtype.storm.topology.IComponent#declareOutputFields(backtype.storm.topology.OutputFieldsDeclarer)
	 */
	@Override
	public void declareOutputFields(OutputFieldsDeclarer declarer) {
		// TODO Auto-generated method stub
		log.debug("declareOutputFields----> 設置輸出字段");
		declarer.declare(new Fields("person"));
	}

	public DemoSpout(List<Person> list) {
		super();
		this.list = list;
	}

	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#activate()
	 */
	@Override
	public void activate() {
		// TODO Auto-generated method stub
		
	}

	/* (non-Javadoc)
	 * @see backtype.storm.spout.ISpout#deactivate()
	 */
	@Override
	public void deactivate() {
		// TODO Auto-generated method stub
		
	}

	/* (non-Javadoc)
	 * @see backtype.storm.topology.IComponent#getComponentConfiguration()
	 */
	@Override
	public Map<String, Object> getComponentConfiguration() {
		// TODO Auto-generated method stub
		return null;
	}

}

接着新建一個處理數據的Bolt,主要是在execute方法中通過之前設置的字段person,獲取當前傳輸的對象(此處需要主要的是storm早期版本貌似不能傳輸對象,我後來採用的是當前最新版本 0.8版本也可以這樣)。然後進行處理,處理成功會調用ack方法,若失敗則調用fail方法。

/**
 * ListBolt.java
 * 版權所有(C) 2013 
 * 創建:cuiran 2013-01-15 16:05:25
 */
package com.stormdemo.demo;

import java.util.Map;

import org.apache.commons.logging.Log;
import org.apache.commons.logging.LogFactory;

import backtype.storm.task.OutputCollector;
import backtype.storm.task.TopologyContext;
import backtype.storm.topology.IRichBolt;
import backtype.storm.topology.OutputFieldsDeclarer;
import backtype.storm.tuple.Tuple;

/**
 * TODO
 * @author cuiran
 * @version TODO
 */
public class ListBolt implements IRichBolt {

	/**
	 * 
	 */
	private static final long serialVersionUID = 6467077126541265761L;
	
	private static Log log = LogFactory.getLog(ListBolt.class.getName());
	
	private OutputCollector collector;

	/* (non-Javadoc)
	 * @see backtype.storm.task.IBolt#cleanup()
	 */
	@Override
	public void cleanup() {
		// TODO Auto-generated method stub

	}

	/* (non-Javadoc)
	 * @see backtype.storm.task.IBolt#execute(backtype.storm.tuple.Tuple)
	 */
	@Override
	public void execute(Tuple tuple) {
		// TODO Auto-generated method stub
		try {
			log.debug("execute----->處理數據");
			Person p= (Person)tuple.getValueByField("person");
			
			log.debug("處理數據  用戶="+p.toString());
			
			collector.ack(tuple);
		}catch (Exception e) {
			collector.fail(tuple);
			// TODO: handle exception
			log.error("處理數據出現異常", e);
		}
		
	}

	/* (non-Javadoc)
	 * @see backtype.storm.task.IBolt#prepare(java.util.Map, backtype.storm.task.TopologyContext, backtype.storm.task.OutputCollector)
	 */
	@Override
	public void prepare(Map map, TopologyContext context, OutputCollector collector) {
		// TODO Auto-generated method stub
		this.collector=collector;
	}

	/* (non-Javadoc)
	 * @see backtype.storm.topology.IComponent#declareOutputFields(backtype.storm.topology.OutputFieldsDeclarer)
	 */
	@Override
	public void declareOutputFields(OutputFieldsDeclarer declarer) {
		// TODO Auto-generated method stub

	}

	/* (non-Javadoc)
	 * @see backtype.storm.topology.IComponent#getComponentConfiguration()
	 */
	@Override
	public Map<String, Object> getComponentConfiguration() {
		// TODO Auto-generated method stub
		return null;
	}

}


最後就是我們的測試類:由於啓動storm後一直運行,若需要停止需要kill掉,我們測試時候就是用的

cluster.killTopology("test");
 cluster.shutdown();

需要注意的是在setSpout和setBolt方法中第一個參數id在早期版本是int類型,後期版本就改爲string了。

/**
 * DemoTopology.java
 * 版權所有(C) 2013 
 * 創建:cuiran 2013-01-15 16:13:27
 */
package com.stormdemo.demo;

import java.util.ArrayList;
import java.util.List;

import org.apache.commons.logging.Log;
import org.apache.commons.logging.LogFactory;

import backtype.storm.Config;
import backtype.storm.LocalCluster;
import backtype.storm.generated.StormTopology;
import backtype.storm.topology.TopologyBuilder;
import backtype.storm.utils.Utils;
import junit.framework.TestCase;

/**
 * TODO
 * @author cuiran
 * @version TODO
 */
public class DemoTopology extends TestCase {
	
	private static Log log = LogFactory.getLog(DemoTopology.class.getName());
	
	public static StormTopology buildTopology(List<Person> list) {
		TopologyBuilder builder = new TopologyBuilder();
		
		builder.setSpout("1", new DemoSpout(list));
		
		builder.setBolt("2", new ListBolt()).globalGrouping("1");
		
		return builder.createTopology();
	}
	
	public static List<Person> getPerson(){
		List<Person> list=new ArrayList<Person>();
		
		for(int i=1;i<10;i++){
			Person p=new Person();
			p.setId((long)i);
			p.setName("zhang"+i);
			p.setAge(20+i);
			
			list.add(p);
		}
		
		
		return list;
	}
	
	public static List<String> getStr(){
		List<String> list=new ArrayList<String>();
		
		for(int i=1;i<10;i++){
			
			list.add("test"+i);
		}
		
		return list;
	}
	
	public void testTopology(){
		log.debug("stormdemo開始");
		long startTime=System.currentTimeMillis();
		Config conf = new Config();
		conf.setDebug(true);
		conf.setNumWorkers(2);
		conf.setMaxSpoutPending(1);
		LocalCluster cluster = new LocalCluster();
		List<Person> list=getPerson();

		
		
		cluster.submitTopology("demo", conf, buildTopology(list));
		long executeTime=System.currentTimeMillis();
		Utils.sleep(30000);
		log.debug("stormdemo結束");
		long stopTime=System.currentTimeMillis();
		
		log.debug("共消耗時間:運行="+(executeTime-startTime)+",總時間:"+(stopTime-startTime)+"");
		
		cluster.killTopology("test");
		cluster.shutdown();
		
		
	}
}

最後運行結果:

log4j:ERROR Could not find value for key log4j.appender.fileout
log4j:ERROR Could not instantiate appender named "fileout".
2013-01-16 09:20:42:DEBUG com.stormdemo.demo.DemoTopology - stormdemo開始
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=PC2010110311cvt
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.6.0_01
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Sun Microsystems Inc.
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=D:\Java\jre1.6.0_01
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=D:\workspace\stormdemo1\WebRoot\WEB-INF\classes;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clout-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-exec-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-fileupload-1.2.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-io-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\compojure-0.6.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\core.incubator-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\hiccup-0.3.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-util-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jline-0.9.94.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\json-simple-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\junit-3.8.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jzmq-2.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-1.2.16.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-core-0.3.10.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-jetty-adapter-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-servlet-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5-20081211.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.macro-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\asm-4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\carbonite-1.5.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clj-time-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clojure-1.4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-codec-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-lang-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-logging-1.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-client-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-framework-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\disruptor-2.10.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\guava-13.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpclient-4.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpcore-4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jgrapht-0.8.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\joda-time-2.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\kryo-2.17.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\libthrift7-0.7.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-over-slf4j-1.6.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-classic-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-core-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\math.numeric-tower-0.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\minlog-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\objenesis-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\reflectasm-1.07-shaded.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\slf4j-api-1.6.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\snakeyaml-1.9.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.cli-0.2.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.logging-0.2.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\zookeeper-3.3.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\storm-0.9.0-wip7.jar;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/543/1/.cp/;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/541/1/.cp/
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=D:\Java\jre1.6.0_01\bin;.;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:\Java\jdk1.6.0_01\bin;e:\oracle\product\10.2.0\client_1\bin;d:\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\Program Files\TortoiseSVN\bin;;C:\Program Files\Common Files\Thunder Network\KanKan\Codecs;E:\ant182\bin;C:\Program Files\Java\jdk1.6.0_01\bin;;C:\Program Files\Android\android-sdk-windows\platform-tools;c:\php\ext;D:\Java\jdk1.6.0_01;C:\Program Files\MySQL\MySQL Server 5.1\bin;D:\Program Files\TortoiseSVN\bin;C:\Program Files\Microsoft SQL Server\80\Tools\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\Program Files\Microsoft SQL Server\90\DTS\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files\Microsoft Visual Studio 8\Common7\IDE\PrivateAssemblies\;D:\Ruby193\bin;D:\PHP;D:\PHP\ext;D:\Maven\bin
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Windows XP
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=x86
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=5.1
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=Administrator
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=C:\Documents and Settings\Administrator
2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=D:\workspace\stormdemo1
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:host.name=PC2010110311cvt
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.version=1.6.0_01
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.vendor=Sun Microsystems Inc.
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.home=D:\Java\jre1.6.0_01
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.class.path=D:\workspace\stormdemo1\WebRoot\WEB-INF\classes;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clout-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-exec-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-fileupload-1.2.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-io-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\compojure-0.6.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\core.incubator-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\hiccup-0.3.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-util-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jline-0.9.94.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\json-simple-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\junit-3.8.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jzmq-2.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-1.2.16.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-core-0.3.10.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-jetty-adapter-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-servlet-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5-20081211.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.macro-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\asm-4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\carbonite-1.5.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clj-time-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clojure-1.4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-codec-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-lang-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-logging-1.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-client-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-framework-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\disruptor-2.10.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\guava-13.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpclient-4.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpcore-4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jgrapht-0.8.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\joda-time-2.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\kryo-2.17.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\libthrift7-0.7.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-over-slf4j-1.6.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-classic-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-core-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\math.numeric-tower-0.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\minlog-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\objenesis-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\reflectasm-1.07-shaded.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\slf4j-api-1.6.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\snakeyaml-1.9.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.cli-0.2.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.logging-0.2.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\zookeeper-3.3.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\storm-0.9.0-wip7.jar;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/543/1/.cp/;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/541/1/.cp/
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.library.path=D:\Java\jre1.6.0_01\bin;.;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:\Java\jdk1.6.0_01\bin;e:\oracle\product\10.2.0\client_1\bin;d:\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\Program Files\TortoiseSVN\bin;;C:\Program Files\Common Files\Thunder Network\KanKan\Codecs;E:\ant182\bin;C:\Program Files\Java\jdk1.6.0_01\bin;;C:\Program Files\Android\android-sdk-windows\platform-tools;c:\php\ext;D:\Java\jdk1.6.0_01;C:\Program Files\MySQL\MySQL Server 5.1\bin;D:\Program Files\TortoiseSVN\bin;C:\Program Files\Microsoft SQL Server\80\Tools\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\Program Files\Microsoft SQL Server\90\DTS\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files\Microsoft Visual Studio 8\Common7\IDE\PrivateAssemblies\;D:\Ruby193\bin;D:\PHP;D:\PHP\ext;D:\Maven\bin
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.io.tmpdir=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.compiler=<NA>
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:os.name=Windows XP
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:os.arch=x86
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:os.version=5.1
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:user.name=Administrator
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:user.home=C:\Documents and Settings\Administrator
2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:user.dir=D:\workspace\stormdemo1
2013-01-16 09:20:47:INFO org.apache.zookeeper.server.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\a79a4c6f-b820-4d54-85e2-212abbd237f6\version-2 snapdir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\a79a4c6f-b820-4d54-85e2-212abbd237f6\version-2
2013-01-16 09:20:47:INFO org.apache.zookeeper.server.NIOServerCnxn - binding to port 0.0.0.0/0.0.0.0:2000
3312 [main] INFO  backtype.storm.zookeeper - Starting inprocess zookeeper at port 2000 and dir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/a79a4c6f-b820-4d54-85e2-212abbd237f6
2013-01-16 09:20:47:INFO org.apache.zookeeper.server.persistence.FileTxnSnapLog - Snapshotting: 0
3734 [main] INFO  backtype.storm.daemon.nimbus - Starting Nimbus with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/905e5ab3-42c8-47ef-9687-322ffe72a619", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
3765 [main] INFO  backtype.storm.daemon.nimbus - Using default scheduler
3859 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:47:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@46a09b
2013-01-16 09:20:47:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:47:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:47:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2006
2013-01-16 09:20:47:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2006
2013-01-16 09:20:47:INFO org.apache.zookeeper.server.persistence.FileTxnLog - Creating new log file: log.1
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720000 with negotiated timeout 20000 for client /127.0.0.1:2006
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720000, negotiated timeout = 20000
4546 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720000
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720000 closed
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-01-16 09:20:48:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b2720000, likely client has closed socket
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2006 which had sessionid 0x13c40f1b2720000
4625 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1eea7f0
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2009
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2009
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720001 with negotiated timeout 20000 for client /127.0.0.1:2009
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720001, negotiated timeout = 20000
4796 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@62be97
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2013
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2013
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720002 with negotiated timeout 20000 for client /127.0.0.1:2013
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720002, negotiated timeout = 20000
4843 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720002
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720002 closed
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
4859 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2013 which had sessionid 0x13c40f1b2720002
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@d8e902
4859 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@6c08b2
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2016
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2016
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2019
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2019
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720003 with negotiated timeout 20000 for client /127.0.0.1:2016
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720003, negotiated timeout = 20000
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720004, negotiated timeout = 20000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720004 with negotiated timeout 20000 for client /127.0.0.1:2019
4890 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720004
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720004 closed
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2019 which had sessionid 0x13c40f1b2720004
4906 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@164804
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2023
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2023
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720005 with negotiated timeout 20000 for client /127.0.0.1:2023
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720005, negotiated timeout = 20000
4953 [main] INFO  backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/dd108ee9-8f33-4324-9ef7-7b3b2f443f23", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1 2 3), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
5031 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@19d794d
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2026
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2026
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720006 with negotiated timeout 20000 for client /127.0.0.1:2026
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720006, negotiated timeout = 20000
5062 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720006
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720006 closed
2013-01-16 09:20:48:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b2720006, likely client has closed socket
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2026 which had sessionid 0x13c40f1b2720006
5078 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@d713fe
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2030
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2030
2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720007 with negotiated timeout 20000 for client /127.0.0.1:2030
2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720007, negotiated timeout = 20000
5125 [main] INFO  backtype.storm.daemon.supervisor - Starting supervisor with id a753e74a-55c8-47b5-b5f8-3e5c957335f8 at host PC2010110311cvt
5140 [main] INFO  backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/86c7a04d-fe18-4dba-b751-24507fd794e0", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
5156 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:49:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@16c1227
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2033
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2033
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720008 with negotiated timeout 20000 for client /127.0.0.1:2033
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720008, negotiated timeout = 20000
5171 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720008
2013-01-16 09:20:49:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720008 closed
5187 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:49:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1b5eba4
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-01-16 09:20:49:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b2720008, likely client has closed socket
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2033 which had sessionid 0x13c40f1b2720008
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2036
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2036
2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720009 with negotiated timeout 20000 for client /127.0.0.1:2036
2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720009, negotiated timeout = 20000
5234 [main] INFO  backtype.storm.daemon.supervisor - Starting supervisor with id a9368e3d-c540-49c8-b7ef-11327e92f9cd at host PC2010110311cvt
2013-01-16 09:20:49:DEBUG com.stormdemo.demo.DemoSpout - declareOutputFields----> 設置輸出字段
5546 [main] INFO  backtype.storm.daemon.nimbus - Received topology submission for demo with conf {"topology.max.task.parallelism" nil, "topology.acker.executors" 1, "topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name" "demo", "storm.id" "demo-1-1358299249", "topology.workers" 2, "topology.debug" true, "topology.max.spout.pending" 1}
5593 [main] INFO  backtype.storm.daemon.nimbus - Activating demo: demo-1-1358299249
5734 [main] INFO  backtype.storm.scheduler.EvenScheduler - Available slots: (["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 4] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 5] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 6] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 1] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 2] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 3])
5765 [main] INFO  backtype.storm.daemon.nimbus - Setting new assignment for topology id demo-1-1358299249: #backtype.storm.daemon.common.Assignment{:master-code-dir "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249", :node->host {"a753e74a-55c8-47b5-b5f8-3e5c957335f8" "PC2010110311cvt", "a9368e3d-c540-49c8-b7ef-11327e92f9cd" "PC2010110311cvt"}, :executor->node+port {[3 3] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 4], [2 2] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 1], [1 1] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 4]}, :executor->start-time-secs {[1 1] 1358299249, [3 3] 1358299249, [2 2] 1358299249}}
6109 [Thread-5] INFO  backtype.storm.daemon.supervisor - Downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249
6328 [Thread-8] INFO  backtype.storm.daemon.supervisor - Downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249
6578 [Thread-5] INFO  backtype.storm.daemon.supervisor - Finished downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249
6640 [Thread-6] INFO  backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "demo-1-1358299249", :executors [[2 2]]} for this supervisor a753e74a-55c8-47b5-b5f8-3e5c957335f8 on port 1 with id ce797194-f0a1-4d1f-a0df-6a388935cf26
6656 [Thread-6] INFO  backtype.storm.daemon.worker - Launching worker for demo-1-1358299249 on a753e74a-55c8-47b5-b5f8-3e5c957335f8:1 with id ce797194-f0a1-4d1f-a0df-6a388935cf26 and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/dd108ee9-8f33-4324-9ef7-7b3b2f443f23", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1 2 3), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
6656 [Thread-6] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@a64a92
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2039
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2039
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000a, negotiated timeout = 20000
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000a with negotiated timeout 20000 for client /127.0.0.1:2039
6671 [Thread-6-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b272000a
2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b272000a closed
2013-01-16 09:20:50:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b272000a, likely client has closed socket
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2039 which had sessionid 0x13c40f1b272000a
6687 [Thread-6] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1264666
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2042
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2042
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000b, negotiated timeout = 20000
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000b with negotiated timeout 20000 for client /127.0.0.1:2042
7031 [Thread-8] INFO  backtype.storm.daemon.supervisor - Finished downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249
7093 [Thread-9] INFO  backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "demo-1-1358299249", :executors ([3 3] [1 1])} for this supervisor a9368e3d-c540-49c8-b7ef-11327e92f9cd on port 4 with id b56bca1d-cdd0-458c-941a-7f1719d5bc2b
7109 [Thread-9] INFO  backtype.storm.daemon.worker - Launching worker for demo-1-1358299249 on a9368e3d-c540-49c8-b7ef-11327e92f9cd:4 with id b56bca1d-cdd0-458c-941a-7f1719d5bc2b and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/86c7a04d-fe18-4dba-b751-24507fd794e0", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
7109 [Thread-9] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@b80017
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2045
2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2045
2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000c with negotiated timeout 20000 for client /127.0.0.1:2045
2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000c, negotiated timeout = 20000
7171 [Thread-9-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
2013-01-16 09:20:51:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b272000c
2013-01-16 09:20:51:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b272000c closed
2013-01-16 09:20:51:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b272000c, likely client has closed socket
2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2045 which had sessionid 0x13c40f1b272000c
7203 [Thread-9] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
2013-01-16 09:20:51:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1be3bb2
2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000
2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2048
2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2048
2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000d, negotiated timeout = 20000
2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000d with negotiated timeout 20000 for client /127.0.0.1:2048
7531 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor 2:[2 2]
7531 [Thread-9] INFO  backtype.storm.daemon.executor - Loading executor __acker:[3 3]
7546 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: 2 __system ["startup"]
7546 [Thread-9] INFO  backtype.storm.daemon.task - Emitting: __acker __system ["startup"]
7546 [Thread-9] INFO  backtype.storm.daemon.executor - Loaded executor tasks __acker:[3 3]
7546 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks 2:[2 2]
7562 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor 2:[2 2]
7562 [Thread-6] INFO  backtype.storm.daemon.worker - Launching receive-thread for a753e74a-55c8-47b5-b5f8-3e5c957335f8:1
7562 [Thread-23] INFO  backtype.storm.daemon.executor - Preparing bolt 2:(2)
7562 [Thread-22] INFO  backtype.storm.daemon.executor - Preparing bolt __acker:(3)
7562 [Thread-9] INFO  backtype.storm.daemon.executor - Finished loading executor __acker:[3 3]
7578 [Thread-23] INFO  backtype.storm.daemon.executor - Prepared bolt 2:(2)
7578 [Thread-22] INFO  backtype.storm.daemon.executor - Prepared bolt __acker:(3)
7578 [Thread-9] INFO  backtype.storm.daemon.executor - Loading executor 1:[1 1]
7593 [Thread-9] INFO  backtype.storm.daemon.task - Emitting: 1 __system ["startup"]
7593 [Thread-9] INFO  backtype.storm.daemon.executor - Loaded executor tasks 1:[1 1]
7593 [Thread-6] INFO  backtype.storm.daemon.worker - Worker has topology config {"storm.id" "demo-1-1358299249", "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/dd108ee9-8f33-4324-9ef7-7b3b2f443f23", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.kryo.decorators" (), "topology.name" "demo", "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" 1, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1 2 3), "topology.debug" true, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 2, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
7593 [Thread-6] INFO  backtype.storm.daemon.worker - Worker ce797194-f0a1-4d1f-a0df-6a388935cf26 for storm demo-1-1358299249 on a753e74a-55c8-47b5-b5f8-3e5c957335f8:1 has finished loading
7609 [Thread-9] INFO  backtype.storm.daemon.executor - Finished loading executor 1:[1 1]
7609 [Thread-9] INFO  backtype.storm.daemon.worker - Launching receive-thread for a9368e3d-c540-49c8-b7ef-11327e92f9cd:4
7609 [Thread-27] INFO  backtype.storm.daemon.executor - Opening spout 1:(1)
7609 [Thread-9] INFO  backtype.storm.daemon.worker - Worker has topology config {"storm.id" "demo-1-1358299249", "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/86c7a04d-fe18-4dba-b751-24507fd794e0", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.kryo.decorators" (), "topology.name" "demo", "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" 1, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" true, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 2, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
7609 [Thread-9] INFO  backtype.storm.daemon.worker - Worker b56bca1d-cdd0-458c-941a-7f1719d5bc2b for storm demo-1-1358299249 on a9368e3d-c540-49c8-b7ef-11327e92f9cd:4 has finished loading
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - spout-----> 將集合數據轉換至隊列中
7609 [Thread-27] INFO  backtype.storm.daemon.executor - Opened spout 1:(1)
7609 [Thread-27] INFO  backtype.storm.daemon.executor - Activating spout 1:(1)
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=1
7609 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=1 name=zhang1 age=21]]
7609 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [2694535958820228165 3828879903368972585 1]
7609 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [2694535958820228165 3828879903368972585 1]
7625 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {2694535958820228165=3828879903368972585}, [[Person id=1 name=zhang1 age=21]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=1 name=zhang1 age=21]
7625 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [2694535958820228165 3828879903368972585]
7625 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [2694535958820228165, 3828879903368972585]
7625 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [2694535958820228165]
7625 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [2694535958820228165]
7625 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=1 name=zhang1 age=21]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=1 name=zhang1 age=21]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=2
7625 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=2 name=zhang2 age=22]]
7625 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [-5811949556035385002 -6890630316263539517 1]
7625 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [-5811949556035385002 -6890630316263539517 1]
7625 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {-5811949556035385002=-6890630316263539517}, [[Person id=2 name=zhang2 age=22]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=2 name=zhang2 age=22]
7625 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [-5811949556035385002 -6890630316263539517]
7625 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [-5811949556035385002, -6890630316263539517]
7625 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [-5811949556035385002]
7640 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [-5811949556035385002]
7640 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=2 name=zhang2 age=22]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=2 name=zhang2 age=22]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=3
7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=3 name=zhang3 age=23]]
7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [219257472962751953 6078625470356348063 1]
7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [219257472962751953 6078625470356348063 1]
7640 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {219257472962751953=6078625470356348063}, [[Person id=3 name=zhang3 age=23]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=3 name=zhang3 age=23]
7640 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [219257472962751953 6078625470356348063]
7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [219257472962751953, 6078625470356348063]
7640 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [219257472962751953]
7640 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [219257472962751953]
7640 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=3 name=zhang3 age=23]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=3 name=zhang3 age=23]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=4
7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=4 name=zhang4 age=24]]
7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [4318562922526141994 8191650156051441196 1]
7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [4318562922526141994 8191650156051441196 1]
7640 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {4318562922526141994=8191650156051441196}, [[Person id=4 name=zhang4 age=24]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=4 name=zhang4 age=24]
7640 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [4318562922526141994 8191650156051441196]
7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [4318562922526141994, 8191650156051441196]
7640 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [4318562922526141994]
7640 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [4318562922526141994]
7640 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=4 name=zhang4 age=24]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=4 name=zhang4 age=24]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=5
7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=5 name=zhang5 age=25]]
7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [-5525623119314927399 3663529653696391654 1]
7640 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {-5525623119314927399=3663529653696391654}, [[Person id=5 name=zhang5 age=25]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=5 name=zhang5 age=25]
7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [-5525623119314927399 3663529653696391654 1]
7640 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [-5525623119314927399 3663529653696391654]
7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [-5525623119314927399, 3663529653696391654]
7656 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [-5525623119314927399]
7656 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [-5525623119314927399]
7656 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=5 name=zhang5 age=25]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=5 name=zhang5 age=25]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=6
7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=6 name=zhang6 age=26]]
7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [4444831176256327809 6692541082140116000 1]
7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [4444831176256327809 6692541082140116000 1]
7656 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {4444831176256327809=6692541082140116000}, [[Person id=6 name=zhang6 age=26]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=6 name=zhang6 age=26]
7656 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [4444831176256327809 6692541082140116000]
7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [4444831176256327809, 6692541082140116000]
7656 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [4444831176256327809]
7656 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [4444831176256327809]
7656 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=6 name=zhang6 age=26]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=6 name=zhang6 age=26]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=7
7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=7 name=zhang7 age=27]]
7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [6115911456780872788 1675690715082104323 1]
7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [6115911456780872788 1675690715082104323 1]
7656 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {6115911456780872788=1675690715082104323}, [[Person id=7 name=zhang7 age=27]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=7 name=zhang7 age=27]
7656 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [6115911456780872788 1675690715082104323]
7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [6115911456780872788, 1675690715082104323]
7656 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [6115911456780872788]
7671 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [6115911456780872788]
7671 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=7 name=zhang7 age=27]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=7 name=zhang7 age=27]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=8
7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=8 name=zhang8 age=28]]
7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [8569256651305376437 5838382650884274902 1]
7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [8569256651305376437 5838382650884274902 1]
7671 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {8569256651305376437=5838382650884274902}, [[Person id=8 name=zhang8 age=28]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=8 name=zhang8 age=28]
7671 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [8569256651305376437 5838382650884274902]
7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [8569256651305376437, 5838382650884274902]
7671 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [8569256651305376437]
7671 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [8569256651305376437]
7671 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=8 name=zhang8 age=28]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=8 name=zhang8 age=28]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 發送數據,用戶ID=9
7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=9 name=zhang9 age=29]]
7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [4632521528974275102 -5861573244111071873 1]
7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [4632521528974275102 -5861573244111071873 1]
7671 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {4632521528974275102=-5861573244111071873}, [[Person id=9 name=zhang9 age=29]]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->處理數據
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 處理數據  用戶=[Person id=9 name=zhang9 age=29]
7671 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [4632521528974275102 -5861573244111071873]
7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [4632521528974275102, -5861573244111071873]
7671 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [4632521528974275102]
7671 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [4632521528974275102]
7671 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=9 name=zhang9 age=29]
2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=9 name=zhang9 age=29]
2013-01-16 09:21:19:DEBUG com.stormdemo.demo.DemoTopology - stormdemo結束
2013-01-16 09:21:19:DEBUG com.stormdemo.demo.DemoTopology - 共消耗時間:運行=7109,總時間:37109




發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章