首先人員表數據一共有100W條,前期開始是想先用PL/SQL導出爲xml格式,然後在SAX解析xml,後來發現xml超過10W條的時候解析起來會有問題,特別佔用CPU資源,後改用java程序直接連oracle和mongo,該表有50多個全大寫字段,如果先獲取到oracle表的列名和值,再寫條件判斷 if(列名==類屬性){ 新實例賦值}, 要寫50多個if代碼塊.覺得用反射更代碼更簡潔一點。
PatMaster實體類中的NAME字段
String NAME;
public String getNAME() {
return NAME;
}
public void setNAME(String nAME) {
NAME = nAME;
}
Class<PatMaster> c = PatMaster.class;
PatMaster patMaster = c.newInstance();
Method m1 = c.getDeclaredMethod("set" + column, String.class);
m1.setAccessible(true);
m1.invoke(patMaster, value);
column爲oracle獲取的字段列,String.class是指改set方法需要傳入一個String,那麼m1就獲取到這個set方法了,如果不是public方法,需要setAccessible(true);然後invoke的時候傳入實例和數據庫中該字段值即可.
全部代碼:直接拷過去就可以用,你改個IP定義個你的實體類就好了, 如果搞不定加我QQ468165108
用到的jar包 :ojdbc14.jar,mongo-2.5.3.jar
JAR下載地址:http://pan.baidu.com/s/1kTGNVoj 密碼:69fz ,
public void OdbcTOMongo() throws Exception {
Mongo mongo = new Mongo("192.168.1.3", 30000);
DB db = mongo.getDB("test");
db.authenticate("user", "user".toCharArray());
DBCollection dbc = db.getCollection("patMasterIndex");
//自定義數據字典
FieldfUtils fu = new FieldfUtils();
HashMap<String, String> map = fu.GetMinField();
Class.forName("oracle.jdbc.driver.OracleDriver");
String url = "jdbc:oracle:thin:@192.168.1.111:1521:dba";
String user = "user";
String password = "pwd";
Connection conn = DriverManager.getConnection(url, user, password);
PreparedStatement ps = conn.prepareStatement("select * from PAT_MASTER_INDEX");
ResultSet rs = ps.executeQuery();
int num = 0;
ResultSetMetaData rsmd = rs.getMetaData();
int colCount = rsmd.getColumnCount();
while (rs.next()) {
//計數器 每導入1W行記錄輸入
num++;
if(num%10000==0){
System.out.println(num);
}
Class<PatMaster> c = PatMaster.class;
PatMaster patMaster = c.newInstance();
BasicDBObject bdo = new BasicDBObject();
for (int i = 1; i <= colCount; i++) {
String column = rsmd.getColumnName(i);
Object object = rs.getObject(i);
String value = "";
if (object == null) {
} else {
value = (String) object.toString();
}
Method m1 = c.getDeclaredMethod("set" + column, String.class);
m1.setAccessible(true);
m1.invoke(patMaster, value);
String minName = map.get(column);
bdo.put(minName, value);
}
dbc.insert(bdo);
}
rs.close();
ps.close();
conn.close();
}
}
public class FieldfUtils {
public HashMap<String, String> GetPatMasterMinField() throws Exception{
Properties pro = new Properties();
InputStream in =getClass().getResourceAsStream("PAT_MASTER_Min.properties");
pro.load(in);
HashMap<String, String> mapMaxMin = new HashMap<String, String>();
HashMap<String, String> mapMinMax = new HashMap<String, String>();
Iterator it=pro.entrySet().iterator();
while(it.hasNext()){
Map.Entry entry=(Map.Entry)it.next();
String key = (String) entry.getKey();
String value = (String) entry.getValue();
mapMaxMin.put(key, value);
mapMinMax.put(value,key);
}
return mapMaxMin;
}
}
PAT_MASTER_Min.properties-----------------------------
PATIENT_ID=a1
INP_NO=a2
NAME=a3
NAME_PHONETIC=a4
SEX=a5
DATE_OF_BIRTH=a6
BIRTH_PLACE=a7
CITIZENSHIP=a8
#
左邊是oralce字段 右邊是Mongdb字段 自己定義就行了