在ArcGIS Engine程序開發過程中是否遇到過要將新獲取的數據向已有要素類中插入?對於數據插入的幾種方法您是否清楚?各種方法的效率您對比過嗎?今天我們討論的話題爲Engine中如何往已有要素類中插入數據,上述問題的答案會爲您一一揭曉。
一、往已有要素類中插入數據的幾種方式及其優缺點:
1,IFeatureClass.CreateFeature配合IFeature.Store使用。該方法在調用Store時會觸發所有與Feature相關的行爲,不但會觸發IObjectClassEvents,還會觸發涉及網絡、註記要素,以及參與拓撲的要素等特殊的行爲(比如向參加拓撲的要素類中添加要素後會自動創建dirty area)。
該方法在調用CreateFeature方法時,創建要素的OID,執行Store時將要素存入數據庫中。
優點:代碼簡單;
缺點:效率低,如果僅僅插入幾個要素或者進行測試而不考慮性能的話可以考慮。
2,IFeatureClass.CreateFeatureBuffer配合insert cursor使用。不會觸發事件,該方法常常用來一次性插入大量要素,比第一種方法效率高很多。此外,IFeatureClass.Insert(bool useBuffering)方法中參數useBuffering建議總將其設爲true,這樣數據會先緩衝在客戶端,然後執行Flush時批量寫入,以提升效率。
該方法創建的IFeatureBuffer可以進行多次賦值,在執行InsertFeature時,創建要素的OID,但是此時數據並沒有寫入到數據庫中,只有在執行IFeatureCursor.Flush時數據纔會真正寫入到數據庫中。注意Flush方法是需要手動調用的,如果不執行,在程序釋放或者Buffer滿了會自動執行,但這樣會無法檢測錯誤,比如要素類空間不夠了就會報錯。
優點:效率高,尤其是插入大量數據時。如果僅就性能而言,除非插入一個要素,其餘情況都推薦使用該方法;
缺點:代碼相比第一種,稍顯複雜,注意需要釋放ICursor和IFeatureBuffer對象。
這裏提一下,該方法中涉及到cursor的釋放,有兩種方法釋放遊標:
a, 直接使用ComReleaser.ReleaseCOMObject(cursor); 或者Marshal.FinalReleaseComObject(cursor);
b, 使用using(){ }方式,如下:
using(ComReleaser comReleaser = new ComReleaser())
{
// Create a feature buffer.
IFeatureBuffer featureBuffer = featureClass.CreateFeatureBuffer();
comReleaser.ManageLifetime(featureBuffer);
// Create an insert cursor.
IFeatureCursor insertCursor = featureClass.Insert(true);
comReleaser.ManageLifetime(insertCursor);
…
}
執行完using後會自動釋放insertCursor和featureBuffer,可以避免程序比較複雜時不確定在哪釋放或者忘記釋放的情況,是比較優秀的編程方式,推薦使用。
3,使用Load-Only模式插入數據(SDE以及FileGDB都支持)。這種方法是對第二種方法的升級,主要用來在插入數據量特別大的情況下提高性能。Load-Only模式僅能用來插入新的要素,而不能用於編輯已有要素。原理是開啓Load-Only模式後,插入數據時會停止更新空間索引和屬性索引,解除Load-Only後才重建索引(重建索引是重建該要素類所有要素的索引,如果已有要素類中含有大量要素,而插入數據量不太大時,重建索引可能會影響性能)。開啓Load-Only模式時,其它程序不能訪問該數據,可以在獲取排它鎖之後設置Load-Only。如下:
// Cast the feature class to the IFeatureClassLoad interface.
IFeatureClassLoad featureClassLoad = (IFeatureClassLoad)featureClass;
// Acquire an exclusive schema lock for the class.
ISchemaLock schemaLock = (ISchemaLock)featureClass;
try
{
schemaLock.ChangeSchemaLock(esriSchemaLock.esriExclusiveSchemaLock);
// Enable load-only mode on the feature class.
featureClassLoad.LoadOnlyMode = true;
using(ComReleaser comReleaser = new ComReleaser())
{
// Create the feature buffer.
IFeatureBuffer featureBuffer = featureClass.CreateFeatureBuffer();
comReleaser.ManageLifetime(featureBuffer);
// Create an insert cursor.
IFeatureCursor insertCursor = featureClass.Insert(true);
comReleaser.ManageLifetime(insertCursor);
…
}
}
catch (Exception)
{
// Handle the failure in a way appropriate to the application.
}
finally
{
// Disable load-only mode on the feature class.
featureClassLoad.LoadOnlyMode = false;
// Demote the exclusive schema lock to a shared lock.
schemaLock.ChangeSchemaLock(esriSchemaLock.esriSharedSchemaLock);
}
插入數據常用的就是以上三種方式,下面兩種方式也可以插入數據,但是不常用,簡要介紹一下。
4,IObjectLoader.LoadObjects方法。該方法只能在Desktop產品下使用,也就是Engine許可無法使用,相比之前的方法,該方法代碼簡單,對於屬性值的複製也更爲簡單,如下:
IObjectLoader objectLoader = new ObjectLoaderClass();
IFeatureClass sourceFeatureClass = getFeatureClass("esriDataSourcesGDB.FileGDBWorkspaceFactory", fileGDBPath, sourceFCName);
IFeatureClass targetFeatureClass = getFeatureClass("esriDataSourcesGDB.SdeWorkspaceFactory", sdePath, targetFCName);
string sInFieldList = targetFeatureClass.Fields.get_Field(0).Name;
for(int i=1;i< targetFeatureClass.Fields.FieldCount;i++)
sInFieldList = sInFieldList + "," + targetFeatureClass.Fields.get_Field(i).Name;
IQueryFilter queryFilter = new QueryFilterClass();
queryFilter.WhereClause = queryClause;
queryFilter.SubFields = sInFieldList;
IEnumInvalidObject invalidObject;
objectLoader.LoadObjects(null, sourceFeatureClass as ITable, queryFilter, targetFeatureClass as ITable, targetFeatureClass.Fields, false, 0, false, false, 1000, out invalidObject);
優點:代碼簡單,屬性值複製也更爲簡單;
缺點:只能在Desktop許可下使用。
5,IFeatureClass.CreateFeature配合IFeatureClassWrite.WriteFeature/WriteFeatures使用。IFeatureClassWrite是low-level的接口,不會觸發任何事件。只是使用WriteFeature/WriteFeatures替換IFeature.Store將要素寫入數據庫,用的人很少。
以上就是插入數據的幾種方式,您是否都清楚了?接下來,在程序的編寫過程中有哪些需要注意的呢?
a, 以下數據類型需要EngineGeoDB許可或者Desktop產品的Standard或者Advanced許可:涉及幾何網絡、拓撲、Dimension要素類、註記類、ArcSDE數據庫的。
b, 以下情況需要開啓編輯會話:涉及拓撲、幾何網絡、terrain、representation以及ArcSDE中的版本數據的。
c, 在給要素賦予Shape時,有必要執行一下ITopologicalOperator.Simplify來驗證幾何,尤其是往SDE中插入時,有幾何錯誤會導致失敗。
d, 插入數據可能導致要素類的Extent發生變化,插入完後建議調用IFeatureClassManage. UpdateExtent更新範圍(需要獲取要素類的排他鎖,也就是不能有別的用戶或程序訪問該要素類),不然有可能執行縮放到圖層或全圖時數據顯示不全。
e, Geometry的空間參考需要與目標要素類的空間參考相一致,否則會進行動態投影而影響性能。
f, 如果源要素類中有Z值或M值,注意賦Shape時需要使用IZAware或者IMAware進行設置。
二、效率對比
由於經常碰到用戶需要將本地數據庫的數據往SDE中導入,所以本文以將FileGDB中的點要素類插入到ArcSDE中已有的字段結構相同的要素類中爲例進行測試。
代碼可參考:ArcObjects幫助文檔
測試結果:
1, 將100個點要素從FileGDB中插入SDE要素類中使用五種方法分別用時:2.25秒、0.19秒、0.21秒、0.23秒、2.40秒。
2, 將10000個點要素從FileGDB中插入SDE要素類中使用五種方法分別用時:185秒、14.5秒、11.3秒、13.2秒、204秒。
3, 將100000個點要素從FileGDB中插入SDE要素類中使用五種方法分別用時:1345秒、163秒、127秒、146秒、1409秒。
4, 文中提到使用遊標方式插入數據,如果將IFeatureClass.Insert(bool useBuffering)方法中參數useBuffering設爲true會提高效率,現在就來測試一下。將100000個點要素插入SDE中,設爲false所用時間爲:164秒,設爲true所用時間爲:122秒。
5, 開啓編輯會話會不會提高效率呢?將100000個點要素插入SDE中,設爲false所用時間爲:161秒,設爲true所用時間爲:117秒。相比不開啓編輯會話,幾乎沒有差別。
從上述測試結果可以看出:
a, 無論是插入少量數據還是插入大量數據,Insert方式都比CreateFeature方式快;
b, 如果僅插入少量數據,使用LoadOnly模式反而會慢(文中插入100個點),如果插入大量要素使用LoadOnly會快(文中插入1萬和10萬個點),但是如果該要素類中已有大量要素,而僅插入不是太多數據的話重建索引可能會影響性能;
c, IFeatureClassWrite.WriteFeature方法比IFeature.Store還要慢,這大概也是該方法用的很少的原因之一吧;
d, IObjectLoader.LoadObjects方法比Insert稍快,但是比LoadOnly要慢些(文中插入1萬和10萬個點)。由於測試數據中僅含有兩個自定義字段,如果字段個數較多的話,我覺得這種方法會更快;
e, IFeatureClass.Insert(bool useBuffering)方法中參數useBuffering設爲true確實可以提高效率;
f, 開啓編輯會話與不開啓效率幾乎一樣,當然如果涉及到拓撲,幾何網絡等複雜情況時必須開啓編輯會話。
完整代碼:
using ESRI.ArcGIS.ADF;
using ESRI.ArcGIS.Catalog;
using ESRI.ArcGIS.EditorExt;
using ESRI.ArcGIS.esriSystem;
using ESRI.ArcGIS.Geodatabase;
using System;
using System.Collections.Generic;
using System.ComponentModel;
using System.Data;
using System.Diagnostics;
using System.Drawing;
using System.Linq;
using System.Text;
using System.Threading.Tasks;
using System.Windows.Forms;
namespace insertingFeatures
{
public partial class Form1 : Form
{
public Form1()
{
InitializeComponent();
}
string sdePath = @"C:\Users\Xinying\AppData\Roaming\ESRI\Desktop10.4\ArcCatalog\Connection to 192.168.220.132 (3).sde";
string fileGDBPath = Application.StartupPath + "\\test.gdb";
string sourceFCName = "testPoint_10w";
string targetFCName = "testPoint_10w_sde";
string queryClause = "OBJECTID <101";
private void createFeatureToolStripMenuItem_Click(object sender, EventArgs e)
{
Stopwatch myWatch = Stopwatch.StartNew();
IFeatureClass sourceFeatureClass = getFeatureClass("esriDataSourcesGDB.FileGDBWorkspaceFactory", fileGDBPath, sourceFCName);
IFeatureClass targetFeatureClass = getFeatureClass("esriDataSourcesGDB.SdeWorkspaceFactory", sdePath, targetFCName);
createFeature(sourceFeatureClass, targetFeatureClass);
myWatch.Stop();
string time = myWatch.Elapsed.TotalSeconds.ToString();
MessageBox.Show(time + " Seconds");
}
public void createFeature(IFeatureClass sourceFeatureClass, IFeatureClass targetFeatureClass)
{
IQueryFilter queryFilter = new QueryFilterClass();
queryFilter.WhereClause = queryClause;
IFeatureCursor cursor = sourceFeatureClass.Search(queryFilter, true);
IFeature sourceFeature = cursor.NextFeature();
while (sourceFeature != null)
{
IFeature targetFeature = targetFeatureClass.CreateFeature();
//如果是線或面要素類需要執行下Simplify,這裏用的點要素類,不做驗證了
targetFeature.Shape = sourceFeature.ShapeCopy;
for (int i = 0; i < sourceFeature.Fields.FieldCount; i++)
{
IField field = sourceFeature.Fields.get_Field(i);
if (field.Type != esriFieldType.esriFieldTypeOID && field.Type != esriFieldType.esriFieldTypeGeometry && field.Type != esriFieldType.esriFieldTypeGlobalID && field.Type != esriFieldType.esriFieldTypeGUID)
{
string fieldName = field.Name;
int index = targetFeature.Fields.FindField(fieldName);
if (index > -1 && fieldName != "Shape_Length" && fieldName != "Shape_Area")
targetFeature.set_Value(index, sourceFeature.get_Value(i));
}
}
targetFeature.Store();
sourceFeature = cursor.NextFeature();
}
ComReleaser.ReleaseCOMObject(cursor);
IFeatureClassManage targetFeatureClassManage = targetFeatureClass as IFeatureClassManage;
targetFeatureClassManage.UpdateExtent();
}
private IFeatureClass getFeatureClass(string WorkspaceFactoryProgID, string GDBPath, string featureClassName)
{
IWorkspaceName workspaceName = new WorkspaceNameClass
{
WorkspaceFactoryProgID = WorkspaceFactoryProgID,
PathName = GDBPath
};
IName workspaceIName = (IName)workspaceName;
IWorkspace workspace = (IWorkspace)workspaceIName.Open();
IFeatureClass featureClass = (workspace as IFeatureWorkspace).OpenFeatureClass(featureClassName);
return featureClass;
}
private void insertFeatureToolStripMenuItem_Click(object sender, EventArgs e)
{
Stopwatch myWatch = Stopwatch.StartNew();
IFeatureClass sourceFeatureClass = getFeatureClass("esriDataSourcesGDB.FileGDBWorkspaceFactory", fileGDBPath, sourceFCName);
IFeatureClass targetFeatureClass = getFeatureClass("esriDataSourcesGDB.SdeWorkspaceFactory", sdePath, targetFCName);
InsertFeaturesUsingCursor(sourceFeatureClass, targetFeatureClass);
myWatch.Stop();
string time = myWatch.Elapsed.TotalSeconds.ToString();
MessageBox.Show(time + " Seconds");
}
public void InsertFeaturesUsingCursor(IFeatureClass sourceFeatureClass, IFeatureClass targetFeatureClass)
{
using (ComReleaser comReleaser = new ComReleaser())
{
// Create a feature buffer.
IFeatureBuffer featureBuffer = targetFeatureClass.CreateFeatureBuffer();
comReleaser.ManageLifetime(featureBuffer);
// Create an insert cursor.
IFeatureCursor insertCursor = targetFeatureClass.Insert(true);
comReleaser.ManageLifetime(insertCursor);
IQueryFilter queryFilter = new QueryFilterClass();
queryFilter.WhereClause = queryClause;
IFeatureCursor cursor = sourceFeatureClass.Search(queryFilter, true);
IFeature sourceFeature = cursor.NextFeature();
while (sourceFeature != null)
{
//如果是線或面要素類需要執行下Simplify,這裏用的點要素類,不做驗證了
featureBuffer.Shape = sourceFeature.ShapeCopy;
for (int i = 0; i < sourceFeature.Fields.FieldCount; i++)
{
IField field = sourceFeature.Fields.get_Field(i);
if (field.Type != esriFieldType.esriFieldTypeOID && field.Type != esriFieldType.esriFieldTypeGeometry && field.Type != esriFieldType.esriFieldTypeGlobalID && field.Type != esriFieldType.esriFieldTypeGUID)
{
string fieldName = field.Name;
int index = featureBuffer.Fields.FindField(fieldName);
if (index > -1 && fieldName != "Shape_Length" && fieldName != "Shape_Area")
featureBuffer.set_Value(index, sourceFeature.get_Value(i));
}
}
insertCursor.InsertFeature(featureBuffer);
sourceFeature = cursor.NextFeature();
}
// Flush the buffer to the geodatabase.
insertCursor.Flush();
ComReleaser.ReleaseCOMObject(cursor);
}
IFeatureClassManage targetFeatureClassManage = targetFeatureClass as IFeatureClassManage;
targetFeatureClassManage.UpdateExtent();
}
private void loadOnlyToolStripMenuItem_Click(object sender, EventArgs e)
{
Stopwatch myWatch = Stopwatch.StartNew();
IFeatureClass sourceFeatureClass = getFeatureClass("esriDataSourcesGDB.FileGDBWorkspaceFactory", fileGDBPath, sourceFCName);
IFeatureClass targetFeatureClass = getFeatureClass("esriDataSourcesGDB.SdeWorkspaceFactory", sdePath, targetFCName);
LoadOnlyModeInsert(sourceFeatureClass, targetFeatureClass);
myWatch.Stop();
string time = myWatch.Elapsed.TotalSeconds.ToString();
MessageBox.Show(time + " Seconds");
}
public void LoadOnlyModeInsert(IFeatureClass sourceFeatureClass, IFeatureClass targetFeatureClass)
{
// Cast the feature class to the IFeatureClassLoad interface.
IFeatureClassLoad featureClassLoad = (IFeatureClassLoad)targetFeatureClass;
// Acquire an exclusive schema lock for the class.
ISchemaLock schemaLock = (ISchemaLock)targetFeatureClass;
try
{
schemaLock.ChangeSchemaLock(esriSchemaLock.esriExclusiveSchemaLock);
// Enable load-only mode on the feature class.
featureClassLoad.LoadOnlyMode = true;
using (ComReleaser comReleaser = new ComReleaser())
{
// Create the feature buffer.
IFeatureBuffer featureBuffer = targetFeatureClass.CreateFeatureBuffer();
comReleaser.ManageLifetime(featureBuffer);
// Create an insert cursor.
IFeatureCursor insertCursor = targetFeatureClass.Insert(true);
comReleaser.ManageLifetime(insertCursor);
IQueryFilter queryFilter = new QueryFilterClass();
queryFilter.WhereClause = queryClause;
IFeatureCursor cursor = sourceFeatureClass.Search(queryFilter, true);
IFeature sourceFeature = cursor.NextFeature();
while (sourceFeature != null)
{
//如果是線或面要素類需要執行下Simplify,這裏用的點要素類,不做驗證了
featureBuffer.Shape = sourceFeature.ShapeCopy;
for (int i = 0; i < sourceFeature.Fields.FieldCount; i++)
{
IField field = sourceFeature.Fields.get_Field(i);
if (field.Type != esriFieldType.esriFieldTypeOID && field.Type != esriFieldType.esriFieldTypeGeometry && field.Type != esriFieldType.esriFieldTypeGlobalID && field.Type != esriFieldType.esriFieldTypeGUID)
{
string fieldName = field.Name;
int index = featureBuffer.Fields.FindField(fieldName);
if (index > -1 && fieldName != "Shape_Length" && fieldName != "Shape_Area")
featureBuffer.set_Value(index, sourceFeature.get_Value(i));
}
}
insertCursor.InsertFeature(featureBuffer);
sourceFeature = cursor.NextFeature();
}
// Flush the buffer to the geodatabase.
insertCursor.Flush();
ComReleaser.ReleaseCOMObject(cursor);
IFeatureClassManage targetFeatureClassManage = targetFeatureClass as IFeatureClassManage;
targetFeatureClassManage.UpdateExtent();
}
}
catch (Exception)
{
// Handle the failure in a way appropriate to the application.
MessageBox.Show("無法獲取該要素類的排它鎖,檢查ArcMap是否打開了該要素類,建議關閉!");
}
finally
{
// Disable load-only mode on the feature class.
featureClassLoad.LoadOnlyMode = false;
// Demote the exclusive schema lock to a shared lock.
schemaLock.ChangeSchemaLock(esriSchemaLock.esriSharedSchemaLock);
}
}
private void objectLoaderToolStripMenuItem_Click(object sender, EventArgs e)
{
Stopwatch myWatch = Stopwatch.StartNew();
IObjectLoader objectLoader = new ObjectLoaderClass();
IFeatureClass sourceFeatureClass = getFeatureClass("esriDataSourcesGDB.FileGDBWorkspaceFactory", fileGDBPath, sourceFCName);
IFeatureClass targetFeatureClass = getFeatureClass("esriDataSourcesGDB.SdeWorkspaceFactory", sdePath, targetFCName);
string sInFieldList = targetFeatureClass.Fields.get_Field(0).Name;
for (int i = 1; i < targetFeatureClass.Fields.FieldCount; i++)
sInFieldList = sInFieldList + "," + targetFeatureClass.Fields.get_Field(i).Name;
IQueryFilter queryFilter = new QueryFilterClass();
queryFilter.WhereClause = queryClause;
queryFilter.SubFields = sInFieldList;
IEnumInvalidObject invalidObject;
objectLoader.LoadObjects(null, sourceFeatureClass as ITable, queryFilter, targetFeatureClass as ITable, targetFeatureClass.Fields, false, 0, false, false, 1000, out invalidObject);
IFeatureClassManage targetFeatureClassManage = targetFeatureClass as IFeatureClassManage;
targetFeatureClassManage.UpdateExtent();
myWatch.Stop();
string time = myWatch.Elapsed.TotalSeconds.ToString();
MessageBox.Show(time + " Seconds");
}
private void comboBox1_SelectedIndexChanged(object sender, EventArgs e)
{
queryClause = comboBox1.Text;
}
private void featureClassWriteToolStripMenuItem_Click(object sender, EventArgs e)
{
Stopwatch myWatch = Stopwatch.StartNew();
IFeatureClass sourceFeatureClass = getFeatureClass("esriDataSourcesGDB.FileGDBWorkspaceFactory", fileGDBPath, sourceFCName);
IFeatureClass targetFeatureClass = getFeatureClass("esriDataSourcesGDB.SdeWorkspaceFactory", sdePath, targetFCName);
featureClassWrite(sourceFeatureClass, targetFeatureClass);
myWatch.Stop();
string time = myWatch.Elapsed.TotalSeconds.ToString();
MessageBox.Show(time + " Seconds");
}
public void featureClassWrite(IFeatureClass sourceFeatureClass, IFeatureClass targetFeatureClass)
{
IQueryFilter queryFilter = new QueryFilterClass();
queryFilter.WhereClause = queryClause;
IFeatureCursor cursor = sourceFeatureClass.Search(queryFilter, true);
IFeature sourceFeature = cursor.NextFeature();
IFeatureClassWrite featureClassWrite = targetFeatureClass as IFeatureClassWrite;
ISet setAdd = new SetClass();
while (sourceFeature != null)
{
IFeature targetFeature = targetFeatureClass.CreateFeature();
//如果是線或面要素類需要執行下Simplify,這裏用的點要素類,不做驗證了
targetFeature.Shape = sourceFeature.ShapeCopy;
for (int i = 0; i < sourceFeature.Fields.FieldCount; i++)
{
IField field = sourceFeature.Fields.get_Field(i);
if (field.Type != esriFieldType.esriFieldTypeOID && field.Type != esriFieldType.esriFieldTypeGeometry && field.Type != esriFieldType.esriFieldTypeGlobalID && field.Type != esriFieldType.esriFieldTypeGUID)
{
string fieldName = field.Name;
int index = targetFeature.Fields.FindField(fieldName);
if (index > -1 && fieldName != "Shape_Length" && fieldName != "Shape_Area")
targetFeature.set_Value(index, sourceFeature.get_Value(i));
}
}
//setAdd.Add(targetFeature);
featureClassWrite.WriteFeature(targetFeature);
sourceFeature = cursor.NextFeature();
}
//featureClassWrite.WriteFeatures(setAdd);//與WriteFeature沒啥效率上的區別
ComReleaser.ReleaseCOMObject(cursor);
IFeatureClassManage targetFeatureClassManage = targetFeatureClass as IFeatureClassManage;
targetFeatureClassManage.UpdateExtent();
}
}
}