達夢數據庫升級和配置以及部分異常處理
背景
最近幾天發現一個達夢數據庫出現多次報錯
後臺的提示信息是:
Cause: dm.jdbc.driver.DMException: 超出全局hash join空間,適當增加HJ_BUF_GLOBAL_SIZE
感覺比較奇怪. 因爲內存空間自己設置的應該是沒問題的.
耗費了很長的時間進行問題整改. 所以這裏想總結一下.
問題過程
自己從 達夢 8.1的如下版本 備份了數據庫:
1-1-190-21.03.26-137190-ENT
然後再如下版本的數據庫上面執行了恢復
03134284132-20240115-215128-20081
鏈接應用後一直報錯:
超出全局hash join空間,適當增加HJ_BUF_GLOBAL_SIZE
一開始以爲是 版本的bug 然後上 eco.dameng.Com
下載了更新的版本
03134284172-20240321-222308-20093
升級之後問題依舊.
升級方法
因爲感覺版本號變化不大, 所以直接本地安裝移動文件的方式進行
下載後 mount iso 到本地
安裝 達夢數據庫到 /tmp 路徑下
注意安裝選擇使用 自定義模式, 只選擇 1 2 3 4 不創建數據庫
然後停止數據庫的服務 systemctl stop DmServiceDMSERVER
然後將 /opt/dmdbms/下面的 bin 和 bin2 目錄都覆蓋成 tmp錄下的
需要注意 原來的 bin 目錄下面的DmServiceDMSERVER 需要保留
然後重啓數據庫就可以了
systemctl start DmServiceDMSERVER
內存參數設置問題
達夢數據庫沒有整體的內存配置參數
需要多個參數共同生效.
cat /opt/dmdbms/data/DAMENG/dm.ini
MAX_OS_MEMORY = 30 #發現這個參數 不是自己理解的. 內存使用量超過30%
MEMORY_POOL = 500 #單位MB 有多個.
MEMORY_N_POOLS = 1 #內存池的個數..
MEMORY_TARGET = 6144 #單位MB, 備註是共享池的大小. 感覺名不對題呢
MEMORY_EXTENT_SIZE = 32 # 懷疑是內存區塊大小, 具體含義不明
MEMORY_LEAK_CHECK = 0 #Memory Pool Leak Checking Flag
MEMORY_MAGIC_CHECK = 1 #Memory Pool Magic Checking Flag
HUGEPAGE_THRESHOLD = 16 #IF not zero, try using hugepage if allocating size >= threshold * 2M
MEMORY_BAK_POOL = 4 #Memory Backup Pool Size In Megabyte
HUGE_MEMORY_PERCENTAGE = 50 #Maximum percent of HUGE buffer that can be allocated to work as common memory pool
HUGE_BUFFER = 80 #Initial Huge Buffer Size In Megabytes
HUGE_BUFFER_POOLS = 4 #number of Huge buffer pools
BUFFER = 1000 #Initial System Buffer Size In Megabytes
BUFFER_POOLS = 8 #應該是兩者的成績是 buff 區域的大小. 這樣的話是 8G的buffer區域.默認值好像是19G
FAST_POOL_PAGES = 3000 #number of pages for fast pool
FAST_ROLL_PAGES = 1000 #number of pages for fast roll pages
KEEP = 8 #system KEEP buffer size in Megabytes
RECYCLE = 300 #system RECYCLE buffer size in Megabytes
RECYCLE_POOLS = 8 #回收池因該是 2.4G了
ROLLSEG = 1 #system ROLLSEG buffer size in Megabytes
ROLLSEG_POOLS = 8 #Number of rollseg buffer pools
MULTI_PAGE_GET_NUM = 1 #Maximum number of pages for each read of buffer
PRELOAD_SCAN_NUM = 0 #The number of pages scanned continuously to start preload task
PRELOAD_EXTENT_NUM = 0 #The number of clusters preloaded for the first time
SORT_BUF_SIZE = 20 #maximum sort buffer size in Megabytes
SORT_BLK_SIZE = 1 #maximum sort blk size in Megabytes
SORT_BUF_GLOBAL_SIZE = 1000 #maximum global sort buffer size in Megabytes
SORT_FLAG = 1 #choose method of sort
HAGR_HASH_SIZE = 100000 #hash table size for hagr
HJ_BUF_GLOBAL_SIZE = 10240 #maximum hash buffer size for all hash join in Megabytes
HJ_BUF_SIZE = 50 #maximum hash buffer size for single hash join in Megabytes
HJ_BLK_SIZE = 2 #hash buffer size allocated each time for hash join in Megabytes
HAGR_BUF_GLOBAL_SIZE = 5000 #maximum buffer size for all hagr in Megabytes
HAGR_BUF_SIZE = 500 #maximum buffer size for single hagr in Megabytes
HAGR_BLK_SIZE = 2 #buffer size allocated each time for hagr in Megabytes
MTAB_MEM_SIZE = 8 #memory table size in Kilobytes
FTAB_MEM_SIZE = 0 #file table package size in Kilobytes
MMT_GLOBAL_SIZE = 4000 #memory map table global size in megabytes
MMT_SIZE = 0 #memory map table size in megabytes
MMT_FLAG = 1 #ways of storing bdta data in memory map table
DICT_BUF_SIZE = 50 #dictionary buffer size in Megabytes
HFS_CACHE_SIZE = 160 #hfs cache size in Megabytes, used in huge horizon table for insert, update,delete
VM_STACK_SIZE = 256 #VM stack size in Kilobytes
VM_POOL_SIZE = 64 #VM pool size in Kilobytes
VM_POOL_TARGET = 16384 #VM pool target size in Kilobytes
SESS_POOL_SIZE = 64 #session pool size in Kilobytes
SESS_POOL_TARGET = 16384 #session pool target size in Kilobytes
RT_HEAP_TARGET = 8192 #runtime heap target size in Kilobytes
VM_MEM_HEAP = 0 #Whether to allocate memory to VM from HEAP
RFIL_RECV_BUF_SIZE = 16 #redo file recover buffer size in Megabytes
COLDATA_POOL_SIZE = 0 #coldata pool size for each worker group
HAGR_DISTINCT_HASH_TABLE_SIZE = 10000 #Size of hagr distinct hash table
CNNTB_HASH_TABLE_SIZE = 100 #Size of hash table in connect-by operation
GLOBAL_RTREE_BUF_SIZE = 100 #The total size of buffer for rtree
SINGLE_RTREE_BUF_SIZE = 10 #The size of buffer for single rtree
SORT_OPT_SIZE = 0 #once max memory size of radix sort assist count array
TSORT_OPT = 1 #minimizing memory allocation during small rowset sorting if possible
DFS_BUF_FLUSH_OPT = 0 #Whether to flush buffer page in opt mode for DFS storage
BIND_PLN_PERCENT = 30 #Maximum percent of bind plan in plan cache pool
FBACK_HASH_SIZE = 10000 #hash table size for flashback function
XBOX_MEMORY_TARGET = 1024 #Memory target size in Megabyte of XBOX system
LIKE_PATTERN_NUM = 300 #The maximum length of like pattern-matching
MEM_POOL_EXTEND_MODE = 7 #Memory pool extend policy
定期處理統計信息
systemctl restart DmServiceDMSERVER
sleep 20
cd /opt/dmdbms/bin/
./disql mydbname/[email protected] <<EOS
select id_code() ;
DBMS_STATS.GATHER_SCHEMA_STATS('mydbname',100,TRUE,'FOR ALL COLUMNS SIZE AUTO');
exit
EOS
設置計劃任務
1 */12 * * * /deploy/perfdm
進行處理
