Clickhouse自帶系統庫system,啓動時創建系統表,無數據文件,主要用於記錄系統信息,我們可以同過系統表來查看clickhouse運行狀態。
processes:當前連接進程信息
>select query_id,initial_user,initial_address,elapsed,query from system.processes;
is_initial_query: |
1 |
user: |
default |
query_id: |
b589a0a1-440a-4cd7-a03e-e6da0ddc427b |
address: |
127.0.0.1 |
port: |
39714 |
initial_user: |
default |
initial_query_id: |
b589a0a1-440a-4cd7-a03e-e6da0ddc427b |
initial_address: |
127.0.0.1 |
initial_port: |
39714 |
interface: |
1 |
os_user: |
root |
client_hostname: |
A01-R21-I55-99-9001887.LOCAL |
client_name: |
ClickHouse |
client_version_major: |
18 |
client_version_minor: |
14 |
client_version_patch: |
19 |
client_revision: |
54409 |
http_method: |
0 |
http_user_agent: |
|
quota_key: |
|
elapsed: |
0.001502786 |
is_cancelled: |
0 |
read_rows: |
0 |
read_bytes: |
0 |
total_rows_approx: |
0 |
written_rows: |
0 |
written_bytes: |
0 |
memory_usage: |
0 |
peak_memory_usage: |
121 |
query: |
Select * from … |
thread_numbers: |
[74] |
ProfileEvents.Names: |
['Query','SelectQuery','ReadCompressedBytes','CompressedReadBufferBlocks','CompressedReadBufferBytes','IOBufferAllocs','IOBufferAllocBytes','ContextLock','RWLockAcquiredReadLocks'] |
ProfileEvents.Values: |
[1,1,36,1,10,1,57,4,1] |
Settings.Names: |
['max_threads','max_query_size','queue_max_wait_ms','use_uncompressed_cache','background_pool_size','load_balancing','max_memory_usage'] |
Settings.Values: |
['48','262144000','5000000','0','64','random','50000000000'] |
replicas:查看當前複製信息
>select database,table,is_leader,is_readonly,is_session_expired,future_parts,parts_to_check,columns_version,queue_size,inserts_in_queue,merges_in_queue,log_max_index,log_pointer,total_replicas,active_replicasFROM system.replicas WHERE is_readonly OR is_session_expired OR future_parts > 20 OR parts_to_check > 10 OR queue_size > 20 OR inserts_in_queue > 10 OR log_max_index - log_pointer > 10 OR total_replicas < 2 OR active_replicas < total_replicas;
如果結果返回有值,則有延遲,需要排查。
asynchronous_metrics:系統性能表,非實時
與metrics計算方式不同,jemalloc是內存分配算法:
metrics:系統信息指標,實時
Query |
當前連接數量 |
Merge |
當前後臺合併數量 |
PartMutation |
當前更改的數量delete\update |
ReplicatedFetch |
從副本獲取的數據 |
ReplicatedSend |
發送到副本的數據 |
ReplicatedChecks |
一致性校驗的數量 |
BackgroundPoolTask |
|
BackgroundSchedulePoolTask |
|
DiskSpaceReservedForMerge |
|
DistributedSend |
分佈式表發送遠程的連接數 |
QueryPreempted |
|
TCPConnection |
TCP連接數量 |
HTTPConnection |
HTTP連接數量 |
InterserverConnection |
|
OpenFileForRead |
打開讀文件數 |
OpenFileForWrite |
打開寫文件數 |
Read |
|
Write |
|
SendExternalTables |
|
QueryThread |
查詢處理線程數 |
ReadonlyReplica |
|
LeaderReplica |
|
MemoryTracking |
當前查詢內存分配的數量 |
MemoryTrackingInBackgroundProcessingPool |
|
MemoryTrackingInBackgroundSchedulePool |
|
MemoryTrackingForMerges |
合併分配的內存數量 |
LeaderElection |
|
EphemeralNode |
|
ZooKeeperSession |
|
ZooKeeperWatch |
|
ZooKeeperRequest |
|
DelayedInserts |
|
ContextLockWait |
|
StorageBufferRows |
|
StorageBufferBytes |
|
DictCacheRequests |
|
Revision |
|
RWLockWaitingReaders |
|
RWLockWaitingWriters |
|
RWLockActiveReaders |
|
RWLockActiveWriters |
build_options:軟件信息
name |
value |
VERSION_FULL |
ClickHouse 18.14.19 |
VERSION_DESCRIBE |
v18.14.19-testing |
VERSION_GITHASH |
8883b8888de0a4b9b8a1687b450c4dd99a97f066 |
VERSION_REVISION |
54409 |
BUILD_DATE |
2018-12-20 |
BUILD_TYPE |
Release |
SYSTEM |
Linux-3.10.0-957.1.3.el7.x86_64 |
SYSTEM_PROCESSOR |
x86_64 |
LIBRARY_ARCHITECTURE |
|
CMAKE_VERSION |
3.12.2 |
C_COMPILER |
/opt/rh/devtoolset-7/root/usr/bin/gcc |
C_COMPILER_VERSION |
7.3.1 |
CXX_COMPILER |
/opt/rh/devtoolset-7/root/usr/bin/g++ |
CXX_COMPILER_VERSION |
7.3.1 |
C_FLAGS |
-pipe -msse4.1 -msse4.2 -mpopcnt -fno-omit-frame-pointer -Wall -no-pie -O2 -DNDEBUG |
CXX_FLAGS |
-pipe -msse4.1 -msse4.2 -mpopcnt -fno-omit-frame-pointer -Wall -Wnon-virtual-dtor -no-pie -O2 -DNDEBUG |
LINK_FLAGS |
-static-libgcc -static-libstdc++ |
BUILD_COMPILE_DEFINITIONS |
|
BUILD_INCLUDE_DIRECTORIES |
|
STATIC |
ON |
USE_EMBEDDED_COMPILER |
0 |
USE_INTERNAL_MEMCPY |
ON |
USE_GLIBC_COMPATIBILITY |
ON |
USE_JEMALLOC |
1 |
USE_TCMALLOC |
|
USE_UNWIND |
1 |
USE_ICU |
1 |
USE_MYSQL |
1 |
USE_RE2_ST |
1 |
USE_VECTORCLASS |
|
USE_RDKAFKA |
1 |
USE_CAPNP |
1 |
USE_POCO_SQLODBC |
|
USE_POCO_DATAODBC |
1 |
USE_POCO_MONGODB |
1 |
USE_POCO_NETSSL |
1 |
Clusters:集羣信息
>select c.shard_num,c.host_name as master_host,d.host_name as rep_host from (select shard_num,host_name from system.clusters where replica_num=1) as c left join (select shard_num,host_name from system.clusters where replica_num=2) as d on c.shard_num=d.shard_num
cluster:羣集名稱
shard_num:集羣中的分片編號,從1開始
shard_weight:寫入數據時分片的相對權重,1
replica_num:分片中的副本號,從1開始
host_name:主機名,在config中指定
host_address:從DNS獲取的主機IP地址
port:用於連接服務器的端口,9000
is_local: 是不是當前所在機器,1
user:用於連接服務器的用戶的名稱,默認default
data_type_families:數據類型
ClickHouse release 18.16.1版本新加的系統表
name:數據類型名稱
case_insensitive:是否區分大小寫,0不區分,1區分
alias_to:別名,BIGINT=Int64,TEXT=String
collations:字符集排序規則
databases、tables、columns
庫、表、列信息
functions:函數信息
formats:輸出格式
XML、JSON、Vertical、CSV等等
SELECT * FROM system.formats FORMAT JSON;
events:已處理的系統事件監控
Query |
總查詢數 |
SelectQuery |
僅select數量 |
InsertQuery |
僅insert數量 |
FileOpen |
打開文件數量 |
ReadBufferFromFileDescriptorRead |
文件描述符的讀取次數 |
ReadBufferFromFileDescriptorReadBytes |
從文件描述符讀取的字節數 |
WriteBufferFromFileDescriptorWrite |
文件描述符的寫入次數 |
WriteBufferFromFileDescriptorWriteBytes |
寫入文件描述符的字節數 |
InsertedRows |
插入到所有表的行數 |
MergedRows |
合併前的行數 |
MergesTimeMilliseconds |
後臺合併花費總時間 |
merges:正在進行合併的信息
database: |
db |
table: |
table |
elapsed: |
0.038135789 |
progress: |
0.294799805 |
num_parts: |
5 |
source_part_names: |
['20181231_12026210_12026567_44','20181231_12026568_12026568_0','20181231_12026570_12026570_0','20181231_12026572_12026572_0','20181231_12026574_12026574_0'] |
result_part_name: |
20181231_12026210_12026574_45 |
partition_id: |
20181231 |
total_size_bytes_compressed: |
560012 |
total_size_marks: |
7 |
bytes_read_uncompressed: |
3824250 |
rows_read: |
16905 |
bytes_written_uncompressed: |
1852376 |
rows_written: |
8192 |
columns_written: |
0 |
memory_usage: |
152843009 |
thread_number: |
62 |
numbers 、numbers_mt:測試使用,從零開始的所有自然數
one:測試使用,類似於其他DBMS中的DUAL表
settings:查看當前設置信息
max_threads |
最大線程 |
max_block_size |
讀取最大塊大小 |
load_balancing |
random分佈式隨機選取副本 |
force_primary_key |
強制使用主鍵,無主鍵報錯 |
force_index_by_date |
強制使用時間,無時間報錯 |
log_query_settings |
將日誌寫入系統表query_log |
log_queries |
是否打開全日誌 |
max_memory_usage |
單個查詢最大使用內存,0爲無限制 |
parts、parts_columns:查看分區表信息
>select database,table,partition_id,partition,name,active,rows,path,modification_time from system.parts where table='';
zookeeper :未配置ZooKeeper,則表不存在
>select * from system.zookeeper WHERE path = '/clickhouse/tables/02-02/cluster/' and name='metadata' FORMAT Vertical