Clickhouse 系統表

Clickhouse自帶系統庫system,啓動時創建系統表,無數據文件,主要用於記錄系統信息,我們可以同過系統表來查看clickhouse運行狀態。

processes:當前連接進程信息

>select query_id,initial_user,initial_address,elapsed,query from system.processes;

is_initial_query:

1

user:

default

query_id:

b589a0a1-440a-4cd7-a03e-e6da0ddc427b

address:

127.0.0.1

port:

39714

initial_user:

default

initial_query_id:

b589a0a1-440a-4cd7-a03e-e6da0ddc427b

initial_address:

127.0.0.1

initial_port:

39714

interface:

1

os_user:

root

client_hostname:

A01-R21-I55-99-9001887.LOCAL

client_name:

ClickHouse

client_version_major:

18

client_version_minor:

14

client_version_patch:

19

client_revision:

54409

http_method:

0

http_user_agent:

 

quota_key:

 

elapsed:

0.001502786

is_cancelled:

0

read_rows:

0

read_bytes:

0

total_rows_approx:

0

written_rows:

0

written_bytes:

0

memory_usage:

0

peak_memory_usage:

121

query:

Select * from …

thread_numbers:

[74]

ProfileEvents.Names:

['Query','SelectQuery','ReadCompressedBytes','CompressedReadBufferBlocks','CompressedReadBufferBytes','IOBufferAllocs','IOBufferAllocBytes','ContextLock','RWLockAcquiredReadLocks']

ProfileEvents.Values:

[1,1,36,1,10,1,57,4,1]

Settings.Names:

['max_threads','max_query_size','queue_max_wait_ms','use_uncompressed_cache','background_pool_size','load_balancing','max_memory_usage']

Settings.Values:

['48','262144000','5000000','0','64','random','50000000000']

replicas:查看當前複製信息

>select database,table,is_leader,is_readonly,is_session_expired,future_parts,parts_to_check,columns_version,queue_size,inserts_in_queue,merges_in_queue,log_max_index,log_pointer,total_replicas,active_replicasFROM system.replicas WHERE is_readonly OR is_session_expired OR future_parts > 20 OR parts_to_check > 10 OR  queue_size > 20 OR  inserts_in_queue > 10 OR log_max_index  - log_pointer > 10 OR total_replicas < 2 OR active_replicas < total_replicas;

如果結果返回有值,則有延遲,需要排查。

asynchronous_metrics:系統性能表,非實時

與metrics計算方式不同,jemalloc是內存分配算法:

 

metrics:系統信息指標,實時

Query

當前連接數量

Merge

當前後臺合併數量

PartMutation

當前更改的數量delete\update

ReplicatedFetch

從副本獲取的數據

ReplicatedSend

發送到副本的數據

ReplicatedChecks

一致性校驗的數量

BackgroundPoolTask

 

BackgroundSchedulePoolTask

 

DiskSpaceReservedForMerge

 

DistributedSend

分佈式表發送遠程的連接數

QueryPreempted

 

TCPConnection

TCP連接數量

HTTPConnection

HTTP連接數量

InterserverConnection

 

OpenFileForRead

打開讀文件數

OpenFileForWrite

打開寫文件數

Read

 

Write

 

SendExternalTables

 

QueryThread

查詢處理線程數

ReadonlyReplica

 

LeaderReplica

 

MemoryTracking

當前查詢內存分配的數量

MemoryTrackingInBackgroundProcessingPool

 

MemoryTrackingInBackgroundSchedulePool

 

MemoryTrackingForMerges

合併分配的內存數量

LeaderElection

 

EphemeralNode

 

ZooKeeperSession

 

ZooKeeperWatch

 

ZooKeeperRequest

 

DelayedInserts

 

ContextLockWait

 

StorageBufferRows

 

StorageBufferBytes

 

DictCacheRequests

 

Revision

 

RWLockWaitingReaders

 

RWLockWaitingWriters

 

RWLockActiveReaders

 

RWLockActiveWriters

 

build_options:軟件信息

name

value

VERSION_FULL

ClickHouse 18.14.19

VERSION_DESCRIBE

v18.14.19-testing

VERSION_GITHASH

8883b8888de0a4b9b8a1687b450c4dd99a97f066

VERSION_REVISION

54409

BUILD_DATE

2018-12-20

BUILD_TYPE

Release

SYSTEM

Linux-3.10.0-957.1.3.el7.x86_64

SYSTEM_PROCESSOR

x86_64

LIBRARY_ARCHITECTURE

 

CMAKE_VERSION

3.12.2

C_COMPILER

/opt/rh/devtoolset-7/root/usr/bin/gcc

C_COMPILER_VERSION

7.3.1

CXX_COMPILER

/opt/rh/devtoolset-7/root/usr/bin/g++

CXX_COMPILER_VERSION

7.3.1

C_FLAGS

-pipe -msse4.1 -msse4.2 -mpopcnt  -fno-omit-frame-pointer  -Wall  -no-pie -O2 -DNDEBUG

CXX_FLAGS

-pipe -msse4.1 -msse4.2 -mpopcnt  -fno-omit-frame-pointer  -Wall   -Wnon-virtual-dtor -no-pie -O2 -DNDEBUG

LINK_FLAGS

-static-libgcc -static-libstdc++

BUILD_COMPILE_DEFINITIONS

 

BUILD_INCLUDE_DIRECTORIES

 

STATIC

ON

USE_EMBEDDED_COMPILER

0

USE_INTERNAL_MEMCPY

ON

USE_GLIBC_COMPATIBILITY

ON

USE_JEMALLOC

1

USE_TCMALLOC

 

USE_UNWIND

1

USE_ICU

1

USE_MYSQL

1

USE_RE2_ST

1

USE_VECTORCLASS

 

USE_RDKAFKA

1

USE_CAPNP

1

USE_POCO_SQLODBC

 

USE_POCO_DATAODBC

1

USE_POCO_MONGODB

1

USE_POCO_NETSSL

1

Clusters:集羣信息

>select c.shard_num,c.host_name as master_host,d.host_name as rep_host from (select shard_num,host_name from system.clusters  where replica_num=1) as c left join (select shard_num,host_name from  system.clusters where replica_num=2) as d on c.shard_num=d.shard_num

 

cluster:羣集名稱

shard_num:集羣中的分片編號,從1開始

shard_weight:寫入數據時分片的相對權重,1

replica_num:分片中的副本號,從1開始

host_name:主機名,在config中指定

host_address:從DNS獲取的主機IP地址

port:用於連接服務器的端口,9000

is_local: 是不是當前所在機器,1

user:用於連接服務器的用戶的名稱,默認default

 

data_type_families:數據類型

ClickHouse release 18.16.1版本新加的系統表

name:數據類型名稱

case_insensitive:是否區分大小寫,0不區分,1區分

alias_to:別名,BIGINT=Int64,TEXT=String

collations:字符集排序規則

databases、tables、columns

庫、表、列信息

functions:函數信息

formats:輸出格式

XML、JSON、Vertical、CSV等等

SELECT * FROM system.formats  FORMAT JSON;

events:已處理的系統事件監控

Query

總查詢數

SelectQuery

僅select數量

InsertQuery

僅insert數量

FileOpen

打開文件數量

ReadBufferFromFileDescriptorRead

文件描述符的讀取次數

ReadBufferFromFileDescriptorReadBytes

從文件描述符讀取的字節數

WriteBufferFromFileDescriptorWrite

文件描述符的寫入次數

WriteBufferFromFileDescriptorWriteBytes

寫入文件描述符的字節數

InsertedRows

插入到所有表的行數

MergedRows

合併前的行數

MergesTimeMilliseconds

後臺合併花費總時間

merges:正在進行合併的信息

database:

db

table:

table

elapsed:

0.038135789

progress:

0.294799805

num_parts:

5

source_part_names:

['20181231_12026210_12026567_44','20181231_12026568_12026568_0','20181231_12026570_12026570_0','20181231_12026572_12026572_0','20181231_12026574_12026574_0']

result_part_name:

20181231_12026210_12026574_45

partition_id:

20181231

total_size_bytes_compressed:

560012

total_size_marks:

7

bytes_read_uncompressed:

3824250

rows_read:

16905

bytes_written_uncompressed:

1852376

rows_written:

8192

columns_written:

0

memory_usage:

152843009

thread_number:

62

numbers 、numbers_mt:測試使用,從零開始的所有自然數

one:測試使用,類似於其他DBMS中的DUAL表

settings:查看當前設置信息

max_threads

最大線程

max_block_size

讀取最大塊大小

load_balancing

random分佈式隨機選取副本

force_primary_key

強制使用主鍵,無主鍵報錯

force_index_by_date

強制使用時間,無時間報錯

log_query_settings

將日誌寫入系統表query_log

log_queries

是否打開全日誌

max_memory_usage

單個查詢最大使用內存,0爲無限制

parts、parts_columns:查看分區表信息

>select database,table,partition_id,partition,name,active,rows,path,modification_time from system.parts where table='';

zookeeper :未配置ZooKeeper,則表不存在

>select * from system.zookeeper WHERE path = '/clickhouse/tables/02-02/cluster/' and name='metadata' FORMAT Vertical

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章