TDengine
TDEngine is a high-performance, distributed, SQL-enabled time series Database (Database). Familiarize yourself with the basic concepts of TDEngine before opening the collector.
TDengine collector needs to connect taos_adapter can work normally, taosAdapter from TDengine v2.4. 0.0 version comes to becoming a part of TDengine server software, this paper is mainly a detailed introduction of measurement.
Configuration¶
Collector Config¶
Go to the conf.d/samples directory under the DataKit installation directory, copy tdengine.conf.sample and name it tdengine.conf. Examples are as follows:
[[inputs.tdengine]]
## adapter restApi Addr, example: http://taosadapter.test.com (Required)
adapter_endpoint = "http://<FQND>:6041"
user = "<userName>"
password = "<pw>"
## log_files: TdEngine log file path or dirName (optional).
## log_files = ["tdengine_log_path.log"]
## pipeline = "tdengine.p"
## Set true to enable election
election = true
## add tag (optional)
[inputs.tdengine.tags]
## Different clusters can be distinguished by tag. Such as testing,product,local ,default is 'testing'
# cluster_name = "testing"
# some_tag = "some_value"
# more_tag = "some_other_value"
After configuration, restart DataKit.
At present, the collector can be turned on by injecting the collector configuration in ConfigMap mode.
Info
Please make sure the port is open before connecting to the taoAdapter. And the connecting user needs to have read permission. If the connection still fails, please refer to
Metric¶
tdengine¶
| Tags & Fields | Description |
|---|---|
| client_ip ( tag) |
Client IP |
| cluster_name ( tag) |
Cluster name |
| database_name ( tag) |
Database name |
| dnode_ep ( tag) |
Data node name, generally equivalent to end_point |
| end_point ( tag) |
Remote address name, the general naming rule is (host:port) |
| first_ep ( tag) |
First endpoint |
| host ( tag) |
Host name |
| version ( tag) |
Version |
| vgroup_id ( tag) |
VGroup ID |
| client_ip_count | Client IP request statistics Type: float | (gauge) Unit: count |
| cpu_cores | Total number of CPU cores per data node Type: float | (gauge) Unit: count |
| cpu_engine | CPU usage per data node Type: float | (gauge) Unit: percent,percent |
| cpu_percent | Adapter occupies CPU usage Type: float | (gauge) Unit: percent,percent |
| cpu_system | CPU system usage of data nodes Type: float | (gauge) Unit: count |
| database_count | Total number of databases Type: float | (gauge) Unit: count |
| disk_percent | Data node disk usage percentage Type: float | (gauge) Unit: percent,percent |
| disk_total | Total disk size of data nodes Type: float | (gauge) Unit: digital,GB |
| disk_used | Disk usage of data nodes Type: float | (gauge) Unit: digital,GB |
| dnodes_alive | Total number of dnodes in ready state Type: float | (gauge) Unit: count |
| dnodes_total | Total number of dnodes(data nodes) in cluster Type: float | (gauge) Unit: count |
| expire_time | Time until grants expire in seconds Type: int | (gauge) Unit: time,s |
| io_read_taosd | Average data size of IO reads per second Type: float | (gauge) Unit: digital,MB |
| io_write_taosd | Average data size of IO writes per second Type: float | (gauge) Unit: digital,MB |
| master_uptime | Seconds of master's uptime Type: float | (gauge) Unit: time,s |
| mem_engine | Memory usage of tdengine Type: float | (gauge) Unit: digital,MB |
| mem_engine_percent | taosd memory usage percentageType: float | (gauge) Unit: percent,percent |
| mem_percent | Adapter memory usage Type: float | (gauge) Unit: percent,percent |
| mem_system | Available memory on the server Type: float | (gauge) Unit: digital,MB |
| mem_total | Total memory of server Type: float | (gauge) Unit: digital,GB |
| mnodes_alive | Total number of mnodes in ready state Type: float | (gauge) Unit: count |
| mnodes_total | Total number of mnodes(management nodes) in cluster Type: float | (gauge) Unit: count |
| net_in | IO rate of the ingress network Type: float | (gauge) Unit: digital,KB |
| net_out | IO rate of egress network Type: float | (gauge) Unit: digital,KB |
| req_http | Total number of requests via HTTP Type: float | (gauge) Unit: count |
| req_http_rate | HTTP request rate Type: float | (gauge) Unit: count |
| req_insert_batch_rate | Number of batch insertions divided by monitor interval Type: float | (gauge) Unit: count |
| req_insert_rate | Number of insert queries received per dnode divided by monitor interval Type: float | (gauge) Unit: count |
| req_select | Number of select queries received per dnode Type: float | (gauge) Unit: count |
| req_select_rate | Number of select queries received per dnode divided by monitor interval Type: float | (gauge) Unit: count |
| request_in_flight | Number of requests being sorted Type: float | (gauge) Unit: count |
| status_code | Status code returned by the request Type: float | (gauge) Unit: count |
| table_count | Total number of tables in the database Type: float | (gauge) Unit: count |
| tables_count | Number of tables per vgroup Type: float | (gauge) Unit: count |
| timeseries_total | Total time series Type: float | (gauge) Unit: count |
| timeseries_used | Time series used Type: float | (gauge) Unit: count |
| total_req_count | Total adapter requests Type: float | (gauge) Unit: count |
| vgroups_alive | Total number of vgroups in ready state Type: float | (gauge) Unit: count |
| vgroups_total | Total number of vgroups in cluster Type: float | (gauge) Unit: count |
| vnodes | The number of virtual node groups contained in a single data node Type: float | (gauge) Unit: count |
| vnodes_alive | Total number of vnode in ready state Type: float | (gauge) Unit: count |
| vnodes_num | Total number of virtual nodes per data node Type: float | (gauge) Unit: count |
| vnodes_total | Total number of vnode in cluster Type: float | (gauge) Unit: count |
- Some tables in the database do not have the
tsfield, and DataKit uses the current collection time.