TDengine
TDEngine is a high-performance, distributed, SQL-enabled time series Database (Database). Familiarize yourself with the basic concepts of TDEngine before opening the collector.
TDengine collector needs to connect taos_adapter can work normally, taosAdapter from TDengine v2.4. 0.0 version comes to becoming a part of TDengine server software, this paper is mainly a detailed introduction of measurement.
Configuration¶
Collector Config¶
Go to the conf.d/db directory under the DataKit installation directory, copy tdengine.conf.sample and name it tdengine.conf. Examples are as follows:
[[inputs.tdengine]]
## adapter restApi Addr, example: http://taosadapter.test.com (Required)
adapter_endpoint = "http://<FQND>:6041"
user = "<userName>"
password = "<pw>"
## log_files: TdEngine log file path or dirName (optional).
## log_files = ["tdengine_log_path.log"]
## pipeline = "tdengine.p"
## Set true to enable election
election = true
## add tag (optional)
[inputs.tdengine.tags]
## Different clusters can be distinguished by tag. Such as testing,product,local ,default is 'testing'
# cluster_name = "testing"
# some_tag = "some_value"
# more_tag = "some_other_value"
After configuration, restart DataKit.
At present, the collector can be turned on by injecting the collector configuration in ConfigMap mode.
Info
Please make sure the port is open before connecting to the taoAdapter. And the connecting user needs to have read permission. If the connection still fails, please refer to
Metric¶
tdengine¶
- Tags
| Tag | Description |
|---|---|
| client_ip | Client IP |
| cluster_name | Cluster name |
| database_name | Database name |
| dnode_ep | Data node name, generally equivalent to end_point |
| end_point | Remote address name, the general naming rule is (host:port) |
| first_ep | First endpoint |
| host | Host name |
| version | Version |
| vgroup_id | VGroup ID |
- Metrics
| Metric | Description |
|---|---|
| client_ip_count | Client IP request statistics Type: float Unit: count |
| cpu_cores | Total number of CPU cores per data node Type: float Unit: count |
| cpu_engine | CPU usage per data node Type: float Unit: percent,percent |
| cpu_percent | Adapter occupies CPU usage Type: float Unit: percent,percent |
| cpu_system | CPU system usage of data nodes Type: float Unit: count |
| database_count | Total number of databases Type: float Unit: count |
| disk_percent | Data node disk usage percentage Type: float Unit: percent,percent |
| disk_total | Total disk size of data nodes Type: float Unit: digital,GB |
| disk_used | Disk usage of data nodes Type: float Unit: digital,GB |
| dnodes_alive | Total number of dnodes in ready state Type: float Unit: count |
| dnodes_total | Total number of dnodes(data nodes) in cluster Type: float Unit: count |
| expire_time | Time until grants expire in seconds Type: int Unit: time,s |
| io_read_taosd | Average data size of IO reads per second Type: float Unit: digital,MB |
| io_write_taosd | Average data size of IO writes per second Type: float Unit: digital,MB |
| master_uptime | Seconds of master's uptime Type: float Unit: time,s |
| mem_engine | Memory usage of tdengine Type: float Unit: digital,MB |
| mem_engine_percent | taosd memory usage percentageType: float Unit: percent,percent |
| mem_percent | Adapter memory usage Type: float Unit: percent,percent |
| mem_system | Available memory on the server Type: float Unit: digital,MB |
| mem_total | Total memory of server Type: float Unit: digital,GB |
| mnodes_alive | Total number of mnodes in ready state Type: float Unit: count |
| mnodes_total | Total number of mnodes(management nodes) in cluster Type: float Unit: count |
| net_in | IO rate of the ingress network Type: float Unit: digital,KB |
| net_out | IO rate of egress network Type: float Unit: digital,KB |
| req_http | Total number of requests via HTTP Type: float Unit: count |
| req_http_rate | HTTP request rate Type: float Unit: count |
| req_insert_batch_rate | Number of batch insertions divided by monitor interval Type: float Unit: count |
| req_insert_rate | Number of insert queries received per dnode divided by monitor interval Type: float Unit: count |
| req_select | Number of select queries received per dnode Type: float Unit: count |
| req_select_rate | Number of select queries received per dnode divided by monitor interval Type: float Unit: count |
| request_in_flight | Number of requests being sorted Type: float Unit: count |
| status_code | Status code returned by the request Type: float Unit: count |
| table_count | Total number of tables in the database Type: float Unit: count |
| tables_count | Number of tables per vgroup Type: float Unit: count |
| timeseries_total | Total time series Type: float Unit: count |
| timeseries_used | Time series used Type: float Unit: count |
| total_req_count | Total adapter requests Type: float Unit: count |
| vgroups_alive | Total number of vgroups in ready state Type: float Unit: count |
| vgroups_total | Total number of vgroups in cluster Type: float Unit: count |
| vnodes | The number of virtual node groups contained in a single data node Type: float Unit: count |
| vnodes_alive | Total number of vnode in ready state Type: float Unit: count |
| vnodes_num | Total number of virtual nodes per data node Type: float Unit: count |
| vnodes_total | Total number of vnode in cluster Type: float Unit: count |
- Some tables in the database do not have the
tsfield, and DataKit uses the current collection time.