Guance ES Multi-Tenant Lifecycle Management Practice¶
Lifecycle Management (ILM)¶
Data Stages¶
| Stage Name | Description | Write | Query |
|---|---|---|---|
| hot | Hot data stage | Frequent writes | Frequent queries |
| warm | Warm data stage | No writes | Moderately frequent queries |
| cold | Cold data stage | No writes | Infrequent queries, slow queries |
| frozen | Frozen data stage | No writes | Rare queries, very slow queries |
| delete | Data deletion stage | No writes | Unqueryable |
Index Operations¶
Note:
-
For the hot data stage, the rolling start time is the index creation time;
-
For other data stages (except the hot data stage), the time calculation starts from the end of the rolling period.
Example¶
Guance Practical Application¶
| Retention Policy | Description | Hot Data Stage | Warm Data Stage | Data Deletion Stage |
|---|---|---|---|---|
| es_rp0 | Data retained for 1 day | min_age = 0 rollover |
min_age = 6h forcemerge {1} shrink |
min_age = 1d delete |
| es_rp2d | Data retained for 2 days | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 2d delete |
| es_rp1 | Data retained for 7 days (1 week) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 7d delete |
| es_rp2 | Data retained for 14 days (2 weeks) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 14d delete |
| es_rp3 | Data retained for 30 days (1 month) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 30d delete |
| es_rp60d | Data retained for 60 days (2 months) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 60d delete |
| es_rp4 | Data retained for 90 days (3 months) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 90d delete |
| es_rp5 | Data retained for 180 days (6 months) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 180d delete |
| es_rp6 | Data retained for 360 days (1 year) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 360d delete |
| es_rp720d | Data retained for 720 days (nearly 2 years) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age=720d delete |
| es_rp7 | Data retained for 1095 days (3 years) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age=1095d delete |
Common Issues¶
Shortened Data Retention Time¶
After modifying the retention policy, new indexes will roll over. Previous index data will not be deleted until it meets the deletion date condition, meaning that previous index data will continue to incur charges.
Extended Data Retention Time¶
After modifying the retention policy, new indexes will roll over. The retention time of previous index data will not be extended, and new indexes will use the new configuration.
