Guance ES Multi-Tenant Lifecycle Management Practice¶
Lifecycle Management (ILM)¶
Data Phases¶
| Phase Name | Description | Write | Query |
|---|---|---|---|
| hot | Hot data phase | Frequent writes | Frequent queries |
| warm | Warm data phase | No writes | Relatively frequent queries |
| cold | Cold data phase | No writes | Infrequent queries, slower queries |
| frozen | Frozen data phase | No writes | Rare queries, very slow queries |
| delete | Delete data phase | No writes | No queries |
Index Operations¶
Note
-
For the hot data phase, the rollover time starts from the index creation time.
-
For other data phases (except the hot data phase), the time calculation starts from the rollover end time.
Guance Practical Application¶
| Retention Policy | Description | Hot Data Phase | Warm Data Phase | Delete Data Phase |
|---|---|---|---|---|
| es_rp0 | Data retention for 1 day | min_age = 0 rollover |
min_age = 6h forcemerge {1} shrink |
min_age = 1d delete |
| es_rp2d | Data retention for 2 days | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 2d delete |
| es_rp1 | Data retention for 7 days (1 week) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 7d delete |
| es_rp2 | Data retention for 14 days (2 weeks) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 14d delete |
| es_rp3 | Data retention for 30 days (1 month) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 30d delete |
| es_rp60d | Data retention for 60 days (2 months) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 60d delete |
| es_rp4 | Data retention for 90 days (3 months) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 90d delete |
| es_rp5 | Data retention for 180 days (6 months) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 180d delete |
| es_rp6 | Data retention for 360 days (1 year) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age = 360d delete |
| es_rp720d | Data retention for 720 days (almost 2 years) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age=720d delete |
| es_rp7 | Data retention for 1095 days (3 years) | min_age = 0 rollover |
min_age = 1d forcemerge {1} shrink |
min_age=1095d delete |
Common Issues¶
Shortened Data Retention Period¶
After modifying the retention policy, new indices will be rolled out. The data in the previous indices will not be deleted until the deletion date condition is met, meaning that the data in the previous indices will continue to be billed.
Extended Data Retention Period¶
After modifying the retention policy, new indices will be rolled out. The retention period for the data in the previous indices will not be extended. The new indices will use the new configuration for retention.
