Node Types and Lifecycle Strategies
Netdata categorizes nodes as ephemeral or permanent to help you tailor alerting, cleanup, and monitoring strategies for dynamic or static infrastructures.
Node Types
| Type | Description | Common Use Cases |
|---|---|---|
| Ephemeral | Expected to disconnect or reconnect frequently | • Auto-scaling cloud instances • Dynamic containers and VMs • IoT devices with intermittent connectivity • Test environments |
| Permanent | Expected to maintain continuous connectivity | • Production servers • Core infrastructure nodes • Critical monitoring systems • Stable database servers |
Disconnections in permanent nodes may indicate system failures and require immediate attention.
Key Benefits of Ephemeral Nodes
- Reduced Alert Noise: Disconnection alerts apply only to permanent nodes.
- Support for Dynamic Infrastructure: Designate temporary resources as ephemeral to avoid false alarms.
- Automated Cleanup: Configure retention policies for ephemeral nodes to keep dashboards uncluttered.
Configuring Ephemeral Nodes
By default, Netdata treats all nodes as permanent. To mark a node as ephemeral:
- Open the
netdata.conffile on the target node. - Add the following configuration:
[global]
is ephemeral node = yes - Restart the Netdata Agent.
Once restarted, Netdata automatically applies the _is_ephemeral host label to the node. This label propagates to your Parent nodes and appears in Netdata Cloud, allowing the system to identify and handle the node as ephemeral.
Alerts for Parent Nodes
Netdata v2.3.0 introduces two alerts specific to permanent nodes:
| Alert | Trigger Condition |
|---|---|
streaming_never_connected | A permanent node has never connected to a Parent. |
streaming_disconnected | A previously connected permanent node has disconnected. |
Automatic Node Instance Cleanup in Netdata Cloud
Netdata Cloud automatically removes inactive nodes to keep your dashboards clean and organized.
Cleanup Rules
| Node Type | Offline Duration | Description |
|---|---|---|
| Child nodes | 48 hours | Nodes that connect through a Parent node. Deleted when: • The child node goes offline, OR • The Parent node goes offline |
| Directly connected nodes | 60 days | Nodes claimed directly to Netdata Cloud without going through a Parent. |
| Ephemeral nodes | Custom | Temporary nodes (containers, auto-scaling VMs) with configurable cleanup periods. See configuration below. |
If a child node is deleted and later reconnects, it's automatically recreated in Netdata Cloud. Any historical data retained on the Parent node remains accessible.
Monitoring and Managing Node Status
Mark Permanently Offline Nodes as Ephemeral
To mark nodes (including virtual ones) as ephemeral:
netdatacli mark-stale-nodes-ephemeral <node_id | machine_guid | hostname | ALL_NODES>
This keeps historical data queryable and clears active alerts.
Removing Offline Nodes
To fully remove permanently offline nodes:
netdatacli remove-stale-node <node_id | machine_guid | hostname | ALL_NODES>
For detailed instructions on removing nodes from Netdata Cloud (including offline and stale nodes, bulk operations, and UI-based removal), see the Remove Node Guide. This covers scenarios where UI removal is disabled due to parent-child configured relationships.
Automatically Removing Ephemeral Nodes
To enable automatic cleanup of ephemeral nodes:
-
Open the
netdata.conffile on Netdata Parent nodes. -
Add the following configuration:
[db]
cleanup ephemeral hosts after = 1d -
Restart the Netdata Agent.
This removes ephemeral nodes after 24 hours of disconnection. Once all Parents purge the node, it is automatically removed from Netdata Cloud.
Do you have any feedback for this page? If so, you can open a new issue on our netdata/learn repository.