Node Types and Lifecycle Strategies
Netdata categorizes nodes as ephemeral or permanent to help you tailor alerting, cleanup, and monitoring strategies for dynamic or static infrastructures.
Node Types
Type | Description | Common Use Cases |
---|---|---|
Ephemeral | Expected to disconnect or reconnect frequently | • Auto-scaling cloud instances • Dynamic containers and VMs • IoT devices with intermittent connectivity • Test environments |
Permanent | Expected to maintain continuous connectivity | • Production servers • Core infrastructure nodes • Critical monitoring systems • Stable database servers |
Disconnections in permanent nodes may indicate system failures and require immediate attention.
Key Benefits of Ephemeral Nodes
- Reduced Alert Noise: Disconnection alerts apply only to permanent nodes.
- Support for Dynamic Infrastructure: Designate temporary resources as ephemeral to avoid false alarms.
- Automated Cleanup: Configure retention policies for ephemeral nodes to keep dashboards uncluttered.
Configuring Ephemeral Nodes
By default, Netdata treats all nodes as permanent. To mark a node as ephemeral:
-
Open the
netdata.conf
file on the target node. -
Add the following configuration:
[global]
is ephemeral node = yes -
Restart the Netdata Agent.
This applies the _is_ephemeral
host label, which propagates to your Parents and Netdata Cloud.
Click to see visual representation of configuration flow
Alerts for Parent Nodes
Netdata v2.3.0 introduces two alerts specific to permanent nodes:
Alert | Trigger Condition |
---|---|
streaming_never_connected | A permanent node has never connected to a Parent. |
streaming_disconnected | A previously connected permanent node has disconnected. |
Monitoring and Managing Node Status
Mark Permanently Offline Nodes as Ephemeral
To mark nodes (including virtual ones) as ephemeral:
netdatacli mark-stale-nodes-ephemeral <node_id | machine_guid | hostname | ALL_NODES>
This keeps historical data queryable and clears active alerts.
Click to see visual representation of CLI workflow
Removing Offline Nodes
To fully remove permanently offline nodes:
netdatacli remove-stale-node <node_id | machine_guid | hostname | ALL_NODES>
For detailed instructions on removing nodes from Netdata Cloud (including offline and stale nodes, bulk operations, and UI-based removal), see the Remove Node Guide. This covers scenarios where UI removal is disabled due to parent-child configured relationships.
Click to see visual representation of node removal flow
Automatically Removing Ephemeral Nodes
To enable automatic cleanup of ephemeral nodes:
-
Open the
netdata.conf
file on Netdata Parent nodes. -
Add the following configuration:
[db]
cleanup ephemeral hosts after = 1d -
Restart the Netdata Agent.
This removes ephemeral nodes after 24 hours of disconnection. Once all Parents purge the node, it is automatically removed from Netdata Cloud.
Click to see visual representation of auto-removal process
Do you have any feedback for this page? If so, you can open a new issue on our netdata/learn repository.