Skip to main content

Node Types and Lifecycle Strategies

Netdata categorizes nodes as ephemeral or permanent to help you tailor alerting, cleanup, and monitoring strategies for dynamic or static infrastructures.

Node Types

TypeDescriptionCommon Use Cases
EphemeralExpected to disconnect or reconnect frequently• Auto-scaling cloud instances
• Dynamic containers and VMs
• IoT devices with intermittent connectivity
• Test environments
PermanentExpected to maintain continuous connectivity• Production servers
• Core infrastructure nodes
• Critical monitoring systems
• Stable database servers
note

Disconnections in permanent nodes may indicate system failures and require immediate attention.

Key Benefits of Ephemeral Nodes

  1. Reduced Alert Noise: Disconnection alerts apply only to permanent nodes.
  2. Support for Dynamic Infrastructure: Designate temporary resources as ephemeral to avoid false alarms.
  3. Automated Cleanup: Configure retention policies for ephemeral nodes to keep dashboards uncluttered.

Configuring Ephemeral Nodes

By default, Netdata treats all nodes as permanent. To mark a node as ephemeral:

  1. Open the netdata.conf file on the target node.

  2. Add the following configuration:

    [global]
    is ephemeral node = yes
  3. Restart the Netdata Agent.

This applies the _is_ephemeral host label, which propagates to your Parents and Netdata Cloud.

Click to see visual representation of configuration flow

Alerts for Parent Nodes

Netdata v2.3.0 introduces two alerts specific to permanent nodes:

AlertTrigger Condition
streaming_never_connectedA permanent node has never connected to a Parent.
streaming_disconnectedA previously connected permanent node has disconnected.

Monitoring and Managing Node Status

Mark Permanently Offline Nodes as Ephemeral

To mark nodes (including virtual ones) as ephemeral:

netdatacli mark-stale-nodes-ephemeral <node_id | machine_guid | hostname | ALL_NODES>

This keeps historical data queryable and clears active alerts.

Click to see visual representation of CLI workflow

Removing Offline Nodes

To fully remove permanently offline nodes:

netdatacli remove-stale-node <node_id | machine_guid | hostname | ALL_NODES>
note

For detailed instructions on removing nodes from Netdata Cloud (including offline and stale nodes, bulk operations, and UI-based removal), see the Remove Node Guide. This covers scenarios where UI removal is disabled due to parent-child configured relationships.

Click to see visual representation of node removal flow

Automatically Removing Ephemeral Nodes

To enable automatic cleanup of ephemeral nodes:

  1. Open the netdata.conf file on Netdata Parent nodes.

  2. Add the following configuration:

    [db]
    cleanup ephemeral hosts after = 1d
  3. Restart the Netdata Agent.

This removes ephemeral nodes after 24 hours of disconnection. Once all Parents purge the node, it is automatically removed from Netdata Cloud.

Click to see visual representation of auto-removal process


Do you have any feedback for this page? If so, you can open a new issue on our netdata/learn repository.