To use AWS Kinesis for metric collecting and processing, you should first
install AWS SDK for C++. Netdata
works with the SDK version 1.7.121. Other versions might work correctly as well, but they were not tested with Netdata.
libcurl are also required to compile Netdata with Kinesis support enabled. Next, Netdata
should be re-installed from the source. The installer will detect that the required libraries are now available.
If the AWS SDK for C++ is being installed from source, it is useful to set
-DBUILD_ONLY="kinesis". Otherwise, the
building process could take a very long time. Note that the default installation path for the libraries is
/usr/local/lib64. Many Linux distributions don't include this path as the default one for a library search, so it is
advisable to use the following options to
cmake while building the AWS SDK:
To enable data sending to the Kinesis service, run
./edit-config exporting.conf in the Netdata configuration directory
and set the following options:
destination option to an AWS region.
Set AWS credentials and stream name:
Alternatively, you can set AWS credentials for the
netdata user using AWS SDK for C++ standard methods.
Netdata automatically computes a partition key for every record with the purpose to distribute records across available shards evenly.