Stream logs using Kinesis Data Firehose

If your log data is already being monitored by Amazon Kinesis Data Firehose, you can use our Kinesis Data Firehose integration to forward and enrich your log data in New Relic. Kinesis Data Firehose is a service that can stream data in real time to a variety of destinations, including our platform.

Forwarding your Kinesis Data Firehose logs to New Relic will give you enhanced log management capabilities to collect, process, explore, query, and alert on your log data.

Create the delivery stream for New Relic

To forward your logs from Kinesis Data Firehose to New Relic:

1. Make sure you have a New Relic license key.

2. Follow the procedures to create an Amazon Kinesis Data Firehose delivery stream, and select New Relic as the destination: In the AWS Management Console, go to Amazon Kinesis.

3. Select Kinesis Data Firehose and click Create delivery stream.

4. Enter a name for the stream and select your data source.

5. When selecting the destination, click Third-party partner and then New Relic.

   

6. Under HTTP endpoint URL, select New Relic logs - US from the dropdown.

   Note: To send your logs to the EU, complete the remaining steps in this section, then proceed to the configuration procedures for EU accounts.

7. Paste your license key in the API key field.

8. Configure and review the remaining settings.

Configure your stream to send logs to EU accounts

If you have a New Relic account in our EU data center:

1. Follow standard procedures to create your delivery stream.

2. Once your stream has been created, navigate to the Amazon Kinesis Console, and click Delivery streams.

3. Click the name of your newly created delivery stream, and select the Configuration tab.

4. Next to the Destination settings section, click Edit.

5. Update the value for HTTP endpoint URL to our Firehose endpoint for EU accounts:

   https://aws-api.eu.newrelic.com/firehose/v1

   Copy

6. Click Save changes to ensure your stream is updated.

View log data

If everything is configured correctly and your data is being collected, you should see data logs in both of these places:

• New Relic Logs UI
• New Relic tools for running NRQL queries. For example, you can execute a query like this:

SELECT * FROM Log

If no data appears after you enable our log management capabilities, follow our standard log troubleshooting procedures.

What's next?

Explore logging data across your platform with the New Relic One UI.

• Get deeper visibility into both your application and your platform performance data by forwarding your logs with our logs in context capabilities.
• Set up alerts.
• Query your data and create dashboards.