ELK stack with Amazon Web Services

ELK stack with Amazon Web Services

ELK – Elasticsearch + Logstash + Kibana triad is a leading open source log management solution. In the previous post we have installed Logstash, today let’s focus on Elasticsearch (and Kibana). With AWS, ELK deployment is quite simple as Elasticsearch cluster and Kibana are provided by Amazon as a service. Let’s see how it works.

  1. At AWS console select Analytics -> Elasticsearch service.

001

  1. Click “Create new domain” and provide a name for your domain.
  2. Instance of “micro” type is available with Free Tier. It’s a good choice for testing and small deployments.

002

  1. “micro” instance must use EBS storage. Let’s configure it.

003

  1. Finally, set access policy. Select “Allow access to the domain from specific IP(s)”. For the testing you may put Logstash server public IP and your IP. You have to put your IP in order to access Kibana. Using proxy server is also an option (especially if you don’t have static IP).

004

  1. Confirm the settings and wait – according to Amazon, initialization takes around 10 minutes.
  2. Congratulations! Your Elasticsearch domain is ready. Now the status is green, but later it is going to change to yellow. Don’t worry – it just indicates no redundancy. That’s fine, because one single node cannot provide it. Click on Kibana link to access Kibana’s web interface. In the next part of this tutorial I am going to show how get logs into Elasticsearch with Logstash.

005

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.