Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/docs/Druid-Personal-Demo-Cluster.md

6.1 KiB
Raw Blame History

layout
default

Druid Personal Demo Cluster (DPDC)

Note, there are currently some issues with the CloudFormation. We are working through them and will update the documentation here when things work properly. In the meantime, the simplest way to get your feet wet with a cluster setup is to run through the instructions at housejester/druid-test-harness, though it is based on an older version. If you just want to get a feel for the types of data and queries that you can issue, check out Realtime Examples

Introduction

To make it easy for you to get started with Druid, we created an AWS (Amazon Web Services) CloudFormation Template that allows you to create a small pre-configured Druid cluster using your own AWS account. The cluster contains a pre-loaded sample workload, the Wikipedia edit stream, and a basic query interface that gets you familiar with Druid capabilities like drill-downs and filters.

This guide walks you through the steps to create the cluster and then how to create basic queries. (The cluster setup should take you about 15-20 minutes depending on AWS response times).

What’s in this Druid Demo Cluster?

  1. A single "Master" node. This node co-locates the Master process, the Broker process, Zookeeper, and the MySQL instance. You can read more about Druid architecture Design.

  2. Three compute nodes; these compute nodes, have been pre-configured to work with the Master node and should automatically load up the Wikipedia edit stream data (no specific setup is required).

Setup Instructions

  1. Log in to your AWS account: Start by logging into the Console page of your AWS account; if you don’t have one, follow this link to sign up for one http://aws.amazon.com/.

AWS Console Page

  1. If you have a Key Pair already created you may skip this step. Note: this is required to create the demo cluster and is generally not used unless instances need to be accessed directly (e.g. via SSH).

    1. Click EC2 to go to the EC2 Dashboard. From there, click Key Pairs under Network & Security. EC2 Dashboard

    2. Click on the button Create Key Pair. A dialog box will appear prompting you to enter a Key Pair name (as long as you remember it, the name is arbitrary, for this example we entered Druid). Click Create. You will be prompted to download a .pam; store this file in a safe place. Create Key Pair

  2. Unless you’re there already, go back to the Console page, or follow this link: https://console.aws.amazon.com. Click CloudFormation under Deployment & Management. CloudFormation

  3. Click Create New Stack, which will bring up the Create Stack dialog. Create New Stack

  4. Enter a Stack Name (it’s arbitrary, we chose, DruidStack). Click Provide a Template URL type in the following template URL: https://s3.amazonaws.com/cf-templates-jm2ikmzj3y6x-us-east-1/2013081cA9-Druid04012013.template. Press Continue, this will take you to the Create Stack dialog. Stack Name & URL

  5. Enter Druid (or the Key Pair name you created in Step 2) in the KeyPairName field; click Continue. This should bring up another dialog prompting you to enter a Key and Value. Stack Parameters

  6. While the inputs are arbitrary, it’s important to remember this information; we chose to enter version for Key and 1 for Value. Press Continue to bring up a confirmation dialog. Add Tags

  7. Click Continue to start creating your Druid Demo environment (this will bring up another dialog box indicating your environment is being created; click Close to take you to a more detailed view of the Stack creation process). Note: depending on AWS, this step could take over 15 minutes – initialization continues even after the instances are created. (So yes, now would be a good time to grab that cup of coffee). Review Create Stack Complete

  8. Click and expand the Events tab in the CloudFormation Stacks window to get a more detailed view of the Druid Demo Cluster setup.

CloudFormations

  1. Get the IP address of your Druid Master Node:
    1. Go to the following URL: https://console.aws.amazon.com/ec2
    2. Click Instances in the left pane – you should see something similar to the following figure.
    3. Select the DruidMaster instance
    4. Your IP address is right under the heading: EC2 Instance: DruidMaster. Select and copy that entire line, which ends with amazonaws.com.

EC2 Instances

Querying Data

  1. Use the following URL to bring up the Druid Demo Cluster query interface (replace IPAddressDruidMaster with the actual druid master IP Address):

http://IPAddressDruidMaster:8082/druid/v3/demoServlet

As you can see from the image below, there are default values in the Dimensions and Granularity fields. Clicking Execute will produce a basic query result. Demo Query Interface

  1. Note: when the Query is in running the Execute button will be disabled and read: Fetching… Demo Query

  2. You can add multiple Aggregation values, adjust Granularity, and Dimensions; query results will appear at the bottom of the window.

Enjoy! And for sure, please send along your comments and feedback or, aspirations on expanding and developing this demo. https://groups.google.com/d/forum/druid-development. Attention R users: we just open-sourced our R Druid connector: https://github.com/metamx/RDruid.