Merge pull request #225 from aws-samples/data-processing-updates

Data processing updates

Author: samdengler

DataProcessing/guide/content/data-lake.md

@@ -33,7 +33,7 @@ must be globally unique. We recommend using a name such as
 
     ![](images/data-lake-create-bucket.png)</kbd>
 
-1. Click **Next** twice, and then click **Create bucket**.
+1. Click **Next** three times, and then click **Create bucket**.
 
 #### 2. Create an Amazon Kinesis Data Firehose delivery stream
 
@@ -140,8 +140,13 @@ text editor to see the contents.
 
     ![](images/data-lake-object-list.png)
 
-1. Click on one of the files and click **Download**. Open the file with a text
-   editor and explore its contents.
+1. Click on one of the files.
+
+1. Click the **Select from** tab, select ``JSON`` from **File format**, and click
+   the **Show file preview** to preview the file content.
+
+    ![](images/data-lake-object-preview.png)
+
 
 #### 5. Query the data files
 

DataProcessing/guide/content/stream-processing.md

@@ -129,7 +129,9 @@ environment variable with the key `TABLE_NAME` and the value
 
 1. Click **Create a function**.
 
-1. Enter `WildRydesStreamProcessor` in the **Name** field.
+1. Enter `WildRydesStreamProcessor` in the **Function name** field.
+
+1. Select **Node.js 10.x** from **Runtime**.
 
 1. Select **WildRydesStreamProcessorRole** from the **Existing role** dropdown.
 
@@ -139,8 +141,6 @@ environment variable with the key `TABLE_NAME` and the value
 
 1. Scroll down to the **Function code** section.
 
-1. Select **Node.js 6.10** from **Runtime**.
-
 1. Copy and paste the JavaScript code below into the code editor.
 
     ```javascript

DataProcessing/guide/content/streaming-data.md

@@ -81,7 +81,7 @@ the stream.
 1. In the Amazon Kinesis Streams console, click on **wildrydes** and click on
    the **Monitoring** tab.
 
-1. After several minutes, you will see the **Put Record (success count)** graph
+1. After several minutes, you will see the **Put Record Success (percent) - Average** graph
    begin to record a single put a second.
 
 #### 3. Read messages from the stream
@@ -177,13 +177,33 @@ the stream to plot the unicorns on the map.
 
 1. Tick the **Read** and **List** permissions checkboxes.
 
-1. Click **Resources** to limit the role to the **wildrydes** stream.
+1. Click **Resources** to limit the role to the **wildrydes** stream and consumer.
+
+1. Click **Add ARN** next to **consumer**.
+
+1. In the **Add ARN(s)** dialog box, enter the following information:
+
+    *  the region you're using in **Region** (e.g. us-east-1)
+    *  your [Account ID][find-account-id] in **Account**
+    * `*` in **Stream type**
+    * `wildrydes` in **Stream name**
+    * `*` in **Consumer name**
+    * `*` in **Consumer creation timestamp**
+
+    <br/>
+    ![](images/streaming-data-consumer-arn.png)
+
+1. Click **Add**.
 
 1. Click **Add ARN** next to **stream**.
 
-1. Enter the region you're using in **Region** (e.g. us-east-1), your [Account
-   ID][find-account-id] in **Account**, and `wildrydes` in **Stream name**.
+1. In the **Add ARN(s)** dialog box, enter the following information:
+
+    *  the region you're using in **Region** (e.g. us-east-1)
+    *  your [Account ID][find-account-id] in **Account**
+    * `wildrydes` in **Stream name**
 
+    <br/>
     ![](images/streaming-data-stream-arn.png)
 
 1. Click **Add**.

DataProcessing/guide/site/cleanup.html

@@ -62,7 +62,7 @@ <h4 id="amazon-dynamodb">Amazon DynamoDB</h4>
 <p><strong><em>UnicornSensorData</em> table</strong></p>
 <ol type="1">
 <li><p>Click on <strong>Services</strong> then select <strong>DynamoDB</strong> in the Database section.</p></li>
-<li><p>Click <strong>Tables</strong> from the left-hand navigation</p></li>
+<li><p>Click <strong>Tables</strong> from the left-hand navigation.</p></li>
 <li><p>Click the radio button next to <strong>UnicornSensorData</strong>.</p></li>
 <li><p>Click <strong>Delete table</strong> and click <strong>Delete</strong> to confirm the deletion.</p></li>
 </ol>

DataProcessing/guide/site/dashboard.html

@@ -23,10 +23,6 @@ <h6 class='modal-title'>Configure Dashboard</h6>
 <label for='cognitoIdentityPoolId'>Cognito Identity Pool ID</label>
 <input autocomplete='off' class='form-control' id='cognitoIdentityPoolId' spellcheck='false' type='text'>
 </div>
-<div class='form-group'>
-<label for='kinesisStreamName'>Kinesis Data Stream Name</label>
-<input autocomplete='off' class='form-control' id='kinesisStreamName' spellcheck='false' type='text' value='wildrydes'>
-</div>
 </div>
 <div class='modal-footer'>
 <button class='btn btn-primary' id='start'>Start</button>

DataProcessing/guide/site/data-lake.html

@@ -88,7 +88,7 @@ <h4 id="create-an-amazon-athena-table">3. Create an Amazon Athena table</h4>
 <button class="btn btn-outline-primary copy">
 Copy to Clipboard
 </button></li>
-<li><p>Click <strong>Run Query</strong>. You might have to run the query twice.</p></li>
+<li><p>Click <strong>Run Query</strong>.</p></li>
 <li><p>Verify the table <strong>wildrydes</strong> was created by ensuring it has been added to the list of tables in the left navigation.</p></li>
 </ol>
 <h4 id="explore-the-batched-data-files">4. Explore the batched data files</h4>
@@ -99,7 +99,9 @@ <h4 id="explore-the-batched-data-files">4. Explore the batched data files</h4>
 <li><p>Enter the bucket name you create in the first section in the <strong>Search for buckets</strong> text input.</p></li>
 <li><p>Click on the bucket name and navigate through the year, month, day, and hour folders to ensure that files are being populated in your bucket.</p>
 <p><img src="images/data-lake-object-list.png" /></p></li>
-<li><p>Click on one of the files and click <strong>Download</strong>. Open the file with a text editor and explore its contents.</p></li>
+<li><p>Click on one of the files.</p></li>
+<li><p>Click the <strong>Select from</strong> tab, select <code>JSON</code> from <strong>File format</strong>, and click the <strong>Show file preview</strong> to preview the file content.</p>
+<p><img src="images/data-lake-object-preview.png" /></p></li>
 </ol>
 <h4 id="query-the-data-files">5. Query the data files</h4>
 <p>Query the Amazon Athena table to see all records that have been delivered via Kinesis Data Firehose to S3.</p>