You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# Using AWS Lambda with Kinesis<aname="with-kinesis"></a>
2
2
3
-
You can create a Kinesis stream to continuously capture and store terabytes of data per hour from hundreds of thousands of sources such as website click streams, financial transactions, social media feeds, IT logs, and location\-tracking events\. For more information, see [Kinesis](https://aws.amazon.com/kinesis/)\.
3
+
You can create a Kinesis stream to continuously capture and store terabytes of data per hour from hundreds of thousands of sources such as website click streams, financial transactions, social media feeds, IT logs, and location\-tracking events\. For more information, see [Kinesis](https://aws.amazon.com/kinesis/)\.
4
4
5
5
You can subscribe Lambda functions to automatically read batches of records off your Kinesis stream and process them if records are detected on the stream\. AWS Lambda then polls the stream periodically \(once per second\) for new records\.
6
6
7
7
Note the following about how the Kinesis and AWS Lambda integration works:
8
-
+**Stream\-based model** – This is a model \(see [Event Source Mapping](invocation-options.md#intro-invocation-modes)\), where AWS Lambda polls the stream and, when it detects new records, invokes your Lambda function by passing the new records as a parameter\.
8
+
+**Stream\-based model** – This is a model \(see [Event Source Mapping](invocation-options.md#intro-invocation-modes)\), where AWS Lambda polls the stream and, when it detects new records, invokes your Lambda function by passing the new records as a parameter\.
9
9
10
-
In a stream\-based model, you maintain event source mapping in AWS Lambda\. The event source mapping describes which stream maps to which Lambda function\. AWS Lambda provides an API \([CreateEventSourceMapping](API_CreateEventSourceMapping.md)\) that you can use to create the mapping\. You can also use the AWS Lambda console to create event source mappings\.
11
-
+**Synchronous invocation** – AWS Lambda invokes a Lambda function using the `RequestResponse` invocation type \(synchronous invocation\) by polling the Kinesis Stream\. For more information about invocation types, see [Invocation Types](invocation-options.md)\.
10
+
In a stream\-based model, you maintain event source mapping in AWS Lambda\. The event source mapping describes which stream maps to which Lambda function\. AWS Lambda provides an API \([CreateEventSourceMapping](API_CreateEventSourceMapping.md)\) that you can use to create the mapping\. You can also use the AWS Lambda console to create event source mappings\.
11
+
+**Synchronous invocation** – AWS Lambda invokes a Lambda function using the `RequestResponse` invocation type \(synchronous invocation\) by polling the Kinesis Stream\. For more information about invocation types, see [Invocation Types](invocation-options.md)\.
12
12
+**Event structure** – The event your Lambda function receives is a collection of records AWS Lambda reads from your stream\. When you configure event source mapping, the batch size you specify is the maximum number of records that you want your Lambda function to receive per invocation\.
13
13
14
14
While AWS Lambda will only poll for records once per second, it can be invoked multiple times per second provided that:
15
-
+ There were more records retrieved during the poll than the batch size will allow for a single invocation\.
16
-
+ The processing time for the function allowed it to complete before 1 second had elapsed\.
17
15
18
-
This means that the limiting factor on how many records your function can process is defined by how quickly it can process records, not how often Lambda polls for new records\.
19
16
20
17
Regardless of what invokes a Lambda function, AWS Lambda always executes a Lambda function on your behalf\. If your Lambda function needs to access any AWS resources, you need to grant the relevant permissions to access those resources\. You also need to grant AWS Lambda permissions to poll your Kinesis stream\. You grant all of these permissions to an IAM role \(execution role\) that AWS Lambda can assume to poll the stream and execute the Lambda function on your behalf\. You create this role first and then enable it at the time you create the Lambda function\. For more information, see [Manage Permissions: Using an IAM Role \(Execution Role\)](intro-permission-model.md#lambda-intro-execution-role)\.
21
18
@@ -29,4 +26,4 @@ The following diagram illustrates the application flow:
29
26
30
27
1. AWS Lambda executes the Lambda function by assuming the execution role you specified at the time you created the Lambda function\.
31
28
32
-
For a tutorial that walks you through an example setup, see [Tutorial: Using AWS Lambda with Kinesis](with-kinesis-example.md)\.
29
+
For a tutorial that walks you through an example setup, see [Tutorial: Using AWS Lambda with Kinesis](with-kinesis-example.md)\.
0 commit comments