Serverless GraalVM Demo
This is a simple serverless application built in Java and uses the GraalVM native-image tool. It consists of an Amazon API Gateway backed by four AWS Lambda functions and an Amazon DynamoDB table for storage.
Requirements
Software
Within the software folder is the products maven project. This single maven project contains all the code for all four Lambda functions. It uses the hexagonal architecture pattern to decouple the entry points, from the main domain logic and the storage logic.
Custom Runtime
The GraalVM native-image tool will produce a stand-alone executable binary. This does not require the JVM to run. To run our application on Lambda we must make a custom runtime and implement the Lambda Runtime API. This is done my including the aws-lambda-java-runtime-interface-client dependency in our project. The maven assembly build plugin is used to create a zip file which includes the executable binary as well as the entry point bootstrap file.
Infrastructure
Deployment
Deploy the demo to your AWS account using AWS CDK.
cdk deploy
The command cdk deploy will first build the products maven project using a docker build image with all the required GraalVM tools. Then it will use AWS CloudFormation to deploy the resources to your account.
CDK will create an output of the API Gateway endpoint URL for future use in our load tests.
Load Test
Artillery is used to make 300 requests / second for 10 minutes to our API endpoints. You can run this with the following command.
cd load-test
./run-load-test.sh
This is a demanding load test, to change the rate alter the arrivalRate value in load-test.yml.
CloudWatch Logs Insights
Using this CloudWatch Logs Insights query you can analyse the latency of the requests made to the Lambda functions.
The query separates cold starts from other requests and then gives you p50, p90 and p99 percentiles.
filter @type="REPORT"
| fields greatest(@initDuration, 0) + @duration as duration, ispresent(@initDuration) as coldStart
| stats count(*) as count, pct(duration, 50) as p50, pct(duration, 90) as p90, pct(duration, 99) as p99, max(duration) as max by coldStart
AWS X-Ray Tracing
You can add additional detail to your X-Ray tracing by adding a TracingInterceptor to your AWS SDK clients. Here is the code for my DynamoDbClient from the DynamoDbProductStore class.
private final DynamoDbClient dynamoDbClient=DynamoDbClient.builder()
.credentialsProvider(EnvironmentVariableCredentialsProvider.create())
.region(Region.of(System.getenv(SdkSystemSetting.AWS_REGION.environmentVariable())))
.overrideConfiguration(ClientOverrideConfiguration.builder()
.addExecutionInterceptor(new TracingInterceptor())
.build())
.build();
Example cold start trace
Example warm start trace
👀
With other languages
You can find implementations of this project in other languages here:
Security
See CONTRIBUTING for more information.
License
This library is licensed under the MIT-0 License. See the LICENSE file.
2 Jan 6, 2023
7 Dec 3, 2021
8 Dec 31, 2021
10 Nov 14, 2022
7 Mar 3, 2022
0 May 21, 2022
28 Nov 2, 2022
6 Nov 23, 2022
42 Dec 17, 2022
7 May 2, 2022
7 Dec 21, 2022
28 Dec 4, 2022
11.4k Jan 2, 2023
14k Jan 8, 2023
33.2k Dec 31, 2022
18.4k Dec 31, 2022
1 Jan 29, 2022
1 Jan 23, 2022
18 Aug 4, 2022