Deploying Serverless Embedding App with AWS CDK, Lambda and Amazon Aurora PostgreSQL

Elizabeth Fuentes L - Sep 17 - - Dev Community

πŸ‡»πŸ‡ͺπŸ‡¨πŸ‡± Dev.to Linkedin GitHub Twitter Instagram Youtube
Linktr

elizabethfuentes12 image

Elizabeth Fuentes L

AWS Developer Advocate

Welcome to Part 2 of our two-part blog series! In this post, I'll elevate the concepts explored in Part 1 to create a scalable, production-ready solution. Using AWS Lambda functions and AWS CDK, you'll transform our notebook-based prototype into a robust, serverless architecture. Together, we'll develop AWS Lambda functions for embedding generation and retrieval, leverage AWS CDK for infrastructure-as-code deployment, and integrate with Amazon S3 and Amazon Aurora PostgreSQL for efficient data storage and retrieval. By the end of this tutorial, you'll have a fully functional, serverless multimodal search engine capable of understanding and retrieving both textual and visual content.

βœ… AWS Level: Advanced - 300

Prerequisites:

  • Foundational knowledge of Python
  • AWS Account
  • Enable model Access for the following models:
  • Amazon Titan Embeddings V2
  • Anthropic Claude 3 models (Haiku or Sonnet).
  • Set up the AWS Command Line Interface (CLI)
  • Optional: Bootstrap your account/region if this is your first CDK Project
  • Read about AWS CDK "Get started with Python"

πŸ’° Cost to complete:

In the second part, you'll construct a Serverless Embedding App utilizing the AWS Cloud Development Kit (CDK) to create four Lambda Functions.

Learn how test Lambda Functions in the console with test events.

AWS Lambda Functions for Generating Embeddings for Text and Image Files:

AWS Lambda Functions for Generating Embeddings for Text and Image Files

To handle the embedding process, there is a dedicated Lambda Function for each file type:

To generate embeddings for the text content of PDF files with FAISS.

Event to trigger:

{
    "location": "REPLACE-YOU-KEY",
    "vectorStoreLocation": "REPALCE-NAME.vdb",
    "bucketName": "REPLACE-YOU-BUCKET",
    "vectorStoreType": "faiss",
    "splitStrategy": "semantic",
    "fileType": "application/pdf", 
    "embeddingModel": "amazon.titan-embed-text-v1"
  }
Enter fullscreen mode Exit fullscreen mode

Event to trigger

To generate embeddings for images with FAISS.

Event to trigger:

{
    "location": "REPLACE-YOU-KEY-FOLDER",
    "vectorStoreLocation": "REPLACE-NAME.vdb",
    "bucketName": "REPLACE-YOU-BUCKET",
    "vectorStoreType": "faiss",
    "splitStrategy": "semantic",
    "embeddingModel": "amazon.titan-embed-image-v1"
}
Enter fullscreen mode Exit fullscreen mode

To generate embeddings for image/pdf with pgvector and Amazon Aurora.

To generate embeddings for image/pdf with pgvector and Amazon Aurora.

πŸ’‘ Before testing this Lambda Function keep in mind that it must be in the same VPC and be able to access the Amazon Aurora PostreSQL DB, for that check Automatically connecting a Lambda function and an Aurora DB cluster, Using Amazon RDS Proxy for Aurora and Use interface VPC endpoints (AWS PrivateLink) for Amazon Bedrock VPC endpoint.

Event to trigger:

{
  "location": "YOU-KEY",
  "bucketName": "YOU-BUCKET-NAME",
  "fileType": "pdf or image",
  "embeddingModel": "amazon.titan-embed-text-v1", 
  "PGVECTOR_USER":"YOU-RDS-USER",
  "PGVECTOR_PASSWORD":"YOU-RDS-PASSWORD",
  "PGVECTOR_HOST":"YOU-RDS-ENDPOINT-PROXY",
  "PGVECTOR_DATABASE":"YOU-RDS-DATABASE",
  "PGVECTOR_PORT":"5432",
  "collectioName": "YOU-collectioName",
  "bedrock_endpoint": "https://vpce-...-.....bedrock-runtime.YOU-REGION.vpce.amazonaws.com"
}
Enter fullscreen mode Exit fullscreen mode

Event to trigger

AWS Lambda Funtions to Query for Text and Image Files in a Vector DB:

AWS Lambda Funtions to Query for Text and Image Files in a Vector DB

To handle the embedding process, there is a dedicated Lambda Function for each file type:

To retrieval text content from a vector DB

Event to trigger:

{
  "vectorStoreLocation": "REPLACE-NAME.vdb",
  "bucketName": "REPLACE-YOU-BUCKET",
  "vectorStoreType": "faiss",
  "query": "YOU-QUERY",
  "numDocs": 5,
  "embeddingModel": "amazon.titan-embed-text-v1"
}
Enter fullscreen mode Exit fullscreen mode

Event to trigger

To retrieval image location from a vector DB

You can search by text or by image

  • Text event to trigger 
{
  "vectorStoreLocation": "REPLACE-NAME.vdb",
  "bucketName": "REPLACE-YOU-BUCKET",
  "vectorStoreType": "faiss",
  "InputType": "text",
  "query":"TEXT-QUERY",
  "embeddingModel": "amazon.titan-embed-text-v1"
}
Enter fullscreen mode Exit fullscreen mode

Text event to trigger

  • Image event to trigger

πŸ’‘ The next step is to take the image_path value and download the file from Amazon S3 bucket with a download_file boto3 method.

To generate embeddings for image/pdf with pgvector and Amazon Aurora.
To generate embeddings for image/pdf with pgvector and Amazon Aurora

{
  "location": "YOU-KEY",
  "bucketName": "YOU-BUCKET-NAME",
  "fileType": "pdf or image",
  "embeddingModel": "amazon.titan-embed-text-v1", 
  "PGVECTOR_USER":"YOU-RDS-USER",
  "PGVECTOR_PASSWORD":"YOU-RDS-PASSWORD",
  "PGVECTOR_HOST":"YOU-RDS-ENDPOINT-PROXY",
  "PGVECTOR_DATABASE":"YOU-RDS-DATABASE",
  "PGVECTOR_PORT":"5432",
  "collectioName": "YOU-collectioName",
  "bedrock_endpoint": "https://vpce-...-.....bedrock-runtime.YOU-REGION.vpce.amazonaws.com",
  "QUERY": "YOU-TEXT-QUESTION"
  }
Enter fullscreen mode Exit fullscreen mode

event

πŸ’‘ Use location and bucketName to deliver image location to make a query.

πŸš€ Let's build!

The Amazon Lambdas that you build in this deployment are created with a container images, you must have Docker Desktop installed and active in your computer.

Step 1: APP Set Up

βœ… Clone the repo

git clone https://github.com/build-on-aws/langchain-embeddings
Enter fullscreen mode Exit fullscreen mode

βœ… Go to:

cd serveless-embeddings
Enter fullscreen mode Exit fullscreen mode

βœ… Configure the AWS Command Line Interface
βœ… Deploy architecture with CDK Follow steps

Follow steps:

Step 2: Deploy architecture with CDK.

βœ… Create The Virtual Environment: by following the steps in the README:

python3 -m venv .venv
source .venv/bin/activate
Enter fullscreen mode Exit fullscreen mode

for windows:

.venv\Scripts\activate.bat
Enter fullscreen mode Exit fullscreen mode

βœ… Install The Requirements:

pip install -r requirements.txt
Enter fullscreen mode Exit fullscreen mode

βœ… Synthesize The Cloudformation Template With The Following Command:

cdk synth
Enter fullscreen mode Exit fullscreen mode

βœ… πŸš€ The Deployment:

cdk deploy
Enter fullscreen mode Exit fullscreen mode

🧹 Clean the house!:

If you finish testing and want to clean the application, you just have to follow these two steps:

βœ… Delete the files from the Amazon S3 bucket created in the deployment.
βœ… Run this command in your terminal:

cdk destroy
Enter fullscreen mode Exit fullscreen mode

Conclusion

In this post, you've demonstrated how to transform a notebook-based multimodal search solution into a scalable, serverless architecture using AWS services. You've walked through the process of developing Lambda functions for embedding tasks, utilizing AWS CDK for infrastructure deployment, and integrating with S3 and Aurora PostgreSQL for efficient data management.

By leveraging these serverless technologies, you can now deploy a robust, production-ready multimodal search engine capable of handling both textual and visual content. This approach not only enhances scalability but also reduces operational overhead, allowing you to focus on improving your search capabilities and user experience.

I encourage you to build upon this foundation, experiment with different embedding models, and explore additional AWS services to further enhance your multimodal search engine. Don't hesitate to share your experiences or ask questions in the comments below. Happy building!

Thanks,
Eli

πŸ‡»πŸ‡ͺπŸ‡¨πŸ‡± Dev.to Linkedin GitHub Twitter Instagram Youtube
Linktr

Continue to Building a Multimodal Search Engine with Amazon Titan Embeddings, Aurora Serveless PostgreSQL and LangChain

Image
Why 0.1 + 0.2 != 0.3: Understanding Floating Point Arithmetic in Computers
Image
Why Two Addresses? - Cisco 300-425 ENWLSD Study Guide

cisco, study, exam, certification
Image
RTX 4090 PC for AI Training: To Rent or Not to Rent?
Image
Internet Protocol Version 4 - Cisco 300-420 ENSLD Study Guide

cisco, exam, certification, study
Image
Bug or anything else Need Explanation for Js Increment
Image
Physical Addresses - Cisco 300-415 ENSDWI Study Guide

cisco, exam, certification, study
Image
Ω…Ψ§ Ω‡ΩŠ ΨͺΩ‚Ω†ΩŠΨ© Ψ§Ω„Ψ¨Ω„ΩˆΩƒΨ΄ΩŠΩ† ΩˆΩƒΩŠΩ ΨͺΨΉΩ…Ω„ Ω‡Ψ°Ω‡ Ψ§Ω„ΨͺΩ‚Ω†ΩŠΨ© Ψ§Ω„Ω…Ψ§Ω„ΩŠΨ©
Image
Easily Create Interactive Floor Planner Diagrams in Vue

vue, development, ui
Image
Simple and fast resume document generator with AI

resume, career, ai, productivity
Image
Testing microservices in isolation (contract testing)

testing, microservices, csharp, dotnet
Image
PHP and Frontend Integration: Bridging the Gap for Dynamic Web Applications | Julio Herrera Via dei Velutini

php, webdev, javascript, beginners
Image
Top 5 Salesforce Features Every Developer Should Master in 2024

webdev, developer, development, devchallenge
Image
Renting Options: 7900 XTX vs 4080 vs 4090 for DeepΒ Learning
Image
Roadmap to Mastering the Spring Framework πŸš€

spring, springboot, springsecurity, java
Image
The Power of Hooks in WordPress Development: An In-Depth Tutorial
Image
The World of Anime: A Deep Dive into Japan’s Creative Phenomenon
Image
Spring Framework: A Beginner's Guide to the Ultimate Java Framework πŸš€
Image
How to Create an E-Commerce Website
Image
Download Terabox Mod Apk

googlecloud, aws
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Terabox Video Player