Skip to content

Terraform, Lambda, and Frontend Changes#104

Open
gt1074 wants to merge 31 commits intomainfrom
Terraform2
Open

Terraform, Lambda, and Frontend Changes#104
gt1074 wants to merge 31 commits intomainfrom
Terraform2

Conversation

@gt1074
Copy link
Copy Markdown
Collaborator

@gt1074 gt1074 commented Apr 15, 2026

Full implementation of the Terraform AWS suite. Transfers data pipeline from scripts to Terraform configuration. Initializes all necessary S3 buckets, Lambda functions, IAM privileges, ECS and EC2 modules, SNS modules, and private VPC configurations. All required attributes are configurable through terraform variables.

Changed Geojson metadata configuration. Geojson metadata is now configured in the validation lambda, fixing a bug where non validated files were left hanging in the staging bucket with no way to delete them.

Added AWS SSM parameter to handle the provider authentication string for submitting to DCDB using the submission lambda.

Submission and validation lambda now correctly update metadata to include upload and validation status, while showing whether a file is online, archived, or deleted. Metadata is now kept even if a file is deleted from S3.

Changed python consumers and socket manager to include payload and reconnection support.

Configured the frontend Geojson map to render tiles from AWS Location Services.

Configured frontend to now display status (upload/validation/conversion) and state (online/archived/deleted) of files.

Use AWS RDS instances instead of ECS container database instances for the frontend and manager.

Switched to AWS Elasticache for Redis implementation.

gt1074 and others added 30 commits September 25, 2025 10:25
…n-fix

Update conversion start lambda permissions
…redis / Changed frontend database configurations / Working towards fixed static file s3 storage
…bdas & ecs / Moving geojson metadata initialization from submission to validation lambda
@gt1074 gt1074 self-assigned this Apr 15, 2026
@gt1074 gt1074 requested a review from selimnairb April 15, 2026 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants