Skip to content

Add a backup fastpath to be used as fallback on submission failure #412

@LDiazN

Description

@LDiazN

When a measurement submission fails, we send it straight into S3. This usually happens during incidents, and it's a good worst-case scenario but it requires reprocessing the missing data.

A better best-effort thing for this kind of situation is to fall back to a second fastpath

In this context, the requires tasks are the following:

  • Consolidate the fastpath as a module in terraform, so we can duplicate it
  • Add a second fastpath to the infrastructure, properly set up and ready to accept measurements. Make sure that the collector_id in this fastpath is different to the original one
  • Change the submission logic in the ooniprobe service to fallback to the second fastpath if it fails
  • Change the OTHER_COLLECTORS env variable in oonimeasurements to also include the second fastpath. This is important to support real-time serving of measurements from the spool dir

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions