Skip to content

Improve fastly loggings in S3 and athena #13989

Open
1 of 1 issue completed
Open
1 of 1 issue completed
@marjisound

Description

@marjisound

In AWS S3 bucket aws-frontend-logs under fastly folder, there are some fastly services which are sending the logs in a none-partitioned pattern. This is not idea, because it'll make the athena query slower and harder to find the recods we're looking for.

After partitioning the logs, we will need to also add the partition to the relevant athena tables. Follow the instruction here: https://github.com/guardian/fastly-edge-cache/blob/main/theguardiancom/docs/logging.md#setup-aws-glue

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions