Customer orders ETL

README.md
Copied
1
# Template: Customer orders etl
2

3
This task will query the database to get all customers who made an order in the last 24 hours.
4
Then it will upload the data to AWS S3 and bulk load the data into Snowflake.
5

6
## Setup
7
- Configure a [Snowflake resource](https://docs.airplane.dev/resources/snowflake) named `snowflake`.
8
- Give your Snowflake instance [access to your AWS S3 bucket](https://docs.snowflake.com/en/user-guide/data-load-s3)
9
- You'll need to configure [OIDC with Amazon Web Services](https://docs.airplane.dev/platform/oidc-aws) to allow Airplane tasks to upload to s3.
10
-- Once that is configured, create a [config variable](https://docs.airplane.dev/platform/configs) named `aws_oidc_role` with the AWS role you created (e.g. `arn:aws:iam::ACCOUNT_ID:role/airplane_oidc"`) 
11
- Replace `YOUR_S3_BUCKET_NAME` and `YOUR_BUCKET_REGION` in the task code with your AWS S3 bucket name and region.
12

13
## Next steps
14
- Navigate to the customer_orders_etl directory: `cd customer_orders_etl`
15
- Develop your template locally: `airplane dev`
16
- Deploy your tasks and view: `airplane deploy --yes`
17
- Visit the docs to learn more about how to build views: https://docs.airplane.dev/views/getting-started