ABLE Workflow ETL Copier¶
A copier template for an extract-transform-load (ETL) process that generates datasets, features, or models module for the project's python package.
This template assumes that you have already created an able-workflow-copier project and created a able-workflow-module-copier module
Overview of ABLE Workflow copier templates¶
Contributing¶
Environment configuration¶
See the environment configuration able-workflow-copier.
- Create a development environment with conda
# Create the environment (or update and prune if it already exists)
conda env update --name able-workflow-etl-copier --file environment-py312-dev.yaml --prune
Alternatively, run the script scripts/conda_update.sh.
Then activate
Configure the able-workflow-copier as the default python environment in the Python Environments VSCode extension.
- Install pre-commit into the repo to run checks on every commit