Update readme.md
This commit is contained in:
parent
c20557a036
commit
996a60bc7d
1 changed files with 12 additions and 32 deletions
44
readme.md
44
readme.md
|
|
@ -36,22 +36,11 @@
|
|||
<li><a href="#gold-curated--analytics-ready">Gold (Curated & Analytics-Ready)</a></li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>
|
||||
<a href="#getting-started">Getting Started</a>
|
||||
<ul>
|
||||
<li><a href="#prerequisites">Prerequisites</a></li>
|
||||
<li><a href="#installation">Installation</a></li>
|
||||
<li><a href="#configuration">Configuration</a></li>
|
||||
</ul>
|
||||
</li>
|
||||
<li><a href="#usage">Usage</a></li>
|
||||
<li><a href="#data-quality--validation">Data Quality & Validation</a></li>
|
||||
<li><a href="#outputs">Outputs</a></li>
|
||||
<li><a href="#roadmap">Roadmap</a></li>
|
||||
<li><a href="#contributing">Contributing</a></li>
|
||||
<li><a href="#license">License</a></li>
|
||||
<li><a href="#contact">Contact</a></li>
|
||||
<li><a href="#acknowledgments">Acknowledgments</a></li>
|
||||
</ol>
|
||||
</details>
|
||||
|
||||
|
|
@ -168,36 +157,27 @@ Downstream analytics and metric definitions
|
|||
|
||||
<p align="right">(<a href="#readme-top">back to top</a>)</p>
|
||||
|
||||
Roadmap
|
||||
## Roadmap
|
||||
|
||||
Add orchestration (Airflow / Dagster)
|
||||
- Add orchestration (Airflow / Dagster)
|
||||
- Implement incremental processing and partitioning
|
||||
- Add automated pipeline health checks (row counts, null rates, duplicates)
|
||||
- Add unit tests for validation logic
|
||||
- Add monitoring, alerting, and run logs
|
||||
- Add CDC-style ingestion simulation
|
||||
|
||||
Implement incremental processing and partitioning
|
||||
|
||||
Add automated pipeline health checks (row counts, null rates, duplicates)
|
||||
<p align="right">(<a href="#readme-top">back to top</a>)</p>
|
||||
|
||||
Add unit tests for validation logic
|
||||
|
||||
Add monitoring, alerting, and run logs
|
||||
|
||||
Add CDC-style ingestion simulation
|
||||
|
||||
See the open issues
|
||||
for a full list of proposed features and known issues.
|
||||
|
||||
<p align="right">(<a href="#readme-top">back to top</a>)</p>License
|
||||
## License
|
||||
|
||||
Distributed under the MIT License. See LICENSE.txt for more information.
|
||||
|
||||
<p align="right">(<a href="#readme-top">back to top</a>)</p>
|
||||
Contact
|
||||
|
||||
Cameron Seamons
|
||||
Ogden, Utah
|
||||
Email: CameronSeamons@gmail.com
|
||||
## 💬 Connect With Me
|
||||
|
||||
LinkedIn: linkedin_username
|
||||
|
||||
Project Link: https://github.com/github_username/repo_name
|
||||
<span>[](https://www.linkedin.com/in/cameron-css/) [](https://CamDoesData.com) [](https://www.kaggle.com/cameronseamons) [](mailto:CameronSeamons@gmail.com) [](https://drive.google.com/file/d/1YaM4hDtt2-79ShBVTN06Y3BU79LvFw6J/view?usp=sharing)</span>
|
||||
|
||||
|
||||
<p align="right">(<a href="#readme-top">back to top</a>)</p>
|
||||
|
|
|
|||
Loading…
Reference in a new issue