List: Data Engineering | Curated by Akshaya Balaji

Dec 30, 2024
40 stories
Data Engineering
In
Pipeline: Your Data Engineering Resource
by
Zach Quinn
1 Sheet To Get You Hired Or Promoted In 2025How data engineers can wield the power of the “brag sheet” to achieve career-altering results.
Dec 26, 2024
Dec 26, 2024
In
TDS Archive
by
💡Mike Shakhomirov
A Guide To Data Pipeline Testing with PythonA gentle introduction to unit testing, mocking and patching for beginners
Mar 9, 2024
1
Mar 9, 2024
1
Utsav Raj
Structuring Your Data Science Project: A Guide to the Cookiecutter TemplateIn the fast-paced world of software development, efficiency and consistency are key. Cookiecutter, a tool that simplifies project setup and…
Jan 11, 2024
1
Jan 11, 2024
1
In
ITNEXT
by
Artem Lajko
Necessary Culture Change with GitOpsDon’t underestimate the Role of Culture in Successful GitOps Implementation
Feb 20, 2024
1
Feb 20, 2024
1
Rahul Sounder
Data Warehousing Concepts for Beginners — Data EngineersData warehousing is a process of collecting, storing, and managing data from different sources to support business decision-making. It…
Jan 8, 2024
Jan 8, 2024
In
TDS Archive
by
💡Mike Shakhomirov
Data Warehouse Design PatternsHow I organize everything in my new data warehouse
Jan 29, 2024
3
Jan 29, 2024
3
In
TDS Archive
by
💡Mike Shakhomirov
Lead Data Engineer Career GuideKnowledge and skills for successful data leadership
Jan 6, 2024
7
Jan 6, 2024
7
In
TDS Archive
by
Sarthak Sarbahi
Streamline Data Pipelines: How to Use WhyLogs with PySpark for Data Profiling and ValidationLearn to use whylogs with PySpark for data profiling and validation
Jan 7, 2024
Jan 7, 2024
In
TDS Archive
by
Sanil Khurana
System Design Series: 0 to 100 Guide to Data Streaming SystemsLearning data streaming systems and their nuances by building a real-world recommendation system using Kafka, Cassandra, and microservices
Dec 17, 2023
9
Dec 17, 2023
9
In
TDS Archive
by
Gustavo R Santos
Best Data Wrangling Functions in PySparkLearn the most helpful functions when wrangling Big Data with PySpark
Dec 12, 2023
3
Dec 12, 2023
3
Susan Olapade
Mastering SQL Query Optimization: My Journey from 5 Hours to Under 10 Minutes
Nov 26, 2023
1
Nov 26, 2023
1
In
TDS Archive
by
Tobi Sam
How SQL execution orders varies across databasesWhy you can’t GROUP BY ordinal positions in SQL Server but can in others
Dec 7, 2023
1
Dec 7, 2023
1
In
TDS Archive
by
💡Mike Shakhomirov
Data Engineering BooksReaders Digest to Learn Data Engineering Gradually
Nov 12, 2023
5
Nov 12, 2023
5
In
TDS Archive
by
Xiaoxu Gao
Demystify Data BackfillingLet’s talk about data engineers’ nightmare
Nov 20, 2023
2
Nov 20, 2023
2
In
TDS Archive
by
Pablo Porto
A Complete Guide to Effectively Scale your Data Pipelines and Products with Contract Testing and…All you need to know to start implementing contract tests with dbt
Oct 25, 2023
2
Oct 25, 2023
2
In
TDS Archive
by
💡Mike Shakhomirov
Building a Batch Data Pipeline with Athena and MySQLAn End-To-End Tutorial for Beginners
Oct 20, 2023
Oct 20, 2023
In
TDS Archive
by
Iffat Malik
Window Functions — A must know for Data Engineers and Data ScientistsBack To Basics | SQL fundamentals for beginners
Jun 14, 2023
5
Jun 14, 2023
5
In
TDS Archive
by
Col Jung
From Data Lakes to Data Mesh: A Guide to the Latest Enterprise Data ArchitectureUnderstand why large companies are embracing data mesh
May 30, 2023
9
May 30, 2023
9
In
TDS Archive
by
Willem Koenders
A Maturity Model for Data Modeling and DesignBest practices for mastering the standardization of data definitions
Apr 25, 2023
3
Apr 25, 2023
3
In
TDS Archive
by
Madison Schott
Creating a Transparent Data Environment with Data LineageThe benefits of column-level lineage across your stack
Apr 11, 2023
2
Apr 11, 2023
2