Data engineering patterns for ETL pipelines, data warehousing, Apache Spark, and data quality validation