Building Data Quality in ETL pipelines using AWS Glue Data Quality

10 Views
Published
Data volume is growing exponentially and business needs reliable data at a faster pace in order to be agile. At the same time, quality data is critical for efficient business operation, otherwise lot of time is wasted in fixing data and data consumers lose trust in the data. Applications use Machine learning to make data-driven decisions. However the success is heavily dependent on the quality of data. At the pace of data, we need data quality checks in the ETL pipeline so it is available immediately. This demo shows how you can achieve data quality in ETL pipeline using AWS Glue data quality.

Resources:
Category
AWS Developers
Tags
aws developers, technical tutorials, github
Be the first to comment