Data Pipeline

Created: 2023-02-13 11:39
#note

It helps creating repeatable machine learning processes while reducing human costs.

Functions:

  • fetch data from source;
  • cleansing, filtering, and validation;
  • transformations and enrichment;
  • feature store operations;
  • continuous cycle;

Managed data pipelines:

  • Engineering life cycle;
  • traceability;
  • reproducibility;
  • automation.

Tags

#mlops #ml