Pipelines

.

Pipelines

Purpose: define and schedule (batch) jobs for Model training/scoring or feature extraction How: Pyspark + cron

Writing jobs

Adding dependencies

Scheduling jobs

Best practices