Skip to content

Workflows

In Qualiz, a workflow represents a complete data processing pipeline within a project. Workflows are the primary abstraction for organizing ETL and data quality operations, ensuring that data flows smoothly from sources to destinations while maintaining structure, integrity, and consistency.

Key Concepts

Project Association

  • Every workflow is linked to a specific project.
  • This association ensures that workflows, their configurations, and metadata are scoped and isolated per project.
  • Supports multi-tenant or multi-domain environments by separating workflows logically and securely.

Pipeline Abstraction

  • Workflows represent end-to-end data pipelines, encapsulating multiple steps and processes under a single logical unit.
  • They provide a clear structure for defining dependencies and execution sequences, abstracting complexity for users and developers.

Workflow Isolation

  • Workflows inherit the project’s data isolation settings.
  • Ensures that workflow data, metadata, and configurations remain segregated between projects for privacy, compliance, and operational clarity.

Extensibility

  • New workflows can be added within a project without impacting existing ones.
  • Provides a scalable architecture for managing growing data processing requirements across multiple domains or tenants.

Centralized Management

  • Workflows serve as a central concept for organizing all pipelines within a project.
  • They allow easy grouping, governance, and standardization across an organization or tenant.

Summary

Workflows in Qualiz are the foundational abstraction for data pipelines. By associating them with projects, ensuring isolation, and providing a scalable structure, they enable organized, secure, and maintainable ETL and data quality operations across multiple domains or tenants.