← Back
Demo LiveNDMO P1–P3UAE PDPL

Manarah Suite — Architecture

An AI-native alternative to the Informatica stack. Four independent services behind a single URL, sharing auth, connectors, and i18n — built for UAE government data environments.

System Architecture

Manarah PortalAuthentication · Session Management · Reverse Proxy/wasit/*/mizan/*/amin/*Wasit (واسط)ETL Engine30+ connectors:5004Mizan (ميزان)Data QualityScoring · Trends:5002Amin (أمين)GovernanceLineage · NDMO:5001Manarah AILLM AgentNatural-language opsClaude APIShared Packagesshared_auth · shared_i18n · shared_connectors · shared_core

The portal is the single entry point and reverse proxy. One URL routes /wasit/*, /mizan/*, and /amin/* to independent gunicorn processes running on internal ports.

A shared SECRET_KEY means a single signed session cookie authenticates across all four services — no separate login per tool, no token exchange.

The dashed lines represent importable Python packages (shared_*) that each service installs at build time — not HTTP calls.

Components

ETL Engine:5004

Wasit (واسط)

Pipeline builder with a visual editor and 30+ enterprise source adapters. Pipelines are versioned and auditable. UAE PDPL data masking is applied per-field during extraction.

  • ·Visual pipeline editor
  • ·30+ connector adapters (Snowflake, BigQuery, SAP HANA, Oracle, Azure, Salesforce…)
  • ·Pipeline versioning and audit trail
  • ·Scheduled + event-triggered runs
  • ·Field-level PII masking before load
PythonFlaskSQLAlchemyAPScheduler
Data Quality:5002

Mizan (ميزان)

Automated DQ scoring across datasets. Measures completeness, consistency, accuracy, and timeliness. Failed records drill-down and compliance-ready reports map to NDMO P2 controls.

  • ·Completeness, consistency, accuracy, timeliness dimensions
  • ·Failed-record drill-down per dataset
  • ·NDMO P2 DQ control coverage
  • ·Score trend tracking over time
  • ·Scheduled quality runs with alerts
PythonFlaskSQLitePandas
Data Governance:5001

Amin (أمين)

Governance platform covering data stewardship, asset cataloguing, lineage, and PDPL/NDMO compliance. Role-based access with viewer, steward, and admin roles across data domains.

  • ·Data asset catalogue with classifications
  • ·Dataset lineage graph
  • ·NDMO P1–P3 control tracking per asset
  • ·Role-based stewardship (viewer / steward / admin)
  • ·PDPL consent and retention records
PythonFlaskPostgreSQLSQLAlchemyAlembic
LLM AgentClaude API

Manarah AI

Natural-language interface over the entire suite. Translates chat requests into API calls against Wasit, Mizan, and Amin using tool-use chains. Supports Arabic and English.

  • ·Natural-language ETL pipeline builder
  • ·DQ analysis and fix suggestions via chat
  • ·Tool-use chains across all three services
  • ·Context-aware governance recommendations
  • ·Arabic and English language support
PythonClaude APIFlask

Shared Infrastructure

shared_auth

Session management, inactivity timeout, and LDAP integration. All four services share the same SECRET_KEY — one signed cookie, one login.

shared_connectors

30+ adapters behind a unified Connector interface. Adding a new source is one class — no changes to the ETL engine.

shared_i18n

Full Arabic/English bilingual support with RTL layout switching. Translations are YAML files loaded at app-factory time.

shared_core

Config loader, DB helpers, error middleware, and health-check endpoints shared across all services.

NDMO Control Mapping

PriorityControl AreaImplemented in
P1Data ClassificationAmin
P1Access Control & StewardshipAmin
P1Data LineageAmin
P2Data Quality ScoringMizan
P2Pipeline Audit TrailWasit
P2PII Masking in TransitWasit
P3Retention Policy EnforcementAmin
P3Consent RecordsAmin

Enterprise Connectors (Wasit)

SnowflakeBigQueryRedshiftDatabricksSAP HANAOracle DBMicrosoft SQL ServerPostgreSQLMySQLAzure SQLAzure Blob StorageAzure Data LakeSalesforceGoogle SheetsAmazon S3SharePointREST APIsSFTPFTPMongoDBElasticsearchKafkaRabbitMQTeradataIBM Db2Google Cloud StorageDelta Lake
Try the Demo →← Back to Portfolio