Skip to content
View danlevimb's full-sized avatar

Block or report danlevimb

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
danlevimb/README.md

Dan Levi — Data Engineer

SQL Server & ETL foundations → Azure Data Engineering → Reliable, observable data systems.

Data infrastructure • Reliability • Azure • Streaming • Lakehouse • Operational analytics

LinkedIn Tableau Public Carrd Email


👨🏻‍💻 About me

I’m a Data Engineer with a long-standing background in SQL Server, ETL, data infrastructure, and operational reliability, now extending that foundation into modern Azure Data Engineering.

My portfolio follows a deliberate progression:

SQL Server / ETL / operational reliability
                ↓
Cloud ingestion and orchestration
                ↓
Lakehouse transformation and history
                ↓
Analytical serving
                ↓
Security / IaC / monitoring / alerting
                ↓
Real-time reliability / state / observability

The recurring theme across my work is reliability: knowing what arrived, what changed, what failed, what state is true, and what downstream consumers can trust.


🧭 Engineering focus

  • Data infrastructure & reliability — traceability, recoverability, data quality, observability, failure handling, and operational clarity.
  • SQL Server & ETL — T-SQL, SSIS, performance tuning, backup/recovery, HA/DR, and production support.
  • Azure Data Engineering — ADF, ADLS Gen2, Databricks, Delta Lake, Synapse Serverless SQL, Event Hubs, KQL, Azure Monitor, and Managed Identity.
  • Production readiness — RBAC, Key Vault, Bicep, GitHub Actions validation, diagnostics, alerts, and cost-aware resource decisions.
  • Real-time analytics — event quality, canonicalization, integrity vs timeliness, state reconstruction, Gold serving, and operational observability.

🛠️ Core technologies


🚀 Flagship Azure Data Engineering projects

Real-time Azure Data Engineering pipeline using Event Hubs + KQL with Raw / Parsed / Canonical analytical layers, stream integrity and timeliness analysis, Raw-to-Canonical reconciliation, state reconstruction, Gold serving, controlled failure scenarios, and a four-page operational dashboard.

What it proves: real-time analytical engineering, stream reliability, event semantics, state modeling, and operational observability.

Production-readiness project focused on Managed Identity, RBAC, Key Vault, Bicep, GitHub Actions validation, Log Analytics, KQL diagnostics, Azure Monitor alerts, and failure handling around a small ADF ingestion pipeline.

What it proves: operational maturity beyond a pipeline that merely “works.”

Lakehouse project using PySpark + Delta Lake with Bronze / Silver / Gold layers, MERGE, SCD Type 2, Time Travel, rejected records, and validation reporting.

What it proves: modern transformation, historical modeling, data quality, and Lakehouse engineering.


🧩 Supporting Azure projects

Metadata-driven ADF ingestion framework integrating SQL Server and file sources with control tables, watermarks, incremental loading, retry/failure validation, and operational monitoring.

SQL serving layer over ADLS Gen2 using Synapse Serverless SQL, external tables, reporting views, data-quality checks, CETAS, and cost-aware querying.

Foundation event-driven project using Event Hub, Azure Functions, ADLS Gen2, layered validation, stateful modeling, and Gold aggregation.


🛡️ SQL Server reliability project

Production-oriented framework for backup orchestration, restore-chain construction, restore validation, point-in-time recovery testing, and auditability.

This project represents the operational reliability mindset that also runs through my Azure portfolio.


📊 Analytics

  • Energy Multimarket Dashboard — Brent vs WTI exploratory dashboard built from an automated ETL workflow.
  • Additional analytics work includes customer churn, A/B testing, telecom behavior analysis, SQL analysis, and Tableau reporting.

🎯 Current professional direction

I’m focused on Data Engineering roles centered on reliable data infrastructure, especially environments that value:

  • SQL Server and ETL depth.
  • Azure Data Engineering.
  • Data reliability and observability.
  • Production-aware pipeline design.
  • Real-time and event-driven systems.
  • Clear technical documentation and operational ownership.

The next technical capability on my roadmap is data governance and lineage, but my current priority is turning the completed portfolio into a concise recruiter-facing and interview-ready story.


🤝 Let’s connect

If your team is working on data infrastructure, Azure pipelines, SQL Server modernization, streaming analytics, or reliability-heavy data systems, feel free to reach out on LinkedIn or email.

Pinned Loading

  1. azure-real-time-analytics-pipeline azure-real-time-analytics-pipeline Public

    Azure real-time Data Engineering pipeline using Event Hubs and KQL, with stream reliability, state reconstruction, Gold serving, and operational observability.

    Python 1

  2. production-ready-azure-data-pipeline production-ready-azure-data-pipeline Public

    Production-ready Azure Data Factory pipeline with Managed Identity, Key Vault, Bicep, GitHub Actions validation, Log Analytics, KQL diagnostics, and Azure Monitor alerting.

    PowerShell 1

  3. azure-adf-incremental-ingestion-framework azure-adf-incremental-ingestion-framework Public

    Metadata-driven incremental ingestion framework using Azure Data Factory, SQL Server, ADLS Gen2, control tables, watermarks, and operational validation evidence.

    TSQL

  4. azure-databricks-delta-lakehouse azure-databricks-delta-lakehouse Public

    Azure Databricks Delta Lakehouse project using PySpark, Delta Lake, Bronze/Silver/Gold layers, MERGE, SCD Type 2, time travel, and data quality validation.

    Python

  5. azure-synapse-serverless-serving-layer azure-synapse-serverless-serving-layer Public

    Azure Synapse Serverless SQL serving layer over ADLS Gen2 with external tables, reporting views, CETAS, data quality checks, and cost-aware querying.

    TSQL

  6. sql-server-recovery-validation-framework sql-server-recovery-validation-framework Public

    SQL Server backup, restore-chain, PITR, and recovery-validation framework focused on reliability, traceability, and operational resilience.

    TSQL