Skip to content

Latest commit

 

History

90 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

Hi, I'm Shahzeb Ali

Data Engineer based in Lahore | Open-Source Contributor

I build reliable data pipelines, from ingestion to analytics-ready datasets. Day to day, that means ETL/ELT in Python and SQL, large-scale processing on Apache Spark and Databricks, and dimensional modeling, with a focus on getting incremental ingestion right: CDC, Delta Lake MERGE, and clean dbt transformations. I also hunt the bugs that do not crash. They quietly return the wrong answer.

What I'm working on now

  • Building the Jira source connector for Galaxy's Filament (assigned November 2026): YAML manifest and docs page first, following the Asana connector pattern
  • Contributing to delta-rs (Delta Lake, Rust) and maintaining my open pull requests across the data stack
  • Research: fault-injection benchmarking for data quality monitoring, and CDC strategies on Delta Lake under late-arriving updates

Open-source contributions: 21 merged pull requests

Project Merged Pull requests What I contributed
delta-io/delta-rs 7 #4832, #4833, #4866, #4890, #4942, #4966, #5004 Correctness fixes: schema-merge nullability, pre-epoch timestamp statistics, TIMESTAMP UTC offset, validation error naming; docs on retention config, merge examples, and writer env vars
kedro-org/kedro 3 #5808, #5809, #5828 CachedDataset docs example, templating concept page rewrite, OmegaConfigLoader resolver fix
apache/iceberg-python 3 #4135, #4142, #4144 Timestamp parser and predicate evaluation fixes
apache/datafusion 1 #26489 width_bucket bucket-computation dedup
bytewax/bytewax 1 #637 Build info: __version__, __git_revision__, __git_dirty__
open-metadata/docs-om 2 #599, #615 OpenSearch FGAC permissions guide, dev container setup fix
ClickHouse/ClickHouse 1 #125739 Version note for Replicated engine default_replica_path settings
sqlfluff/sqlfluff 1 #8715 Removed outdated Snowflake USING note from Rule ST07
airbytehq/airbyte 1 #88468 Fixed dead low-code CDK sample connector links
canonical/starbase 1 #638 llms.txt description from index.rst

Also in review: Prefect #23819 (type-preserving hash_objects fix), delta-rs #5012 and #5037, dbt #16690, Airflow #74424, and pull requests in Trino, Chroma, Apache Iceberg, lakeFS, and Canonical projects.

Previously validated the Databricks Zerobus sink for Galaxy's Filament, which shipped in Filament v0.24.0.

Technical skills

  • Languages: Python, SQL, Rust, Go
  • Data processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
  • Databases: PostgreSQL, MS SQL Server, SSIS, SSAS
  • Data manipulation: Pandas, NumPy
  • Architecture: Medallion Architecture, CDC, Delta Lake MERGE, Dimensional Modeling
  • Testing and quality: pytest, Rust tests, SQL validation

Experience and education

  • Data Engineer — Alphabridge Consulting, Lahore (Aug – Sep 2026)
  • Teaching Assistant, DBMS & Data Warehousing / BI — PUCIT, Lahore (Jan 2025 – Jan 2026)
  • BS Data Science — University of the Punjab, PUCIT (2022 – 2026)

Connect with me


Building reliable data pipelines, one PR at a time.

Releases

Packages

Used by

Contributors