Data Engineer in Islamabad, Pakistan. I build data pipelines for US healthcare claims and payments data. I also build retrieval-augmented generation (RAG) applications with LLMs.
Data Engineer, Biome Analytics (March 2025 to present)
- Work with US healthcare revenue-cycle data under HIPAA rules.
- Migrated data pipelines from Spark to Ibis.
- Built a service that loads 500 million records from the data lake into the database. The service uses parallel processing.
- Built data quality checks for the pipelines.
- Tools: Python, SQL, Spark, Ibis, Databricks, Dagster, Azure (AKS).
Junior Software Engineer, Kalsoft (August 2024 to February 2025)
- Built data analytics and AI products.
- Data scraping, data cleaning and preprocessing.
- Machine learning use cases and an OCR system for text extraction.
| Project | Description |
|---|---|
| underpayment-checker | Compares insurance payments with the rates that insurers publish. A streaming parser reads multi-gigabyte rate files. DuckDB SQL layers apply the matching rules. 98 tests. |
| weather-etl-pipeline | ETL pipeline from a public weather API to SQLite, with rolling statistics, anomaly detection, retries and run auditing. |
| pdf-rag-assistant | RAG application for PDF documents with admin and user roles. LangChain, FAISS and Streamlit. |
- Languages: Python, SQL
- Data processing: Spark, Databricks, Ibis, DuckDB, pandas
- Orchestration: Dagster
- Cloud: AWS, Azure (AKS)
- LLM applications: LangChain, FAISS, Hugging Face embeddings, Groq
- Healthcare data: claims and remittances (837/835), CPT codes, payer rate files (Transparency in Coverage)
BS Computer Science, Capital University of Science and Technology (CUST), Islamabad. CGPA 3.99/4.00. University Gold Medal.