Skip to content
View himanshuvnm's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report himanshuvnm

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
himanshuvnm/README.md

πŸ”¬ Himanshu Singh

I am an AI Researcher with a background in pure and applied mathematics, scientific computing, and machine learning. My research develops mathematically grounded methods for scientific AI, representation learning, operator learning, and foundation models, with applications ranging from atmospheric dynamics and data assimilation to biomedical AI.

My work bridges theory and practice through:

  • Mathematical foundations of AI and representation learning
  • Scientific machine learning and neural operators
  • Koopman and kernel operator methods
  • Sparse and efficient neural architectures
  • Generative and foundation models for physical systems
  • Mechanistic interpretability and representation dynamics

πŸ”­ Current Research Interests

  • Scientific Foundation Models β€” generative modeling, uncertainty, and ensemble learning for physical systems
  • Representation Learning β€” geometry, invariance, kernels, and operator-adapted representations
  • Operator Learning β€” Koopman operators, neural operators, and spectral methods
  • Efficient AI β€” sparse neural networks, compact-support kernels, and structured architectures
  • Mechanistic Interpretability β€” representation dynamics and internal mechanisms of language models
  • AI for Science & Medicine β€” atmospheric science, data assimilation, and biomedical learning

πŸ“š Selected Publications & Accepted Papers

✨ 2026 β€” Recent Accepted Work

Matrix-Free Covariance-Response Approach for Data Assimilation-Ready Weather Ensembles

New 2026

Himanshu Singh, Steven J. Greybush, Laura E. Dailey, Melissa Adrian, and Romit Maulik

40th Conference on Neural Information Processing Systems (NeurIPS 2026)

A matrix-free framework for learning and evaluating covariance response in generative weather ensembles, motivated by the requirements of ensemble-based data assimilation.

πŸ“„ Paper


Operator-Adapted Reproducing Kernel Geometries for Structure-Preserving Representation Learning

Research Highlight

Himanshu Singh

40th Conference on Neural Information Processing Systems (NeurIPS 2026)

Develops an inverse geometric formulation of representation learning: rather than modifying an operator to preserve a prescribed geometry, construct an RKHS geometry in which the given operator acts isometrically. The work characterizes the complete family of admissible invariant kernels and develops operator-adapted Gaussian representations.

πŸ“„ Paper Β· 🌐 Interactive Project Website Β· πŸ’» Code


Kernelized Koopman Representation Geometry Governs Transient Amplification in Neural Dynamical Systems

Featured 2026

Himanshu Singh

NeurIPS 2026 Workshop on Symmetry and Geometry in Neural Representations β€” Proceedings Track

Studies how kernel-induced representation geometry governs transient amplification in neural dynamical systems through a Koopman-operator perspective.

πŸ“„ Paper Β· 🌐 Interactive Project Website Β· πŸ’» Project Repository


Which Anatomy Matters Under Limited Labels? A Data-Efficient Anatomy-Aware Benchmark for Cardiac Pathology Prediction

Himanshu Singh

43rd International Conference on Machine Learning (ICML 2026), Seoul, South Korea β€” PMLR 306

Investigates low-data cardiac pathology prediction using anatomy-aware representations, asking whether carefully chosen anatomical structure can provide more useful predictive information than increased model complexity.

πŸ“„ Paper


Sparse Koopman Neural Operator for Atmospheric Dynamics with Spectral Stability and Latent Scaling

Himanshu Singh and Drishty Singh

International Conference on Scientific Computing and Machine Learning (SCML 2026)

Introduces a sparse Koopman neural-operator framework for atmospheric dynamics, combining latent-space evolution, spectral stability, and scalable scientific machine learning.

πŸ“„ Paper Β· πŸ’» Project Repository


Sparse Global Mixing via Compact-Support Graph Kernels

Himanshu Singh

AI4X – Accelerate, Singapore, 16–19 June 2026

Develops compact-support graph kernels as a sparse alternative to dense global pairwise mixing, using localized kernel structure to reduce interaction complexity while retaining global representation capability.

πŸ“„ Paper


πŸ“– Earlier & Foundational Work

Kernel Dynamic Mode Decomposition for Sparse Reconstruction of Closable Koopman Operators

Nishant Panda, Himanshu Singh, and J. Nathan Kutz

arXiv:2505.06806, 2025

Studies the operator-theoretic foundations of kernel Dynamic Mode Decomposition by constructing a Laplacian-kernel RKHS and investigating closability of Koopman operators, with applications to sparse spatiotemporal reconstruction.

πŸ“„ arXiv Β· 🌐 Project Page


Machine Learning Application of Generalized Gaussian Radial Basis Function and Its Reproducing Kernel Theory

Himanshu Singh

Mathematics, 12(6), 829, 2024

Develops the reproducing-kernel theory of the Generalized Gaussian Radial Basis Function and investigates its use in machine-learning architectures including kernel regression, support vector machines, and neural networks.

πŸ“„ Journal Article Β· πŸ”— DOI


🧠 Research Areas

Area Topics
Scientific AI Foundation models, generative ensembles, data assimilation
Operator Learning Koopman operators, neural operators, FNO
Representation Learning RKHS geometry, invariant representations, kernel methods
Efficient AI Sparse neural networks, graph kernels, structured models
Mechanistic Interpretability Representation dynamics, activation analysis, LLM behavior
Applied AI Atmospheric science, biomedical imaging, dynamical systems

πŸ§ͺ Selected Research Projects

  • Atmospheric Foundation Models β€” generative ensemble modeling and data assimilation
  • Operator-Adapted RKHS Geometry β€” structure-preserving representation learning
  • Sparse Koopman Neural Operators β€” stable learning of atmospheric dynamics
  • Kernel Koopman Theory β€” RKHS closability and sparse dynamical reconstruction
  • Mechanistic Interpretability of LLMs β€” representation and repetition dynamics
  • Anatomy-Aware Biomedical AI β€” data-efficient cardiac pathology prediction

πŸ› οΈ Methods & Tools

Python Β· PyTorch Β· Scientific ML Β· Neural Operators Β· Koopman Operators Β· RKHS Β· Kernel Methods Β· Generative Models Β· Diffusion Models Β· Graph Neural Networks Β· High-Performance Computing


πŸ”— Research Links

🌐 Personal Website Β· πŸ’» GitHub Β· πŸ“„ Koopman–RKHS Project


Research theme: developing mathematically grounded and computationally scalable AI for learning representations, operators, and uncertainty in complex scientific systems.

Pinned Loading

  1. GIFT_KASTL_POSTER GIFT_KASTL_POSTER Public

    https://himanshuvnm.github.io/gift-kastl/ 2025 SciFM Conference Research Poster on the graph foundation model on the Discrete Fracture Networks dataset. We introduced a novel neural net layer to ac…

    1

  2. Generalized-Gaussian-Radial-Basis-Function-in-Artificial-Intelligence-MATLAB Generalized-Gaussian-Radial-Basis-Function-in-Artificial-Intelligence-MATLAB Public

    This is the recent work of my on the importance and application of mathematical function around its Hilbert function theory on artificial intelligence algorithms. The main motivation was the desire…

    MATLAB 2

  3. Mechanistic_Artificial_Intelligence_Interpretability Mechanistic_Artificial_Intelligence_Interpretability Public

    In this codebook, we perform real causal interpretability experiment and perform real mechanistic interpretability.

    Jupyter Notebook 1

  4. Foundation-Model-Large-Language-Model-FM-LLM Foundation-Model-Large-Language-Model-FM-LLM Public

    This repository was commited under the action of executing important tasks on which modern Generative AI concepts are laid on. In particular, we focussed on three coding actions of Large Language M…

    Jupyter Notebook 2 2

  5. Learning_Fourier_Neural_Operator Learning_Fourier_Neural_Operator Public

    We provide the action of the Fourier Neural Operator over the Burger's Equation with non-dimensional parameter value of the system as 10.

    Jupyter Notebook 1

  6. PyTorch-regime-for-Deep-Kolmogorov-Method-for-Heat-Equation PyTorch-regime-for-Deep-Kolmogorov-Method-for-Heat-Equation Public

    Here, we will provide a PyTorch regime to handle the partial differential equation solution of the heat equation by executing Deep Kolmogorov Method of Beck et. al.

    Jupyter Notebook 1