Skip to content
View akash20065ray-sys's full-sized avatar

Block or report akash20065ray-sys

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
akash20065ray-sys/README.md

πŸ’« Akash Kumar

AI Systems & GPU Infrastructure β€’ Low-Level Systems β€’ Deep Learning Runtimes

Typing SVG

Email GitHub nano-vllm Live Demo


πŸ‘¨β€πŸ’» About Me

I am a systems and AI infrastructure engineer focused on GPU memory architectures, high-throughput LLM serving runtimes, low-latency computer architecture, and bare-metal systems programming.

  • πŸš€ AI Systems & Deep Learning: Engineering paged memory allocators, continuous batching schedulers, and Copy-On-Write prefix caches for autoregressive transformers.
  • ⚑ Low-Level Architecture: Bare-metal x86 firmware, bus-cycle hardware interception, and high-performance digital signal processing (DSP).
  • πŸ“œ Research: Author of Targeted Bus-Cycle Interception: A Low-Latency WebAssembly Bridge for 16-Bit Bare-Metal Audio Synthesis and Multi-Timbral Acoustic Resynthesis (Camera-Ready IEEE Conference Publication).
  • πŸ”¬ Engineering Philosophy: Building transparent, hardware-conscious systems software, measuring nanosecond-level empirical telemetry, and crafting rich observability interfaces.

🌟 Featured Flagship Projects

⚑ nano-vllm

High-Throughput Paged KV-Cache LLM Inference Engine & Memory Management Runtime

  • 🧠 Paged Memory Allocation: Adapts OS virtual memory paging to GPU VRAM, eliminating internal & external fragmentation.
  • ⚑ Copy-On-Write (CoW) Prefix Sharing: Shares immutable system prompt blocks across sessions; drops TTFT to near-zero.
  • πŸ”„ Iteration-Level Continuous Batching: Retires completed sequences dynamically on every token step, maximizing GPU compute utilization.
  • πŸ›‘οΈ Fault-Tolerant Preemption: Gracefully evicts cold prefixes via LRU and pauses requests under 100% saturation without CUDA OOM.
  • πŸ“Š Systems Observability Matrix: Real-time 2D physical VRAM block visualizer & per-request latency diagnostics HUD.

[View Repository] β€’ [Architecture Specification]

🎡 Crimson Orbit

Low-Latency Bare-Metal 8086 Audio Synthesis & Acoustic Resynthesis Platform

  • ⚑ 11.8 ms end-to-end audio latency (6.3Γ— faster than monolithic emulators).
  • ⏱️ 0.889 Β΅s targeted I/O bus-cycle interceptor (PIT 8253 / PPI 61h).
  • πŸ’Ύ Custom 512-byte MBR bootloader running autonomous real-mode x86 kernel.
  • 🎹 Multi-timbral acoustic resynthesis engine (Steinway Piano, Martin Guitar, Ludwig Drums).
  • πŸ“„ Accompanied by camera-ready 6-page IEEE conference paper & Turnitin verification.

[Live Web Studio] β€’ [Download v1.0.0 Bootable FLP]

πŸ‘οΈ Argus-ML

Production Machine Learning Observability & Statistical Drift Detection Engine

  • πŸ“Š Real-time covariate and concept drift detection on streaming datasets.
  • πŸ“ˆ Kolmogorov-Smirnov (KS) & Population Stability Index (PSI) testing pipelines.
  • πŸ“‰ Automated model performance degradation alerts and telemetry dash.
  • πŸ›‘οΈ Zero-trust statistical guardrails for mission-critical inference pipelines.

[View Repository]

⚑ Logic_verse

Interactive Discrete Logic & Digital Circuit Simulation System

  • πŸ”Œ Gate-level dynamic propagation delays and clock phase generation.
  • πŸ“ Modular schematic builder with interactive truth-table verification.

[View Repository]


πŸ› οΈ Technical Arsenal & Competencies

Domain Technologies & Frameworks
AI Systems & Inference Infrastructure CUDA PyTorch PagedAttention FastAPI KV-Cache
Low-Level & Computer Architecture x86 C/C++ Wasm MBR PIT8253
Machine Learning & Observability Python ScikitLearn Pandas NumPy Drift
Web & Systems Visualization JavaScript HTML5 CSS3 SSE
Tooling & Environments Git Linux Docker QEMU

πŸ“Š GitHub Activity & Telemetry

Akash's GitHub Stats Top Languages

πŸ“œ Publications & Research Manuscripts

@inproceedings{crimsonorbit2026,
  author    = {Aher, Krishna and Bhargude, Sanskar and Agaldare, Ghansham and Birare, Hari and Kumar, Akash},
  title     = {Targeted Bus-Cycle Interception: A Low-Latency WebAssembly Bridge for 16-Bit Bare-Metal Audio Synthesis and Multi-Timbral Acoustic Resynthesis},
  booktitle = {Proceedings of the IEEE Conference on Computer Systems and Multidisciplinary Engineering},
  year      = {2026},
  pages     = {1--6},
  publisher = {IEEE}
}
Designed with precision by Akash Kumar β€’ AI Systems & GPU Infrastructure

Popular repositories Loading

  1. ORCA ORCA Public

    Containerized Workflow & Distributed Cloud Systems Orchestrator

    JavaScript 1

  2. Pokemon_Game Pokemon_Game Public

    Turn-Based RPG Engine & Battle State Machine with Interactive Gameplay Mechanics

    1

  3. Logic_verse Logic_verse Public

    Interactive Discrete Logic & Digital Circuit Simulation System (Gate Propagation Delays & Truth Table Verification)

    TypeScript 1

  4. Argus-ML Argus-ML Public

    Production Machine Learning Observability & Statistical Drift Detection Engine (KS & PSI Drift Testing, Pipeline Telemetry)

    Python 1

  5. Crimson_Orbit Crimson_Orbit Public

    Low-Latency Bare-Metal 8086 Audio Synthesis & Acoustic Resynthesis Platform (11.8ms AudioWorklet Bridge, IEEE Paper, Bootable x86 MBR)

    HTML 1

  6. ChronoStudy ChronoStudy Public

    Structured Learning & Deep Work Productivity Orchestrator (Focus Analytics & Habit Decay Modeling)

    TypeScript 1