Experience

What I work on right now:

• Efficient on-device AI - getting large models to run well on memory-constrained consumer hardware, rather than offloading everything to the cloud.
• Hardware-aware optimization - learning-based scheduling of AI workloads across heterogeneous silicon, trading off latency, energy, and quality.
• Reliability under compression - keeping models calibrated, factually grounded, and secure as they get aggressively quantized.

Published work from this role:

• As main engineer and design lead, engineered distributed LLM inference for low-latency serving, personally building the disaggregated prefill/decode, speculative decoding and KV-cache quantization components: 3× throughput and under 1 s end-to-end latency versus 2.5 s for vLLM on the same 4× A800 node, with integration into a new Dell product.
• Developed RAMP (arXiv:2603.17891), RL-based mixed-precision quantization for LLMs: bit allocation as a constrained MDP solved via Soft Actor-Critic, with Scale Folding to absorb activation outliers. On Llama 2 7B, 5.54 perplexity at 3.65 effective bits (3.68 GB) versus 5.60 for uniform 4-bit AWQ at 3.90 GB, retaining 99.5% of FP16 commonsense reasoning; the policy transfers zero-shot to Llama 2 13B and Mistral 7B.
• Designed DiffuTruth (FEVER @ EACL 2026), an unsupervised hallucination detector grounded in non-equilibrium thermodynamics: a Generative Stress Test via discrete text diffusion computes NLI-based semantic energy. 0.725 vs 0.710 AUROC on FEVER and, zero-shot, 0.566 vs 0.525 on multi-hop HOVER (+4.1 points) against a Direct NLI baseline.

• Co-developed CogniSQL-R1-Zero (third author, arXiv:2507.06013), an execution-aligned Text-to-SQL reasoning model trained via pure GRPO on a lightweight sparse-reward signal with no cold-start SFT; converged in 6.2 hours on 4× A100 GPUs via DeepSpeed ZeRO-2.
• State of the art on BIRD at release: 59.97% execution accuracy with a 7B backbone, on BIRD dev, above the DeepSeek-Coder 236B, Mistral 123B and GPT-4 baselines; 69.68% with best-of-6 test-time scaling.
• Architected a parallel multi-agent reasoning pipeline (query decomposition, runtime self-healing, majority-voting ensembles): about +30 points of execution accuracy on proprietary schemas over the previous copilot, in an enterprise Text-to-SQL copilot piloted during the internship and later deployed in production.

Real-time theft detection using SlowFast networks and 3D CNNs, optimized for low-latency edge deployment.

Researched and implemented two features for the DocX Document AI product. Used SonarQube for code quality analysis.

AI/ML work on drone footage (120m altitude). Led mentoring group guiding 30+ interns.

Developed two end-to-end ML projects (Omnizenon & KnowCrimez). Applied ML for data analysis and deployed web UIs.

Abstractive text summarization using HuggingFace Transformers. Benchmarked accuracy across LLMs.

Sprint tickets, model building, API implementation, and database maintenance.

Co-inventor. U.S. Patent Application No. 19/670,270 (pending).

Co-inventor. Approved by the Dell Technologies Internal Patent Committee; formal drafts in progress with Dell Legal.

Advisor: Dr. Varun Tiwari.

• PRISM (published, Discover Computing, Oct 2026): a mechanistic diagnostic framework using component-wise mixed precision, showing that low-bit quantization disproportionately collapses MLP parametric memory while preserving external RAG context utilization.

• Hybrid CNN+GRU+LSTM for lymphoma detection from histopathology images - Dr. Vivek Bhardwaj (accepted ICCCNT @ IIT Indore 2025, oral).
• Real-time QUIC traffic classifier with LightGBM and SHAP+LIME explainability - Mr. Rajesh Kumar (accepted ICCCNT @ IIT Indore 2025).

RL (TD3)-based autonomous navigation for robots in nuclear radiation environments - Ushnish Sarkar (Scientific Officer F).

Hyperspectral image classification on the QUH dataset (10⁶+ samples) - Prof. Rajeev Srivastava. Hybrid deep learning model achieving 91.90% accuracy.

B.Tech. (Hons) CSE - Specialization: AI & ML · GPA 8.56/10
Dean's List Award · 4× Student Excellence Award · MUJ Wizard Programmer Gold Medal · 2× Tea with President Award

Led workshops at IBM Z Datathon guiding 3300+ students in LinuxONE for AI development. Mentored winning teams on mainframe-based ML integration.

Tutorials and lab sessions for AI3241 Reinforcement Learning (Dr. Animesh Kumar) and AI3231 Computer Vision & Pattern Lab (Prof. Harish Sharma).

Author of educational challenges on Deep-ML spanning quantization, RAG, RLHF, and inference optimization.

Mentored teams at global and regional hackathons.

300+ members in first year. Organized events and hackathons on ML, CV, and NLP.

Speaker at IBM Z Day. Promoting mainframe technology globally.

One of 10 leaders among 216 ambassadors globally. Works with the Streamlit team directly.