Sri Harsha Patallapalli

Sri Harsha Patallapalli

I build the infrastructure machine learning runs on — GPU kernels, compilers, and the harnesses that keep them honest — on top of seven years moving petabytes through distributed data systems.

Hyderabad, India. MS in Artificial Intelligence from Northeastern. Open to ML systems and distributed systems roles.

  1. µs

    Hand-written CUDA and HVX kernels, each gated on a correctness check before its timing counts.

  2. ms

    Inference serving and REST paths held under 100 ms for 10K concurrent users.

  3. s

    Streaming ingest at 70M records a day, under 2 s of lag.

  4. hr

    2 TB of Spark batch inside a 6-hour SLA, and LLM fine-tuning ladders.

The work, arranged by the timescale it answers on.

Background

Education

  • Northeastern University — MS, Artificial Intelligence. GPA 3.83/4. Sept 2023 – Dec 2025
  • Amrita School of Engineering — BTech, Computer Science and Engineering. CGPA 8.24/10. Jun 2015 – May 2019

Certifications

Tools

ML
PyTorch, Triton, CUDA, MLIR, TensorRT-LLM, ONNX, LoRA and PEFT, vLLM, Hugging Face
Languages
Python, C++, Java, Scala, Rust, SQL, Bash
Distributed
Kafka, Spark, ClickHouse, Hive, Hadoop, Airflow, event-driven architecture, idempotency
Services
Spring Boot, FastAPI, REST, gRPC, MySQL, PostgreSQL, DynamoDB, Redis, Elasticsearch
Operations
AWS (EKS, S3, Glue, Redshift), Kubernetes, Terraform, Helm, Docker, CI/CD, Prometheus, Grafana, on-call

Work

Dextr.ai Founding Software Engineer

Built the backend and the multi-channel agent platform: REST on AWS EKS for 10K concurrent guests under 100 ms, with fail-closed LLM agents that cut in-stay response from 47 minutes to under one.

Lowe’s Software Engineer, Data Platform

Owned streaming and batch: a Kafka and ClickHouse service ingesting 10K+ clickstream events per second, and a Spark system moving 2 TB inside a 6-hour SLA.

GE Healthcare Software Engineer

Medical equipment tracking on Kafka, Spring Boot, and Elasticsearch at 70M+ records a day under 2 s lag, plus a petabyte-scale migration to AWS at 80% lower cost.

Open source

Compilers, GPU kernels, and the harnesses that keep them honest. Everything below is public and runnable.

  1. Crucible

    Correctness and timing harness for Triton kernels

    A fast kernel is worthless if it is quietly wrong. Crucible verifies a kernel against an fp64 CPU reference at 95% confidence and ships as a zero-config pytest plugin, so the check runs wherever your tests already run. It has caught real defects: tail-dropping and contiguity assumptions failed 5 of 16 and 15 of 16 generated shapes, and every failure minimises to a reproducible seed you can paste into a bug report.

    Python · Triton · pytest Repository Documentation

  2. hexlib

    Compiler and kernel library for Qualcomm Hexagon NPUs

    Compiles a vision transformer down to an explicit VTCM and DMA plan, then runs it on hand-written HVX and HMX kernels. Each kernel is gated on three things before it counts: correctness, cycle count, and vector use proven by disassembling the ELF rather than trusting the source. Targets Hexagon v75, the NPU in the Snapdragon 8 Gen 3.

    Python · C · HVX/HMX Repository

  3. grepit

    GPU-accelerated pattern search library

    Scans 10 GB+ files by chunking them through GPU memory automatically, behind a single API call that serves both in-memory buffers and files on disk. Supports regex wildcards, quantifiers, and character classes, with kernels tuned for Ampere.

    C++17 · CUDA Repository

Also on GitHub: fuseflow, an MLIR pass that fuses neural network operators; reduction kernels benchmarked against Triton, PyTorch, and CUB; mossformer2-denoise, speech denoising shipped in both PyTorch and Rust; openMed, medical imaging with GradCAM explanations; and Triton with TensorRT-LLM on Kubernetes.

Hackathons & awards

Four wins, judged against open fields. Prize money and field size, as awarded.

  1. Best in Enterprise Computer Vision

    HP & NVIDIA Developer Challenge

    Prize
    $5,000
    Field
    1,000+ entrants
  2. Winner

    GE Digital Industrial IIoT Hackathon

    Prize
    ₹1,00,000
    Field
    180+ teams
  3. 2nd Runner-Up

    K-GIS Hackathon, Bengaluru Tech Summit Global Hack

    AI traffic signal control. A YOLO model reads vehicle density straight off live camera feeds, and a Deep Q-Learning agent retimes the signals from the queue lengths and speeds it sees — cutting average waiting time 40%, with a pre-emption path for ambulances and other priority vehicles.

    Prize
    ₹1,00,000
  4. Best mentor

    Lowe’s, for training and onboarding new recruits

Applied ML

LLaVA multimodal fine-tuning

Fine-tuned llava-1.5-7b, a 7-billion-parameter vision-language model, into a chat instruction model over a dataset of paired images and text. Trained with LoRA on an A100, with the base model quantised to 4-bit so the run fit on a single GPU.

PEFT · LoRA · Quantisation · LMMRepository

Garment segmentation

Fine-tuned a transformer encoder with an MLP decoder into a semantic segmentation model over 18 labels and 17K samples. 3.7M parameters, mIoU 0.514. Weights are published on Hugging Face.

Segmentation · Transformers · Fine-tuningHugging FaceColab

Also: pre-training versus fine-tuning, a controlled comparison of ResNet-18, VGG-19, and Inception V3 trained from scratch against the same architectures fine-tuned from ImageNet weights.

Papers