Skip to main content
HB

All Projects

Filter by category

MLOps & GPU Serving
Freelance client

Self-Hosted LLM Inference on Bare-Metal GPUs

Moved 200 attorneys off $18K/month in API token bills onto self-hosted A100s at 82% lower cost with 420ms p95 latency.

82%Inference Cost Reduction vs. Closed APIs
MLOpsModel DeploymentGenAIObservability & SRE+1
llama.cppvLLMNVIDIA A100CUDA 12.2+9
Inspect Architecture Blueprint
Platform & SRE
Freelance client

EKS at Scale: Karpenter Autoscaling & JVM SRE

Rebuilt cluster autoscaling with Karpenter spot-first provisioning — cut compute spend 70% while keeping 99.98% uptime.

<82sScale-Up Latency (Down from 4.5 Minutes)
AWSKubernetesCI/CDObservability & SRE+1
AWS EKSKubernetesKarpenterHelm+8
Inspect Architecture Blueprint
Platform & SRE
Built at QisstPay (2022–2024)

Hybrid Cloud Infrastructure for a BNPL Fintech

Unified AWS + GCP infrastructure for a fintech handling 1M+ daily transactions across 17 microservices under PCI DSS audit.

1M+Daily Transactions on Infrastructure I Operated
AWSGCPSecurityDatabase+3
AWS ECSGCP Cloud RunTerraformMySQL+10
Inspect Architecture Blueprint Demo
AI & RAG Platforms
Freelance client

Multi-Stage Legal RAG with Azure AI Search

Built a 5-layer retrieval pipeline over 3,145 dense legal documents, fixing real failure modes at each step.

0.98Ragas Faithfulness Score (Up from 0.72)
AzureRAGGenAIAI Agents+3
PythonFastAPINext.jsAzure AI Search+8
Inspect Architecture Blueprint
Platform & SRE
FinTech Client Engagement

Payment API Observability & Latency SLOs

Consolidated fragmented metrics into Datadog APM with strict latency SLOs, cutting recovery time from 40+ min to under 9 min.

78%MTTR Reduction (99.99% Peak Availability)
Observability & SREAWSBackend & APIsSecurity+1
DatadogAWS LambdaPythonDocker+4
Inspect Architecture Blueprint