TheProdSDETheProdSDE

Writing

Production engineering — the decisions, trade-offs, and systems that don't show up in tutorials.

Dev.to20 min read

Software Debugging Techniques: Which One Do You Reach For at 2 AM?

Most engineers have one go-to method. The best engineers have a playbook of software debugging...

Sep 26, 2026
debuggingsoftwaresoftwareengineering
Direct7 min read

Our Benchmark Reported 0.96 Recall. It Was Measuring Nothing.

An overnight benchmark run produced a 0.9653 and a 0.0000 for the same dataset. Both numbers were wrong, for different reasons. A postmortem on four measurement bugs — and why every one of them reported success.

Sep 22, 2026
benchmarkingaimemory
What If AI Stopped Talking? Inside Jev, System One Models, and RLCD
Medium6 min read

What If AI Stopped Talking? Inside Jev, System One Models, and RLCD

LLMs are great at generating text. But many software systems do not need generated text.They need decisions.For example:Is this transaction suspicious?Which team should handle this ticket?Is this RAG …

Sep 21, 2026
jevslarge-language-modelsmachine-learning
Direct3 min read

Your Agent's Memory Shouldn't Answer Questions It Wasn't Asked

Every agent-memory demo stores a question and retrieves it back. Here's the query that breaks most of them — and why I think memory needs a decision layer, not just a retriever.

Sep 21, 2026
agentsaimemory
Direct5 min read

I Built an Incident-Triage Agent That Resumes From Checkpoints

Most LLM agents lose everything when they crash. AgentCore checkpoints every pipeline step to Postgres and writes resolved incidents into episodic memory — here's the architecture, and what it actually learns.

Sep 20, 2026
ai-agentssreincident-response
I Built a Developer Portfolio With AI and GitHub Pages — For $0
Medium7 min read

I Built a Developer Portfolio With AI and GitHub Pages — For $0

No hosting bill. No design expertise. Just a few hours, GitHub, Next.js, and AI.Most developers know they should have a portfolio.So they follow the same tutorial:Pick a templateChange the nameAdd thr…

Sep 4, 2026
aiprogramminggithub
Direct9 min read

Build a Free Developer Portfolio with AI and GitHub Pages — In an Afternoon

No hosting bill. No design skills required. A step-by-step guide to shipping a real portfolio link you can hand to an interviewer today.

Sep 4, 2026
careerai-toolsnextjs
Direct7 min read

I Got Tired of Benchmarks That Test Models Instead of Agent Frameworks, So I Built My Own

Every benchmark tells you which model is best. None of them tell you which agent framework is best for your actual daily work. So I built one that does.

Sep 2, 2026
agentsaibenchmarking
Building an A2A Client: What the Protocol Gives You — and What You Still Have to Build
Medium9 min read

Building an A2A Client: What the Protocol Gives You — and What You Still Have to Build

Agent interoperability is only one layer of a multi-agent system. Discovery, routing, authentication, execution, and failure handling are still your application’s job.AI agents are becoming increasing…

Aug 24, 2026
productiona2a-protocolgoogle-a2a
Direct2 min read

What Nobody Teaches You After You Learn to Code

The gap between tutorial engineer and production engineer is real, wide, and almost entirely undocumented. That's what TheProdSDE is here for.

Aug 21, 2026
productionengineeringcareer
LLMs Under the Hood: KV Cache, VRAM, Tokens & Inference Explained
Medium11 min read

LLMs Under the Hood: KV Cache, VRAM, Tokens & Inference Explained

From RNNs to PagedAttention — everything that actually matters, explained with intuition first.Understand how modern LLMs work under the hood — transformers, tokenization, VRAM, KV Cache, quantization…

Jul 30, 2026
software-engineeringai-engineeringdeep-learning
A Production Engineer’s Guide to Choosing the Right Prompting Strategy
Medium10 min read

A Production Engineer’s Guide to Choosing the Right Prompting Strategy

Most prompt engineering articles explain techniques: Zero‑shot, Few‑shot, Chain‑of‑Thought, ReAct, Tree‑of‑Thought.Production engineers need something different: a framework that tells them which prom…

Jul 23, 2026
prompt-engineeringproductionwriting-prompts
Why NVIDIA NIM’s Free API Feels Slow (And What Your Upgrade Path Actually Looks Like)
Medium3 min read

Why NVIDIA NIM’s Free API Feels Slow (And What Your Upgrade Path Actually Looks Like)

If you’ve used NVIDIA’s free API through build.nvidia.com — part of their NIM (Inference Microservices) platform — you’ve likely hit frustrating latency. Before you “upgrade,” it’s worth understanding…

Jul 13, 2026
software-developmentagentic-aiopen-source
Cutting My Subscription Cost Without Impact on Workflow — Here’s the Exact System I Use
Medium8 min read

Cutting My Subscription Cost Without Impact on Workflow — Here’s the Exact System I Use

Most developers are haemorrhaging money on AI tools. This one mindset shift changed everything.TL;DR: Routing your prompts to the right AI model — premium for reasoning, free for execution — can cut y…

Jul 13, 2026
programmingsoftware-engineeringartificial-intelligence
I ran two AI builders in parallel at a solo hackathon — here's what the 429 errors revealed
Dev.to1 min read

I ran two AI builders in parallel at a solo hackathon — here's what the 429 errors revealed

At a 3-hour Google for Developers hackathon, I ran two AI builders simultaneously on the same...

Jul 8, 2026
aihackathontypescript
One Prompt vs Six: I Ran Two AI Builders in Parallel at a Hackathon
Medium13 min read

One Prompt vs Six: I Ran Two AI Builders in Parallel at a Hackathon

A real build log from PromptWars (Google for Developers): autonomous agent vs spec-first workflow, how each one handled rate limits differently, and the exact prompts I used — word for word.SEO descri…

Jul 8, 2026
generative-ai-solutionprompt-engineeringproduct-development
Senior AI Interviews Don’t Test What You Know. They Test What Breaks at 2am.
Medium17 min read

Senior AI Interviews Don’t Test What You Know. They Test What Breaks at 2am.

15 questions that separate engineers who’ve shipped production AI from those who’ve only read about it — and the answers that actually hold up when the latency doubles overnight and nobody knows why.M…

Jun 30, 2026
design-systemssoftware-engineeringartificial-intelligence
Zero Trust Security in Production: Identity, OPA, Vault, mTLS & Audit Logging — A Complete Reference
Dev.to7 min read

Zero Trust Security in Production: Identity, OPA, Vault, mTLS & Audit Logging — A Complete Reference

This is **Part 5* of the Building a Zero-Trust Security Architecture series. Parts 1–4 covered...

Jun 24, 2026
securitydevopskubernetes
Your App Has 6 Security Layers. You’re Probably Collapsing Them Into 1.
Medium11 min read

Your App Has 6 Security Layers. You’re Probably Collapsing Them Into 1.

Authentication, authorization, secrets, encryption, audit, and network control are six different jobs — and collapsing them is the #1 architecture mistake I keep seeing in production.Series: Part 1 · …

Jun 23, 2026
distributed-systemsauthenticationsecurity
Azure Key Vault vs AWS Secrets Manager: Cutting Through the Cloud Marketing
Dev.to3 min read

Azure Key Vault vs AWS Secrets Manager: Cutting Through the Cloud Marketing

"A hands-on breakdown of Azure Key Vault, AWS Secrets Manager, IRSA, Azure Managed Identity,...

Jun 16, 2026
kubernetessecuritydevops
Dev.to5 min read

I Built a Finance App at a Hackathon, Abandoned It for Months, Then GitHub Copilot Helped Me Finally Ship It

This is a submission for the GitHub Finish-Up-A-Thon Challenge What I Built "Where did...

Jun 6, 2026
devchallengegithubchallengeai
Dev.to1 min read

Your JWT Is Lying to You — The Authorization Problem Nobody Solves Correctly

A valid token proves who you are. It says almost nothing about what you're actually allowed to...

Jun 2, 2026
securitywebdevarchitecture
Vibe-Coding Works. That's Exactly Why It Will Destroy Your Codebase at Scale.
Dev.to6 min read

Vibe-Coding Works. That's Exactly Why It Will Destroy Your Codebase at Scale.

The productivity gains are real. The compound debt is realer. And almost no team is measuring the...

May 11, 2026
aiproductivitysoftwaredevelopment
Dev.to15 min read

MCP for Backend Engineers: When to Use It (and When to Skip It)

"If you only have one consumer, MCP is a liability." Subtitle: Real code, real cost, and an honest...

Apr 21, 2026
aiarchitecturebackend
Dev.to1 min read

Worth Each minute read if you work on RAG

Why Most RAG Systems Fail in Production (And How to Design One That Actually Works) ...

Apr 6, 2026
Agentic AI Fails in Production for Simple Reasons — What MLDS 2026 Taught Me
Dev.to3 min read

Agentic AI Fails in Production for Simple Reasons — What MLDS 2026 Taught Me

TL;DR: Most agentic AI failures in production are not caused by weak models, but by stale data, poor...

Mar 31, 2026
aiarchitecturedevops
Why Most RAG Systems Fail in Production (And How to Design One That Actually Works)
Dev.to4 min read

Why Most RAG Systems Fail in Production (And How to Design One That Actually Works)

A practical, system design–focused breakdown of why RAG systems degrade after launch—and what...

Mar 24, 2026
airagagents
Most AI Agent Frameworks Are Overkill — Here's How to Choose the Right One in 30 Seconds
Dev.to13 min read

Most AI Agent Frameworks Are Overkill — Here's How to Choose the Right One in 30 Seconds

A senior engineer's field-tested breakdown of LangGraph, AutoGen, CrewAI, Microsoft Agent Framework,...

Mar 18, 2026
aisoftwareagents
Dev.to1 min read

[Boost]

Stop Guessing Your LLM Replacement TheProdSDE ・ Mar 14 ...

Mar 18, 2026
aillmcloud
Stop Guessing Your LLM Replacement
Dev.to6 min read

Stop Guessing Your LLM Replacement

A Practical Guide to Migrating GPT Apps Across Azure, AWS, and GCP TL;DR — Most LLM...

Mar 14, 2026
aillmcloud
Dev.to1 min read

Worth your 10min of time if deciding which framework suits your use case better

LangGraph vs Semantic Kernel: Python AI Agents in 2026 ...

Mar 13, 2026
pythonaiagents
Dev.to1 min read

[Boost]

7 AI Prompts Senior Engineers Use to Build Production Code...

Mar 13, 2026
aiprogrammingproductivity
7 AI Prompts Senior Engineers Use to Build Production Code Faster
Dev.to3 min read

7 AI Prompts Senior Engineers Use to Build Production Code Faster

AI coding tools are powerful — but most developers still use them like autocomplete. The difference...

Mar 13, 2026
aiprogrammingproductivity
Stop Treating AI Like Autocomplete — Design an AI-First Developer Workflow Instead
Dev.to5 min read

Stop Treating AI Like Autocomplete — Design an AI-First Developer Workflow Instead

AI coding tools are everywhere — but most teams still use them like autocomplete. The result? Faster...

Mar 12, 2026
aiprogrammingproductivity
LangGraph vs Semantic Kernel: Python AI Agents in 2026
Dev.to8 min read

LangGraph vs Semantic Kernel: Python AI Agents in 2026

Why This Comparison Matters Right Now Here's the honest reality of building Python AI...

Mar 11, 2026
pythonaiagents
Dev.to9 min read

Azure App Service, Container Apps, and AKS compared: Real costs in INR, architecture constraints, and when to upgrade for production micro-services

If you’ve ever tried to deploy a full stack (Node backend, MCP server, ETL jobs, Angular SPA, and...

Feb 4, 2026
azuredevopsarchitecture