Echo Yin — Senior A.I. Engineer
Building governed, observable AI systems and the tools around them · Calgary, AB, Canada
I’m a senior AI engineer with over 10 years in software, the last several focused on machine learning and applied AI. I started out on enterprise systems, moved into online game programming and developer tooling, and since my master’s in Computer Science I’ve concentrated on production AI: RAG pipelines, MCP tooling and agentic systems, most recently for a federal agency.
On my own time I build open-source AI infrastructure, like Aegis, a governed gateway between apps and LLMs, and a CUDA benchmark for extreme learning machines, and I write up what I learn along the way.
Résumé (PDF) · GitHub · LinkedIn · Email
Projects
- Feature ELM — Extreme Learning Machines in C++20, trained in one least-squares solve on CPU or CUDA. Batch, online, drift-aware and multilayer ELM variants behind one Backend::kGpu switch, with a live digit-drawing demo and measured CPU vs GPU benchmarks.
- Aegis AI Gateway — A self-hosted AI gateway that shows its work. Guardrails, human approvals, and a tamper-evident audit trail between your apps and any LLM, behind an OpenAI-compatible endpoint and configured in one YAML file. Built with FastAPI, LangGraph, and Docker.
- EcoManage — Energy management for real buildings. Solar, batteries, EV chargers and heat pumps on one live 3D view, bills from the site's own tariff, and changes that only reach a device once someone approves them. Built with TypeScript, React, three.js, MQTT, and MongoDB.
- NeighborIQ — Rental-property analysis for small investors in Canadian cities: fair value from comparable listings, cash flow under Canadian mortgage rules, and neighbourhood open data. Built with FastAPI, PostGIS, Celery and Vue 3.
- PDF Sanitizer — An offline Windows desktop app that strips scripts, attachments, outbound links and metadata from PDF files, verifying every result before replacing the original. Built with Rust, Tauri and Svelte.
- Wu-Tang: Rise of the Deceiver — An online co-op Action RPG where players team up with the legendary Wu-Tang Clan. Built with Unreal Engine 5, C++, and C#. This game features a robust 3-player multiplayer system set in a unique Afro-surrealist world.
- Bubble UP! — A vibrant puzzle game built with Unity, challenging players with fast-paced, Tetris-inspired gameplay. Master chain reactions and aim for high scores in this bubbly, arcade-style adventure.
Experience
- Senior A.I. Developer, Impact Assessment Agency of Canada / Agence d'évaluation d'impact du Canada (Nov. 2025 – May 2026)
- Online Programmer, Brass Lion Entertainment (Jul. 2023 – Apr. 2025)
- Tools Engineer Intern, Rec Room (Jan. 2023 – Apr. 2023)
- MLOps Engineer Intern, PointClickCare (Jan. 2022 – Apr. 2022)
- Software Engineer, Hubei Xinyegang Co., Ltd. (Jul. 2012 – Feb. 2020)
Writing
- The Clean Envelope: Debugging Production Pipelines Without Touching PII — Jul 2026
- The Honest Parts: Residency, Tenancy, and Saying No — May 2026
- Guardrails That Tell You the Truth About Streaming — May 2026
- Rebuilding an AI Gateway as a Framework, Not a Product — May 2026
- Advanced RAG: Hybrid Search with Sparse and Dense Retrieval Plus Cross Encoder Reranking — Dec 2025
- Building Aegis: An Enterprise AI Gateway — Nov 2025
- Chapter 1.12 - Multi-Stage Builds: From a 1.3 GB Image to 7 MB — Jul 2025
- Chapter 1.11 - Docker Swarm: From One Host to a Cluster — Jul 2025
- Chapter 1.9 - Docker Compose: Whole Applications in One File — Jul 2025
- Chapter 1.10 - Remote Docker Hosts: Docker Contexts over SSH — Jul 2025
- Chapter 1.8 - Docker Networking: Bridge, User-Defined Networks, Host, Container and None — Jul 2025
- Chapter 1.7 - Redis in Docker: Persistence, Memory Limits and Safe Upgrades — Jul 2025
- Chapter 1.6 - MySQL in Docker: Data That Survives, Config That Works — Jul 2025
- Chapter 1.5 - Self-Hosted GitLab in Docker: Setup, Runners, Backups and Upgrades — Jul 2025
- Chapter 1.4 - Jenkins in Docker: Every Build in a Clean Container — Jul 2025
- Chapter 1.3 - Nginx in Docker: Static Sites, Reverse Proxy and HTTPS — Jul 2025
- Chapter 1.2 - Living with Containers: Lifecycle, Debugging and a Private Registry — Jul 2025
- Chapter 1.1 - Docker Basics: From "Works on My Machine" to Works Everywhere — Jul 2025
- Chapter 0.1 - Back to the Root: The Linux Command Line You'll Actually Use — Jul 2025
- Chapter 3.1 - Building Your Internal Developer Portal with Backstage - A Comprehensive Guide — May 2025
- Building a Local RAG System for Document Question Answering — Jan 2025
- Building Scalable REST APIs with Node.js — Jan 2025
- A Modern Introduction to C++ Multithreading (C++11 to C++20) — Jun 2024
- Socket Programming in C/C++: Building a TCP Server–Client Echo — Jun 2024
- Designing Decoupled Game Backends with the Publish-Subscribe Pattern — Jun 2024