At OpenAI I have spent the last few months of my life developing a Kubernetes scheduler plugin to customize preemption to better suit our ML workloads. This has been the most challenging project in my career so far.…
- A Deeper Dive of kube-scheduler
- Managing LLM Context Is a Knapsack Problem
LLMs can be more useful and less prone to hallucination when they’re able to read relevant documents, webpages, and prior conversations before responding to a new user question. Unfortunately, LLMs have a finite context…
- How To Build an Evil Compiler
Did you know there is a type of compiler backdoor attack that is theoretically impossible to defend against? In this post I’ll show you how to implement such an attack in less than 100 lines of code. Ken Thompson…
- SimpleDB: A Basic RDBMS Built From Scratch
My databases class at UCLA wasn’t very challenging so I never truly understood the internals of databases. This always bothered me so I vowed to build a simple database from scratch to learn the fundamentals. MIT's…
- Quick Splits: Manage Your Shared Finances Better
Using Venmo has always been a frustrating yet unavoidable part of my life. I cannot realistically use another platform because most of my peers use Venmo. I think Venmo lacks some core features that any P2P payments…
- My Useless Contribution to the GNU C Sine Function
Have you ever wondered how computers calculate trigonometric functions like sin and cos? Because CPUs can only do basic arithmetic, I always guessed that these functions were implemented using the Taylor Series. I…
- How Scala Changed My Perspective on Programming
My last job required me to learn Scala, which is considered to be a functional-OOP hybrid language. Seeing real-world applications of Scala was what ultimately sold me on the language's concepts, and now I'm very…
- Tools That Improved My Engineering Productivity
My friends and coworkers often ask me what tools I use because they view me as a productivity enthusiast. I have always enjoyed improving my productivity because the feeling of efficiency makes working more enjoyable.…
- Exploring SIMD performance improvements in WebAssembly
In this blog post, we are going to run some SIMD (Single Instruction Multiple Data) performance experiments in WebAssembly and see whether the results agree with our theoretical predictions. I chose to do this in…
- Click: My Primary Kubernetes Tool
Click has made my Kubernetes experience a pleasure. I adopted Click after joining Databricks because using kubectl was too inconvenient. There aren't many articles or blog posts discussing Click, so I decided to write…