Email Archive

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time

Score 0.876 · Account tjphuhs@gmail.com · 5/12/2026, 11:31:03 AM

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time from bytebytego@substack.com on 2026-05-12T15:31:03.000Z is based on publicly shared details from the Figma Engineering Team. Please comment if you notice any inaccuracies. When SELECT * Becomes Your Bottleneck Figma’s original data pipeline did what’s called a full sync. Every run copied the entire contents of a database table, regardless of how much had actually changed since the last run. If a table had ten million rows and

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time

Score 0.862 · Account tjphuhs@gmail.com · 5/12/2026, 11:31:03 AM

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time from bytebytego@substack.com on 2026-05-12T15:31:03.000Z is largely self-operating, and developers get involved only when alerts fire. The payoff came early. One week into testing in their staging environment, the automated re-bootstrap routine caught a severe failure mode. Had it reached production, it would have triggered a site-wide outage lasting at least twenty minutes. The old system, a daily cron job with no automated va

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time

Score 0.855 · Account tjphuhs@gmail.com · 5/12/2026, 11:31:03 AM

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time from bytebytego@substack.com on 2026-05-12T15:31:03.000Z View this post on the web at https://blog.bytebytego.com/p/how-figma-upgraded-data-pipeline Harness engineering for agentic code review (Sponsored) [ https://substack.com/redirect/ba4d0cbb-1659-42ea-835a-00e16b4b9ee2?j=eyJ1IjoiNGl3b2U2In0.sVDxRtmZ85v8kfdamY0krRXGMy3p768BWtuZifRB-Zs ] Underneath every review sits a purpose-built, independent context engine. It’s the layer

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time

Score 0.854 · Account tjphuhs@gmail.com · 5/12/2026, 11:31:03 AM

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time from bytebytego@substack.com on 2026-05-12T15:31:03.000Z Here’s why the timing matters. For example, Ssy Figma kicks off a snapshot export at 2:00 AM, and the export takes two hours to complete. During those two hours, users are still active. Records are being created, updated, and deleted. The snapshot finishes at 4:00 AM, but it only reflects the state of the table as of 2:00 AM. If the change stream starts capturing events a

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time

Score 0.826 · Account tjphuhs@gmail.com · 5/12/2026, 11:31:03 AM

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time from bytebytego@substack.com on 2026-05-12T15:31:03.000Z ways multiple ways that don’t produce errors. For example: A partial failure during a snapshot export A misconfigured CDC connector An unexpected data format from the source. These issues don’t crash the pipeline. They just produce wrong data. And wrong data in an analytics warehouse leads to wrong KPIs, wrong business decisions, and a slow erosion of trust in the entire

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time

Score 0.804 · Account tjphuhs@gmail.com · 5/12/2026, 11:31:03 AM

How Figma Upgraded Data Pipeline from Multi-Day Latency to Real-Time from bytebytego@substack.com on 2026-05-12T15:31:03.000Z capture only what changed and apply those changes to the destination. The concept is simple, but the execution is not. Incremental Synchronization Incremental synchronization flips the model. Rather than asking “what does the whole table look like right now?” it asks “what changed since last time?” Only the inserts, updates, and deletes since the last sync get transferred

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond

Score 0.640 · Account tjphuhs@gmail.com · 5/11/2026, 6:48:00 PM

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond from noreply@email.openai.com on 2026-05-11T22:48:00.000Z ( https://developers.openai.com/api/docs/guides/deployment-checklist ). This includes reasoning effort, tool_search, built-in tools, compaction, prompt caching, background mode, and if you’re getting fancy with it, WebSocket mode ( https://developers.openai.com/api/docs/guides/websocket-mode ) to speed up agentic runs with 20+ tool calls by 20-40%. *Codex use cases:* Try using Co

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond

Score 0.639 · Account tjphuhs@gmail.com · 5/11/2026, 6:48:00 PM

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond from noreply@email.openai.com on 2026-05-11T22:48:00.000Z ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ A lot has shipped lately. We’ve rolled out updates across models, Codex, and APIs, and developers are already turning these releases into new products, games, workflows, and tools. But if we had to pick the thing we’re most excited about righ

High Performance Rate Limiting at Databricks

Score 0.636 · Account tjphuhs@gmail.com · 5/13/2026, 11:30:35 AM

High Performance Rate Limiting at Databricks from bytebytego@substack.com on 2026-05-13T15:30:35.000Z View this post on the web at https://blog.bytebytego.com/p/high-performance-rate-limiting-at ScyllaDB Founders Share What Real-Time AI Requires from the Database (Sponsored) [ https://substack.com/redirect/cc973a24-c008-4be2-a06b-86d5eca83aba?j=eyJ1IjoiNGl3b2U2In0.sVDxRtmZ85v8kfdamY0krRXGMy3p768BWtuZifRB-Zs ] AI is pushing databases to their limits; learn what it takes to stay ahead AI workloads

How Stripe Detects Fraudulent Transactions Within 100 ms

Score 0.624 · Account tjphuhs@gmail.com · 4/27/2026, 11:03:53 PM

How Stripe Detects Fraudulent Transactions Within 100 ms from bytebytego@substack.com on 2026-04-28T03:03:53.000Z overnight jobs could now run multiple times in a single working day. Stripe is now exploring techniques that this architectural shift made possible, including multi-task learning, where a single model is trained to handle several related objectives simultaneously. [Live on May 6] Stop babysitting your agents (Sponsored) [ https://substack.com/redirect/a95b6182-9924-4322-9ece-ce3923bf

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond

Score 0.624 · Account tjphuhs@gmail.com · 5/11/2026, 6:48:00 PM

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond from noreply@email.openai.com on 2026-05-11T22:48:00.000Z results for review. Other updates: * GPT-5.5 ( https://openai.com/index/introducing-gpt-5-5/ ) is our most intelligent model yet with stronger reasoning, improved tool use, and more reliable long-running execution. * Agents SDK ( https://openai.com/index/the-next-evolution-of-the-agents-sdk/ ) lets agents inspect files, run commands, edit code, and work on long-horizon tasks with

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond

Score 0.623 · Account tjphuhs@gmail.com · 5/11/2026, 6:48:00 PM

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond from noreply@email.openai.com on 2026-05-11T22:48:00.000Z Lots of new launches and one date for you to save ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ‍͏ ͏ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­ ­ ­ ­ ͏‌ ­

Secure your seat: DigitalOcean Deploy

Score 0.613 · Account tjphuhs@gmail.com · 4/6/2026, 2:24:51 PM

Secure your seat: DigitalOcean Deploy from team@info.digitalocean.com on 2026-04-06T18:24:51.000Z [DigitalOcean's 'Deploy 26 San Francisco: The Production Inference Era' event banner, featuring a stylized Golden Gate Bridge at dusk with city lights.](https://www.digitalocean.com/deploy?utm_source=marketo&utm_medium=email&utm_campaign=deploy_2026&utm_content=friends_and_family) DigitalOcean Deploy April 28, 2026 | 12:00pm – 8:00pm PT Convene 100 Stockton Join AI leaders from Character.AI, Workato

How Stripe Detects Fraudulent Transactions Within 100 ms

Score 0.610 · Account tjphuhs@gmail.com · 4/27/2026, 11:03:53 PM

How Stripe Detects Fraudulent Transactions Within 100 ms from bytebytego@substack.com on 2026-04-28T03:03:53.000Z advanced, they moved to more complex architectures. Each jump produced an equivalent leap in model performance. The architecture preceding the current one was called Wide & Deep. It combined two models into an ensemble. The “wide” component was XGBoost, a gradient-boosted decision tree that works by combining many small decision trees into one powerful predictor. XGBoost excelled at

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond

Score 0.604 · Account tjphuhs@gmail.com · 5/11/2026, 6:48:00 PM

OpenAI Dev News: Realtime 2.0, Codex for Chrome, and beyond from noreply@email.openai.com on 2026-05-11T22:48:00.000Z Perplexity Computer. *Developer spotlight: Ashe Magelhaes* From driving solar-powered electric cars to open-sourcing AI prototypes, Ashe Magelhaes ( https://www.youtube.com/watch?v=flweA_I-VKE ) shares how she’s weaving AI into her creative process, product workflow, and everyday life. “The name of the game is speed. You could build so much software nowadays, but what will you bu

[Update on project availability] 🐴🪽 Pegasus SE: Rate the Quality and Usefulness of AI-Generated Summaries in Gmail [K-481328812]

Score 0.603 · Account tjphuhs@gmail.com · 2/5/2026, 12:22:52 PM

[Update on project availability] 🐴🪽 Pegasus SE: Rate the Quality and Usefulness of AI-Generated Summaries in Gmail [K-481328812] from noreply@mail.dataannotation.tech on 2026-02-05T17:22:52.000Z This project is a bit different than what you might typically see on your dashboard, so we wanted to take a moment to explain how it works: * In this project, you will review and rate an AI-generated summary of to-dos and updates in your email inbox across several axes. * Because you are providing an e

Video generation, workspaces, 35 new models. Here's what shipped.

Score 0.598 · Account tjphuhs@gmail.com · 5/7/2026, 12:13:00 PM

Video generation, workspaces, 35 new models. Here's what shipped. from welcome@openrouter.ai on 2026-05-07T16:13:00.000Z Across 60+ providers Tokens / month 70T Processed on platform Developers 5M+ Globally on OpenRouter Browse all models ( https://openrouter.ai/models?utm_campaign=050726_monthly-recap_s1&utm_content=April+2026+Recap+-+V3+Final+B&utm_medium=email_action&utm_source=customer.io ) Latest from the blog GPT-5.5 price increase: what it actually costs ( https://openrouter.ai/announceme

New Project: Keyframe 🖼️ Upload a Video and Write a Prompt and an Ideal Response! [ID: 3566] ⭐️

Score 0.597 · Account tjphuhs@gmail.com · 1/25/2026, 1:26:28 PM

New Project: Keyframe 🖼️ Upload a Video and Write a Prompt and an Ideal Response! [ID: 3566] ⭐️ from noreply@mail.dataannotation.tech on 2026-01-25T18:26:28.000Z New Project Available! DataAnnotation New Project A new project is available: Keyframe 🖼️ Upload a Video and Write a Prompt and an Ideal Response! [ID: 3566] ⭐️ <https://app.dataannotation.tech/workers/tasks?project_id=a8a6220b-b4cb-4d20-b82c-c30d5947855d> (3 tasks available). Click the link to start working on it now! If the link doe

Fwd: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes

Score 0.597 · Account tjphuhs@gmail.com · 3/17/2026, 11:46:27 AM

Fwd: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes from tjphuhs@gmail.com on 2026-03-17T15:46:27.000Z TJ Begin forwarded message: From: ByteByteGo <bytebytego@substack.com> Date: March 17, 2026 at 11:43:14 AM EDT To: tjphuhs@gmail.com Subject: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes Reply-To: ByteByteGo <reply+357rw3&4iwoe6&&457f75760bc411accd07b85c686060610590a8b4419f12cd9695d552c12ad6be@mg1.substack.com> How Reddit Migrated Petabyte-Scale Kafka from EC

Fwd: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes

Score 0.596 · Account tjphuhs@gmail.com · 3/17/2026, 11:46:27 AM

Fwd: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes from tjphuhs@gmail.com on 2026-03-17T15:46:27.000Z logical cluster. The Cruise Control topic was overridden to stay consistent across both broker sets, allowing Reddit to use Cruise Control to move data between EC2 and Kubernetes brokers. Cruise Control is a Kafka tool that automates the process of rebalancing data across brokers in a controlled, measured way. It was central to the actual movement of data during the migration.

Video generation, workspaces, 35 new models. Here's what shipped.

Score 0.594 · Account tjphuhs@gmail.com · 5/7/2026, 12:13:00 PM

Video generation, workspaces, 35 new models. Here's what shipped. from welcome@openrouter.ai on 2026-05-07T16:13:00.000Z to 1M tokens. See the rankings → ( https://openrouter.ai/rankings?utm_campaign=050726_monthly-recap_s1&utm_content=April+2026+Recap+-+V3+Final+B&utm_medium=email_action&utm_source=customer.io ) 05 I/O loggingBETA The Activity log can now capture the full request and response for every API call. Open any generation to inspect the prompt, switch to Dev mode for raw JSON, or repl

Fwd: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes

Score 0.594 · Account tjphuhs@gmail.com · 3/17/2026, 11:46:27 AM

Fwd: How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes from tjphuhs@gmail.com on 2026-03-17T15:46:27.000Z was comparatively straightforward. Phase 6: Cleaning Up and Handing Off to Standard Strimzi After both the data plane and the control plane were fully running on Kubernetes, Reddit removed all the configuration overrides that the forked Strimzi operator had introduced. Control of the clusters was handed off to the standard, unmodified Strimzi operator. The EC2 infrastructure wa

The You Report: NEW Eval harness, Research API controls, auto top-up

Score 0.592 · Account tjphuhs@gmail.com · 5/6/2026, 2:47:31 PM

The You Report: NEW Eval harness, Research API controls, auto top-up from developer@mail.you.com on 2026-05-06T18:47:31.000Z Benchmark any search API, structure outputs, and avoid credit-related downtime Welcome to this month’s newsletter! Here’s what’s new this month: Research API controls (source_control, output_schema), an open-source eval harness, and auto top-up to prevent credit-related downtime. **************** Product Releases **************** -------------------------------------------

How Pinterest Built a Production MCP Ecosystem

Score 0.590 · Account tjphuhs@gmail.com · 5/11/2026, 11:31:17 AM

How Pinterest Built a Production MCP Ecosystem from bytebytego@substack.com on 2026-05-11T15:31:17.000Z View this post on the web at https://blog.bytebytego.com/p/how-pinterest-built-a-production Agents need context. Ship the integrations that give it to them. (Sponsored) [ https://substack.com/redirect/87dc365a-cf87-4640-8889-81a07e071928?j=eyJ1IjoiNGl3b2U2In0.sVDxRtmZ85v8kfdamY0krRXGMy3p768BWtuZifRB-Zs ] The context that actually matters isn't in your database. It's in the tools your users liv

Supa Update May 2026

Score 0.590 · Account tjphuhs@gmail.com · 5/12/2026, 12:10:41 AM

Supa Update May 2026 from welcome@supabase.com on 2026-05-12T04:10:41.000Z to copy any entry as Markdown or ask Claude/ChatGPT. [Changelog ( https://supabase.com/changelog )] * Wrappers v0.6.0 ships with a new OpenAPI FDW, Snowflake timeout support, Clerk CRUD, and several bug fixes. [GitHub ( https://github.com/supabase/wrappers/releases/tag/v0.6.0 )] [Docs ( https://fdw.dev/ )] * Supabase Agent Skills: an open-source set of instructions that teach AI coding agents how to build on Supabase corr