Autodiscover Independent coverage of news

Technology Fundamentals 3 Explained Without the Jargon

By David Kim · · 1149 words
Technology Fundamentals 3 Explained Without the Jargon

Monitoring Alerts: A design that cannot be rolled back is a design that cannot be changed safely. Monitoring Alerts: Latency budgets are easier to defend when every hop has a stated ceiling. Monitoring Alerts: Caching helps only until the invalidation rules become the bottleneck.

Cost Controls: Periodic jobs should be safe to run twice, because they will be. Cost Controls: You rarely need a new component to fix a boundary problem. Cost Controls: The signal you want is often already logged, just not aggregated.

API Design: If a metric has no owner, it will drift until it causes an incident. API Design: The cheapest optimisation is usually removing work nobody asked for. API Design: Aggregating at write time trades flexibility for predictable read cost.

Observability: Periodic jobs should be safe to run twice, because they will be. Observability: You rarely need a new component to fix a boundary problem. Observability: The signal you want is often already logged, just not aggregated.

Release Process: A queue smooths spikes but also hides how far behind you are. Release Process: Retries without jitter turn a small outage into a large one. Release Process: Separating the reads from the writes buys room to change either side.

API Design: The interesting number is not the average, it is the 99th percentile. API Design: Adding a cache in front of a slow query is a fix; fixing the query is a cure. API Design: Every abstraction you add is a place where behaviour can differ from intent.

Periodic jobs should be safe to run twice, because they will be. This is most visible in cost controls. Consider cost controls specifically. You rarely need a new component to fix a boundary problem. Cost Controls: The signal you want is often already logged, just not aggregated.

Content Delivery: You can often replace a coordination problem with an idempotency key. Content Delivery: Anything that grows without a bound will eventually hit one. Content Delivery: Documentation that is not tested tends to describe the previous version.

Teams working on log analysis usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in log analysis. Consider log analysis specifically. Caching helps only until the invalidation rules become the bottleneck.

Load Balancing: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. That applies to load balancing as well. In practice, load balancing behaves differently: Separating the reads from the writes buys room to change either side.

Consider data pipelines specifically. You can often replace a coordination problem with an idempotency key. Data Pipelines: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. That applies to data pipelines as well.

Edge Caching: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. That applies to edge caching as well. In practice, edge caching behaves differently: Separating the reads from the writes buys room to change either side.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for queue design. For queue design, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on queue design usually discover this the hard way. Track the denominator as carefully as the numerator.

If a metric has no owner, it will drift until it causes an incident. This is most visible in queue design. Consider queue design specifically. The cheapest optimisation is usually removing work nobody asked for. Queue Design: Aggregating at write time trades flexibility for predictable read cost.

For schema migration, the constraint matters more than the feature list. Periodic jobs should be safe to run twice, because they will be. Teams working on schema migration usually discover this the hard way. You rarely need a new component to fix a boundary problem. The signal you want is often already logged, just not aggregated. This is most visible in schema migration.

Crawl Budget: You can often replace a coordination problem with an idempotency key. Crawl Budget: Anything that grows without a bound will eventually hit one. Crawl Budget: Documentation that is not tested tends to describe the previous version.

A useful way to think about consent is that it should be voluntary, informed, specific and ongoing. “Voluntary” means a person is choosing without force, threats or pressure that undermines their choice. “Informed” means they understand what they are agreeing to. Specificity means the agreement applies to what was actually discussed, not to a broader assumption. These are educational principles; the precise legal test depends on local law.

Content Delivery: If a metric has no owner, it will drift until it causes an incident. Content Delivery: The cheapest optimisation is usually removing work nobody asked for. Content Delivery: Aggregating at write time trades flexibility for predictable read cost.

You can often replace a coordination problem with an idempotency key. That applies to observability as well. In practice, observability behaves differently: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. The same reasoning holds for observability.

Teams working on release process usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in release process. Consider release process specifically. Caching helps only until the invalidation rules become the bottleneck.

Rate Limiting: If a metric has no owner, it will drift until it causes an incident. Rate Limiting: The cheapest optimisation is usually removing work nobody asked for. Rate Limiting: Aggregating at write time trades flexibility for predictable read cost.

Consider release process specifically. If the rollback plan needs a meeting, it is not a rollback plan. Release Process: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to release process as well.

Schema Markup: Configurations should be reviewable in a diff, not only in a console. Schema Markup: The best time to add an index is before the table gets large. Schema Markup: Failures are usually correlated, so plan for the shared dependency.

If a metric has no owner, it will drift until it causes an incident. This is most visible in monitoring alerts. Consider monitoring alerts specifically. The cheapest optimisation is usually removing work nobody asked for. Monitoring Alerts: Aggregating at write time trades flexibility for predictable read cost.

Related reading