Understanding Site Topics Fundamentals 4: Costs, Limits and Trade-offs

For cloud infrastructure, the constraint matters more than the feature list. A queue smooths spikes but also hides how far behind you are. Teams working on cloud infrastructure usually discover this the hard way. Retries without jitter turn a small outage into a large one. Separating the reads from the writes buys room to change either side. This is most visible in cloud infrastructure.

API Design: The interesting number is not the average, it is the 99th percentile. API Design: Adding a cache in front of a slow query is a fix; fixing the query is a cure. API Design: Every abstraction you add is a place where behaviour can differ from intent.

Storage Tiers: If a metric has no owner, it will drift until it causes an incident. Storage Tiers: The cheapest optimisation is usually removing work nobody asked for. Storage Tiers: Aggregating at write time trades flexibility for predictable read cost.

Listening is part of the conversation. Ask what the other person understands, and invite them to describe their own boundaries without treating the exchange as a negotiation in which every limit must be traded away. Open questions such as “What would help you feel comfortable?” can clarify expectations. If a question feels intrusive, either person can decline to answer it.

In practice, queue design behaves differently: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. The same reasoning holds for queue design. For queue design, the constraint matters more than the feature list. Failures are usually correlated, so plan for the shared dependency.

Schema Markup: The interesting number is not the average, it is the 99th percentile. Schema Markup: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Schema Markup: Every abstraction you add is a place where behaviour can differ from intent.

A design that cannot be rolled back is a design that cannot be changed safely. That applies to storage tiers as well. In practice, storage tiers behaves differently: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. The same reasoning holds for storage tiers.

Content Delivery: A queue smooths spikes but also hides how far behind you are. Content Delivery: Retries without jitter turn a small outage into a large one. Content Delivery: Separating the reads from the writes buys room to change either side.

A design that cannot be rolled back is a design that cannot be changed safely. The same reasoning holds for queue design. For queue design, the constraint matters more than the feature list. Latency budgets are easier to defend when every hop has a stated ceiling. Teams working on queue design usually discover this the hard way. Caching helps only until the invalidation rules become the bottleneck.

A queue smooths spikes but also hides how far behind you are. This is most visible in log analysis. Consider log analysis specifically. Retries without jitter turn a small outage into a large one. Log Analysis: Separating the reads from the writes buys room to change either side.

Crawl Budget: If the rollback plan needs a meeting, it is not a rollback plan. Crawl Budget: Small pages that stay small are easier to keep fast than large ones made fast. Crawl Budget: Write the invariant down; otherwise it lives only in someone's memory.

Monitoring Alerts: If a metric has no owner, it will drift until it causes an incident. Monitoring Alerts: The cheapest optimisation is usually removing work nobody asked for. Monitoring Alerts: Aggregating at write time trades flexibility for predictable read cost.

Search Indexing: If the rollback plan needs a meeting, it is not a rollback plan. Search Indexing: Small pages that stay small are easier to keep fast than large ones made fast. Search Indexing: Write the invariant down; otherwise it lives only in someone's memory.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for content delivery. For content delivery, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on content delivery usually discover this the hard way. Track the denominator as carefully as the numerator.

Monitoring Alerts: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. That applies to monitoring alerts as well. In practice, monitoring alerts behaves differently: The signal you want is often already logged, just not aggregated.

Edge Caching: If the rollback plan needs a meeting, it is not a rollback plan. Edge Caching: Small pages that stay small are easier to keep fast than large ones made fast. Edge Caching: Write the invariant down; otherwise it lives only in someone's memory.

Release Process: A design that cannot be rolled back is a design that cannot be changed safely. Release Process: Latency budgets are easier to defend when every hop has a stated ceiling. Release Process: Caching helps only until the invalidation rules become the bottleneck.

Queue Design: If the rollback plan needs a meeting, it is not a rollback plan. Queue Design: Small pages that stay small are easier to keep fast than large ones made fast. Queue Design: Write the invariant down; otherwise it lives only in someone's memory.

Cost Controls: Serving static bytes is the cheapest thing you can do at the edge. Cost Controls: A schema is an interface; changing it is a migration, not an edit. Cost Controls: Track the denominator as carefully as the numerator.

Consent is ongoing. A person can withdraw it at any point, including after previously agreeing or after an activity has begun. If they say stop, move away, become unresponsive or otherwise indicate discomfort, pause immediately and ask what they want. Do not argue, bargain or demand an explanation.

In practice, observability behaves differently: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. The same reasoning holds for observability. For observability, the constraint matters more than the feature list. Failures are usually correlated, so plan for the shared dependency.

Data Pipelines: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. That applies to data pipelines as well. In practice, data pipelines behaves differently: Failures are usually correlated, so plan for the shared dependency.

For observability, the constraint matters more than the feature list. A queue smooths spikes but also hides how far behind you are. Teams working on observability usually discover this the hard way. Retries without jitter turn a small outage into a large one. Separating the reads from the writes buys room to change either side. This is most visible in observability.

API Design: If a metric has no owner, it will drift until it causes an incident. The cheapest optimisation is usually removing work nobody asked for. That applies to api design as well. In practice, api design behaves differently: Aggregating at write time trades flexibility for predictable read cost.