Technology Fundamentals 6 in Practice: Lessons From Real Deployments

Teams working on data pipelines usually discover this the hard way. The interesting number is not the average, it is the 99th percentile. Adding a cache in front of a slow query is a fix; fixing the query is a cure. This is most visible in data pipelines. Consider data pipelines specifically. Every abstraction you add is a place where behaviour can differ from intent.

Schema Migration: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. That applies to schema migration as well. In practice, schema migration behaves differently: Separating the reads from the writes buys room to change either side.

API Design: You can often replace a coordination problem with an idempotency key. API Design: Anything that grows without a bound will eventually hit one. API Design: Documentation that is not tested tends to describe the previous version.

Observability: The interesting number is not the average, it is the 99th percentile. Observability: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Observability: Every abstraction you add is a place where behaviour can differ from intent.

Edge Caching: You can often replace a coordination problem with an idempotency key. Edge Caching: Anything that grows without a bound will eventually hit one. Edge Caching: Documentation that is not tested tends to describe the previous version.

Rate Limiting: You can often replace a coordination problem with an idempotency key. Rate Limiting: Anything that grows without a bound will eventually hit one. Rate Limiting: Documentation that is not tested tends to describe the previous version.

The interesting number is not the average, it is the 99th percentile. The same reasoning holds for schema migration. For schema migration, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on schema migration usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.

If a metric has no owner, it will drift until it causes an incident. This is most visible in cloud infrastructure. Consider cloud infrastructure specifically. The cheapest optimisation is usually removing work nobody asked for. Cloud Infrastructure: Aggregating at write time trades flexibility for predictable read cost.

In practice, api design behaves differently: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. The same reasoning holds for api design. For api design, the constraint matters more than the feature list. The signal you want is often already logged, just not aggregated.

Teams working on search indexing usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in search indexing. Consider search indexing specifically. Caching helps only until the invalidation rules become the bottleneck.

Load Balancing: If the rollback plan needs a meeting, it is not a rollback plan. Load Balancing: Small pages that stay small are easier to keep fast than large ones made fast. Load Balancing: Write the invariant down; otherwise it lives only in someone's memory.

Use direct, ordinary language. For example, ask, “Would you like to continue?” or “Are you comfortable with this?” A clear spoken answer can reduce guesswork, especially when you are unsure how to read someone’s response. Consent can be communicated in different ways, but a practical approach is to check verbally rather than infer agreement from silence, body language or the absence of resistance.

Use statements about your own needs rather than trying to guess your partner’s intentions. You might say, “I’m comfortable with this, but not with that,” or, “I need us to stop if I say pause.” Be specific about what you mean by words such as “slow down” or “check in.” Ask your partner what they are comfortable with, and leave room for an answer without interrupting or arguing.

Storage Tiers: The first thing to settle is the failure mode, not the happy path. Storage Tiers: Measurements taken once are anecdotes; you need a baseline that repeats. Storage Tiers: Costs usually concentrate in a small number of operations, so find those first.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for observability. For observability, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on observability usually discover this the hard way. Track the denominator as carefully as the numerator.

API Design: If a metric has no owner, it will drift until it causes an incident. API Design: The cheapest optimisation is usually removing work nobody asked for. API Design: Aggregating at write time trades flexibility for predictable read cost.

Monitoring Alerts: Periodic jobs should be safe to run twice, because they will be. Monitoring Alerts: You rarely need a new component to fix a boundary problem. Monitoring Alerts: The signal you want is often already logged, just not aggregated.

You can often replace a coordination problem with an idempotency key. The same reasoning holds for rate limiting. For rate limiting, the constraint matters more than the feature list. Anything that grows without a bound will eventually hit one. Teams working on rate limiting usually discover this the hard way. Documentation that is not tested tends to describe the previous version.

For release process, the constraint matters more than the feature list. Configurations should be reviewable in a diff, not only in a console. Teams working on release process usually discover this the hard way. The best time to add an index is before the table gets large. Failures are usually correlated, so plan for the shared dependency. This is most visible in release process.

Consider edge caching specifically. A design that cannot be rolled back is a design that cannot be changed safely. Edge Caching: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. That applies to edge caching as well.

A screening result only reflects the tests performed and the samples collected at that time. If a result is positive, the service can explain what it means and discuss appropriate next steps, including whether partners should be informed. If a result is negative but concern remains, the clinician can advise whether timing, another test or a different assessment matters. Personal questions are best directed to a clinician or qualified sexual-health educator.

Load Balancing: A design that cannot be rolled back is a design that cannot be changed safely. Load Balancing: Latency budgets are easier to defend when every hop has a stated ceiling. Load Balancing: Caching helps only until the invalidation rules become the bottleneck.

The interesting number is not the average, it is the 99th percentile. The same reasoning holds for crawl budget. For crawl budget, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on crawl budget usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.

Configurations should be reviewable in a diff, not only in a console. This is most visible in access control. Consider access control specifically. The best time to add an index is before the table gets large. Access Control: Failures are usually correlated, so plan for the shared dependency.