A Field Guide to Log Analysis

Search Indexing: Periodic jobs should be safe to run twice, because they will be. Search Indexing: You rarely need a new component to fix a boundary problem. Search Indexing: The signal you want is often already logged, just not aggregated.

Queue Design: A queue smooths spikes but also hides how far behind you are. Queue Design: Retries without jitter turn a small outage into a large one. Queue Design: Separating the reads from the writes buys room to change either side.

Use statements about your own needs rather than trying to guess your partner’s intentions. You might say, “I’m comfortable with this, but not with that,” or, “I need us to stop if I say pause.” Be specific about what you mean by words such as “slow down” or “check in.” Ask your partner what they are comfortable with, and leave room for an answer without interrupting or arguing.

Queue Design: The interesting number is not the average, it is the 99th percentile. Queue Design: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Queue Design: Every abstraction you add is a place where behaviour can differ from intent.

Access Control: The first thing to settle is the failure mode, not the happy path. Access Control: Measurements taken once are anecdotes; you need a baseline that repeats. Access Control: Costs usually concentrate in a small number of operations, so find those first.

Schema Markup: The interesting number is not the average, it is the 99th percentile. Schema Markup: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Schema Markup: Every abstraction you add is a place where behaviour can differ from intent.

Cost Controls: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. That applies to cost controls as well. In practice, cost controls behaves differently: Failures are usually correlated, so plan for the shared dependency.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for content delivery. For content delivery, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on content delivery usually discover this the hard way. Track the denominator as carefully as the numerator.

If the rollback plan needs a meeting, it is not a rollback plan. That applies to schema migration as well. In practice, schema migration behaves differently: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. The same reasoning holds for schema migration.

Use direct, ordinary language. For example, ask, “Would you like to continue?” or “Are you comfortable with this?” A clear spoken answer can reduce guesswork, especially when you are unsure how to read someone’s response. Consent can be communicated in different ways, but a practical approach is to check verbally rather than infer agreement from silence, body language or the absence of resistance.

Serving static bytes is the cheapest thing you can do at the edge. That applies to schema markup as well. In practice, schema markup behaves differently: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. The same reasoning holds for schema markup.

Schema Markup: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. That applies to schema markup as well. In practice, schema markup behaves differently: Failures are usually correlated, so plan for the shared dependency.

API Design: Configurations should be reviewable in a diff, not only in a console. API Design: The best time to add an index is before the table gets large. API Design: Failures are usually correlated, so plan for the shared dependency.

Load Balancing: Serving static bytes is the cheapest thing you can do at the edge. Load Balancing: A schema is an interface; changing it is a migration, not an edit. Load Balancing: Track the denominator as carefully as the numerator.

Teams working on schema markup usually discover this the hard way. The interesting number is not the average, it is the 99th percentile. Adding a cache in front of a slow query is a fix; fixing the query is a cure. This is most visible in schema markup. Consider schema markup specifically. Every abstraction you add is a place where behaviour can differ from intent.

Storage Tiers: Periodic jobs should be safe to run twice, because they will be. Storage Tiers: You rarely need a new component to fix a boundary problem. Storage Tiers: The signal you want is often already logged, just not aggregated.

Consider cost controls specifically. You can often replace a coordination problem with an idempotency key. Cost Controls: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. That applies to cost controls as well.

Schema Markup: A queue smooths spikes but also hides how far behind you are. Schema Markup: Retries without jitter turn a small outage into a large one. Schema Markup: Separating the reads from the writes buys room to change either side.

Queue Design: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. That applies to queue design as well. In practice, queue design behaves differently: Costs usually concentrate in a small number of operations, so find those first.

For search indexing, the constraint matters more than the feature list. Configurations should be reviewable in a diff, not only in a console. Teams working on search indexing usually discover this the hard way. The best time to add an index is before the table gets large. Failures are usually correlated, so plan for the shared dependency. This is most visible in search indexing.

The first thing to settle is the failure mode, not the happy path. This is most visible in storage tiers. Consider storage tiers specifically. Measurements taken once are anecdotes; you need a baseline that repeats. Storage Tiers: Costs usually concentrate in a small number of operations, so find those first.

A design that cannot be rolled back is a design that cannot be changed safely. That applies to cost controls as well. In practice, cost controls behaves differently: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. The same reasoning holds for cost controls.

Log Analysis: If the rollback plan needs a meeting, it is not a rollback plan. Log Analysis: Small pages that stay small are easier to keep fast than large ones made fast. Log Analysis: Write the invariant down; otherwise it lives only in someone's memory.

API Design: The first thing to settle is the failure mode, not the happy path. API Design: Measurements taken once are anecdotes; you need a baseline that repeats. API Design: Costs usually concentrate in a small number of operations, so find those first.