正在加载内容...

963963 Chat Data Portal Independent coverage of news

Getting Started With Technology Fundamentals 6

By James Whitfield · · 1139 words
Getting Started With Technology Fundamentals 6

API Design: Serving static bytes is the cheapest thing you can do at the edge. API Design: A schema is an interface; changing it is a migration, not an edit. API Design: Track the denominator as carefully as the numerator.

Consider schema migration specifically. A design that cannot be rolled back is a design that cannot be changed safely. Schema Migration: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. That applies to schema migration as well.

If the rollback plan needs a meeting, it is not a rollback plan. That applies to schema migration as well. In practice, schema migration behaves differently: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. The same reasoning holds for schema migration.

Consider search indexing specifically. If the rollback plan needs a meeting, it is not a rollback plan. Search Indexing: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to search indexing as well.

The sender printed on a label can be the retailer, a parent company or a fulfilment warehouse. A short or unfamiliar company name may offer less information at the doorstep, but it can also make a parcel harder to recognize. The parcel’s return address may reveal a business location even when the product category is not named. Compare the seller’s stated shipping policy with the checkout details; if the label name is not specified, customer service is the only reliable way to confirm it before purchase.

If the rollback plan needs a meeting, it is not a rollback plan. The same reasoning holds for data pipelines. For data pipelines, the constraint matters more than the feature list. Small pages that stay small are easier to keep fast than large ones made fast. Teams working on data pipelines usually discover this the hard way. Write the invariant down; otherwise it lives only in someone's memory.

Access Control: A queue smooths spikes but also hides how far behind you are. Access Control: Retries without jitter turn a small outage into a large one. Access Control: Separating the reads from the writes buys room to change either side.

Data Pipelines: The first thing to settle is the failure mode, not the happy path. Data Pipelines: Measurements taken once are anecdotes; you need a baseline that repeats. Data Pipelines: Costs usually concentrate in a small number of operations, so find those first.

Backup Strategy: The interesting number is not the average, it is the 99th percentile. Backup Strategy: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Backup Strategy: Every abstraction you add is a place where behaviour can differ from intent.

Observability: If a metric has no owner, it will drift until it causes an incident. Observability: The cheapest optimisation is usually removing work nobody asked for. Observability: Aggregating at write time trades flexibility for predictable read cost.

Monitoring Alerts: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. That applies to monitoring alerts as well. In practice, monitoring alerts behaves differently: The signal you want is often already logged, just not aggregated.

Monitoring Alerts: Configurations should be reviewable in a diff, not only in a console. Monitoring Alerts: The best time to add an index is before the table gets large. Monitoring Alerts: Failures are usually correlated, so plan for the shared dependency.

Observability: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. That applies to observability as well. In practice, observability behaves differently: The signal you want is often already logged, just not aggregated.

“Discreet shipping” usually describes how a parcel looks from the outside, not a promise that every part of an order is private. Before buying, check the seller’s packaging policy, the sender name on the label, payment descriptors and the information that carriers or customs may require. These details determine what other people could see at delivery and what records remain in email, payment and tracking accounts.

API Design: The first thing to settle is the failure mode, not the happy path. API Design: Measurements taken once are anecdotes; you need a baseline that repeats. API Design: Costs usually concentrate in a small number of operations, so find those first.

Backup Strategy: A queue smooths spikes but also hides how far behind you are. Backup Strategy: Retries without jitter turn a small outage into a large one. Backup Strategy: Separating the reads from the writes buys room to change either side.

Rate Limiting: Periodic jobs should be safe to run twice, because they will be. Rate Limiting: You rarely need a new component to fix a boundary problem. Rate Limiting: The signal you want is often already logged, just not aggregated.

Edge Caching: Serving static bytes is the cheapest thing you can do at the edge. Edge Caching: A schema is an interface; changing it is a migration, not an edit. Edge Caching: Track the denominator as carefully as the numerator.

Access Control: You can often replace a coordination problem with an idempotency key. Access Control: Anything that grows without a bound will eventually hit one. Access Control: Documentation that is not tested tends to describe the previous version.

Storage Tiers: If a metric has no owner, it will drift until it causes an incident. Storage Tiers: The cheapest optimisation is usually removing work nobody asked for. Storage Tiers: Aggregating at write time trades flexibility for predictable read cost.

Access Control: The interesting number is not the average, it is the 99th percentile. Access Control: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Access Control: Every abstraction you add is a place where behaviour can differ from intent.

Access Control: If a metric has no owner, it will drift until it causes an incident. Access Control: The cheapest optimisation is usually removing work nobody asked for. Access Control: Aggregating at write time trades flexibility for predictable read cost.

Cloud Infrastructure: If a metric has no owner, it will drift until it causes an incident. Cloud Infrastructure: The cheapest optimisation is usually removing work nobody asked for. Cloud Infrastructure: Aggregating at write time trades flexibility for predictable read cost.

Queue Design: Serving static bytes is the cheapest thing you can do at the edge. Queue Design: A schema is an interface; changing it is a migration, not an edit. Queue Design: Track the denominator as carefully as the numerator.

Related reading