Interview Observability

Why is index-time configuration expensive, and when do you use it? [Intermediate]

Answer

Index-time configuration is expensive because it affects ingestion, storage, license usage, parsing queues, and sometimes requires reindexing to correct historical data. I use it only when there is a strong operational, security, or performance reason.

Technical explanation

Index-time transformations are applied before data is stored, so mistakes can permanently change indexed data.

They can increase CPU load on parsing/indexing tiers and add operational complexity.

Valid uses include timestamp correction, line breaking, routing, nullQueue filtering, sourcetype assignment, and sensitive-data masking.

Hands-on example

Example: if logs contain credit-card numbers, use index-time masking or filtering before indexing because search-time masking is too late. For a normal application field like feature_flag, use search-time extraction instead.

Preparing for an interview?

Check how well your resume matches the role with our free resume checker— match score, ATS check, and the skills you're missing.

More Observability interview questions

← All Observability questions