Indexing Your Data

Immediately start indexing you're data without the complexity of building out mappings

Start Indexing

ChaosSearch indexing is a deep data analysis of S3 content based on an object group filter. To get started indexing:

  1. Select the desired object group
  2. Click Index Object Group

Once Start Indexing execution begins, the service starts a deep analysis of associated content, generating a proprietary data representation, and attempts to infer structure (schema).

Viewing Modeled Data

Once the analysis is complete a comprehensive report of your data is displayed. This report shows detailed information including:

  1. Object group details: group name, creation date, model progress, source type, sample regex, data format
  2. Trending data: data frequency (tabular format with quantities, visual text cloud)
  3. Modeled structure: column numbers, column names, data types

Indexing Options

❗️

Currently, Daily is the only supported Indexing option for interval selection.

Live Indexing

Live Indexing in ChaosSearch requires configuration of an AWS SQS Integration. For more information please navigate to Live Indexing - Amazon SQS

ChaosSearch allows you to set-up multiple ways to start indexing your data.

Setting up Index Intervals for Daily, Weekly, or Monthly are done at the end of the Object Group creation.

Live Indexing - Daily

This will create a new Daily index that is continuously updated as new log files get put into an S3 bucket

Live Indexing - Weekly

This will create a new Weekly index that is continuously updated as new log files get put into an S3 bucket

Live Indexing - Monthly

This will create a new Monthly index that is continuously updated as new log files get put into an S3 bucket

Daily Indexing

When selecting Daily as an interval option, ChaosSearch will create a new index pattern to be searched on that day's worth of data.

Weekly Indexing

When selecting Weekly as an interval option, ChaosSearch will create a new index pattern that Week's worth of data.

Monthly Indexing

When selecting Monthly as an interval option, ChaosSearch will create a new index pattern for that Month's worth of data.

📘

We're currently building support for Weekly & Monthly Index Patterns.

Updated 3 days ago

Indexing Your Data


Immediately start indexing you're data without the complexity of building out mappings

Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.