Live Index Object Groups

When you create an object group, the Live indexing option causes ChaosSearch to watch for notifications and to index new matching files after they are written to the storage bucket. Live indexing is the typical option for most environments where the cloud storage bucket receives new objects to index on a regular cadence.

Live indexing requires the configuration of an Amazon Web Services (AWS) SQS integration or Google Pub/Sub integration (depending on the cloud storage service used) to notify the indexing service that new objects are available. For more information, see Live Indexing - Amazon SQS or Live Indexing - Google PubSub.

To configure Live Indexing, select the Live Indexing option and paste in the ARN created for the AWS SQS queue, or the GCP Pub/Sub Project ID. A sample window follows:

If you do not select Live Indexing, the indexing style defaults to static indexing. Static indexing causes the system to index all matching objects defined by the object group filters only once, when you click Start Indexing. It assumes that the bucket contents are relatively static. If new objects are added to the bucket, you can click Start Indexing again to run a new static index and index new files added since the last time the index service ran.