Service Limits
Review these configurable settings that can help to manage configuration sizes and resource usage
ChaosSearch offers flexibility for designing cost-effective environments to index your expected cloud storage content and to support the search and analysis activities for your business analytics users. The tunable configuration service limits can help system administrators to keep usage within the expected configuration plan by stopping the creation of new objects after a service limit has been met.
As usage grows, these settings can help to identify when it could be time to increase supporting resources, or to prune objects that were created but are no longer used or needed. If users are reporting service limit errors when trying to create new objects or API failures due to service limits, contact your ChaosSearch Customer Success representative to evaluate the configured limits for your site and next steps.
| Object or action | Default Limit | Description |
|---|---|---|
| Kibana saved objects | 15000 | The maximum number of OpenSearch Dashboards (Kibana) objects such as saved queries, visualizations, and dashboards that can be defined for the system. (KibanaSavedObjectsLimit) |
| Object groups | 50 | The maximum number of object groups that can be created for the system. 50 is a common starting point for new setups, and is adjusted to match the site planning and analysis needs. (ObjectGroupLimit) |
| Object group columns | 10000 | The maximum number of columns that can be created in the indexed data for an object group. For an object group that uses isolation keys, each isolated slice can have up to 10,000 columns. Different limits could be specified on a group name prefix basis. See the note below the table. (ObjectGroupColumnsLimit)An object group also displays a warning message when it reaches 90% of the configured column limit. |
| Query fields limit | 1024 | The maximum number of fields that can be included in a query. Queries that exceed this limit fail with a "query spans too many fields" error. This limit helps to guard against very wide queries that will be very slow to run. (QueryFieldsLimit) |
| Query predicate limit | 1024 | The maximum number of predicates allowed in a query. Queries that exceed this limit fail with a "number of predicates exceeded limit" error. This limit helps to guard against queries that might fail due to a huge number of filters aggregations. (QueryPredicatesLimit) |
| Query result size limit | 5000 | The maximum number of results that a Search Analytics Discover or SQL Analytics query can return. The query result size limit is a system configuration setting that can be enabled for an environment if desired. If enabled, result sets that exceed this limit fail with a Number of rows requested exceeds service limit. Please contact your ChaosSearch representative for further details.error. This limit helps to guard against very large query responses that might exceed browser memory limits and fail to display. (QueryResultSizeLimit). |
| RBAC Groups | 30 | The maximum number of user groups that can be created for the system. (RBACGroupsLimit) |
| Subaccounts | 100 | The maximum number of subaccount users that can be created for the system. (SubaccountsLimit) |
| Views | 200 | The maximum number of Refinery views that can be created for the system. (ViewLimit) |
| API calls | 1000 per second | The maximum number of API calls that can be running at one time on the system. Different limits can be specified on an HTTP path prefix match basis. (ServiceAPILimit) |
| API keys per system | 100 | The maximum number of API keys that can be defined for the system. (ApiKeysLimit) |
| API keys per subaccount | 5 | The maximum number of API keys that can be defined for one subaccount. (SubaccountApiKeysLimit) |
About the Object Group Columns Limit
The object group columns limit is usually related to the indexing of JSON files. The JSON array structures and nesting complexity, as well as the object group selections for horizontal or vertical expansion and the array flattening depth (such as Unlimited), could result in an object group reaching this limit during indexing.
ChaosSearch displays a warning message on the object group Events tab when a group reaches 90% of the configured column limit, for example:
Your schema column count is 9000 of 10000, (90%) of the soft limit imposed on the system. There may be performance impact, consult the ChaosSearch documentation for guidance and ChaosSearch for assistance if needed.If your object group returns the column limit warning or error message during indexing, review the format of the source object files being indexed, and the expansion and depth options that were selected for the object group. Some changes such a lower depth value (such as NONE or 1), or a blacklist to exclude unnecessary columns from indexing, can help to avoid this error. See JSON Log and Event File Challenges.
Object Group Field Width Limit
A field in a ChaosSearch object group has a maximum width of 1MB. During indexing, if the content of a field exceeds that limit, the content is truncated to 1MB, and any truncated data is not included in the indexed data. The field width limit is not currently a configurable setting.
Updated 6 months ago