Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

README.md

Cirrus

Cirrus is a feature configuration server that allows clients to obtain a set of features based on their provided client_id and context information. There are two ways in which you can use Cirrus

  • Sidecar deployment
  • Nimbus cirrus shared service This document provides information on setting up the Cirrus environment, including required environment variables and commands for running and testing Cirrus.

Environment Setup

To set up the Cirrus environment, follow these steps:

  1. Create a .env file inside the cirrus/server directory.

  2. Copy the contents of .env.example into .env by running the following command:

    cp .env.example .env
  3. Open the .env file and modify the values of the following environment variables:

    CIRRUS_REMOTE_SETTING_URL=https://firefox.settings.services.mozilla.com/v1/buckets/main/collections/nimbus-web-experiments/changeset?_expected=0
    CIRRUS_REMOTE_SETTING_PREVIEW_URL=https://firefox.settings.services.mozilla.com/v1/buckets/main/collections/nimbus-web-preview/changeset?_expected=0
    CIRRUS_REMOTE_SETTING_REFRESH_RATE_IN_SECONDS=10
    CIRRUS_REMOTE_SETTING_REFRESH_JITTER_IN_SECONDS=1
    CIRRUS_REMOTE_SETTING_REFRESH_RETRY_DELAY_IN_SECONDS=30
    CIRRUS_REMOTE_SETTING_REFRESH_MAX_ATTEMPTS=3
    CIRRUS_APP_ID=test_app_id
    CIRRUS_APP_NAME=test_app_name
    CIRRUS_CHANNEL=developer
    CIRRUS_FML_PATH=./feature_manifest/sample.fml.yaml
    CIRRUS_SENTRY_DSN=dsn_url
    CIRRUS_INSTANCE_NAME=cirrus_pod_app_v1
    CIRRUS_ENV_NAME=test_app_stage
    CIRRUS_GLEAN_MAX_EVENTS_BUFFER=10
    
    

    Here's what each variable represents:

    • CIRRUS_REMOTE_SETTING_URL: The URL of the remote settings where the experiments data is stored. In this case, it points to the collection of nimbus web experiments.
  • CIRRUS_REMOTE_SETTING_PREVIEW_URL: The URL of the remote settings where the preview experiments data is stored. In this case, it points to the collection of nimbus web preview experiments.
  • CIRRUS_REMOTE_SETTING_REFRESH_RATE_IN_SECONDS: The refresh rate in seconds for fetching the experiments recipes from the remote settings. Set it to 10 to retrieve the latest data every 10 seconds.
  • CIRRUS_REMOTE_SETTING_REFRESH_JITTER_IN_SECONDS: The maximum number of random additional seconds to wait between fetching from remote settings, to avoid syncing at the same time as other instances. Set it to 1 to randomly wait an additional 0-1 seconds.
  • CIRRUS_REMOTE_SETTING_RETRY_BACKOFF_FACTOR_IN_SECONDS: A backoff factor to apply between attempts to fetch from remote settings after the second try. urllib3 will sleep for: {backoff factor} * (2 ** ({number of previous retries}))
  • CIRRUS_REMOTE_SETTING_RETRY_TOTAL: Total number of retries to allow when fetching remote settings. Set to 0 to fail on the first retry.
  • CIRRUS_REMOTE_SETTING_REQUIRE_FETCH_BEFORE_START: When set to True, Cirrus will attempt to fetch remote settings during startup before responding to requests, and if it does not succeed within CIRRUS_REMOTE_SETTING_RETRY_TOTAL retries the app will exit with an exception.
  • CIRRUS_APP_ID: Replace test_app_id with the actual ID of your application for example firefox-desktop.
  • CIRRUS_APP_NAME: Replace test_app_name with the desired name for your application for example firefox_desktop.
  • CIRRUS_CHANNEL: Replace developer with the channel like beta, release etc.
  • CIRRUS_FML_PATH: The file path to the feature manifest file. Set it to ./feature_manifest/sample.fml.yaml or specify the correct path to your feature manifest file.
  • CIRRUS_SENTRY_DSN: Replace dsn_url with the appropriate DSN value.
  • CIRRUS_INSTANCE_NAME: Replace with the instance name.
  • CIRRUS_ENV_NAME: Replace with the concatenation of project and environment name
  • CIRRUS_GLEAN_MAX_EVENTS_BUFFER: This value represents the max events buffer size for glean. You can set the value from range 1 to 500, by default Cirrus sets it to 10.

Adjust the values of these variables according to your specific configuration requirements.

By following these steps, you will create the .env file and configure the necessary environment variables for the Cirrus application.

Running as Non-Root User

By default, the Cirrus Docker image runs the application as cirrus/1000/1000. However, if you prefer to run the application as a different user for security reasons, you can build the Docker image with additional parameters.

  • Build the Docker image while specifying the desired username, user ID, and group ID. For example:
docker build --build-arg USERNAME=myuser --build-arg USER_UID=1000 --build-arg USER_GID=1000 -t your_image_name:tag .

Replace myuser with the desired username and 1000 with the desired user ID and group ID.

Commands

The following are the available commands for working with Cirrus:

  • cirrus_build: Builds the Cirrus container.

    • Usage: make cirrus_build
  • cirrus_up: Starts the Cirrus container.

    • Usage: make cirrus_up
  • cirrus_down:cirrus_down: Stops the Cirrus container.

    • Usage: make cirrus_down
  • cirrus_test: Runs tests for the Cirrus application.

    • Usage: make cirrus_test
  • cirrus_check: Performs various checks on the Cirrus application including Ruff linting, Black code formatting check, Pyright static type checking, pytest tests, and documentation generation..

    • Usage: make cirrus_check
  • cirrus_code_format: Formats the code in the Cirrus application.

    • Usage: make cirrus_code_format
  • cirrus_typecheck_createstub: Performs static type checking and creates stub files.

    • Usage: make cirrus_typecheck_createstub
  • cirrus_generate_docs: Generates documentation for the Cirrus application such as openapi schema.

    • Usage: make cirrus_generate_docs

OpenAPI Schema

OpenAPI schema for the Cirrus API

Cirrus Server to get Feature configuration API structure

Api Doc

Cirrus Api Doc for the Cirrus API

Endpoint: POST /v1/features/

  • When making a POST request, please make sure to set headers content type as JSON
      headers: {
              "Content-Type": "application/json",
        }

Endpoint: POST /v2/features/

The v2 endpoint extends the functionality of v1 by also returning enrollments data alongside features.

    headers: {
            "Content-Type": "application/json",
      }

Input

The input should be a JSON object with the following properties:

  • client_id (string): Used for bucketing calculation.
  • context (object): Used for context. It can have any key-value pair.
    • any-key (anytype).
    • language (string): Optional field
    • region (string): Optional field

Note: Make sure to provide a key-value pair when making a call, setting the context value as {} will be considered as False value. For testing you can set value such as

 context: {"key": "example-key" }

Example input:

{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "key1": "value1",
    "key2": {
      "key2.1": "value2",
      "key2.2": "value3"
    }
  }
}
  • To target clients based on languages you can use key as language and it supports list of languages

Example input:

{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "language": "en"
  }
}
  • To target clients based on country you can use key as region and it supports list of countries

Example input:

{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "region": "US"
  }
}
  • To target client based on both language and country

Example input:

{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "language": "en",
    "region": "US"
  }
}
  • You can make your custom field to target too. Prepare what fields you want to be be able to target on, and then work backwards to construct it and populate a targeting context that will satisfy that. Example input:
{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "random_key": "random_value"
  }
}

Optional Query Parameter

nimbus_preview (boolean): Pass this as a query parameter to enable preview mode. When set to true, the endpoint will use the preview experiments to compute enrollments.

Example usage with nimbus_preview query parameter:

# v1 api
curl -X POST "http://localhost:8001/v1/features/?nimbus_preview=true" -H 'Content-Type: application/json' -d '{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "language": "en",
    "region": "US"
  }
}'
# v2 api
curl -X POST "http://localhost:8001/v2/features/?nimbus_preview=true" -H 'Content-Type: application/json' -d '{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "language": "en",
    "region": "US"
  }
}'

Output

V1 API Output

The output will be a JSON object where each feature is represented as a sub-object with its own set of variables.

Example output:

{
  "Feature1": {
    "Variable1.1": "valueA",
    "Variable1.2": "valueB"
  },
  "Feature2": {
    "Variable2.1": "valueC",
    "Variable2.2": "valueD"
  },
  "FeatureN": {
    "VariableN.1": "valueX",
    "VariableN.2": "valueY"
  }
}

V2 API Output

The output will be a JSON object with the following properties:

  • Features (object): An object that contains the set of features. Each feature is represented as a sub-object with its own set of variables.
  • Enrollments (array): An array of objects representing the client's enrollment into experiments. Each enrollment object contains details about the experiment, such as the experiment ID, branch, and type.

Example output:

{
  "Features": {
    "Feature1": { "Variable1.1": "valueA", "Variable1.2": "valueB" },
    "Feature2": { "Variable2.1": "valueC", "Variable2.2": "valueD" }
  },
  "Enrollments": [
    {
      "nimbus_user_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
      "app_id": "test_app_id",
      "experiment": "experiment-slug",
      "branch": "control",
      "experiment_type": "rollout",
      "is_preview": false
    }
  ]
}

Notes

  • This API only accepts POST requests.
  • All parameters should be supplied in the body as JSON.
  • v2 Endpoint: Returns both features and enrollments. Use this if you need detailed enrollment data.
  • Query Parameter: Use nimbus_preview=true to compute enrollments based on preview experiments.

Cirrus as a Service

Cirrus as a service allows your web application to integrate with Cirrus without managing its own infrastructure. The Nimbus team owns and operates the Cirrus service; client teams only need to define configuration and call the API.

You don't need to set Cirrus environment variables manually in .env files or application code. Instead, all required Cirrus values (such as CIRRUS_APP_ID, CIRRUS_URL, CIRRUS_CHANNEL, etc.) will be injected via your Helm chart configuration.

These values are maintained by the Nimbus team as part of shared infrastructure.

See configuration for an example of Helm values.

What the Helm Chart Configures

When you onboard your app with Cirrus, the Nimbus team will define the following for you in Helm:

  • CIRRUS_APP_ID: Unique identifier for your app (e.g. experimenter.cirrus)
  • CIRRUS_APP_NAME: Human-readable name for your app
  • CIRRUS_CHANNEL: Release channel (e.g. developer, staging, production)
  • CIRRUS_URL: Endpoint that your app will call to get features
  • CIRRUS_FML_PATH: Path to your Feature Manifest Language (FML) file
  • CIRRUS_REMOTE_SETTING_REFRESH_RATE_IN_SECONDS: How frequently Cirrus fetches updates from Remote Settings
    (e.g. 100 for stage, 180 for prod)
  • CIRRUS_GLEAN_MAX_EVENTS_BUFFER: Glean event buffer size
    (set to 1 for stage to help with QA, 100 for prod)
  • Autoscaling configuration based on your app’s request load
    (calculated as 10 req/s per container, targeting ~50% container utilization)

🌐 Cirrus API Behavior

Your app will call:

POST https://internal-.cirrus./<app_name>/v2/features/

Examples:

  • Stage:
    https://internal-stage.cirrus.nonprod.webservices.mozgcp.net/<app_name>/v2/features/

  • Prod:
    https://internal-prod.cirrus.prod.webservices.mozgcp.net/<app_name>/v2/features/

  • To enable preview mode, append the query param:
    ?nimbus_preview=true

Example Request Payload

{
  "client_id": "4a1d71ab-29a2-4c5f-9e1d-9d9df2e6e449",
  "context": {
    "language": "en",
    "region": "US"
  }
}

Cirrus responds with both Features and Enrollments. You can append ?nimbus_preview=true to opt into preview experiments.

Example Integration

See this pull request for a complete example: mozilla/experimenter#12972

This shows how Cirrus was integrated into the Experimenter app.