Skip to main content

General Settings

Organizations​

Organizations are used to manage access to workspaces, projects and organization settings. A user can create an organization, invite team members or accept invitations from other organizations.

The 'Organizations' tab, lists all organizations the user is a member of. For organizations owned by the user, the user can permanently delete the organization on this tab.

Creating an organization​

Creating an organization

This video is hosted on YouTube. Playing it may transfer data to YouTube and set cookies. Click 'Accept' below to accept and enable all YouTube videos on this site.

To create a new organization, click Add Organization, enter the organization name and click Save.

After the organization has been created, it is added to the organization list. The user who created the organization is assigned the Organization Owner role.

info

When no organization memberships are available yet, Orangebeard shows an empty state with options to create an organization or accept an invitation.

Deleting an organization​

To permanently delete an organization, click Delete for the organization and confirm the deletion.

warning

Caution: Deleting an organization is immediate and irreversible! All projects, test results, test sets and workspaces in the organization will be lost and unrecoverable after the organization is deleted.

Subscriptions​

On the Subscriptions tab, organization owners can manage the subscriptions of their organizations.
For each subscription, the organization owner can:

  • View the subscription details
  • Update the subscription details
  • Cancel the subscription

When a subscription is downgraded to a smaller plan, changes take effect at the start of the next subscription cycle. When upgrading to a larger plan, the higher limits will be effective immediately.

Pending invitations​

When a user has been invited to an organization, the invitation is shown on this tab.

Accepting an invitation

This video is hosted on YouTube. Playing it may transfer data to YouTube and set cookies. Click 'Accept' below to accept and enable all YouTube videos on this site.

Open the Pending Invitations tab to view the invitation.

The invitation shows:

  • The organization name
  • The assigned organization role
  • The projects included in the invitation

Click Accept to join the organization.

After accepting the invitation, the invitation is removed from the pending invitations list and the organization is added to the Organizations tab.

info

If there are no pending invitations, Orangebeard shows an empty state. Contact the organization owner or an administrator to request an invitation.

Listener Token​

The listener token is a unique, user-bound token that allows authenticated users to report test results to the listener API.
A listener token can be regenerated from here, after which the old token will no longer allow access to the listener API on the user's behalf.

warning

Make sure to keep listener tokens private! Treat them like passwords: never share them or commit them to a repository. To use a listener token in a CI pipeline, store it as a secret and inject it the way your CI tooling prescribes.

User Preferences​

Using the User Preferences tab, the following settings can be configured:

  • Workspace overview timespan: Configure the default timespan setting for workspace overviews. This setting can be overridden for the duration of the current session by selecting a different value from the timespan dropdown on the workspace overview page.
  • Project overview timespan: Configure the default timespan setting for project overviews. This setting can be overridden for the duration of the current session by selecting a different value from the timespan dropdown on the project overview page.
  • Display Workspace statistics: Configures what statistics are displayed on workspace overviews. Options are:
    • Runs - Display pass/fail statistics for all testsets within the selected timespan.
    • Sets - Display pass/fail statistics for all testruns within the selected timespan.
    • Both - Display both (default setting).
  • Hide testcase count donuts on project overview: When this setting is enabled, no test case count donut is displayed on project overview cards. Only the donut for defect types (failures) will be displayed if applicable.
  • Hide status labels for passed sets on project overview : When this setting is enabled, test sets that have a status PASSED will not have a textual label on the project overview cards.
  • Default landing page: Sets whether the default home page is the project overview or the test results page.

Prompts​

The Prompts tab allows quick prompts to be configured for AI Support. Quick prompts can be used to start common assistant actions with a single click.

Configuring quick prompts

This video is hosted on YouTube. Playing it may transfer data to YouTube and set cookies. Click 'Accept' below to accept and enable all YouTube videos on this site.

Prompt Management​

The prompt management overview contains:

  • Prompt list: Shows the available prompts.
  • Search prompt: Filters the prompt list by name.
  • Add Prompt: Creates a new prompt.
  • Prompt details: Shows the selected prompt configuration.

Creating a prompt​

Click Add Prompt to create a new prompt.

The following fields can be configured:

  • Title: The name of the prompt.
  • Description: Optional description of what the prompt is used for.
  • Prompt: The prompt text that is sent to the assistant.
  • Shared: Makes the prompt available to other users.

Click Save to store the prompt.

After the prompt has been saved, it is shown in the prompt list.

Writing a prompt​

Using the Prompt tab, users can create and share quick prompts for the assistant. Quick prompts are used to start common assistant actions with a single click.

Prompts can contain instructions for the assistant, such as the task(s) to perform, the expected output format, analysis steps or classification rules.

For example, a quick prompt could be used for a structured analysis of test results:

Analyze the failed test or tests in this run following structured steps:

- Summarize the test and give a clear, concise overview of the actions performed, test data used and any errors that occurred.
- Determine if the test failed deterministically or due to flakiness. Use attached screenshots, the preceding test in the same 
  run and history (if available) as context.
- If a work item identification is present, use the configured GitHub tools to verify intent, source code or diffs.
- Explain if the problem is an automation issue, product bug or system issue (for environment or data problems)
- Provide a confidence score (percentage) for your analysis

As follow-up: offer to write a defect report.

Sharing a prompt​

Enable the Shared toggle to make the prompt available to other users within the active organization. Shared prompts can be used as quick prompts in AI Support by anyone in the organization.

When a prompt is not shared, it is only available to the user who created it.

Adding a prompt to quick prompts​

Click the bookmark icon next to a prompt to add it to quick prompts. When a prompt has been added, the bookmark icon is highlighted and a confirmation message is shown.

Click the bookmark icon again to remove the prompt from quick prompts.

Using a quick prompt​

Open AI Support from a test result page.

Available quick prompts are shown as buttons in the assistant window. Click a quick prompt to send that prompt to the assistant.
The assistant uses the selected prompt together with the available test result context, such as steps, logs, stack traces and attachments.

API Docs​

All of our APIs publish their respective Swagger documentation in the API tab in the admin panel for maximum transparency.

info

Only the listener API can be accessed using the user's listener token. The other APIs have 2 types of endpoints: /ui/* and /api/*. Only the UI endpoints are accessible to the user, using the user's KeyCloak login token.

API summaries​

The test results API holds all test output of test runs that have finished.

Ask Orangebeard