Loading
About Salesforce Data 360
Table of Contents
Filter by (0)Add
Select Filters

          No results
          No results
          Here are some search tips

          Check the spelling of your keywords.
          Use more general search terms.
          Select fewer filters to broaden your search.

            Search all of Salesforce Help
            Search all of Salesforce Help
            Test a Retriever in Retriever Playground

            You are here:

            1. Salesforce Help
            2. Docs
            3. Data 360

            Test a Retriever in Retriever Playground

            Test a retriever configuration to ensure accurate responses from your AI agents. Save retriever configurations as new versions of the retriever in AI Models (formerly Einstein Studio) and activate them for use in agents with prompt templates, Flow, and applications.

            Required Editions

            Available in: All Editions supported by Data 360. See Data 360 edition availability.
            User Permissions Needed
            To manage retrievers or versions in AI Models (create, edit, test, and delete)

            Allow users to manage models in AI Models

            OR

            Data Cloud Architect Permission Set
            To access data with retrievers

            For the Knowledge object, make sure that the user has read access to the object and has the App Permission: Allow View Knowledge

            For all other standard objects, make sure that the user has read access to the object and appropriate sharing rules. For more information see, Set Your Internal Organization-Wide Sharing Defaults.

            Configure Retriever

            Customize your retriever configuration with filter conditions and expected results.

            1. In AI Models on the Retrievers tab, select Test Retriever. Alternatively, select Test Retriever from the drop-down action menu.
              You can select only active individual retrievers to test. You can't test default retrievers that were automatically created.
            2. Select a mode for testing the retriever. In the basic mode, the retriever playground returns a source recall score and a response time. In the advanced mode, the playground returns an AI-generated context recall score based on an expected answer to a test question. For more information on metrics, see, Retriever Metrics and Results.
            3. Select a retriever that you want to test and validate.
              When you search for retrievers, only active retrievers are listed. The retriever configuration panel displays the search index and retriever details for review.
            4. Include all records or filter records that meet conditions to customize retriever configuration. Configure up to ten filter conditions for retrieval of records based on filter conditions.
              For example, define simple filter conditions such as "document published date is after 2022" or " Company name is equal to Salesforce".
              To select field values at runtime define dynamic filter condtions. For example, to select a car make and model at run time for questions about car mileage, define filter conditions such as, 1. Make Equal to {!$Make} and 2. Model Equal To {!$Model}.
              Select the conditional logic to use filters when all conditions are met, any condition is met, or custom conditional logic is met. For example, with the test question about car mileage, add a third condition, 3. ModelYear greater than 2000. You can configure a custom condition where conditions 1 AND (2 OR 3) are met.
            5. Modify the number of results you want the retriever to return.
              If the results to a question do not include the expected response, increase the number of results returned.
            6. Customize the fields returned by the retriever by adding or removing existing fields.
              Note
              Note The retriever returns these new fields when you save the configuration and use it with agents.

            Test Your Retriever

            Configure test data and enter a natural language query to test your retriever. Test data is the desired source from where the correct answer is expected.

            1. To test your retriever responses from expected sources, select Configure Test Data.
            2. Select data model object records if you know which records contain the response or select an expected response.

              For hybrid search retrievers with keyword matches, select test data by expected response or data model object records. Otherwise, you can only select by data model object records. Select data model object records if you know which records contain the response to your test question. Select records based on an expected response if you know what your response should include, such as, for a question related to paid time-off, you can enter “PTO or Time-off”.

            3. Optionally, in the Test Retriver panel, enter dynamic filter values.
            4. Ask a test question. In the advanced mode, you can test your retriever responses based on an expected answer to the test question.
              After you run your test, the Test Retriever panel displays the number of documents retrieved by the retriever.

            In the Results panel, review the overlap between the top chunks returned by the retriever and the test data chunks. Customize retriever configuration with your test data to get the optimal response. Save tested configurations as new versions.

             
            Loading
            Salesforce Help | Article