Loading
Salesforce now sends email only from verified domains. Read More
Ongoing maintenance for Salesforce HelpRead More
Set Up and Maintain Retail Execution
Table of Contents
Filter by (0)Add
Select Filters

          No results
          No results
          Here are some search tips

          Check the spelling of your keywords.
          Use more general search terms.
          Select fewer filters to broaden your search.

            Search all of Salesforce Help
            Search all of Salesforce Help
            Accelerated Hands-Free Field Execution With Speech-to-Text Integration

            You are here:

            1. Salesforce Help
            2. Docs
            3. Set Up and Maintain Retail Execution

            Accelerated Hands-Free Field Execution With Speech-to-Text Integration

            Give your sales reps a hands-free experience by configuring voice-driven scenarios in the Consumer Goods Cloud mobile app. Sales reps can use their voice to capture survey data, take notes, and update orders while online.

            Required Editions

            Available in: Lightning Experience

            Available in: Agentforce 1, Einstein 1, Enterprise, and Unlimited editions with Consumer Goods Cloud Retail Execution and Agentforce for Consumer Goods Cloud add-on licenses.

            Admins can create seamless voice-driven workflows by setting up APIs in the mobile app customization layer using the Visual Studio Code based Modeler. By orchestrating these APIs, you can design workflows that transcribe verbal requests into structured, AI-driven actions. The Speech-to-Text API captures the user’s voice and converts it into text, which can be then passed to the Prompt Template API for further processing.

            For these configurations to function, the mobile device must be online, and the Integrate Agentforce setting in the Consumer Goods mobile app sync setting must be enabled.

            The key configuration components are:

            • Verify network: Use DeviceManager.isOnlineAsync() to check connectivity. Since the promptTemplateAsync API requires an internet connection, use this check to disable voice features when the device is offline to prevent errors and ensure a smooth user experience.
            • Check Agentforce availability: Use Facade.isAgentForceAvailable() to confirm that the Agentforce feature is active.
            • Capture input (Speech-to-Text): Use launchSpeechToTextAsync() to integrate the native speech-to-text interface. This function captures the user’s spoken words and returns the transcribed text to the application logic, ready to be used as a parameter.
            • Process intent (Prompt Template): Use Facade.executePromptTemplateAsync to connect to Salesforce and retrieve the AI-generated response by sending the inputs to a specific prompt template. The API handles the communication, but customizers should define the business logic to consume the response that is received— for example, capturing data or dynamically querying the system. This functionality is supported on Android, iOS, and the Modeler simulator.
            • Considerations for Speech To Text Integration
              Review these important considerations for setting up speech-to-text. These include changing session limits and silence detection, designing the user interface and theme, stopping sessions automatically, handling errors, and setting up offline language packs.
             
            Loading
            Salesforce Help | Article