You are using Cloudhub 2 with Object Store V2. At intermittent times, you are seeing the error "java.lang.RuntimeException: java.net.UnknownHostException: auth.rtf.svc.cluster.local"
2026-05-01T02:41:35.54Z ERROR [6ht5m] AuthorizationManager event:1234-124532-2342343-23432 [MuleRuntime].uber.02: [my-apii].createSession.BLOCKING @112312 - there was an error communicating with core services X-ANYPNT-TRX-ID=1234-124532-2342343-23432
java.lang.RuntimeException: java.net.UnknownHostException: auth.rtf.svc.cluster.local: Name or service not known
at rx.exceptions.Exceptions.propagate(Exceptions.java:57)
at rx.singles.BlockingSingle.value(BlockingSingle.java:86)
at com.mulesoft.objectstore.client.api.authorization.AuthorizationManager.requestToken(AuthorizationManager.java:68)
at com.mulesoft.objectstore.client.api.authorization.AuthorizationManager.obtainToken(AuthorizationManager.java:53)
at com.mulesoft.objectstore.client.api.authorization.AuthorizationManager.<init>(AuthorizationManager.java:48)
at com.mulesoft.objectstore.client.builder.ObjectStoreClientBuilder.build(ObjectStoreClientBuilder.java:169)
at com.mulesoft.objectstore.cloud.api.internal.factory.ClientFactory.lambda$getObjectStoreClientWithComponentIdHeaders$0(ClientFactory.java:92)
at org.mule.runtime.api@1.11.3/org.mule.runtime.api.util.LazyValue.get(LazyValue.java:75)
at com.mulesoft.objectstore.cloud.api.CloudObjectStore.initializeIfNeeded(CloudObjectStore.java:102)
at com.mulesoft.objectstore.cloud.api.CloudObjectStore.doStore(CloudObjectStore.java:131)
at com.mulesoft.objectstore.cloud.api.AbstractPartitionableObjectStore.store(AbstractPartitionableObjectStore.java:80)
at com.mulesoft.objectstore.cloud.api.AbstractPartitionableObjectStore.store(AbstractPartitionableObjectStore.java:51)
at org.mule.extension.objectstore.api.ExtensionObjectStore.store(ExtensionObjectStore.java:248)
at org.mule.extension.objectstore.internal.ObjectStoreOperations.lambda$store$0(ObjectStoreOperations.java:111)
at org.mule.extension.objectstore.internal.ObjectStoreOperations.withLockedKey(ObjectStoreOperations.java:328)
at org.mule.extension.objectstore.internal.ObjectStoreOperations.store(ObjectStoreOperations.java:109)
at org.mule.extension.objectstore.internal.ObjectStoreOperations$store$MethodComponentExecutor_test_roster_rest_eapi.execute(Unknown Source)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.execution.GeneratedMethodComponentExecutor.execute(GeneratedMethodComponentExecutor.java:95)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.execution.CompletableMethodOperationExecutor.doExecute(CompletableMethodOperationExecutor.java:26)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.execution.AbstractCompletableMethodOperationExecutor.execute(AbstractCompletableMethodOperationExecutor.java:63)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.executeCommand(DefaultExecutionMediator.java:264)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.executeWithInterceptors(DefaultExecutionMediator.java:247)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.lambda$doExecute$2(DefaultExecutionMediator.java:156)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.lambda$new$0(DefaultExecutionMediator.java:78)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.withExecutionTemplate(DefaultExecutionMediator.java:344)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.doExecute(DefaultExecutionMediator.java:155)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.execute(DefaultExecutionMediator.java:147)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.executeOperation(ComponentMessageProcessor.java:586)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.prepareAndExecuteOperation(ComponentMessageProcessor.java:849)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.lambda$onEventSynchronous$16(ComponentMessageProcessor.java:488)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.onEventSynchronous(ComponentMessageProcessor.java:495)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.lambda$createOuterFlux$6(ComponentMessageProcessor.java:399)
at reactor.core@3.8.1/reactor.core.publisher.FluxPeekFuseable$PeekFuseableConditionalSubscriber.onNext(FluxPeekFuseable.java:490)
at reactor.core@3.8.1/reactor.core.publisher.FluxHandleFuseable$HandleFuseableConditionalSubscriber.onNext(FluxHandleFuseable.java:509)
at reactor.core@3.8.1/reactor.core.publisher.FluxPeekFuseable$PeekFuseableConditionalSubscriber.onNext(FluxPeekFuseable.java:504)
at org.mule.runtime.core@4.11.3/org.mule.runtime.core.privileged.processor.chain.AbstractMessageProcessorChain$2.onNext(AbstractMessageProcessorChain.java:764)
at org.mule.runtime.core@4.11.3/org.mule.runtime.core.privileged.processor.chain.AbstractMessageProcessorChain$2.onNext(AbstractMessageProcessorChain.java:759)
at reactor.core@3.8.1/reactor.core.publisher.FluxHide$SuppressFuseableSubscriber.onNext(FluxHide.java:137)
at reactor.core@3.8.1/reactor.core.publisher.FluxOnAssembly$OnAssemblySubscriber.onNext(FluxOnAssembly.java:540)
at reactor.core@3.8.1/reactor.core.publisher.FluxSubscribeOnValue$ScheduledScalar.run(FluxSubscribeOnValue.java:182)
at reactor.core@3.8.1/reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:76)
at reactor.core@3.8.1/reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:28)
at org.mule.runtime.core@4.11.3/org.mule.runtime.core.internal.processor.strategy.PreservingThreadContextExecutorServiceWrapper$DecoratedCallable.call(PreservingThreadContextExecutorServiceWrapper.java:406)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.mule.service.scheduler@1.11.3/org.mule.service.scheduler.internal.AbstractRunnableFutureDecorator.doRun(AbstractRunnableFutureDecorator.java:180)
at org.mule.service.scheduler@1.11.3/org.mule.service.scheduler.internal.RunnableFutureDecorator.run(RunnableFutureDecorator.java:56)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.net.UnknownHostException: auth.rtf.svc.cluster.local: Name or service not known
at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934)
at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543)
at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852)
at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533)
at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385)
at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306)
at io.netty.util.internal.SocketUtils$9.run(SocketUtils.java:169)
at io.netty.util.internal.SocketUtils$9.run(SocketUtils.java:166)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:569)
at io.netty.util.internal.SocketUtils.allAddressesByName(SocketUtils.java:166)
at io.netty.resolver.DefaultNameResolver.doResolveAll(DefaultNameResolver.java:50)
at io.netty.resolver.SimpleNameResolver.resolveAll(Sim
2026-05-01T02:41:35.541Z ERROR [6ht5m] AuthorizationManager event:1234-124532-2342343-23432[MuleRuntime].uber.02: [my-api].createSession.BLOCKING @1231231 - there was an error communicating with core services X-ANYPNT-TRX-ID=1234-124532-2342343-23432
java.lang.RuntimeException: java.net.UnknownHostException: auth.rtf.svc.cluster.local
at rx.exceptions.Exceptions.propagate(Exceptions.java:57)
at rx.singles.BlockingSingle.value(BlockingSingle.java:86)
at com.mulesoft.objectstore.client.api.authorization.AuthorizationManager.requestToken(AuthorizationManager.java:68)
at com.mulesoft.objectstore.client.api.authorization.AuthorizationManager.obtainToken(AuthorizationManager.java:53)
at com.mulesoft.objectstore.client.api.authorization.AuthorizationManager.<init>(AuthorizationManager.java:48)
at com.mulesoft.objectstore.client.builder.ObjectStoreClientBuilder.build(ObjectStoreClientBuilder.java:169)
at com.mulesoft.objectstore.cloud.api.internal.factory.ClientFactory.lambda$getObjectStoreClientWithComponentIdHeaders$0(ClientFactory.java:92)
at org.mule.runtime.api@1.11.3/org.mule.runtime.api.util.LazyValue.get(LazyValue.java:75)
at com.mulesoft.objectstore.cloud.api.CloudObjectStore.initializeIfNeeded(CloudObjectStore.java:102)
at com.mulesoft.objectstore.cloud.api.CloudObjectStore.doStore(CloudObjectStore.java:131)
at com.mulesoft.objectstore.cloud.api.AbstractPartitionableObjectStore.store(AbstractPartitionableObjectStore.java:80)
at com.mulesoft.objectstore.cloud.api.AbstractPartitionableObjectStore.store(AbstractPartitionableObjectStore.java:51)
at org.mule.extension.objectstore.api.ExtensionObjectStore.store(ExtensionObjectStore.java:248)
at org.mule.extension.objectstore.internal.ObjectStoreOperations.lambda$store$0(ObjectStoreOperations.java:111)
at org.mule.extension.objectstore.internal.ObjectStoreOperations.withLockedKey(ObjectStoreOperations.java:328)
at org.mule.extension.objectstore.internal.ObjectStoreOperations.store(ObjectStoreOperations.java:109)
at org.mule.extension.objectstore.internal.ObjectStoreOperations$store$MethodComponentExecutor_test_roster_rest_eapi.execute(Unknown Source)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.execution.GeneratedMethodComponentExecutor.execute(GeneratedMethodComponentExecutor.java:95)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.execution.CompletableMethodOperationExecutor.doExecute(CompletableMethodOperationExecutor.java:26)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.execution.AbstractCompletableMethodOperationExecutor.execute(AbstractCompletableMethodOperationExecutor.java:63)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.executeCommand(DefaultExecutionMediator.java:264)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.executeWithInterceptors(DefaultExecutionMediator.java:247)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.lambda$doExecute$2(DefaultExecutionMediator.java:156)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.lambda$new$0(DefaultExecutionMediator.java:78)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.withExecutionTemplate(DefaultExecutionMediator.java:344)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.doExecute(DefaultExecutionMediator.java:155)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.DefaultExecutionMediator.execute(DefaultExecutionMediator.java:147)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.executeOperation(ComponentMessageProcessor.java:586)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.prepareAndExecuteOperation(ComponentMessageProcessor.java:849)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.lambda$onEventSynchronous$16(ComponentMessageProcessor.java:488)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.onEventSynchronous(ComponentMessageProcessor.java:495)
at org.mule.runtime.extensions.support@4.11.3/org.mule.runtime.module.extension.internal.runtime.operation.ComponentMessageProcessor.lambda$createOuterFlux$6(ComponentMessageProcessor.java:399)
at reactor.core@3.8.1/reactor.core.publisher.FluxPeekFuseable$PeekFuseableConditionalSubscriber.onNext(FluxPeekFuseable.java:490)
at reactor.core@3.8.1/reactor.core.publisher.FluxHandleFuseable$HandleFuseableConditionalSubscriber.onNext(FluxHandleFuseable.java:509)
at reactor.core@3.8.1/reactor.core.publisher.FluxPeekFuseable$PeekFuseableConditionalSubscriber.onNext(FluxPeekFuseable.java:504)
at org.mule.runtime.core@4.11.3/org.mule.runtime.core.privileged.processor.chain.AbstractMessageProcessorChain$2.onNext(AbstractMessageProcessorChain.java:764)
at org.mule.runtime.core@4.11.3/org.mule.runtime.core.privileged.processor.chain.AbstractMessageProcessorChain$2.onNext(AbstractMessageProcessorChain.java:759)
at reactor.core@3.8.1/reactor.core.publisher.FluxHide$SuppressFuseableSubscriber.onNext(FluxHide.java:137)
at reactor.core@3.8.1/reactor.core.publisher.FluxOnAssembly$OnAssemblySubscriber.onNext(FluxOnAssembly.java:540)
at reactor.core@3.8.1/reactor.core.publisher.FluxSubscribeOnValue$ScheduledScalar.run(FluxSubscribeOnValue.java:182)
at reactor.core@3.8.1/reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:76)
at reactor.core@3.8.1/reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:28)
at org.mule.runtime.core@4.11.3/org.mule.runtime.core.internal.processor.strategy.PreservingThreadContextExecutorServiceWrapper$DecoratedCallable.call(PreservingThreadContextExecutorServiceWrapper.java:406)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.mule.service.scheduler@1.11.3/org.mule.service.scheduler.internal.AbstractRunnableFutureDecorator.doRun(AbstractRunnableFutureDecorator.java:180)
at org.mule.service.scheduler@1.11.3/org.mule.service.scheduler.internal.RunnableFutureDecorator.run(RunnableFutureDecorator.java:56)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.net.UnknownHostException: auth.rtf.svc.cluster.local
at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801)
at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533)
at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385)
at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306)
at io.netty.util.internal.SocketUtils$9.run(SocketUtils.java:169)
at io.netty.util.internal.SocketUtils$9.run(SocketUtils.java:166)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:569)
at io.netty.util.internal.SocketUtils.allAddressesByName(SocketUtils.java:166)
at io.netty.resolver.DefaultNameResolver.doResolveAll(DefaultNameResolver.java:50)
at io.netty.resolver.SimpleNameResolver.resolveAll(SimpleNameResolver.java:79)
at io.netty.resolver.SimpleNameResolver.resolveAll(SimpleNameResolver.java:71)
at org.asynchttpclient.resolver.RequestHostnameResolver.resolve(RequestHostnameResolver.java:50)
at org.asynchttpclient.netty.request.NettyRequestSender.resolveAddresses(NettyRequestSender.java:364)
at org
This setting 'persistentObjectStore' in the Object Store configuration should not be enabled for Cloudhub 2 apps. The purpose of this setting is only for RTF: https://docs.mulesoft.com/runtime-fabric/latest/persistence-gateway
Having that enabled in Cloudhub 2 will lead to that error "java.lang.RuntimeException: java.net.UnknownHostException: auth.rtf.svc.cluster.local". However, even if that box is "unchecked", your object store data will still be persisting after restart of your app. It is named in a confusing way, but its purpose is strictly for our RTF deployment.
005321569

We use three kinds of cookies on our websites: required, functional, and advertising. You can choose whether functional and advertising cookies apply. Click on the different cookie categories to find out more about each category and to change the default settings.
Privacy Statement
Required cookies are necessary for basic website functionality. Some examples include: session cookies needed to transmit the website, authentication cookies, and security cookies.
Functional cookies enhance functions, performance, and services on the website. Some examples include: cookies used to analyze site traffic, cookies used for market research, and cookies used to display advertising that is not directed to a particular individual.
Advertising cookies track activity across websites in order to understand a viewer’s interests, and direct them specific marketing. Some examples include: cookies used for remarketing, or interest-based advertising.