Repository: dotnet/orleans

Issue #4721: ServiceId_SiloRestart fails intermittently
Created: 2018-06-28T20:48:36Z
Orleans.Runtime.OrleansLifecycleCanceledException : Lifecycle start canceled due to errors at stage 19999
2018-06-28T18:46:13.4380282Z       ---- System.TimeoutException : MembershipOracle activating failed due to timeout 00:05:00
2018-06-28T18:46:13.4390296Z       Stack Trace:
2018-06-28T18:46:13.4400270Z         D:\build\agent2_work\13\s\src\Orleans.Core\Lifecycle\LifecycleSubject.cs(63,0): at Orleans.LifecycleSubject.d__5.MoveNext()
2018-06-28T18:46:13.4410272Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4420308Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4430311Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4440267Z         D:\build\agent2_work\13\s\src\Orleans.Runtime\Scheduler\ClosureWorkItem.cs(67,0): at Orleans.Runtime.Scheduler.AsyncClosureWorkItem.d__8.MoveNext()
2018-06-28T18:46:13.4450349Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4460312Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4470268Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4480310Z         D:\build\agent2_work\13\s\src\Orleans.Runtime\Silo\Silo.cs(272,0): at Orleans.Runtime.Silo.d__64.MoveNext()
2018-06-28T18:46:13.4490358Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4500269Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4520274Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4530310Z         D:\build\agent2_work\13\s\src\Orleans.TestingHost\InProcessSiloHandle.cs(36,0): at Orleans.TestingHost.InProcessSiloHandle.Create(String siloName, IList1 configurationSources) 2018-06-28T18:46:13.4540301Z         D:\build\agent2\_work\13\s\src\Orleans.TestingHost\TestCluster.cs(523,0): at Orleans.TestingHost.TestCluster.StartOrleansSilo(Int32 instanceNumber, TestClusterOptions clusterOptions, IReadOnlyList1 configurationOverrides, Boolean startSiloOnNewPort)
2018-06-28T18:46:13.4550314Z         D:\build\agent2_work\13\s\src\Orleans.TestingHost\TestCluster.cs(419,0): at Orleans.TestingHost.TestCluster.RestartSilo(SiloHandle instance)
2018-06-28T18:46:13.4560208Z         D:\build\agent2_work\13\s\test\TesterInternal\StreamProvidersTests.cs(90,0): at UnitTests.Streaming.StreamProvidersTests_ProviderConfigNotLoaded.<ServiceId_SiloRestart>d__9.MoveNext()
2018-06-28T18:46:13.4570308Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4580241Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4590278Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4600348Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4610265Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4630367Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4640374Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4650422Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4660310Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4670239Z         ----- Inner Stack Trace -----
2018-06-28T18:46:13.4680201Z         D:\build\agent2_work\13\s\src\Orleans.Core\Async\TaskExtensions.cs(225,0): at Orleans.OrleansTaskExtentions.d__16.MoveNext()
2018-06-28T18:46:13.4690294Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4700308Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4710156Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4720307Z         D:\build\agent2_work\13\s\src\Orleans.Runtime\Silo\Silo.cs(525,0): at Orleans.Runtime.Silo.<g__BecomeActive|72_1>d.MoveNext()
2018-06-28T18:46:13.4730269Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4740231Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4761713Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4770267Z         D:\build\agent2_work\13\s\src\Orleans.Runtime\Silo\Silo.cs(393,0): at Orleans.Runtime.Silo.d__69.MoveNext()
2018-06-28T18:46:13.4780337Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4790334Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4800336Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4820323Z         D:\build\agent2_work\13\s\src\Orleans.Runtime\Silo\Silo.cs(527,0): at Orleans.Runtime.Silo.d__72.MoveNext()
2018-06-28T18:46:13.4830308Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4840265Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4850267Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4860281Z         D:\build\agent2_work\13\s\src\Orleans.Runtime\Lifecycle\SiloLifecycleSubject.cs(82,0): at Orleans.Runtime.SiloLifecycleSubject.MonitoredObserver.d__9.MoveNext()
2018-06-28T18:46:13.4870306Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4880348Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4890265Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4900353Z         D:\build\agent2_work\13\s\src\Orleans.Core\Lifecycle\LifecycleSubject.cs(115,0): at Orleans.LifecycleSubject.d__10.MoveNext()
2018-06-28T18:46:13.4910389Z         --- End of stack trace from previous location where exception was thrown ---
2018-06-28T18:46:13.4920300Z            at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2018-06-28T18:46:13.4930325Z            at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2018-06-28T18:46:13.4940265Z         D:\build\agent2_work\13\s\src\Orleans.Core\Lifecycle\LifecycleSubject.cs(55,0): at Orleans.LifecycleSubject.d__5.MoveNext()

Duplicate issue #4997: ServiceId_SiloRestart test fails intermittently
Created: 2018-09-17T22:04:24Z
UnitTests.Streaming.StreamProvidersTests_ProviderConfigNotLoaded.ServiceId_SiloRestart fails intermittently
MESSAGE:
Orleans.Runtime.OrleansLifecycleCanceledException : Lifecycle start canceled due to errors at stage 19999\r\n---- System.TimeoutException : MembershipOracle activating failed due to timeout 00:05:00
+++++++++++++++++++
STACK TRACE:
at Orleans.LifecycleSubject.d__5.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Core\Lifecycle\LifecycleSubject.cs:line 63 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.Runtime.Scheduler.AsyncClosureWorkItem.d__8.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Runtime\Scheduler\ClosureWorkItem.cs:line 63 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.Runtime.Silo.d__65.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Runtime\Silo\Silo.cs:line 274 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.TestingHost.InProcessSiloHandle.Create(String siloName, IList1 configurationSources) in D:\j\workspace\functional_pr---83d31c72\src\Orleans.TestingHost\InProcessSiloHandle.cs:line 36 at Orleans.TestingHost.TestCluster.StartOrleansSilo(Int32 instanceNumber, TestClusterOptions clusterOptions, IReadOnlyList1 configurationOverrides, Boolean startSiloOnNewPort) in D:\j\workspace\functional_pr---83d31c72\src\Orleans.TestingHost\TestCluster.cs:line 521 at Orleans.TestingHost.TestCluster.RestartSilo(SiloHandle instance) in D:\j\workspace\functional_pr---83d31c72\src\Orleans.TestingHost\TestCluster.cs:line 419 at UnitTests.Streaming.StreamProvidersTests_ProviderConfigNotLoaded.<ServiceId_SiloRestart>d__9.MoveNext() in D:\j\workspace\functional_pr---83d31c72\test\TesterInternal\StreamProvidersTests.cs:line 92 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) ----- Inner Stack Trace ----- at Orleans.OrleansTaskExtentions.d__16.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Core\Async\TaskExtensions.cs:line 0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.Runtime.Silo.<g__BecomeActive|73_1>d.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Runtime\Silo\Silo.cs:line 527 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.Runtime.Silo.d__70.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Runtime\Silo\Silo.cs:line 395 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.Runtime.Silo.d__73.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Runtime\Silo\Silo.cs:line 529 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.Runtime.SiloLifecycleSubject.MonitoredObserver.d__9.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Runtime\Lifecycle\SiloLifecycleSubject.cs:line 82 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Orleans.LifecycleSubject.d__10.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Core\Lifecycle\LifecycleSubject.cs:line 115 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at Orleans.LifecycleSubject.d__5.MoveNext() in D:\j\workspace\functional_pr---83d31c72\src\Orleans.Core\Lifecycle\LifecycleSubject.cs:line 55

Closing comment (2018-12-03T22:01:20Z): Duplicate of #4721