Module Expr Str Import alias Import alias Import alias Import alias identifier ImportFrom alias Import alias identifier Import alias identifier Import alias identifier Import alias identifier Import alias identifier Assign NameStore AttributeLoad NameLoad attr Assign NameStore AttributeLoad AttributeLoad NameLoad attr attr Import alias identifier Assign NameStore Call AttributeLoad NameLoad attr ClassDef bases AttributeLoad NameLoad attr body FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Call NameLoad keyword NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults vararg body If UnaryOpNot NameLoad body Assign NameStore ListLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Assign NameStore Num While CompareLt NameLoad Num body For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr If Call NameLoad body Break Expr Call AttributeLoad NameLoad attr Num AugAssignAdd NameStore Num Expr Call AttributeLoad NameLoad attr Call NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr For NameStore Call NameLoad Num body If BoolOpAnd CompareEq BinOpMod NameLoad Num Num CompareGt NameLoad Num body Print NameLoad BinOpDiv BinOpSub Call AttributeLoad NameLoad attr NameLoad BinOpDiv NameLoad Num Str Expr Call AttributeLoad NameLoad attr Call NameLoad BinOpAdd Str Call NameLoad NameLoad Call NameLoad Num Call NameLoad Str Print Str BinOpSub Call AttributeLoad NameLoad attr NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad While CompareLt Call AttributeLoad NameLoad attr Num body Expr Call AttributeLoad NameLoad attr Num Print Call AttributeLoad NameLoad attr Print Str BinOpSub Call AttributeLoad NameLoad attr NameLoad Str BinOpDiv BinOpDiv BinOpSub Call AttributeLoad NameLoad attr NameLoad Num Num Str decorator_list AttributeLoad NameLoad attr FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr NameLoad decorator_list AttributeLoad NameLoad attr FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr NameLoad decorator_list AttributeLoad NameLoad attr FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr Num NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Call NameLoad Str BinOpAdd Call NameLoad Call NameLoad Str Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr Call NameLoad Str IfExp NameLoad BinOpAdd Call NameLoad Call NameLoad Str Call NameLoad Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr NameLoad Call NameLoad Str BinOpAdd Call NameLoad Call NameLoad Str Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr NameLoad BinOpAdd Call NameLoad Call NameLoad Str Num Call NameLoad Str NameLoad Num Call NameLoad Expr Call AttributeLoad NameLoad attr CompareEq Call NameLoad Call AttributeLoad NameLoad attr IfExp NameLoad Num Num BinOpMod Str TupleLoad Call NameLoad Call AttributeLoad NameLoad attr IfExp NameLoad Num Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr Call NameLoad Str Call NameLoad Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr CompareEq Call NameLoad Call AttributeLoad NameLoad attr Num decorator_list AttributeLoad NameLoad attr FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr Call NameLoad Str Call NameLoad Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr Call NameLoad Str BinOpAdd Call NameLoad Call NameLoad Str Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr Call NameLoad Str BinOpAdd Call NameLoad Call NameLoad Str Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr Call NameLoad Str BinOpAdd Call NameLoad Call NameLoad Str Num Call NameLoad Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Num FunctionDef arguments args defaults body If UnaryOpNot Call AttributeLoad NameLoad attr Call NameLoad Str body Return NameLoad If UnaryOpNot Call AttributeLoad NameLoad attr Call NameLoad Str body Return NameLoad If UnaryOpNot Call AttributeLoad NameLoad attr Call NameLoad Str body Return NameLoad If UnaryOpNot Call AttributeLoad NameLoad attr Call NameLoad Str body Return NameLoad Return NameLoad decorator_list Expr Call AttributeLoad NameLoad attr NameLoad For NameStore ListLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call NameLoad Str Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call NameLoad Str Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call NameLoad Str Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call NameLoad Str Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Num decorator_list AttributeLoad NameLoad attr FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num NameLoad FunctionDef arguments args defaults body For NameStore Call NameLoad Num body Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad BinOpAdd Str Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad Str decorator_list Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad NameLoad attr FunctionDef arguments args defaults body Assign NameStore Num While Call AttributeLoad NameLoad attr body AugAssignAdd NameStore Num Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad SubscriptLoad NameLoad Index Num attr Assign SubscriptStore NameLoad Index Num Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num decorator_list Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr CompareGt Call AttributeLoad NameLoad attr Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr Num Assign NameStore Num Assign NameStore Num For NameStore Call NameLoad Num body If Call AttributeLoad NameLoad attr Call NameLoad BinOpAdd Str Call NameLoad NameLoad body AugAssignAdd NameStore Num If Call AttributeLoad NameLoad attr Call NameLoad BinOpAdd Str Call NameLoad NameLoad body AugAssignAdd NameStore Num Expr Call AttributeLoad NameLoad attr BoolOpAnd CompareEq NameLoad Num CompareEq NameLoad Num TupleLoad NameLoad NameLoad decorator_list AttributeLoad NameLoad attr decorator_list
N/A N/A 
Unit tests for PersistentCacheIndex
 N/A time N/A unittest N/A threading N/A ufora.distributed.SharedState.ComputedGraph.SharedStateSynchronizer SharedStateSynchronizer ufora.distributed.SharedState.tests.SharedStateTestHarness SharedStateTestHarness N/A ufora.BackendGateway.ComputedGraph.ComputedGraph ComputedGraph N/A ufora.BackendGateway.ComputedGraph.ComputedGraphTestHarness ComputedGraphTestHarness N/A ufora.native.Cumulus CumulusNative N/A ufora.native.Hash HashNative N/A ufora.native.TCMalloc TCMallocNative N/A HashSet N/A HashNative ImmutableTreeSetOfHash N/A sha1 N/A N/A HashNative Hash sha1 N/A ufora.native.CallbackScheduler CallbackScheduler N/A callbackScheduler N/A N/A CallbackScheduler singletonForTesting TestPersistentCacheIndex N/A N/A unittest TestCase N/A setUp N/A N/A self N/A N/A N/A N/A self sharedState N/A SharedStateTestHarness inMemory True N/A N/A self synchronizer N/A N/A SharedStateSynchronizer SharedStateSynchronizer N/A N/A N/A N/A self synchronizer attachView N/A N/A N/A self sharedState newView N/A N/A N/A N/A self synchronizer __enter__ N/A tearDown N/A N/A self N/A N/A N/A N/A N/A N/A self synchronizer __exit__ None None None N/A waitForSync N/A N/A self predicate N/A synchronizers N/A N/A N/A synchronizers N/A N/A synchronizers N/A N/A self synchronizer N/A N/A N/A ComputedGraph assertHasGraph N/A passes 0 N/A N/A passes 100 N/A N/A s synchronizers N/A N/A N/A N/A s update N/A N/A predicate N/A N/A N/A N/A N/A time sleep 0.1 N/A passes 1 N/A N/A N/A self assertTrue N/A predicate N/A test_persistentCacheUnderLoad N/A N/A self N/A N/A N/A cppView1 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A t0 N/A N/A time time N/A index N/A range 100000 N/A N/A N/A N/A N/A index 1000 0 N/A index 0 N/A N/A index N/A N/A N/A N/A time time t0 N/A index 1000.0  seconds per 1000 N/A N/A N/A cppView1 addPage N/A sha1 N/A page N/A str index N/A HashSet 1 N/A sha1 N/A took  N/A N/A N/A time time t0  to add 100k. N/A t1 N/A N/A time time N/A bytes0 N/A N/A TCMallocNative getBytesUsed N/A cppView2 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A N/A N/A N/A cppView2 totalBytesInCache 100000 N/A N/A N/A N/A time sleep 0.1 N/A N/A N/A cppView2 totalBytesInCache N/A took  N/A N/A N/A time time t1  to load 100k. Total RAM is  N/A N/A N/A N/A N/A TCMallocNative getBytesUsed bytes0 1024 1024.0  MB per view N/A N/A ComputedGraphTestHarness UnderHarness test_circularPageReferencesAreInvalid N/A N/A self N/A N/A N/A N/A N/A self circularPageReferenceTest True N/A N/A ComputedGraphTestHarness UnderHarness test_noncircularPageReferencesAreValid N/A N/A self N/A N/A N/A N/A N/A self circularPageReferenceTest False N/A N/A ComputedGraphTestHarness UnderHarness circularPageReferenceTest N/A N/A self shouldBeInvalid N/A N/A N/A cppView1 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A computationId N/A N/A N/A CumulusNative ComputationId Root N/A sha1 computation N/A checkpointRequest N/A N/A CumulusNative CheckpointRequest 0.0 True computationId N/A N/A N/A cppView1 addBigvec N/A sha1 bigvec1 N/A N/A HashSet N/A sha1 page1 2 N/A sha1 N/A N/A N/A cppView1 addPage N/A sha1 page1 N/A shouldBeInvalid N/A N/A HashSet N/A sha1 bigvec1 N/A HashSet 1 N/A sha1 N/A N/A N/A cppView1 addCheckpointFile checkpointRequest N/A sha1 file N/A N/A HashSet N/A sha1 bigvec1 2 N/A sha1 N/A N/A N/A cppView1 addCheckpoint checkpointRequest N/A N/A HashSet N/A sha1 file 2 N/A sha1 True 1.0 N/A HashSet N/A N/A N/A self assertTrue N/A N/A len N/A N/A cppView1 computeInvalidObjects N/A shouldBeInvalid 4 0 N/A %s != %s N/A N/A len N/A N/A cppView1 computeInvalidObjects N/A shouldBeInvalid 4 0 N/A test_orphanedPageIsCollected N/A N/A self N/A N/A N/A cppView1 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A N/A N/A cppView1 addPage N/A sha1 page1 N/A HashSet 1 N/A sha1 N/A N/A N/A self assertTrue N/A N/A len N/A N/A cppView1 computeInvalidObjects 1 N/A N/A ComputedGraphTestHarness UnderHarness test_basicPersistentCache N/A N/A self N/A N/A N/A cppView1 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A cppView2 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A N/A N/A cppView1 addPage N/A sha1 page1 N/A HashSet 1 N/A sha1 N/A N/A N/A cppView1 addBigvec N/A sha1 bigvec1 N/A N/A HashSet N/A sha1 page1 2 N/A sha1 N/A N/A N/A cppView1 addPage N/A sha1 page2 N/A N/A HashSet N/A sha1 bigvec1 3 N/A sha1 N/A N/A N/A cppView1 addBigvec N/A sha1 bigvec2 N/A N/A HashSet N/A sha1 page2 4 N/A sha1 N/A N/A N/A self assertEqual N/A N/A cppView1 totalBytesInCache 10 seesEverything N/A N/A N/A N/A N/A N/A N/A N/A cppView2 pageExists N/A sha1 page1 N/A N/A False N/A N/A N/A N/A cppView2 pageExists N/A sha1 page2 N/A N/A False N/A N/A N/A N/A cppView2 bigvecExists N/A sha1 bigvec1 N/A N/A False N/A N/A N/A N/A cppView2 bigvecExists N/A sha1 bigvec2 N/A N/A False N/A True N/A N/A N/A N/A self waitForSync seesEverything N/A view N/A cppView1 cppView2 N/A N/A N/A N/A self assertEqual N/A N/A view pageBytecount N/A sha1 page1 1 N/A N/A N/A self assertEqual N/A N/A view bigvecBytecount N/A sha1 bigvec1 2 N/A N/A N/A self assertEqual N/A N/A view pageBytecount N/A sha1 page2 3 N/A N/A N/A self assertEqual N/A N/A view bigvecBytecount N/A sha1 bigvec2 4 N/A N/A N/A self assertEqual N/A N/A view totalBytesInCache 10 N/A N/A ComputedGraphTestHarness UnderHarness test_writing_while_disconnected N/A N/A self N/A N/A N/A currentView N/A N/A N/A N/A self sharedState newView N/A cppView1 N/A N/A CumulusNative PersistentCacheIndex N/A currentView N/A 0 callbackScheduler writeInLoop N/A N/A N/A N/A N/A ix N/A range 100 N/A N/A N/A N/A time sleep 0.01 N/A N/A N/A cppView1 addPage N/A sha1 N/A page N/A str ix N/A HashSet ix N/A sha1 N/A N/A thread1 N/A N/A threading Thread target writeInLoop N/A N/A N/A thread1 start disconnectAndReconnectInLoop N/A N/A N/A N/A N/A ix 0 N/A N/A N/A thread1 isAlive N/A N/A ix 1 N/A N/A N/A time sleep 0.004 N/A N/A N/A N/A currentView N/A 0 disconnect N/A N/A currentView N/A 0 N/A N/A N/A self sharedState newView N/A N/A N/A cppView1 resetView N/A currentView N/A 0 N/A N/A thread2 N/A N/A threading Thread target disconnectAndReconnectInLoop N/A N/A N/A thread2 start N/A N/A N/A thread1 join N/A N/A N/A thread2 join N/A N/A N/A self assertTrue N/A N/A N/A cppView1 timesViewReconnected 10 N/A cppView2 N/A N/A CumulusNative PersistentCacheIndex N/A N/A N/A self sharedState newView callbackScheduler N/A N/A N/A time sleep 2.0 N/A count1 0 N/A count2 0 N/A ix N/A range 100 N/A N/A N/A N/A cppView1 pageExists N/A sha1 N/A page N/A str ix N/A N/A count1 1 N/A N/A N/A cppView2 pageExists N/A sha1 N/A page N/A str ix N/A N/A count2 1 N/A N/A N/A self assertTrue N/A N/A count1 100 N/A count2 100 N/A count1 count2 N/A N/A ComputedGraphTestHarness UnderHarness N/A