abstract: mobility patterns, agent based models, memory, foraging behaviour, search processes, random media Thanks to recent technological advances, it is now possible to track with an unprecedented precision and for long periods of time the movement patterns of many living organisms in their habitat. The increasing amount of data available on single trajectories offers the possibility of understanding how animals move and of testing basic movement models. Random walks have long represented the main description for micro-organisms and have also been useful to understand the foraging behaviour of large animals. Nevertheless, most vertebrates, in particular humans and other primates, rely on sophisticated cognitive tools such as spatial maps, episodic memory and travel cost discounting. These properties call for other modeling approaches of mobility patterns. We propose a foraging framework where a learning mobile agent uses a combination of memory-based and random steps. We investigate how advantageous it is to use memory for exploiting resources in heterogeneous and changing environments. An adequate balance of determinism and random exploration is found to maximize the foraging efficiency and to generate trajectories with an intricate spatio-temporal order, where travel routes emerge without multi-step planning. Based on this approach, we propose some tools for analysing the non-random nature of mobility patterns in general.
author: Denis Boyer $^{1,2}$ and Peter D. Walsh $^{3}$
title: Modeling the mobility of living organisms in heterogeneous landscapes:
  Does memory improve foraging success?

# Introduction

The literature on the movement of mobile agents has long been dominated by random walk models in which movement decisions are first order Markovian or with rapidly decaying correlations: that is, based entirely on conditions that are proximate in time and local in space. This approach has been extraordinarily successful in describing the behaviour of everything from microscopic particles to simple organisms such as insects and bacteria (Turchin 1998; Colding *et al.* 2008). Extensions of random walk models beyond Brownian motion, for instance to processes governed by steps and/or waiting times with heavy-tailed distributions (Shlesinger $\&$ Klafter 1986), have also been used to describe the displacements of microzooplankton (Bartumeus *et al.* 2003), spider monkeys (Ramos-Fernández *et al.* 2004), marine predators (Sims *et al.* 2008) or even bank notes (Brockmann *et al.* 2006). Other extensions have considered multiple random walks, which are useful to identify the presence of different behavioural states in foraging data (Morales *et al.* 2004)

However, the Markovian approach has serious limitations and other research frameworks are emerging (Nathan *et al.* 2008; Gautestad $\&$ Mysterud 2009). In particular, memory storage and processing capabilities allow humans, nonhuman primates and other large-brained vertebrates, to transcend the shackles of a first order Markov world. Many animals escape the present using episodic memory, the ability not just to associate past events with a particular time and place but project how conditions at that place may have evolved since that event (Griffiths *et al.* 1999; Dere *et al.* 2008; Rolls 2008). In fact, animals can even use episodic memories of past states to predict future states (Martin-Ordas *et al.* 2010), a good example being the ability of mangabeys to predict how weather has affected the ripening of fruit (Janmaat *et al.* 2006$a$, $b$). Animals escape their current location with spatial representations such as cognitive maps (Wills *et al.* 2010), Euclidean representations of space which allow them not only to navigate directly to important habitat features (e.g. resource patches) that are outside of the perceptual range (Normand $\&$ Boesch 2009; Presotto $\&$ Izar 2010), but also *a priori* estimate the cost of traveling there (Lanner 1996; Janson 2007; Janson $\&$ Byrne 2007; Noser $\&$ Byrne 2007). These advanced cognitive capacities mean movements need not be governed entirely by random decisions based on proximate states but may also be informed by deterministic cost-benefit analysis that compare the predicted benefits for different movement choices with their estimated costs (Walton $\&$ Mars 2007; Hillman $\&$ Bilkey 2010). Models motivated by observations on spider monkeys (Boyer *et al.* 2006), ungulates (Getz $\&$ Saltz 2008) or humans (Lee *et al.* 2009) have explored how such decisions can induce complex movement patterns in heterogeneous environments.

In the realm of Markovian processes, a lot of attention has been devoted in the past decade to identify efficient search strategies for finding prey or food patches whose locations are unknown to the forager (Viswanathan *et al.* 1999; Bénichou *et al.* 2005; Viswanathan *et al.* 2008; Oshanin *et al.* 2009). The impressive set of cognitive tools mentioned above offers the promise of more efficient foraging. Nevertheless, efficiently exploiting resources still presents some daunting challenges. Even with perfect information about the size and location of resource patches, the computational load entailed in choosing the most efficient route through a series of patches rises exponentially with the number of patches, quickly becoming intractable (the classic Traveling Salesman Problem). What's more, in the real world information is rarely perfect. Resources are often ephemeral and unpredictable because of the irregularity of environmental forcing, resource production dynamics, and harvesting rates. Consequently, the accuracy of predictions about resource quality tends to decay with time since the last visit to a given location. Because for mobile agents time tends to correlate with displacement, prediction accuracy tends to be greatest within some limited spatial neighborhood of the agent's current location. This suggests that the best vertebrate foragers can hope for may be a combination strategy akin to that employed in search algorithms such as Markov Chain Monte Carlo simulations, with deterministic memory-based movements used to move the forager up local maxima in the rugged foraging efficiency landscape and occasional random steps used to explore the constantly evolving landscape for higher maxima.

Here we use a simulation model of monkeys foraging on fruit trees to explore how spatial and temporal heterogeneity in resource distribution constrain how advantageous it is to have a big brain. More specifically, an adequate balance between deterministic, memory-based movement and random exploration is found to maximize the forager's efficiency. Therefore, some degree of stochastic search is still advantageous for foragers with high cognitive skills and foraging in not-so-scarce environments. We examine how the distribution of fruit tree sizes and the duration of fruiting influence this optimal balance. We show that the concepts of efficiency and order are intricately related in this system: optimal strategies produce the trajectories that have the highest degree of spatio-temporal order. Our simulation model assumes that monkeys have a set of fairly sophisticated skills, including cognitive maps, episodic memory, and travel cost discounting. Although there is mounting empirical evidence that monkeys and other vertebrates have these skills (Janson $\&$ Byrne 2007), our conclusions do not require them. Rather, they are also valid for a much broader class of models in which the hill-climbing advantages of memory are traded off against the exploratory value of random movement (see, *e.g.*, Tabone et al. 2010 in the context of ant foraging).

# Model

**Medium.** We consider a square lattice of $N\times N$ sites with lattice spacing $a$, where a random fraction $\rho$ of the sites is occupied by resource patches (fruit trees). A site contains 1 or 0 resource patch. The medium is also heterogeneous in the sense that the resource patches are not of equal value. A tree located at site $i$ has a size $k_i$ representing the total amount of fruits it can produce each year. The tree size probability distribution function is given by $$\label{fk}
f(k)=Ck^{-\beta},\quad k_{min}\le k\le k_{max},$$ with $k$ a continuous variable, $\beta>1$ an exponent and $(k_{min},k_{max})$ two constants. The form () is justified by empirical observations showing power-law distributions for tree sizes in tropical and temperate forests (Enquist $\&$ Niklas 2001; Niklas *et al.* 2003). For low values of $\beta$ (typically, in the range $[2,4]$), a few sites concentrate an important quantity of resources, whereas for larger values of $\beta$ the medium is homogeneous and composed of trees with similar sizes.

Each tree produces fruit once a year during a fruiting period of $n_{{\rm fruit}}$ consecutive days. $n_{{\rm fruit}}(=30$ days in the following, unless otherwise indicated) is assumed to be the same for all trees. However, not all trees start fruiting at the same time. Rather, start dates are randomly and uniformly distributed throughout the year, see Figure a. Let us denote $fruit_i(t)$ as the amount of ripe fruit on tree $i$ at time $t$. During its fruiting period, $i$ produces $k_i/n_{{\rm fruit}}$ new ripe fruits per day (*i.e.*, $k_i$ fruits during the whole period). For simplicity, the quantity $k_i/n_{{\rm fruit}}$ becomes available (''ripens") at the beginning of each simulation day. Ripe fruits remain available for a period of $n_{\rm rot}$ days after which they rot (become unavailable for consumption).

**Forager movement rules.** A mobile agent foraging in this medium is either immobile eating on a fruiting lattice site with a constant feeding rate $r$ (eaten fruits/min) or moving at constant velocity $v_0$ (lattice spacings/min). The elementary simulation time step is $\Delta t$ ($=0.5$ min in the following). The agent switches its activity from eating to moving when no ripe fruit is left in a tree, and switches from moving to eating when the trajectory crosses a site with ripe fruits. The agent moves in a continuous way along linear steps joining pairs of lattice sites, and can not exit the $N\times N$ domain. At the end of a step or after a feeding event, the forager takes a new step.

Before describing the movement rules, let us note that the agent has cognitive skills that enable it to remember the locations, sizes and fruiting states of previously visited trees. Hence, during the course of ranging, the agent adds to a list of known trees (marked as ''K" in Figure b) any tree which is visited for the first time: the agent records the tree's location, size $k_i$, fruiting state (fruiting or not), and ripe fruit crop size. We assume that once a tree's size and location are known, they are not forgotten. When a known tree is revisited, the agent updates its memory about the tree's fruiting state (for instance, from ''non-fruiting" to ''fruiting") and fruit crop size. We assume that each forager has a model of the fruit ripening process that allows it to correctly estimate how much ripe fruit should now be in a known fruiting tree $j$, $fruit_j(t)$. When a tree known by the agent to be ''fruiting" actually ends its fruiting period, the forager also changes the tree's state to ''non-fruiting" in its memory. However, foragers can only predict the fruiting state of trees visited during their most recent fruiting period. They cannot remember when the fruiting periods of trees are and, therefore, cannot anticipate fruiting states from one year to another.

At each movement step, the forager may or may not decide to visit a known tree. It either heads towards a known tree $j^*$ (with probability $1-p$) or takes a random walk step (with probability $p$), see Figure b. Hence, despite of its knowledge, the forager may decide to take a random walk step, which is drawn from a step length distribution function, $f_{{\rm rnd}}(l)$, where $l>a$. In a deterministic step, the forager chooses as a target the known tree that is most efficient: *i.e.* that provides the best tradeoff between ripe fruit crop size and travel distance. For this purpose, we introduce an one-step efficiency function, $e_i(t)$, given by: $$\label{ruleeff}
e_i(t)={\rm max}_{j}[F_j(t)/d_{ij}]=F_{j^*}(t)/d_{ij^*},$$ where the index $j$ runs over the list of all known trees and $d_{ij}$ is the distance between forager location $i$ and tree $j$. The quantity $F_j$ is the estimated amount of ripe fruit in tree $j$ and, if the tree is known as ''fruiting", is given by $$\label{Fiknown}
F_j(t)=fruit_j(t),$$ If the tree is known as ''non-fruiting" then $F_j(t)=0$ if the tree has already been visited during the current day; otherwise, $$\label{Fiunknown}
F_j(t)=\langle fruit_j(t)\rangle,$$ the average being taken over an entire year. In Eq.(), a tree known as ''non-fruiting" can still be considered as a potential destination as the tree may have started fruiting since the latest visit. Nevertheless, it tends to be less attractive than a known ''fruiting" tree of same size and at the same distance, as $\langle fruit_j(t)\rangle$ tends to be lower than the typical amount of fruit that $j$ carries during its fruiting period. The rule () simply indicates that the closer and the larger a known tree is, the more efficient would be a step toward that tree. The particular tree that maximizes Eq.(), or the 'best' known tree, is $j^*$. Note that a fruiting tree recently depleted by the forager has $F_j(t)=0$ and thus will not be considered until it produces new fruits, the next day.

As explained above, the agent takes a step towards $j^*$ with probability $1-p$, where $p$ is given by: $$\label{eta}
p=\exp(-e_i(t)/\eta),$$ with $\eta$ a constant. The rule () indicates that the forager is more likely to visit $j^*$ if it is a ''good" tree (large $e_i$, low $p$). In turn, if the known trees are far away from the current location of the forager and/or of small sizes, the forager will prefer to take a random step instead ($p\sim1$). Therefore, the parameter $\eta$ does not control the memory capacities of the forager (which are assumed to be perfect), but the use of memory by the forager: known trees with $e_i\gg\eta$ will tend to be visited, while those with $e_i\ll\eta$ will be ignored. The limit $$\eta \rightarrow \infty$$ produces random walk trajectories, whereas $$\eta\rightarrow0,$$ corresponds to a forager with movements that are entirely determined by the memory, tending asymptotically to revisit the same fruit tree. With this set of rules, if all known trees have been visited during a single day (*i.e.* in a time shorter than the refreshing period), then $p=1$. At $t=0$ the forager is placed with no previous knowledge of the medium and $p$ is obviously 1. Each time an unknown tree is encountered (during a random walk step or *en route* towards a known tree), it is added to the list of known trees, which grows as time proceeds.

Below, we will investigate the effects of varying three parameters of the model: $\eta$ (the tendency to take random steps), $\beta$ (the fruit crop size distribution) and $n_{\rm fruit}$ (the duration of each tree fruiting period). The eating rate ($r$), displacement speed ($v_0$) and $(k_{min},k_{max})$ are fixed to realistic values so that the forager visits a number of trees much larger than 1 on average during one day (the period of fruit refreshing). The forager often feeds no more than a few minutes on a tree but may occasionally spend a few hours on a very big fruiting tree, which is consistent with observations on spider monkeys, for instance (Ramos-Fernández *et al.* 2004).

# Results

## Foraging efficiency

We start by computing the foraging efficiency of the mobile agent, defined as: $$\label{defeff}
E=\left\langle \frac{{\cal K}}{{\cal L}}\right\rangle,$$ where ${\cal K}$ is the total amount of fruits eaten and ${\cal L}$ the total distance traveled by the forager. An alternate definition is $E=\langle{\cal K}\rangle/t$ with $t$ the foraging time, leading to similar results to those presented below. The average in Eq.(), which tends to a stationary value after a few years, is taken over different realizations of the media and foraging trajectories. Figure a displays $E$ as a function of the memory parameter $\eta$, for different tree size exponents $\beta$. For easier comparison, $k_{min}$ is adjusted so that the total amount of resources produced in one year in the domain, $\langle k\rangle N^2$, remains the same even though the tree size distribution varies.

The foraging efficiency exhibits a maximum at an intermediate level of memory use, $\eta_{\rm opt}$. Somewhat surprisingly, the deterministic, memory-based steps (), which at small $\eta$ are increasingly common relative to random choices do not necessarily have a positive impact on the long term efficiency. This property can be qualitatively understood by noticing that, given the dynamical rules of Section , random steps are often taken at the beginning of a run because of limited knowledge. When the number of known trees becomes large enough, a forager with very small $\eta$ can forage exclusively on known trees between two fruit production events (*i.e.* a one day interval). Hence, a forager with $\eta\rightarrow0$ will tend to revisit the same set of learned tree locations, reducing the exploration of other areas where other fruiting trees could be encountered. To the contrary, a random forager ($\eta$ large) visits a larger number of different trees but does not use its knowledge to improve efficiency by moving directly to large and/or nearby trees. Note that no fine tuning of the one-step cross-over efficiency $\eta$ that controls the use of random search relative to memory is necessary to bring the forager in the efficient region: the long term forager's efficiency varies with $\log\eta$ rather than with $\eta$.

A mixed strategy is the most efficient in this context, specially if resource patches have heterogeneous sizes (small $\beta$). Whereas the foraging success of random and deterministic foragers is rather independent of the tree-size distribution, efficiency increases with medium heterogeneity in the range of intermediate strategies (Fig. a). In other words, the optimal strategy becomes increasingly advantageous with respect to others when fruits are unevenly distributed in space. In general, the selection of the best tree $j^*$ is biased towards large tree sizes: *i.e.* thanks to rule (), the forager selects preferentially a subset of trees with larger sizes than those given by a random sampling of the distribution (). When $\beta$ decreases, this effect becomes more noticeable. As previously shown analytically on a very simple foraging model (Boyer $\&$ Larralde 2005), the single-step efficiency () of a forager knowing many trees tends to be higher when heterogeneity increases: on average, $F_{j^*}$ increases faster than the travel cost to $j^*$. This explanation does not hold, however, at low values of $\eta$ in the present model, when the number of places susceptible of being visited is reduced by the lack of previous random exploration.

Another significant aspect that favors the use of a mixed foraging strategy is the fruiting duration $n_{\rm fruit}$ of a tree. When $n_{\rm fruit}\ll 365$, the medium is unpredictable to the forager: at a given time only a small fraction of the trees are fruiting ($n_{\rm fruit}/365=0.082$, in Fig.a), and they fruit for a relatively short period of time. To show that behaviours exclusively based on memory ($\eta\sim 0$) are not adapted to rapidly changing environments, we have varied $n_{\rm fruit}$. As shown by Fig.b, the use of the optimal strategy brings a greater relative advantage compared to more deterministic strategies when $n_{\rm fruit}$ is small. Nevertheless, for $\eta>\eta_{\rm opt}$, *i.e.* for behaviours more random than at optimality, the relative efficiency is not affected by the tree fruiting duration.

In the following sections, we investigate connections between the foraging efficiency and the spatio-temporal structure of the walks.

## Spatial order of occupation patterns

Processes involving memory are *a priori* more predictable than random walks. Predictability has been addressed empirically in the context of human displacements by means of entropy measures (Song *et al.* 2010). Assume that the forager is optimal because it better ''knows", at any time, where the most profitable resource sites in the disordered environment currently are and how to exploit them. Do the corresponding walks have an ordered spatio-temporal structure that would make it easier for an external observer unaware of the movement rules to predict the forager position? Among the possible quantities related to the degree of predictability of a trajectory, we will consider two entropies: the average occupation entropy, $$S=-\left\langle \sum_{i} p_i\ln p_i\right\rangle,$$ where $p_i$ is the probability of finding the forager on site $i$ during a time window of duration $T$ (the average being taken over successive time windows); and the average visitation entropy, $$S_v=-\left\langle \sum_{i} v_i\ln v_i\right\rangle,$$ where $v_i$ is the number of visits that site $i$ has received during a time window of duration $T$, normalized to unity ($\sum_i v_i=1$). Contrary to $S$, $S_v$ does not take into account the time spent on $i$, but the number of steps that arrived at $i$. Figure display $E$, $S$ and $S_v$ as functions of $\eta$, for media of varying heterogeneity. We set $T=n_{\rm fruit}(=30$ days) as other choices give similar results.

$S_v$ has lower values when $\eta$ is low, meaning that the visits among sites are unequally distributed. As new fruit are produced each day, the same fruiting trees can be revisited after being depleted. The biased choice toward larger trees also amplify uneven visits: evident in the fact that $S_v$ decreases as $\beta$ decreases, *i.e.*, when the probability of finding large trees in the system increases. In a given medium, after a plateau (in the cases $\beta=2$ and 6), the visitation entropy increases with $\eta$, as more frequent random steps even out the number of visits received by the different trees.

The behaviour of $S$ is quite different as it is not minimum at $\eta=0$ but at an intermediate value close to $\eta_{opt}$. In the case $\beta=3$, the location of the minimum is actually indistinguishable from the maximum for the efficiency. Low values of $S$ can be related to uneven visits and/or uneven occupation times (hence, $S<S_v$). The time spent at a tree is determined by its ripe fruit content. Given the power-law distribution of the tree sizes, one may *a priori* expect very unequal feeding times in media with small $\beta$, thus lowering the entropy. In a given medium, the curves of $S$ show that this effect is maximal in the vicinity of the optimal strategy, when many of the trees visited in a given foraging time are currently fruiting. For $\eta<\eta_{\rm opt}$, however, the higher entropy indicates that residence times are more even: as confirmed by measures of ${\cal L}$ and ${\cal K}$ (not shown), the forager spends more time traveling and less time feeding. In this case, the fruiting trees are more rapidly depleted and non-fruiting trees are more often chosen as target sites, from rule . If a visited tree is not fruiting, the forager stays for a short time at the site, no matter the tree size. Similar patterns are observed at large $\eta$: in this situation, this is because trees are visited more randomly and most of the trees are non-fruiting.

In homogeneous media ($\beta= 6$, Figure ), visitation and occupation patterns become more similar. The minimum in $S$ disappears and is replaced by a flat plateau: $S$ becomes remarkably constant for $\eta<\eta_{\rm opt}$.

## Travel routes

The above entropy measures capture the spatial heterogeneity of the occupation and visitation patterns but not their temporal correlations. To gain some insight into the time regularity with which some sites are visited, we now look for repeated sequences in the trajectories.

As in the previous section, we decompose a whole trajectory in time windows of duration $T(=n_{\rm fruit}$ days in the following). We then convert the continuous forager positions within a same time window into a series of visited lattice sites $\{i_1, i_2,...,i_n\}$. As we focus here on the paths followed by the forager, we do not count the amount of time spent at each site (therefore, two consecutive sites are necessarily different). In the series of visited sites, we denote a $k$-route as a sequence of at least $k$ consecutive sites which appears more than once. For practical purposes, two sequences that are locally distant of no more than one lattice spacing $a$ are considered to be part of the same route. With $\rho=0.75$ and $n_{\rm fruit}=30$ (the values chosen for Fig. ), the mean separation distance between two neighboring fruiting trees is $\sim 6a$. As a route is likely to join two fruiting trees, we choose $k=6$ as the minimal sequence length.

In media with homogeneous tree sizes and for the range of values of $\eta$ considered in Figure , the 6-routes represent about 30$\%$ (higher $\eta$) to 90$\%$ (lower $\eta$) of a trajectory in a given time window $T$. Figure shows two trajectories with their routes highlighted. In this example, at optimality, about $52\%$ of the sites of a trajectory are located on the routes, the mean number of routes is 57 and each route is used 3.3 times on average by the forager. With decreasing randomness, the number of routes slightly decreases but each route is used much more frequently.

We denote the average length of a route as $l_r$. This quantity is analogous to a correlation length and indicates the persistence of the forager when it is engaged in a route. In other words, it measures the predictability of the forager movements when it starts repeating previous positions in the same order. As shown in Figure , this quantity reaches a maximum in the vicinity of $\eta_{\rm opt}$, or at the minimum of the occupation entropy $S$. Other choices of $k$ slightly change the values obtained for $l_r$ but not the existence of the maximum near $\eta_{\rm opt}$.

These results suggest that the optimal forager uses the routes as well as its persistence along the routes to revisit several fruiting trees consecutively (a number of the order of $l_r/6+1\simeq 3$ to $4$). Nevertheless, the complexity of the optimal trajectories is probably not fully described by observing a single object. At $\eta=\eta_{\rm opt}$, the spatial structure of the routes, which is not captured by $l_r$ alone, reveals a relatively regular, interconnected network (Fig. ). In this case, the trajectory is never very far from a route. By contrast, for $\eta\gg\eta_{\rm opt}$ the spatial distribution of the routes is less uniform, some routes become isolated whereas others are clumped.

# Discussion and conclusion

We have shown that trading off between random and memory-based decisions can be advantageous for a forager searching for food. A mixed strategy is specially rewarding if the resources are heterogeneously distributed in space and their production period is short. Memory is in general useful, as it allows the forager to revisit resource patches without searching. But excessive memory use over stochastic decisions prevents the forager from updating its knowledge in rapidly changing environments.

Ideally, optimizing foraging efficiency in our model medium requires combined activities: 1) to deplete nearby or large known trees, 2) to stay in the vicinity of known areas in order to revisit at low travel costs the depleted trees once they have refreshed, 3) to continuously search for new fruiting trees that will replace the known ones when these stop fruiting. Finding the rules that reach the absolute maximum efficiency is a task prohibitively complex. Nevertheless, an animal that uses a one-step optimization procedure such as the one considered here (instead of many-steps planning, for instance) in combination with random steps can increase its efficiency by a factor of about 3 to 7 compared with the uncombined behaviours. This efficiency gain is quite high. In purely random search problems with memoryless agents, optimal strategies (obtained, for instance, by tuning the Lévy exponent of a step length distribution) typically increase the efficiency by $30-40\%$ in scarce environments (Viswanathan *et al.* 1999). Notwithstanding, our results suggest that stochastic decisions are still playing a crucial role for organisms with extremely high cognitive skills and foraging in not-so-scarce environments. These findings open other perspectives in the debate on the relevance of random searches in Biology (Bartumeus $\&$ Catalan 2009; Smouse *et al.* 2010).

Memory leads to unexpected emergent patterns of habitat use, many of which still need to be studied. As shown by a recent multiple random walk approach, revisits are not independent events when memory effects are at play (Gautestad $\&$ Mysterud 2009). In our model, high efficiencies coincide with movements of higher predictability, or order. We find that order is enhanced in environments with broad tree size distributions, where a few patches concentrate many resources. Low values are found for an entropy based on time-averaged spatial occupation patterns. Trajectories also become more predictable from a dynamical point of view, with longer repeated sequences of visited sites. Similar measures have revealed the regular nature of human displacements (Song *et al.* 2010) and their application to real ecological data could be useful to unveil how animals exploit resources. In this context, predictability also has implications on the risk of predation: if one associates low forager's entropy levels with higher predation risks, a deviation from optimal foraging may decreases that risk. This may be achieved by increasing the randomness of the displacements, for instance.

At optimality, the model forager spends about half of its traveling time revisiting previous places in an orderly way, an activity which is reminiscent of the travel routes used by real animals (Noser $\&$ Byrne 2007). In fact, observation that monkeys persistently visit the same sequence of trees has been used to argue that monkeys navigate by choosing from a limited set of multi-step routes rather than Euclidean cognitive map calculations (Di Fiore $\&$ Suarez 2007). What our simulations show is that persistent use of the same sequence of trees need not imply the use of a pre-ordained, multi-step route. Rather, what looks like a multi-step route can emerge spontaneously from a one step optimization algorithm. In areas that are well-known, the forager's cognitive map of the size and location of trees is essentially the same at every visit. As the forager tends to make the same sequence of decisions each time it visits an area, its episodic memory of local fruiting states is also similar between visits. This might occur if depletion dynamics resulted in a characteristic return time such that trees tended to be at the same state of refresh at each visit. Or characteristic return time might be so long that fruiting states were poorly known. In both cases the predicted value for each tree would be proportional to its size and the relative values of alternative choices at each step of the chain would be consistent between visits.

Directional persistence is another observation often interpreted to support multi-step route planning over the use of one step, Euclidean cognitive map navigation. Here, model foragers also tended to show a high level of directional persistence, continuing on in the same direction after feeding on a tree. Directional persistence occurred in our simulations because a forager *en route* to a high yield large tree often passed close enough to a smaller tree to make a short detour cost effective (Janson 2007).

These examples raise a much broader issue in the study of animal movement. Many previous empirical studies have attempted to test alternative models of animal navigation in terms of relatively simple, intuitive predictions such as ''follows route or not" or ''takes direct path or not". What the example above illustrates is not just that alternative models often make the same prediction (Janson $\&$ Byrne 2007), but that the fact that a given alternative model predicts a particular movement pattern is not always intuitively obvious. That a one step optimization algorithm can cause repeated or directionally persistent sequences of movement is not a foregone conclusion that flows necessarily from the algorithm's assumption. It is an emergent consequence of the algorithm's application in a heterogeneous environment.

More importantly, just as alternative models can non-intuitively predict the same emergent patterns, alternative models can also predict very different emergent patterns that often cannot be anticipated from the decision algorithms themselves. These emergent patterns represent a huge and virtually untapped body of data for discriminating between animal navigation mechanisms and motivations. However, what emergent patterns that are predicted by complex navigation models such as the one we describe can only be evaluated through simulation. This necessitates a shift in statistical inference towards methods such as Approximate Bayesian Computation (ABC), which allows the fitting of arbitrarily complex simulation models to real field data (Beaumont *et al.* 2002). What makes ABC particularly attractive for inference on movement models is the fact that it can use observations not just on the turning angle or velocity of particular path segments, but on multiple ensemble properties of movement such as the mean, variance or autocorrelation of angles or velocities and their cross correlation with environmental features. We expect ABC and similar methods to play pivotal roles in shifting the axis of research on animal movement from theory and experiment towards field observation.


author: F. Marin[^1]; P. A. Rojas Lobos; J. M. Hameury; R. W. Goosmann
bibliography: biblio.bib
date: Received 15 December, 2017; Accepted 23 January 2018
title: A near-infrared, optical and ultraviolet polarimetric and timing investigation of complex equatorial dusty structures

From stars to active galactic nuclei, many astrophysical systems are surrounded by an equatorial distribution of dusty material that are, in a number of cases, spatially unresolved even with cutting edge facilities. In this paper, we investigate if and how one can determine the unresolved and heterogeneous morphology of dust distribution around a central bright source using time-resolved polarimetric observations. We use polarized radiative transfer simulations to study a sample of circumnuclear dusty morphologies. We explore a grid of uniform, fragmented, density-stratified, geometrically-variable models in the near-infrared, optical and ultraviolet bands, and present their distinctive time-dependent polarimetric signatures. As expected, varying the structure of the obscuring equatorial disk has a deep impact on the inclination-dependent flux, polarization degree and angle, and time-lags we observe. We find that stratified media are distinguishable by time-resolved polarimetric observations, and that the expected polarization is much higher in the infrared band than in the ultraviolet. However, due to the physical scales imposed by dust sublimation, the average time-lags between the total and polarized fluxes are important (months to years), lengthening the observational campaigns necessary to break more sophisticated (and therefore also more degenerated) models. In the ultraviolet band, time-lags are slightly shorter than in the infrared or optical bands, and, coupled to lower diluting starlight fluxes, time-resolved polarimetry in the UV appears more promising for future campaigns. Equatorial dusty disks differ in terms of inclination-dependent photometric, polarimetric and timing observables, but only the coupling of these different markers can lead to inclination-independent constraints on the unresolved structures. Polarized reverberation mapping in the ultraviolet/blue band, despite being complex and time-consuming, is probably the best technique to rely on in this field.

# Introduction

Dusty disks are detected in a variety of astronomical sources that range from stars to the innermost regions of active galactic nuclei (AGN). A disk[^2] naturally forms when matter with sufficient angular momentum is accreted onto a central object, regardless if it is a star, a neutron star or a black hole. We know that dust grains can form at the outer rim of AGN and young stars accretion disks and the fact that disks are ubiquitous in the Universe naturally provides clues to the physics of accretion in various environments. By studying dust disks, we can put strong constraints on the formation mechanisms of dust grains, and how they survive and evolve.

Equatorial dusty mixtures can be probed locally, i. e. within the Galaxy, by observing stars. It is thought that almost all stars are born with circumstellar disks . Young stars often show protoplanetary disks, which are a collection of material left over from the stellar formation process. In Keplerian orbit, this circumstellar, flared region contains both gas and dust (with a gas to dust ratio of $\sim$ 100, ). While the exact composition of dust in protoplanetary disks is poorly known, silicates and amorphous carbons covered by icy mantles are favored (e.g., or, more recently, ). After the accretion stage of the young stellar object, the dust mixture in the disk continues to evolve. The innermost grains start to collide and stick together, forming larger grains that sink towards the disk mid-plane due to the vertical component of gravity. Substantial dust settling can profoundly alter the geometry of the protoplanetary disk: the photosphere of the disk is dragged down with the dust . Turbulence, if any, tends to mix the grains back up again, resulting in non-homogeneous equatorial structures around the star that can be probed in the mid and far-infrared, where dust thermally re-emit .

The infrared re-emission of dust was used to infer the existence of dusty disks around more evolved stars, such as cool, old white dwarfs in planetary nebulae . A dust-related infrared excess was first discovered around the Helix planetary nebula by and later surveys have found several other dust-encircled candidates . The 24 $\mu$m flux densities of hot white dwarfs and central stars of planetary nebula is more than two orders of magnitude higher than their expected photospheric emission, revealing the presence of cold dust disks . The disk, in those cases, may derive from the AGB phase of the star evolution or collisions of Kuiper belt-like object . It is not easy to distinguish between the two formation mechanisms as the system is not fully resolved. Disk sizes are hard to measure because the outer parts are cool and emit weakly, but it is thought that circumstellar disks extend up to a few hundreds of astronomical units . The inner part of the dusty disk is set up by the sublimation radius that depends on the dust composition and temperature of the central source . Current millimeter and sub-millimeter/interferometers provide images of the dust and gas outer disks with an angular resolution better than 1" (i.e. 150 AU at the distance of the nearest star forming regions). As an example, the Atacama Large Millimeter/submillimeter Array (ALMA) can reach a resolution of 0.5" at 950 GHz in its most compact 12-m array configurations. Using longer baselines (up to 14 km), successfully traced millimeter-sized particles down to spatial scales as small as 1 AU (20 mas).

High angular resolution observations can also be obtained in the K and N bands, with the Keck Interferometer and the Very Large Telescope Interferometer , respectively. The former authors successfully resolved the circumstellar material 2.2 $\mu$m emission within the first astronomical unit around young stars. The later spatially resolved a parsec-sized torus-shaped distribution of dust grains in the Seyfert galaxy NGC 1068. This circumnuclear dust region was for long invisible to our instruments and is now at the edges of the resolution capabilities of current telescopes . However, the true morphology and composition of this equatorial region is still largely unknown; it would require to resolve sizes inferior to a fraction of a parsec at mega-parsec distances. We thus need to find another observation technique to reveal the geometry of unresolvable dusty disks, either around young stars or supermassive black holes.

Indirect techniques such as Doppler tomography or eclipse mapping have been widely used for cataclysmic variables, but these are restricted to binary systems and cannot be applied to isolated stars or AGN. Another very successful method that can go beyond the resolution capabilities of current telescopes is the observation of polarized light. Polarization has proven to be independent of the size of the emitting/scattering region. Only the observed polarization degree and position angle are sensitive to the morphology, composition and magnetic fields of the media that can emit, scatter or absorb photons. Observing the polarized light of NGC 1068, successfully unveiled the broad emission lines that were undetectable in the total flux spectrum. Those lines, obscured by the equatorial distribution of dust around active galactic nuclei cores, were only revealed thanks to near-infrared, optical and ultraviolet spectropolarimetry. They laid the foundations of the unified model of AGN . Polarimetry is also extremely powerful in detecting dusty equatorial structures around bright stars. The polarized light, emerging from scattering of stellar photons on the disk surface, shaves off the unpolarized contribution from the central star. After correcting for stellar starlight dilution only the disk emission is detected thanks to its contrast. Imaging polarimetry then allows to reveal the disk inner regions down to a few astronomical units .

Now that we are able to detect the polarized signatures of dusty disks (at least around stars, not yet for AGN), it is of prime importance to determine their true structure. Models from the literature almost systematically use plain, uniform, constant density disks since they are easier to explore numerically. A simple geometry, reducing the model parameter space, is much less time-consuming when radiative transfer or magneto-hydrodynamical simulations are used. Density-variations have been sometimes included and already revealed a number of photometric and spectroscopic differences with respect to constant-density disks. The same conclusion applies to the disk geometry . Flared or cylindrical disks are the two most common morphologies used in simulations but it has been shown that the structure of circumstellar and circumnuclear disks is more complex. Clumpy dusty structures have been detected around stars and brown dwarfs (e.g., in the $\sigma$ Ori cluster, see ), as well as from galactic structures (e.g., in NGC 4244, see ). Even if the parsec-scale dust disk around the core of AGN has not yet been resolved to the point of detecting individual clumps, hydrodynamical models predict that large homogeneous distributions of dust cannot be stable . Various indirect evidences for the clumpiness of AGN tori are detected in the X-rays, where fluorescent line emission and variations in the obscuring column density of edge-on Seyferts strongly suggest a non-uniform equatorial torus morphology.

It is the aim of this paper to investigate in great details the different morphologies and density stratifications of equatorial dusty disks. By doing so, we want to check whether near-infrared, optical and ultraviolet polarimetry can shed light on the true geometry of those unresolvable regions. We consider disk parameters (in particular disk sizes) appropriate for AGN, but our results can be easily extrapolated to different environments. We thus study very realistic models of dusty environments that exist in accreting objects and present the radiative transfer code we used in Sect. . We compile and discuss our results in Sect. , where the photometric flux, polarization degree, polarization angle and time-lags for each of the fifteen models are presented. We analyze the benefits, problems and the limitations of polarized time reverberation studies in Sect.  by comparing our conclusions to recent observations, and we conclude our paper in Sect. .

# Models of equatorial dusty structures

In the following, we use for a geometrical configuration that matches the observational constraints for AGN. Our goal is not to precisely model a circumstellar or a circumnuclear disk. We instead test the impact of different geometries and compositions onto the resulting photometric flux, polarization and time-lags. We consider throughout this paper a flared disk with inner radius 0.1 pc and outer radius 10 pc. The first value corresponds to the inner radius set by dust sublimation theories for a typical Seyfert galaxy whose dust is mainly composed of graphite and silicate grains . The outer radius is the typical torus extension set by modeling constraints based on spectroscopic and interferometric observations and is of order of 5 – 10 pc . The half-opening angle of the flared disk is set to 45$^\circ$. This corresponds to the estimated torus height derived from quasar observations , numerical modeling , and statistical analyses .

## Dusty disks with increasing complexity

We show in Fig.  the six different disk geometries we investigate in this paper. We consider first a plain flared disk that is uniformly filled with dust. Its radial optical depth in the V-band is larger than 100 to ensure a strong obscuration along the equatorial plane . This is the simplest configuration and it is one of the most used in numerical simulations. Model number 2 is also a plain flared disk but its dust density varies with radial distance from the central source. The third model is a clumpy flared disk with clumps of equal sizes and density. Each clump has an optical depth of 50 and 7 to 10 clumps are obstructing the observer's line-of-sight along equatorial views, ensuring a total optical depth equal to or larger than 100. Its non-homogeneously filled counter-part is model 4, where the dust density varies with the radial distance from the center. Finally, model number 5 is a clumpy disk with clump sizes becoming bigger and bigger as we move away from the center. A clump located at the outer part of the structure is ten times larger than a clump located at the inner edge. In this model the dust density is inversely proportional to the clump radius so that each cloud has a constant optical depth of 50 in the V-band. The last model is the same as model 5 but the dust optical depth is no longer constant.

The different distributions of dust used in models 2, 4 and 6 are presented in Fig. . We consider four dust distributions, defined by their optical depth in the V-band plotted as a function of the radial distance from the central black hole. The size of the disks being the same for all models, the change in optical depths is only due to variations in dust densities. Model (a) corresponds to a linear increase of the optical depth with increasing distances from the central source. Model (b) is for an exponential growth. Model (c) and (d) follow the inverse trend, with model (c) being a linear decrease of the dust optical depth with increasing distances form the center, and model (d) an exponential decrease. We therefore have fifteen different test cases: model 1, models 2(a – d), model 3, models 4(a – d), model 5 and models 6(a – d).

We sample 2000 clumps for each clumpy model, equating to a disk filling factor of $\sim$ 25%. The impact of the number of clumps has been studied in and it was found that the lower the filling factor, the lesser the observed polarization and the higher the total flux. Using a filling factor of $\sim$ 25% allows for a flux decrease between the polar and equatorial inclinations of, at least, one order of magnitude. For all models, we fix the dust composition to the Milky Way mixture . This is the standard dust composition observed in the solar neighborhood, but different mixtures can reside in different systems, such as postulated by and . In the Milky Way, the dust is essentially composed of 62.5% carbonaceous dust grains and 37.5% astronomical silicate. Both ortho- and para-graphite are considered, with twice as much para-graphite as ortho-graphite . The grain size distribution ranges from 0.005 $\mu$m to 0.250 $\mu$m in radii, with a distribution $n(a) \propto a^s$ and $s = -3.5$. Varying the dust grain radius distribution or the dust composition will result in a different albedo, hence different scattered/absorbed fluxes and polarization. However, in the following, we always compare models with the same dust mixture. The exact dust prescription is then of no importance since we are looking at model differences and not quantitative values. Finally, $i$ is the disk inclination, i.e. the angle between the observer line of sight and the symmetry axis of the disk. Pole-on view corresponds to $i=0^\circ$, edge-on view to $i=90^\circ$.

## Polarized radiative transfer

We used the radiative transfer code stokes to achieve our simulations. Developed by and upgraded by , stokes is a Monte Carlo code that simulates the propagation of radiation in a user-defined three-dimensional environment. The code is extensively detailed in the three papers of the series and we only give here a brief summary of its important features. A list of applications of stokes can be found in .

Stokes can model a large range of geometrical shapes that can be filled with electrons, dust grains, atoms and molecules. Emitting regions can be parametrized as sources with a given spectral shape. Photons, once emitted, travel along straight lines until a reprocessing event happens, depending on the optical depth of the media (calculated as $\tau$ = $\displaystyle \int_{0}^{l} \sigma n(z) \, \mathrm{d}z$, $n(z)$ being the number density of that material at $z$, and $\sigma$ the attenuation cross section). Photons can scatter, be absorbed and be re-emitted in all directions according to the Mie, Rayleigh, Thomson or Compton laws. Multiple scattering can occur and the four components of the Stokes vector are modified at each scattering-event. A spherical web of virtual detectors registers each escaping photon, saving its polar and azimuthal coordinates together with the intensity, polarization (linear and circular) and time-lag. The polarization we measure is the scattering-induced, linear, continuum polarization degree ranging from 0 (unpolarized) to 100% (fully polarized). The code can be parallelized and it takes a few days on a basic computer for a computation such as presented in this paper to sample 10$^{10}$ photons.

In the following, we ran our models for three different wavebands: near-infrared (mono-energetic photon emission centered at 10 000 Å), optical (5500 Å), and ultraviolet (2000 Å). Since the scattering phase function of dust is energy-dependent, we aim to find which is the best suited waveband for a polarimetric detection of the specific features of complex dusty disks. The polarimetric results we present are entirely due to scattering. We do not account for external dilution by the host galaxy, stellar starlight or thermal reprocessing by dust grains. This might have an effect on the polarization signatures, particularly in the infrared domain where dilution by the host galaxy is much more important than in the ultraviolet band (see, e.g., ), and it will be discussed in Sect. . We registered the flux, polarization and time-lag along 40 polar directions (from the symmetry axis of the model to the equatorial plane) equally spaced in cosine. We azimuthally integrated the signal to get better statistics. It was shown in that, even for a clumpy distribution, an azimuthally-averaged value is representative of the system provided it is not highly non-axisymmetric.

# Results

## Uniform disks

We present our first results in Fig. , Fig.  and Fig.  for the near-infrared, optical and ultraviolet bands, respectively. They corresponds to models 1 (plain, uniformly-filled dusty flared disk) and 2 (plain disks with radial dust stratification). We investigate, in model 2, all four dust prescriptions (a), (b), (c), and (d) according to Fig. .

### Radiation path

Because of the large disk optical depth resulting in multiple scattering, the radiation path is not straightforward. Photons may scatter more than twice before reaching the observer, especially if the disk is clumpy. We illustrate in Fig.  the different trajectories the photons can have.

The top panel illustrates the case of an observer situated almost along the symmetry axis of the system, i.e. along the polar direction. In this case, there is a direct view of the central source and photons may travel freely towards the observer (dotted orange line). This is the direct flux, which is unpolarized. If photons are emitted along the equatorial plane, they will encounter the disk funnel (dashed pink line). If not absorbed, they may scatter backward and be reprocessed onto the opposite funnel side until being absorbed or being able to escape. Due to the non-isotropic scattering phase function of Mie scattering, photon can also penetrate further into the disk (long-dashed cyan line). Radiation will scatter at different position before escaping at large distances from the central source. Depending on the position of the last scattering event, its polarization position angle can be either parallel or perpendicular. For the remainder of this paper, we consider that a polarization position angle of 90$^\circ$ indicates a polarization angle parallel to the projected symmetry axis of the disk. This is the signature of equatorial scattering. A polarization angle of 0$^\circ$ is thus perpendicular to the model axis and traces scattering event happening preferentially close to the pole of the model. Note that when a model is perfectly axisymmetric, the polarization angle can only take two values, 0$^\circ$ or 90$^\circ$. Otherwise, as in the case of a distribution of clumps, various polarization angles can be obtained, related to the statistics of the clumps.

The bottom panel of Fig.  illustrates the case of an almost edge-on inclination. The central source is obscured by dust and no longer visible. Photons can escape via multiple scattering along the equatorial plane if the dusty medium is not too optically thick or if there are gaps between the clouds (green long-dashed line). The majority of radiation will preferentially scatter onto the disk surface opposite to the observer and then reach the detectors. This could happen with only one scattering event, where photon is emitted at an angle coincident to the half-opening angle of the disk (dotted blue line), or due to multiple scattering (dashed red line). When the inclination of the system is close to 90$^\circ$, the obscuration is maximal and the amount of photons that have backscattered onto the disk surface opposite to the observer (blue and red lines) is minimal.

### Total flux

Focusing first on the normalized photon flux (top-left panel of Figs. , and ), we see an almost inclination-independent flux value until the observer's line-of-sight becomes obstructed by the dusty disk. The central source being unobscured, there is little contribution from the flared disk that absorbs/scatters a small fraction of radiation. Nonetheless, models 2(c) and 2(d) present a slightly smaller (by a factor 1.3) flux at those inclinations. The optical depth being maximum at the inner disk radius (see Fig. ), radiation is more heavily absorbed. Thus, there is less photon scatter toward the polar axis than for the other cases. Once the the dusty material intercepts the observer's line-of-sight, the flux drops by several orders of magnitude. For a plain disk where density decreases with radial distances from the center (models (c – d)), the minimum flux is about three orders of magnitude lower than at face-on inclinations. Radiation that successfully crossed the first, dense layers of the inner disk region can freely propagate towards the disk outer radius. The number of photons is thus higher than in the case of a disk with a constant-density profile (model 1). Here, the flux drops by five orders of magnitude and the attenuation is almost linear with inclination. The attenuation is even stronger for the last two models (a – b) when the dust density increases with radial distances from the source, the flux obscuration is very efficient. Between $i=45^\circ$ and $i=50^\circ$, the flux sharply drops by five orders of magnitude and then stays constant at edge-on inclinations. In this specific case, photons have traveled far inside the dusty material before encountering the densest layers of dust. Radiation then becomes trapped inside the dust disk and naturally suffers from heavy absorption caused by multiple scattering. The emerging flux at edge-on inclinations is thus extremely weak as compared to the source.

As the photon energy increases, models (c – d) with decreasing radial optical depth from the center of the disk show a slightly higher edge-on normalized flux, while it is the opposite for the other cases. This complex behavior is related to the albedo and the scattering and extinction cross sections of dust. The albedo is flat in the optical band but decreases in the ultraviolet and infrared regimes. On the other hand, the scattering cross-section decreases regularly with wavelength. An illustration is given in Fig. 3 in . The combination of the two factors allows ultraviolet radiation to cross a thicker layer of dust close to the inner radius of the disk: more ultraviolet photons can penetrate the disk, but they get more scattered or absorbed than optical or infrared photons. However, in the case of a model with increasing dust density with radial distance from the source, the first layers of dust being optically then, the same ultraviolet photons will have traveled farther inside the dusty material before being absorbed or scattered. Scattered photons will more easily escape along the polar direction, where the remaining optical depth is smaller, rather than towards the equatorial plane where the optical depth is higher. This results in a decrease of the observed flux even at higher photon energies.

### Polarization properties

The polarization properties of the five models (right panels of Figs. , and ) strongly differ both in terms of polarization degree and polarization position angle. At polar inclinations, the degree of polarization is always small, less than a percent. This is due to the strong dilution effect of the unpolarized primary source that outshines the reprocessed component. The polarization degrees are marginally dependent on the half-opening angle of the disk but are very sensitive to its composition. There are however differences between models, even for low inclinations. As it can be seen in the small zoom-box inside the polarization degree panels, a uniformly-filled dusty disk produces the highest polarization degrees, while a disk with a linear increase of the dust density with radial distance from the center has the lowest continuum polarization. If the dust density decreases with radial distances (models (c) and (d)), the degree of polarization linearly increases with inclination until $i=45^\circ$. From 0$^\circ$ to 45$^\circ$, the other three models show a non-linear variation of their polarization properties, a behavior that is strongly impacted by the amount of reprocessed flux, hence by the model itself. This can be clearly seen when considering the intrinsic polarization position angle. When the dust density is constant or increases with radial distance from the center, the polarization angle is 90$^\circ$ whereas it is 0$^\circ$ otherwise. The first three models are dominated by scattering along the equatorial plane, producing a parallel polarization angle, until the line-of-sight of the observer is obscured by the dusty medium. Scattering then occurs along the polar directions, where photons reprocess on the flared disk surface opposite to the observer's position, see Fig. . The polarization angle naturally rotates and the transition between the two polarization states causes the polarization degree to decrease around $i=45^\circ$ (the half-opening angle of the flared disk). When the disk optical depth decreases with radial distances from the source, the inner edge of the disk is similar to a thick wall of dust and radiation preferentially scatters along the polar direction if it is to escape from the disk, hence the perpendicular polarization angle.

As soon as the source is no longer directly visible by the observer, the polarization angle is fixed for all models (0$^\circ$) and the polarization degree rises due to Thomson laws. In the case of a uniformly-filled plain flared disk, the maximum infrared polarization degree is $\sim$ 20% at $i=50^\circ$, where polar scattering dominates. The polarization then decreases with increasing inclinations, as it becomes more and more difficult for radiation to escape the dust funnel, except by multiple scattering which will induce a natural depolarization effect. In the case of models 2(a) and 2(b), the maximum of polarization (27 – 29%) is reached for inclinations close to 45$^\circ$. The polarization degree then decreases for the same reasons as before, but the final edge-on value is lower than in the previous case. This is due, as explained above, to the confinement of radiation inside the flared disk and the subsequent heavy absorption. It also explains the lower statistics at edge-on inclinations. Finally, for the last two models in which the dust density decreases with radial distances from the center, the polarization degree peaks at inclinations close to 70$^\circ$. The maximum infrared polarization is as high as 23%, and then decreases at equatorial orientations, with a polarization level similar to the uniformly-filled case. We thus see that the maximum polarization degree from a plain flared disk occurs for different inclinations and strongly depends on the radial distribution of dust. We see similar behaviors in terms of polarization angles and polarization degrees for all three wavebands considered here, with the polarization degrees decreasing at bluer wavelengths. We also note that the rotation of the polarization position angle of model 2(a) occurs at slightly different inclinations for different energies. Those two phenomena are due to the increase of the dust scattering cross section with decreasing wavelengths.

### Time lags

The last panel of Figs. , and (bottom-left) represents the averaged time-lag between actual photons reaching the observer and photons emitted by the central source that would not have suffered any scattering. Direct emission has a time-lag of zero. This quantity, with respect to the previous ones, is not directly observable as real cosmic photons are emitted at different times. The true averaged time lags must be reconstructed from observations by comparing polarized and primary light curves through theoretical transfer functions. The time-lags we present therein is to be used as a time indicator of the complexity of the radiation paths and the difficulty photons can have to escape from the dusty disk.

We see that, for pole-on inclinations, the time lag is rather small. The continuum is directly seen by the observer (zero time-lag) and polarized radiation mainly scatters on the inner disk funnel before reaching the observer, lagging the continuum by about 10 months. In the infrared band, the uniformly filled model shows the longest times lags but the increase with respect to the other models between 0$^\circ$ and 45$^\circ$ orientations is merely detectable. It is only at inclinations larger than 45$^\circ$ that the five models become truly unique in terms of temporal signatures. When the dust density increases with radius, the time-lag abruptly increases when the inclination becomes slightly larger than 45$^\circ$ and then becomes stable. Since there is a very small number of photons that can escape from the densest outer layers of the disk (see the flux plot), most of the radiation detected at those angles is due to the backscattering of photons onto the opposite disk edge. The photon travel length being almost similar at all edge-on inclinations, the time-lag stabilizes at 400 – 600 months. A model with a constant-density dust prescription has a similar behavior but the time-lags are less important since radiation faces a constant, high optical depth and thus scatters many times before escaping but is not trapped in the outer regions, in contrast with the previous cases. The time-lag slightly drops at perfect equatorial inclinations since photons that have backscattered on the opposite disk funnel are not longer able to reach the observer and thus do not delay the averaged time response. Finally, for models with decreasing radial dust densities, time-lags remain quite constant before and after the transition angle, solely showing a small increase a inclinations larger than 70$^\circ$. This is also due to the amount of backscattered photons that outnumbers those that have traveled through the equatorial plane (i. e. with a smaller time-lag).

We finally note that the time-lags differ in the near-infrared and the optical/ultraviolet bands, when energetic radiation can penetrate further in the dust material. For models with denser dust layers close to the source, IR photons mainly scatter onto the dust funnel while UV photons penetrate more easily in the material, increasing their time-lag. The change in waveband affects the three other models in the opposite way: their time-lag at polar views is lower. This is due to the combination of albedo and scattering/absorbing cross sections variations, as explained above.

Summarizing what we have found for the plain flared disks, we have shown that different dust prescriptions result in specific inclination-dependent attenuations of the flux. If the dust layers become thicker with increasing distances from the central source, less photons are detected towards the equatorial regions. It is not the case for the other configurations that allow more radiation to be detected at high inclinations. The variations of the polarization degrees and angles are also very characteristic; the polarization is maximum for models with radially-increasing dust densities. Those same models also provide the highest time-lags at equatorial views at all three wavebands. We note that the differences are less pronounced for type-1 (pole-on) inclinations, where the structure of the equatorial distribution of dust has a lesser impact on the averaged time lags. This prevents a very clear determination of the morphology of the disk from time reverberation studies that can be achieved only for low inclination objects, showing the importance of coupling timing and polarimetric studies to break degeneracies.

## Fragmented disks with constant-radius clouds

Our second series of models focuses on fragmented disks with clumps of equal sizes. We examine in Fig. , Fig.  and Fig.  a model where the optical depth is the same for all clumps (fixed to 50 in the V-band, model 3) and a model where the dust opacity varies with radial distance from the central source (model 4). In the later case, we consider the same four dust prescriptions (a), (b), (c), and (d) as previously (see Fig. ).

The normalized photon fluxes are maximum at polar inclinations as discussed in the previous section. However the flux attenuation due to obscuration is much less important at edge-on orientations. The clumpy structure of the disk is responsible for gaps between the cloudlets, allowing radiation to escape more easily thanks to multiple scattering. The interclump medium is pure vacuum here, but similar results are found for a clumpy two-phased medium with high-density clumps embedded in a low-density interclump dust . The flux attenuation is model-dependent. In the infrared, fluxes along the equator are smaller by about one order of magnitude than the polar value for models with exponential opacity distributions, and by almost two orders of magnitude in the linear case. The constant-density model (model 3) presents the lowest equatorial flux. We therefore see that the dust distribution has a profound impact on the quantity of transmitted flux at edge-on views. The photon fluxes are almost inclination-independent once the observer's line-of-sight has crossed the disk horizon, with a smooth transition between $i=35^\circ$ and $i=50^\circ$. The geometry of the system drives the shape of the curves and all five models appear similar (albeit their flux levels). Moving towards shorter wavelengths has no impact on the shape of the curve but the derived photon flux at edge-on inclinations is slightly different due to the combined effect of albedo and cross-section. All models appear to give equivalent fluxes along the equatorial plane, between one and two orders of magnitude less than along the pole.

The polarimetric results (right panels of Figs. , and ) are very different from the plain flared disk models, and are also characteristic of the model used. Whereas the infrared polarization degree along polar directions for the plain disk cases can reach $\sim$ 0.25%, here it is at best 0.17% for the model with an exponentially-increasing dust opacity with radial distances from the source (model 4b). For this model, radiation mainly scatters in the equatorial plane until reaching the outer part of the disk. At this location, the dust density is maximum and the resulting polarization position angle is equal to 90$^\circ$. A clumpy disk with a linear increase of dust opacity with distance (model 4a) also presents a 90$^\circ$ polarization angle when observed edge-on, but its polarization degree is smaller. The seemingly chaotic variations of the polarization angle are due to the clumpiness of the medium and not to insufficient statistics. For the other models (model 3 and models 4(c-d)), the level of linear polarization at polar inclinations is very low due to the inefficiency of the clumpy disk to scatter photons towards the observer. The resulting polarization angle is 0$^\circ$. This efficiency increases with inclination as the observer's line-of-sight becomes obstructed by clumps. The infrared polarization degree sharply rises up to 18% in the case of constant-density clumps (model 3). For dust densities that decrease linearly (model 4c), the maximum polarization degree is 15% and for the last two models that are much less capable of absorbing/scattering radiation, the maximum polarization is about 10%. For all models, the polarization position angle is equal to 0$^\circ$ between 40$^\circ$ – 60$^\circ$ inclinations since polar scattering dominates. At larger inclinations, there is a rotation of the polarization angle for all models: the polarization angle becomes parallel while the polarization degree decreases. Scattering along the equatorial plane is now the easiest path to escape the clumpy dusty disk. This results in low infrared polarization degrees with 90$^\circ$ polarization position angles. This behavior was already revealed in and for constant-density clumpy models but we now show that their results also apply to more complex dust distributions. As for the plain disk discussed in Sect. , we find a wavelength-dependent polarization variation, the maximum polarization degree of the models decreasing for shorter wavelength. This is due to smaller scattering cross section when the photon energy increases, which allows radiation to travel more easily through the dusty structure without interacting.

The time-lags results (bottom-left panel of Figs. , and ) are also very different from their plain disk counterparts. Even at polar inclinations the time needed to escape from the dusty structure is large for photons that have scattered only once or twice. Since the medium is clumpy, radiation has traveled far inside the disk before being scattered towards the observer. The time-lag is thus about 10 times larger than for a plain disk, where radiation mainly scatters inside the dust funnel. Note that this is not due to a higher albedo but rather to the existence of vacuum between the cloudlets that allows radiation to travel without being absorbed. Model 4(b) presents the highest time-lags due to the exponential increase of optical depth with distance to the source. Only the outer parts of the disk are filled with high density, high opacity clumps. Photons thus travel a large distance before being scattered towards the observer. All other models show approximatively equal time-lags, the lowest values being obtained for the constant-density sphere model (model 3). When obscuration becomes efficient (at inclination larger than 45$^\circ$), the time-lag values increase by a factor $\sim$ 2 depending on the model. This increase correlates with the flux attenuation and the rise of polarization degree observed in other panels. This is a clear indication for a maximum efficiency of obscuration and a large number of scattering events. Finally, when equatorial scattering dominates at edge-on inclinations, the time-lags decrease but stay larger than at polar angles. The dependence of time-lags with inclination is very similar at shorter wavelengths, with only a marginal quantitative decrease.

We conclude that, for clumpy disks with constant radius spheres, the attenuation between a polar and an equatorial inclination is not very effective. The transition between the two extreme inclinations is smooth and operates around the half-opening angle of the dusty structure. If the half-opening angle is not the same for all observable sources, then it becomes impossible to distinguish between different dust stratifications. However polarimetry can reveal the distribution of dust with respect to the central source as the polarization degree reaches different maxima for different cases. The best waveband for observing the polarimetric signatures of clumpy tori is in the near-infrared where polarization levels larger than 10% are expected for a narrow range of inclinations. Different dust structuring also imprint the polarization position angle with specific values at polar orientations. Finally, reverberation measurements hardly differentiate between the different models since they all give the same inclination-dependent curves. The time-lags they produce are too similar to be clearly distinguished.

## Fragmented disks with variable clump sizes

Our last set of models is presented in Figs. , and . In this case, the dusty disk is clumpy and the clump radii increase with distances from the central source. We arbitrarily set the radius of clumps situated at the outer part of the structure to be ten times larger than clumps located at the inner edge. Similarly to Sect.  and Sect. , we examine a model where the dust opacity is constant for each clump (model 5) and four models (6(a) – 6(d)) where the dust opacity varies with radial distance from the source (see Fig. ).

The normalized total flux appears to be constant at polar viewing angles since, as previously, it is dominated by direct flux from the central source. At low angles, the fluxes are inclination- and model-independent. Differences only appear when the observer's line-of-sight crosses the dusty disk. In the case where the opacity exponentially decreases with distance, the disk does not efficiently block radiation at equatorial viewing angles. The flux has decreased by only one order of magnitude. The gaps between the clouds and the presence of low opacity, large dust cloudlets at the outer disk radius do not allow for a large obscuration. If the dust opacity decreases linearly, obscuration is slightly more efficient since the cloud opacity is still higher than 10 (V-band) at 8 pc from the source (while it is about 2 – 3 in model 6(d)). If the disk is composed of low opacity inner (small) clouds and high opacity outer (large) clouds, radiation is more heavily absorbed. Fluxes are about four orders of magnitude lower at extreme equatorial inclinations for the three remaining models (models 5, 6a and 6b). The flux decrease with inclination is exponential for these three cases and the transition between unobscured and obscured sources is sharp at around the disk half-opening angle. The fluctuations we see in the flux curves are due to the distribution of clouds inside the model. For different realizations of clumpy disk models some features might appear if a given equatorial line-of-sight is not obscured by several optically thick clouds. This occurs, for example, in Fig. , models 5 and 6(c), at inclinations larger than 70$^\circ$. The appearance of peaks and dips in the photometric curves are wavelength-dependent. As the photon energy decreases, radiation is less absorbed by dust grains and, if there is not enough dusty material to block radiation along a given direction, photon will escape more easily. This causes the low amplitude peaks of flux in the photometric curves observed in e.g. 6d which are visible in the ultraviolet but not in the infrared.

The polarimetric plots (right panels of Figs. , and ), show a sharp rise of polarization with increasing inclinations. At polar angles, the polarization degree exponentially rises up to 0.3%. The associated polarization position angle is 0$^\circ$ for all models in the near-infrared. This means that photons have not scattered much along the equatorial plane before escaping the system, but have instead mainly scattered on the large dust clumps located high above the equatorial plane, resulting in the characteristic perpendicular polarization angle. When the observer's line-of-sight becomes obstructed by dust, the polarization degree sharply rises since polar scattering clearly dominates over unpolarized emission from the (now) obscured source. Models with decreasing optical depth with radial distances from the center (6c,6d) have the lowest polarization degrees, since photons easily escape from the system, and therefore do not carry large scattering-induced polarization. This effect is even more pronounced at equatorial inclinations when scattering along the equatorial plane dominates over polar scattering, resulting in a rotation of the polarization position angle for the two aforementioned models. The polarization degree thus shows dips, with minima associated to the rotation of the polarization angle. The case is slightly different for the other three models (5, 6a, 6b). Their polarization degree is as high as 25% and it is always associated with a perpendicular polarization position angle. For increasing inclinations the polarization degree regularly decreases for the same reason as above but since obscuration by large, optically thick, outer clumps is more efficient, equatorial scattering does not dominate and the polarization position angle remains equal to 0$^\circ$. At shorter wavelengths, the results are similar but the polarization degrees are lower (down to 7% for the most polarized models in the ultraviolet band) as obscuration and depolarization through multiple scattering dominate over transmission.

The time-lags (bottom-left panel of Figs. , and ) are also quite different for different dust opacity prescriptions. The time-lags are similar for all models at polar inclinations, since they mainly result from scattering onto the large dust clouds at the outer radii of the fragmented disk. However, once the inclination is larger than 45$^\circ$, the five models show different behaviors. Model 6(d) (density decreasing exponentially with distance) shows the lowest time-lags, with an infrared maximum around $i=50^\circ$. The time-lag decreases at equatorial inclinations as photons preferentially escape by scattering close to the equatorial plane, carrying a smaller time delay than photons that have backscattered onto the disk funnel and then inside the cloud distribution. The same conclusions apply to a model with a linear decrease of density. It follows that a clumpy disk with increasing cloud radii and decreasing optical depths would be, contrary to naive expectations, poor target for reverberation measurements. Better targets are models 5, 6(a) and 6(b). The time-lags increase with inclination, by factors up to up to 5. The presence of optically thick, large dust clouds in the outer borders of the system greatly facilitate time-lag observations since photons have to travel through the whole disk before being efficiently blocked and/or scattered by dust. This statement is even strengthened at shorter wavelengths where the time-lags are larger due to the ability of optical and ultraviolet photons to penetrate deeper in the dusty medium.

In summary, our last set of models has shown that clumpy disks with clumps of variable sizes and optical thickness have very distinctive features that are quite different for a variety of dust prescriptions. The importance of large and dense clumps at the outer edges of the disk is crucial for obtaining an efficient obscuration. They also enable large polarization degrees and time-lags. If the disk becomes more transparent with radial distances from the source, obscuration is less efficient and we observe a rotation of the polarization angle with increasing inclinations.

# Discussion and observational prospects

We have shown that varying the morphology and/or the distribution of dust density in equatorial dusty structures has a profound impact on the observational properties (total flux, polarization degree and angles, time-lags) we have considered. The flux detected at equatorial inclinations is very sensitive to the structure of the disk: uniform or fragmented media result in flux levels that can be orders of magnitude different from those observed at polar viewing angles. Clumpy structures (either with constant or variable cloudlet radii) tend to be less efficient in blocking radiation along the equatorial plane unless the outer clouds are substantially bigger than the inner clouds. The resulting polarization is also distinctively different between the three morphologies and we found it to be much more sensitive to the radial distribution of dust than the photometric marker. The polarization degree is inclination-dependent and varies together with rotations of the polarization position angle that can trace the dust stratification. Finally, the averaged time-lags resulting from multiple scattering in different models is also a very distinctive signature that can probe the morphology of the scattering medium. Those two observational properties, polarization and time-lags, are the bases of the polarized reverberation mapping technique introduced by .

## Polarized reverberation mapping

By comparing the amplitude of variability of the polarized flux to the amplitude of variability of the total flux in a blue passband with effective wavelength of 3600 Å, found that the polarized flux of the Seyfert-1 NGC 4151 follows the total flux with a lag of 8 $\pm$ 3 days. This, together with the orientation of the position angle of the polarized flux, enabled to constrain the effective size of the unresolved equatorial scattering region of the AGN, most probably composed of electrons. This is the first and unique example so far illustrating the importance of polarized reverberation mapping in resolving the innermost structure of AGN. Achieving those observations is time consuming and required about seven years of monitoring the total and polarized fluxes of NGC 4151. In contrast with the work of , who probed the inner broad line region, we have shown here that dust scattering results in longer timescales, of the order of several months for type-1 (polar) inclinations. It is therefore very important to select the optimal wavebands before starting such long observational campaigns.

Our results indicate that the near-infrared band seems to be the best to search for high degrees of polarization, since photons are not energetic enough to travel far into the dusty medium; instead, they are reflected (the albedo is large) and do not penetrate much the disk, leading to high polarization degrees. This applies to either polar, intermediate or equatorial inclinations. However, the reader must bear in mind that thermal re-emission from dust and starlight dilution (from the host galaxy in the case of AGN) may also be strong enough to wipe out the polarization signature . Hence, a more secure waveband to search for the polarization signal from dusty equatorial structures is ultraviolet, where starlight emission decreases in spiral and elliptical galaxies .

The reverberation mapping technique requires to observe both the continuum and the reprocessed spectra; the central source must be directly visible and the line of sight must not cross the obscuring dusty torus. This limits us to polar viewing angles, for which the time-lags are the shortest. In the AGN context, this is beneficial since the averaged time delays between variations of the polarized flux and of the total flux can be of the order of months (see Fig.  for example). We compared our results to the ones obtained by , who investigated the mid-infrared reverberation response of a clumpy torus, and found them to be in agreement with ours, even if the authors considered lower energies. Depending on the isotropic or anisotropic distribution of clumps in their torus models, found an averaged optical-to-infrared time-lag of 80 – 150 days (i.e. 2.6 – 4.9 months) at 3.6 $\mu$m. In comparison, our clumpy model with constant cloudlet radius and optical depth gives a time-lag of 3.9 months (cross-correlated between the total and polarized fluxes at 1 $\mu$m). Shorter delays, can be obtained in the ultraviolet band (a conclusion also shared by ).

We therefore conclude that polarized reverberation mapping is quite possibly better suited for ultraviolet/blue observations. The time-lags between the unpolarized continuum and the polarized reprocessed spectrum will be shortened, while the observed polarization degree will be less diluted by starlight contribution. The combination of the two techniques, leading to $polarized$ time reverberation studies, will strongly help to break degeneracies. Our simulations suggest that much more sophisticated models are less easy to distinguish/constraint, but the combination of observables can still serve to rule out certain scenarios. The main difficulty here is that for low inclinations, the polarized fraction is small whereas for large inclinations, the unabsorbed, direct flux is severely reduced. have nevertheless clearly established the feasibility of such an observational study for the case of NGC 4151, but one has to remember that it took them about seven years to complete the observations. Multi-wavelength analysis such as radio observations to probe the kinematics and composition of the circumstellar/circumnuclear region or hard X-rays, which are much less absorbed/scattered than the optical, might be useful to narrow down the uncertainties. A detailed treatment of the problem is deferred to a forthcoming paper where we intend to construct artificial light curves in both total and polarized light to measure realistic time lags, including both dilution by the host, interstellar polarization and sophisticated transfer functions.

## Towards more sophisticated models

We have shown that two dusty structures with the same geometry but different dust grain distributions (e.g, a linear increase and an exponential increase of opacity with radial distance from the central source) are distinctively different in terms of polarization and timing properties, see Fig.  for example. However, those differences are less likely to be detectable in terms of photometry, since almost all models give the same inclination-dependent trend in flux attenuation. To detect a radial stratification of dust, time-resolved polarimetry appears to be the solution but it is unclear that this conclusion would also applies for vertical stratifications and for chemical variations of the dust grains with distance from the source. It has been known for long that the dust composition and temperature of stellar nebulae varies with distance from its young star ; the same applies to galaxies, since the galactocentric dust mineralogy varies with distance and metallicity . We thus naturally expect circumstellar and circumnuclear dusty disks to be also more complex than considered here.

It is beyond the scope of this paper to consider all possible dust distributions with distance, altitude, temperature or metallicity. We have already proven that uniformly filled equatorial dusty structures give different polarimetric and timing outputs than structures with radial dust opacity gradients. However, in order to illustrate the complexity of the parameter space for filling the disk with dust, we show in Fig.  one realization of our numerical code for a clumpy disk with constant cloud radii in the case of a linear decrease of dust density with vertical distance from the equatorial plane. The simulation was achieved at 1 $\mu$m and results are shown in Fig. using a plain solid black line. For comparison, we also show a model with the same parameters, excepts that the gradient is now radial instead of being vertical; the dust opacity linearly decreases with radial distance from the central source (black dashed line). As can be seen, the two configurations (vertical and radial variations of opacity) are almost indistinguishable in terms of photometry. The signal is the same at polar viewing angles and the obscured flux at equatorial orientations is equivalent. Differences can only be attributed to the random positions of the clouds. The unique true difference between the two models is the inclination angle at which the transition between the "unobscured" and "obscured" state occurs. The vertical opacity stratification configuration is similar to a configuration where an optically thin atmosphere lays on top of denser equatorial layers. Photons grazing the disk surface are less likely to be absorbed. It is only at a larger inclination, where the medium finally becomes optically thick, that the disk can efficiently block radiation. In terms of polarization we see that the inclination-dependent degree of polarization follows the same trend, but the maximum amount of polarization is only 11% instead of 14% at intermediate inclinations. The small bump of polarization observed at an inclination of $\sim$ 75$^\circ$ is due to the random distribution of the clumps position in the disk. The polarization position angle is the only marker showing a distinctive difference between the two configurations. The polarization angle is $90^\circ$ for $i=0^\circ$, indicating that scattering mainly happens along the equatorial plane. In comparison, for a radial opacity stratification, the polarization angle is close to 45$^\circ$ since both equatorial and polar scattering are contributing. Here, the vertical stratification of dust density favors scattering along the equatorial plane where the disk is denser. For larger inclinations, the polarization angle rotates to 0$^\circ$, as in the radial case, since backscattering on the disk funnel becomes important at those intermediate inclinations. It is only at large inclinations, when the continuum is obscured and when backscattering is no longer dominant with respect to equatorial scattering, that the polarization angle switches to 90$^\circ$. Similarly to the photometric results, the angle at which this transition happens is different from the radial stratification scenario. Finally, the inclination-dependent averaged time-lag is almost indistinguishable between the two cases since the geometry of the medium plays a more important role than its composition in time domain studies.

# Conclusions

In this paper, we have shown that the morphology or the distribution of dust density of an equatorial dusty structure has a profound impact on the polarized signal and on the expected (averaged) time-lags. A plain uniform structure may have a similar behavior to that of a complex clumpy one in terms of flux attenuation but the polarization degree and angle would be significantly different. If the polarization signal from the equatorial dusty disk can be isolated from the central source or from additional components (which is more problematic in the case of AGN), it is possible, in principle, to distinguish between different models. In particular, the dust distribution inside a disk has a very clear inclination-dependent polarization signature. Since the inclination is not easy to determine from observations, coupling timing and polarimetric informations is crucial for determining the physical size of the unresolved region, together with its composition.

We also found that the ultraviolet/blue band is quite probably better suited for polarized time-reverberation studies. The polarization level due to dust scattering is not expected to be as high as in the near-infrared but the ultraviolet waveband should be less contaminated by external starlight and thermal re-emission. In addition, the time delays are expected to be slightly shorter in this waveband, allowing for less time-consuming observational campaigns. We intend to continue this study by applying cross-correlation methods to light curves obtained by our Monte Carlo method. We aim at reproducing the observed time-delays of NGC 4151 first, estimate the inclination of the AGN by testing all the possible orientations thanks to our numerical code, and then try to evaluate the existence of additional structures in the AGN by checking their influence onto the resulting polarization signal and time-delays.

[^1]:

[^2]: Collimated polar outflows, quasi-spherical winds and jets can also form during accreting periods but it is beyond the scope of this paper to treat them.