# Wide and Fast: Monitoring the Sky in Subsecond Domain with the FAVOR and TORTORA Cameras

Authors: Sergey Karpov; Grigory Beskin; Sergey Bondar; Adriano Guarnieri; Corrado Bartolini; Giuseppe Greco; Adalberto Piccioni
Journal: Advances in Astronomy
 (2010)

---

## Abstract

In order to detect and investigate short stochastic optical flares from a number of variable astrophysical objects (GRBs, SNe, flare stars, CVs, X-Ray binaries) of unknown localizations as well as near-earth objects (NEOs), both
natural and artificial, it is necessary to perform the systematic monitoring of large regions of the sky with high temporal resolution. Here we discuss the criteria for a system that is able to perform such a task and describe two cameras we created for wide-field monitoring with high temporal resolution—FAVOR and TORTORA. Also, we describe basic principles of real-time data processing for the high frame rates needed to achieve subsecond temporal resolution on a typical hardware.


---

## Body

## 1. Introduction

The systematic study of night sky variability on subsecond time scales still remains an important, but practically unsolved problem. Its necessity for the search of non-stationary objects with unknown localization has been noted by Bondi in [1]. Such studies have been performed [2, 3], but due to technical limitations it has only been possible either to reach high temporal resolution of tens of milliseconds in monitoring of 5’–10’ fields, or use 5–10 seconds time resolution in wider fields. The wide-field monitoring systems currently in operation, such as WIDGET [4], RAPTOR [5], BOOTES [6] and π of the Sky [7], while having good sky coverage and limiting magnitude, lack temporal resolution, which significantly lowers their performance in the study of transient events of subsecond duration.Optical transients of unknown localization may be very short. For example, the rise times of flashes of some UV5 Cet-like stars may be as short as 0.2–0.5 seconds [8], 30% of GRBs have the duration shorter than 2 seconds, and details of their light curves may be seen on time scales shorter than 1 ms [9]. Also, of great interest are the observations of very fast meteors which may be of extra-Solar system origin [10].One more task which requires wide-field observations with high temporal resolution is the monitoring of near-Earth space. There are a number of satellites, as well as a vast amount of small space debris pieces, which have rapidly evolving trajectories, and so are difficult to observe by typical satellite tracking methods. High temporal resolution is needed here due to the fast motion of such objects on the sky.To study the variability of large sky areas on such time scales, it has been proposed [11, 12] to use large low-quality mosaic mirrors of air Cerenkov telescopes. However, in [13, 14] we demonstrated that it is possible to achieve the subsecond temporal resolution in a reasonably wide field with small telescopes equipped with fast CCDs, to perform fully automatic searching and classification of fast optical transients. Moreover, a two-telescope scheme [15, 16], able to study such transients in a very short time after detection, has been proposed. According to these ideas, we created the prototype fast wide-field camera called FAVOR [14] and the TORTORA camera as part of the TORTOREM [17] two-telescope complex, and operated them over several years.The recent discovery of the brightest ever GRB, GRB080319B (the Naked-Eye Burst [18]), by several wide-field monitoring systems—TORTORA [19], RAPTOR [20] and Pi of the Sky [21]—and the subsequent discovery of its fast optical variability [22] on time scales from several seconds down to a subsecond time scale [23] demonstrated that the ideas behind our efforts in fast temporal resolution wide-field monitoring are correct.In this article we describe these basic ideas, covering both the selection of optimal hardware parameters and the principles of real-time data processing for such high temporal resolution observations.


## 2. General Requirements for Wide-Field Monitoring

Typical followup observations, performed for the detailed study of newly discovered transients, require no more than a good robotic telescope with fast repointing. Such instruments, however, will inevitably only begin to capture data after the first few seconds or tens of seconds of the event. To get information from the start of the event, which is essential for understanding the nature and properties of transients, one needs to observe the position of the transient before it appears. And, as transients occur in unpredictable places, the systematic monitoring of large sky regions becomes an important task.For such monitoring, one needs to select the optimal set of mutually exclusive parameters—the angular size of the field of view, the limiting magnitude and the temporal resolution. Indeed, the area of the skyΩ, covered by an objective with diameter D and focal length F, equipped with an N×N pixels CCD with pixel size of l and exposure time of τ seconds, is(1)Ω∝N2l2F2
while the faintest detectable object flux, for a sky background noise dominating over the CCD read-out noise, is(2)Fluxmin∝(DF)D-2lτ-1/2.
For the case of CCD read-out noise σ domination, the limit is(3)Fluxmin∝σD2τ.
The number of detectable events, uniformly distributed in Euclidean space, is(4)Number∝Ω·Flux-3/2=D(DF)1/2τ3/4N2l1/2
when the duration of the event T is longer than the exposure, and(5)Number∝Ω·Flux-3/2(τT)-3/2=D(DF)1/2T3/2τ-3/4N2l1/2
when it is shorter—as Fluxmin decreases, one can detect a larger number of events in a greater volume. High temporal resolution, thus, is essential in the detection and analysis of short optical transients. On the other hand, it requires the application of fast CCD matrices, which usually have large read-out noise, that limits the detection of a faint objects.Most of the general-purpose wide-field monitoring systems currently in operation, listed in Table1, chose a large of field of view while sacrificing the temporal resolution to achieve decent detection limit. Our cameras, FAVOR and TORTORA, in contrast, chose high temporal resolution as a key parameter.Table 1
Wide-field monitoring cameras currently in operation. For FAVOR and TORTORA the limits correspond to 3σ detection on a single frame, and differ from their real-time operational values.
NameField of viewTemporal resolutionLimit(degrees)(seconds)(magnitudes)WIDGET62× 62510mRAPTOR A/B40× 406012mRAPTOR Q180× 1801010mBOOTES16× 113012mπ of the Sky33× 331011.5mAROMA-W25× 355–10010.5m–13mMASTER-VWF20× 21511.5mMASTER-Net30× 3019mFAVOR16× 240.1310m–11.5mTORTORA24× 320.139m–10.5mSeveral examples of various hardware configurations leading to different sizes of field of view for a fixed temporal resolution are shown in Figure1.Figure 1
Limiting magnitudes for various configurations of objective diameter and CCD used. The Sony ICX285AL 1388× 1036 CCD with 6.5 μm pixels and 6e- read-out noise, without and with the image intensifier used to effectively shorten the focal length 7.7 times, is compared to the Andor iXonEM+888 1024 × 1024 EM-CCD with 13 μm pixel and 0.5e- read-out noise. The objectives are assumed to have D/F= 1/1.2. Vertical gray lines mark the objective sizes of FAVOR and TORTORA cameras. Numbers inside the lines represent the corresponding sizes of the field of view. The limiting magnitudes are in B band for 0.13 s exposure. For TORTORA camera, the effective diameter is shown, which is 2 times smaller than the input window size due to multi-mirror objective design which reflects back approximately 50% of incoming light. The variant with a low-noise EM-CCD is obviously the best in sensitivity, while the one with the image intensifier is far superior in a size of field of view.


## 3. FAVOR and TORTORA Cameras

It is obvious that realization of an ideal wide-field system combining both wide field, high temporal resolution and a good detection limit is very difficult. One possible variant of such a project, the Mega TORTORA one, based on a multi-objective design and fast, low-noise EM-CCDs, is presented elsewhere [24]. For our cameras, we have used a simpler and cheaper approach, described in [14]. Its main idea is the application of an image intensifier to both effectively reduce the focal length by downscaling the image, and to overcome the read-out noise of a fast TV-CCD by the high amplification factor of the intensifier. Technical parameters of the cameras are listed in Table 2, and their images are shown in Figure 2. Compared to FAVOR, TORTORA has a somewhat smaller aperture and focal length, as well as cruder pixel scale, but a significantly greater field of view and slightly sharper PSF FWHM.Table 2
Technical parameters of the FAVOR and TORTORA cameras.
FAVORTORTORAMain objectiveDiameter150 mm lens120 mm mirrorFocal length180 mm150 mmFocal ratio1/1.21/1.2Image intensifierPhotocathodeS20S20Diameter90 mm90 mmGain150150Scaling factor7.77.7Quantum efficiency10%10%CCDModelVS-CTT285-2001VS-CTT285-2001Frame size1388× 10361388× 1036Pixel scale57′′/pix81′′/pixExposure0.13 s0.13 sPixel size6.5μm6.5μmRead-out noise6e-/pix6e-/pixStar FWHM3.1′2.7′MountEquatorialAlt-azimuthalFocusmanualautomaticImages of prototype fast wide-field FAVOR camera, located in the Special Astrophysical Observatory of Russian Academy of Sciences at North Caucasus, and the TORTORA camera, mounted on top of the REM robotic telescope in La-Silla Observatory, ESO, Chile.Both cameras use custom f/1.2 objectives, refractive in FAVOR and reflective in TORTORA, and are equipped with image intensifiers and fast CCDs based on the Sony ICX285AL chip. The TORTORA camera is also equipped with two motors for automatic focusing of the main objective and transmission optics, while FAVOR is focused manually. The FAVOR camera is placed on a dedicated equatorial mount, while the TORTORA is mounted on top of the Italian REM telescope, which has an alt-azimuthal mount design (it leads to the field rotation during the observations). The cameras, when possible, are pointed to the regions of the sky observed by the Swift telescope according to its real-time pointing information distributed through GCN network [25].


## 4. Data Acquisition

The cameras are operated by a cluster of three PCs connected via a dedicated Gigabit Ethernet network. The first one is equipped with a TV5 frame-grabber; it acquires the data from a TV-CCD at a 7.5 frames per second rate, attaches a timestamps to them and supplies them to the network as a set of broadcast UDP packets. Any number of clients on this network can collect and process these data. In a typical scheme, one of clients is the RAID array which continuously stores all broadcast data for possible detailed future investigation. The size of the RAID array has to be chosen carefully to be able to store at least the amount of data collected during one or two nights; for an 8-hour long acquisition it corresponds to 580 Gb of data. The RAID PC also hosts the network service which is able to extract any given frame from the RAID array and send it to the client.One more client connected to the local network performs the real-time data processing, extracting the information on transients and performing their basic classification during the observations. Then, during day time, it performs the detailed analysis of these events. Also, this PC hosts the software controlling the whole cluster and, in the case of the TORTORA system, communicating with the REM telescope. A schematic view of the complete set of interacting network services inside the TORTORA system is presented in Figure3.Figure 3
Schematic view of interoperation of various TORTORA subsystems with the REM telescope. The data are distributed from TV-CCD through the local Gigabit Ethernet network to a RAID array for a temporary storage and to a real-time processing software. All subsystems are controlled by a dedicated service connected to the REM operating software and responsible for the management of the image intensifier high voltage power supply, auto-focusing subsystem, and so forth.


## 5. Real-Time Data Processing

The fast TV-CCD camera with 1388× 1036 pixels operating at a 7.5 Hz frame rate produces 20.5 megabytes of data each second. The processing of such an enormous data flow is complicated. A typical data processing pipeline, for example, SExtractor-based [26], requires at least one second on a modern PC to extract all objects from a single frame and perform their comparison with the catalogue. As this is an order of magnitude slower than needed for our task, we decided to use simpler data processing, aimed at the detection of variable objects only. This approach, often named “the differential imaging” method, is based on a statistical analysis of pixel values for a sequence of images. During the data acquisition, an “average frame” is being constantly updated, representing the mean values for each pixel over some number of previous frames (100 frames seems to be the optimal amount, since on longer scales the atmospheric variations become significant). Also, the “dispersion frame” is being formed in a similar way, representing the estimated standard deviations of each pixel over the same number of previous frames.Then, for each consecutive frame we subtract “average frame” to cancel the spatial variations across the frame related to inhomogeneities of both CCD and image intensifier sensitivities, and of the sky due to bright stars and Milky Way. Then, the resulting residual frame is divided by the “dispersion frame” to compensate for different levels of stationary variability—star PSF wings are more variable than the background, while CCD defects are mostly not variable. Finally, the thresholding is performed to locate pixels deviating significantly (i.e., greater than 3σ) from the mean level. The process is illustrated in Figure 4. A fast clustering algorithm is then used to locate continuous areas of interest on the frame—the so-called “events”. A 4σ pixel connected with a 3σ one is regarded as the minimal acceptable event. Assuming Gaussian statistics, this leads to a 0.5 purely stochastic false events per frame; in real operation, the number of such events is found to be 2–4 due to non-Gaussian nature of image intensifier noise, caused by stochastic nature of electron multiplication process as well as by thermal and ion events.Figure 4
Differential imaging method applied to a meteor track. Left pane: original frame imaged by the FAVOR camera. Middle pane: image with the “average frame” (the mean values of each pixel over the last 100 frames), subtracted. There are residual signatures of stars due to higher level of fluctuations in the wings of star PSFs, as well as regions with very low fluctuation levels due to CCD defects and dust in the focal plane. Right pane: residual image divided by a “dispersion frame” (standard deviations for each pixels estimated over last 100 frames). The only significant deviations from the zero level are due to the fast transient, which may be located and extracted by a thresholding on a 3-4σ level.Thus, the marginally detected event has a 7σ flux, which corresponds to V=10.5m-11.5m for FAVOR and V=9.5m-10.5m for TORTORA, depending on the sky conditions.It is worth mentioning that the dispersion estimation used in differential imaging corresponds to the temporal variations of a pixel value, not spatial variations of values across the single frame. The noise behaviour is generally non-ergodic—temporal and spatial dispersions may significantly differ, and the differential imaging limit may deviate from a single-frame “classical” detection limit by up to0.5m in both directions.The differential imaging method is not universal. The estimation of a “null hypothesis” statistical properties of each pixel over previous frames becomes biased when the transient is sufficiently long and bright—its flux on the first frames where it occurs influences the mean and dispersion values for the next frames. This is demonstrated in Figure5 for the case of the 60-seconds-long Naked-Eye Burst as well as a 2-seconds long artificial event with the same temporal structure and peak brightness. It is obvious that differential imaging is ineffective for a long and slowly-changing transients (which may be well studied by another methods on longer time scales); it is, however, extremely powerful in the detection of highly-variable or fast-moving ones (as fast motion implies rapid changes in pixels on the object edges). Also, due to this feature of the differential imaging, it is also insensitive to a slow variations of atmospheric conditions.Response of the differential imaging method to the Naked-Eye Burst, as seen by the TORTORA camera software. Left pane: original burst light curve in counts (black line), and corresponding deviations from the mean value over 100 previous points in units of the standard deviation estimated over the same interval (red line). The response is highly non-linear due to the influence of the burst itself on the estimation of the mean and standard deviation. The deviation never exceeds 5σ. Right pane: response to a burst with the same temporal structure and brightness, but 30 times shorter than Naked-Eye Burst (2-second duration). There is a sharp ~90σ peak in deviation.In spite of these problems, the application of differential imaging method solves the “bottleneck” problem in real-time data processing in a high frame-rate case. The extraction of all events from a single frame, deviating significantly from the average one, requires only~10 ms on a typical PC.


## 6. Detection and Classification of Fast Optical Transients

Detection of a continuous region significantly deviating from the average frame level is not enough to draw a conclusion on its nature—it may be a meteor, satellite, flash of a star-like object or just a noise event. Therefore, some additional steps are then needed to check whether the object is real, and to determine its type.In our software, we use a simple three-stage algorithm. It is based on the determination of the parameters of object motion—its direction and speed. As a first step, after the initial detection of each event on the first frame, we form a circular region of expectation for its appearance on the next one, by assuming that its speed is below some reasonable value (for FAVOR and TORTORA, we chose 1 degree per second as an upper limit for the speed). Then, on the second frame, for all events inside this region, we form a set of hypotheses about the possible directions and speeds of the object; for each hypothesis errors of coordinate determinations for the first and second events define a new, smaller elliptical region of expectation for the next frame. Finally, on the third frame, we check whether the object is detected in the positions predicted by each hypothesis, and usually only one hypothesis survives. This three-stage process is illustrated in Figure6. The object for which no suitable events appeared on the second frame, is assumed to be a noise event, and is rejected. Objects with no suitable events on the third frame may be optionally checked on the fourth one. Objects with detected and confirmed motion may be tracked while they are staying inside the field of view, constantly adding events from new frames to their trajectories and light curves, which allows their motion parameters to be determined with increasing accuracy; a typical satellite passing over the FAVOR site may be seen on a set of up to 500 consecutive frames.Motion hypotheses formulation. Three stages of a detection and classification of a transient. From left to right: the initial detection of the event on a first image, formation of a circular region of expectation based on assumption about some reasonable maximal speed of expectation; the formation of a set of hypotheses on object motion direction and speed based on an appearance of events inside this region on a second frame; the rejection of failed and acceptance of successful hypotheses based on events seen on a third frame. Objects not detected on a second frame are immediately rejected as a probably noise events; objects with determined motion parameters are tracked until their disappearance from field of view or fading out below the detection limit. For FAVOR and TORTORA systems with 0.13 s temporal resolution, this three-stage algorithm is completed in less than 0.4 seconds, resulting in nearly real-time detection and classification of transient.Immobility is just an extremal kind of a motion—the motion with a zero speed. So, if the object is detected during three consecutive frames, and its speed is estimated to be no more than its statistical error, it is assumed to be an immobile transient, probably at a galactic or cosmological distance. Slowly moving satellites, however, may produce flares due to rotation, and the duration of the flares may be too short to measure their speed. An example of such a flare is shown in Figure7. Such events may be identified with known satellites by examining the catalogue of satellite orbital elements [27] and pre-computing their trajectories over the observatory field of view. It is, unfortunately, not always possible to identify such flashes as not all satellites (and large enough pieces of cosmic debris) are in the database. However, they may be identified if their flashes are repeating while they pass through the camera field of view.Figure 7
Example of a short flare detected by the FAVOR camera. The total length of the event is 0.4 seconds (seen on 3 successive frames), and the object motion speed is too low to be detected. This is identified as a satellite event by checking the database of satellite orbital parameters.Meteors cannot be reliably detected by the algorithm, as they move too fast, forming significantly non-point-like tracks on the frames, and they are often visible for only one or two frames. However, bright ones can be extracted by purely geometrical criteria on each frame, and then combined together on a postprocessing stage. Then, classical methods like the Hough transform may be used to estimate the direction of the meteor track, to get their intensity profiles and—in the case of events lasting several frames—to measure their velocities. An example of a fast meteor detected by the FAVOR camera is shown in Figure8.Figure 8
Example of a fast (flight time approximately 0.3 seconds) and bright (Vpeak≈ 3) meteor detected by the FAVOR camera. Sub-frame brightness variations, as well as long-lasting trail, are clearly seen.The algorithm described above can detect a transient and measure its motion parameters in a three consecutive frames, which for the FAVOR and TORTORA cameras corresponds to less than 0.4 seconds. Then the nature of the transient may be guessed based on this information and by comparing its position and time of appearance with the catalogue of satellite passes over the site. At that point, any event not showing signatures of motion and not present in the satellites database, may become the targets of a follow-up and detailed investigation by robotic telescopes [17].


## 7. Conclusions

The importance of wide-field monitoring is obvious. High temporal resolution must be an essential part of such monitoring, as it has been demonstrated by the discovery of the fast optical variability of the Naked-Eye Burst. The real-time data processing is also important, as it allows the detected transient information to be distributed to robotic telescopes or, in the case of a Mega TORTORA-like complex [24], to reconfigure the system for a detailed investigation of the event. We have demonstrated that it is not too difficult to both construct the cameras able to perform such monitoring, and organize the real-time detection and classification of fast optical transients.



---

*Source: 784141-2010-03-02.xml*