fmgoncalves/p5-cassandra-simple — Issue #10: loop over all rows of a column family
Author: neonknight
Created: 2012-02-28 13:28:43+00:00
State: open

I'm trying to loop over all rows in a column family. This is well performing and very scalable in __pycassa__:
```
for row in mycolfam.get_range():
```
My test data set of ~200000 rows is being processed in 20s (10000rows/s) on a weak development virtual machine.

However, I haven't found a working solution in __cassandra-simple__. Using something like
```
$conn->get_range('mycolfam', {'row_count'=>$maxrows});
```
will start loading all tokens from the database into memory. This works for *row_count* with a maximum of 10000. A bigger *row_count* will result in enormous times to finish the request. I'm talking about several hours for 200000 rows.

Is there a scalable way in __cassandra-simple__ that I missed? Or is this impossible at the moment?