lschallenges/data-engineering — pull request #54 by opti (2012-03-18 11:26:04+00:00)
Title: Completed challenge 

# Challenge for Software Engineer

## About
This is an example of Rails application solving the challenge described [here](https://github.com/opti/data-engineering)

## Environment & Requirements
For this challenge were used:

* Ruby (1.9.3)
* Rails (3.2.2)
* RubyGems (1.8.10)
* Bundler gem (1.0.21)

## Installation
bundle install
rake db:setup
rake jobs:work
rails s

## Running tests
rake spec

## What is inside?

1. Rails as web framework
2. RSpec for test coverage
3. activerecord-import for batch imports
4. DelayedJob for imports in background
5. Omniauth for authentication through OpenID
6. Twitter bootsrat for default layout

## What can be improved?

If we're talking about real Big data, then doing calculations through Ruby objects not so fast as it should be.
Some key-value store like Redis will help a lot to improve import speed.