| **Fair Values of Assets and Liabilities (Measured on Recurring Basis) (Details) (USD $)In Thousands, unless otherwise specified**       | Dec. 31, 2013 | Dec. 31, 2012 |
|-----------------------------------------------------------------------------------------------------------------------------------------|---------------|---------------|
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | $ 414,614     | $ 564,850     |
| Mortgage servicing rights                                                                                                               | 1,600         | 700           |
| U.S, Treasury and government agencies debt securities [Member]                                                                          |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 6,981         |
| U.S. government sponsored agencies debt securities [Member]                                                                             |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,077         | 22,173        |
| States and political subdivisions debt securities [Member]                                                                              |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 6,038         |
| Residential mortgage-backed securities - GSE [Member]                                                                                   |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 341,147       | 441,074       |
| Residential mortgage-backed securities - Private [Member]                                                                               |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 20,752        | 22,945        |
| Commercial mortgage-backed securities - GSE [Member]                                                                                    |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 21,439        | 23,359        |
| Commercial mortgage-backed securities - Private [Member]                                                                                |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 9,585         | 5,317         |
| Business Development Company investment [Member]                                                                                        |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,737         |          |
| Corporate notes [Member]                                                                                                                |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 16,877        | 36,963        |
| Continuing operations [Member] | Level 1 [Member]                                                                                       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,737         | 0             |
| Continuing operations [Member] | Level 2 [Member]                                                                                       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 411,877       | 564,850       |
| Continuing operations [Member] | Level 3 [Member]                                                                                       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Total [Member]                                                                    |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 414,614       | 564,850       |
| Mortgage servicing rights                                                                                                               | 1,552         | 726           |
| Total assets at fair value                                                                                                              | 416,166       | 565,576       |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | U.S, Treasury and government agencies debt securities [Member]   |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 6,981         |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | U.S. government sponsored agencies debt securities [Member]      |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,077         | 22,173        |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | States and political subdivisions debt securities [Member]       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 6,038         |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | Residential mortgage-backed securities - GSE [Member]            |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 341,147       | 441,074       |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | Residential mortgage-backed securities - Private [Member]        |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 20,752        | 22,945        |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | Commercial mortgage-backed securities - GSE [Member]             |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 21,439        | 23,359        |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | Commercial mortgage-backed securities - Private [Member]         |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 9,585         | 5,317         |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | Business Development Company investment [Member]                 |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,737         |          |
| Continuing operations [Member] | Recurring [Member] | Total [Member] | Corporate notes [Member]                                         |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 16,877        | 36,963        |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member]                                                                  |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,737         | 0             |
| Mortgage servicing rights                                                                                                               | 0             | 0             |
| Total assets at fair value                                                                                                              | 2,737         | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | U.S, Treasury and government agencies debt securities [Member] |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | U.S. government sponsored agencies debt securities [Member]    |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | States and political subdivisions debt securities [Member]     |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Residential mortgage-backed securities - GSE [Member]          |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Residential mortgage-backed securities - Private [Member]      |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Commercial mortgage-backed securities - GSE [Member]           |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Commercial mortgage-backed securities - Private [Member]       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Business Development Company investment [Member]               |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,737         |          |
| Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Corporate notes [Member]                                       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member]                                                                  |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 411,877       | 564,850       |
| Mortgage servicing rights                                                                                                               | 0             | 0             |
| Total assets at fair value                                                                                                              | 411,877       | 564,850       |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | U.S, Treasury and government agencies debt securities [Member] |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 6,981         |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | U.S. government sponsored agencies debt securities [Member]    |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 2,077         | 22,173        |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | States and political subdivisions debt securities [Member]     |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 6,038         |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Residential mortgage-backed securities - GSE [Member]          |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 341,147       | 441,074       |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Residential mortgage-backed securities - Private [Member]      |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 20,752        | 22,945        |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Commercial mortgage-backed securities - GSE [Member]           |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 21,439        | 23,359        |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Commercial mortgage-backed securities - Private [Member]       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 9,585         | 5,317         |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Business Development Company investment [Member]               |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             |          |
| Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Corporate notes [Member]                                       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 16,877        | 36,963        |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member]                                                                  |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Mortgage servicing rights                                                                                                               | 1,552         | 726           |
| Total assets at fair value                                                                                                              | 1,552         | 726           |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | U.S, Treasury and government agencies debt securities [Member] |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | U.S. government sponsored agencies debt securities [Member]    |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | States and political subdivisions debt securities [Member]     |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Residential mortgage-backed securities - GSE [Member]          |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Residential mortgage-backed securities - Private [Member]      |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Commercial mortgage-backed securities - GSE [Member]           |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                |          | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Commercial mortgage-backed securities - Private [Member]       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             | 0             |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Business Development Company investment [Member]               |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | 0             |          |
| Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Corporate notes [Member]                                       |          |          |
| **Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]**                                                         |          |          |
| Available-for-sale investment securities                                                                                                | $ 0           | $ 0           |

| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Fair value portion of probable future economic benefits obtained or controlled by an entity as a result of past transactions or events.
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 2 -Subparagraph (a) -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19207-110258
+ Details**Name:**us-gaap_AssetsFairValueDisclosure**Namespace Prefix:**us-gaap_**Data Type:**xbrli:monetaryItemType**Balance Type:**debit**Period Type:**instant |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Amount of investment in debt and equity securities categorized neither as held-to-maturity nor trading.
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 320 -SubTopic 10 -Section 25 -Paragraph 1 -Subparagraph (b) -URI http://asc.fasb.org/extlink&oid=28360136&loc=d3e22054-111558Reference 2: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 320 -SubTopic 10 -Section 50 -Paragraph 5 -Subparagraph (aa) -URI http://asc.fasb.org/extlink&oid=27724398&loc=d3e27232-111563Reference 3: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 320 -SubTopic 10 -Section 45 -Paragraph 1 -URI http://asc.fasb.org/extlink&oid=6871852&loc=d3e26610-111562
+ Details**Name:**us-gaap_AvailableForSaleSecurities**Namespace Prefix:**us-gaap_**Data Type:**xbrli:monetaryItemType**Balance Type:**debit**Period Type:**instant |
| X                                                                                                                                                                                                                 |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Details**Name:**us-gaap_FairValueAssetsAndLiabilitiesMeasuredOnRecurringAndNonrecurringBasisLineItems**Namespace Prefix:**us-gaap_**Data Type:**xbrli:stringItemType**Balance Type:**na**Period Type:**duration |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Fair value of an asset representing net future revenue from contractually specified servicing fees, late charges, and other ancillary revenues, in excess of future costs related to servicing arrangements.
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 860 -SubTopic 50 -Section 50 -Paragraph 3 -Subparagraph (a)(1) -URI http://asc.fasb.org/extlink&oid=7882072&loc=d3e122625-111746
+ Details**Name:**us-gaap_ServicingAssetAtFairValueAmount**Namespace Prefix:**us-gaap_**Data Type:**xbrli:monetaryItemType**Balance Type:**debit**Period Type:**instant |