| **Fair Values of Assets and Liabilities (Tables)**                                               | 3 Months Ended                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
|--------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
||
| **Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| Schedule of Fair Value, Assets and Liabilities Measured on Recurring Basis                       | Assets and liabilities carried at fair value on a recurring basis at March 31, 2014 are summarized in the following table:(dollars in thousands) Total Level 1 Level 2 Level 3Assets:        Available-for-sale debt securities:        U.S. government sponsored agencies $2,070 $— $2,070 $—Residential mortgage-backed securities-GSE 337,564 — 337,564 —Residential mortgage-backed securities-Private 20,282 — 20,282 —Commercial mortgage-backed securities-GSE 21,590   21,590  Commercial mortgage-backed securities-Private 9,844 — 9,844 —Business Development Company investment 2,651 2,651 — —Corporate notes 8,467 — 8,467 —Total available-for-sale debt securities 402,468 2,651 399,817 —Mortgage servicing rights 1,587 — — 1,587Interest rate swaps 41 — 41 —Interest rate locks and forward loan sales commitments 39 — 39 —Total assets at fair value $404,135 $2,651 $399,897 $1,587Assets and liabilities carried at fair value on a recurring basis at December 31, 2013 are summarized in the following table:(dollars in thousands) Total Level 1 Level 2 Level 3Assets:        Available-for-sale debt securities:        U.S. government sponsored agencies $2,077 $— $2,077 $—Residential mortgage-backed securities-GSE 341,147 — 341,147 —Residential mortgage-backed securities-Private 20,752 — 20,752 —Commercial mortgage-backed securities-GSE 21,439 — 21,439 —Commercial mortgage-backed securities-Private 9,585 — 9,585 —Business Development Company investment 2,737 2,737 — —Corporate notes 16,877 — 16,877 —Total available-for-sale debt securities 414,614 2,737 411,877 —Mortgage servicing rights 1,552 — — 1,552Interest rate locks and forward loan sales commitments 39 — 39 —Total assets at fair value $416,205 $2,737 $411,916 $1,552                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
| Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation                | The following tables present a reconciliation of all assets and liabilities measured at fair value on a recurring basis using significant unobservable inputs (Level 3) during the periods indicated:  Fair Value Measurements Using Significant  Unobservable Inputs (Level 3)  Mortgage Servicing Rights(dollars in thousands) Three Months Ended March 31,  2014 2013Balance, beginning of period $1,552 $726Total gains or losses (realized/unrealized):    Included in earnings, gross 144 348      Less amortization (109) (46)Balance, end of period $1,587 $1,028                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
| Fair Value Measurements, Recurring and Nonrecurring, Valuation Techniques                        | (dollars in thousands) Fair Value at March 31, 2014 Valuation Techniques UnobservableInput Range        Impaired loans, net $6,993 Discounted appraisals Collateral discounts 1.00% - 30.00%Other real estate owned 17,840 Discounted appraisals Collateral discounts 1.00% - 30.00%Mortgage servicing rights 1,587 Discounted cash flows Prepayment rate 10.00% - 25.00%Mortgage servicing rights     Discount rate 6.00% - 10.00%(dollars in thousands) Fair Value atDecember 31, 2013 Valuation Techniques UnobservableInput Range         Impaired loans, net $2,038 Discounted appraisals Collateral discounts 1.00%-30.00%Other real estate owned 18,263 Discounted appraisals Collateral discounts 1.00%-30.00%Mortgage servicing rights 1,552 Discounted cash flows Prepayment rate 10.00% - 25.00%Mortgage servicing rights     Discount rate 6.00% - 10.00%                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
| Fair Value, by Balance Sheet Grouping                                                            | The estimated fair values of financial instruments are as follows at the periods indicated:  At March 31, 2014(dollars in thousands) Carrying Value Estimated Fair Value Level 1 Level 2 Level 3Financial Assets:          Cash and cash equivalents $104,951 $104,951 $104,951 $— $—Investment securities:  Available-for-sale 402,468 402,468 2,651 399,817 —Investment securities:  Held-to-maturity 149,060 141,002 — 141,002 —Loans held for sale 1,961 1,961 — 1,961 —Loans, net 1,193,746 1,179,506 — — 1,179,506Accrued interest receivable 6,307 6,307 — 1,500 4,807Interest rate swaps 41 41 — 41 —Interest rate locks and forward loan sale commitments 39 39 — 39 —Financial Liabilities:          Deposits 1,767,930 1,768,997 — 1,768,997 —Retail repurchase agreements 5,152 5,152 — 5,152 —Federal Home Loan Bank advances 73,271 76,224 — 76,224 —Long-term notes payable 5,281 5,281 — — 5,281Junior subordinated debentures 56,702 22,973 — — 22,973Accrued interest payable 2,868 2,868 — 378 2,490  At December 31, 2013(dollars in thousands) Carrying Value Estimated Fair Value Level 1 Level 2 Level 3Financial Assets:          Cash and cash equivalents $67,430 $67,430 $67,430 $— $—Investment securities:  Available-for-sale 414,614 414,614 2,737 411,877 —Investment securities:  Held-to-maturity 151,795 141,125   141,125 —Loans held for sale 1,836 1,836 — 1,836 —Loans, net 1,185,463 1,129,826 — — 1,129,826Accrued interest receivable 6,283 6,283 — 1,583 4,700Interest rate locks and forward loan sale commitments 39 39 — 39 —Financial Liabilities:          Deposits 1,748,705 1,748,685 — 1,748,685 —Retail repurchase agreements 6,917 6,917 — 6,917 —Federal Home Loan Bank advances 73,283 75,663 — 75,663 —Long-term notes payable 5,263 5,263 — — 5,263Junior subordinated debentures 56,702 22,316 — — 22,316Accrued interest payable 2,624 2,624 — 389 2,235 |
| Continuing operations [Member]                                                                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| **Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
| Fair Value Measurements, Nonrecurring                                                            | Assets measured at fair value on a nonrecurring basis are included in the following table at March 31, 2014:(dollars in thousands) Total Level 1 Level 2 Level 3Impaired loans, net $6,993 $— $— $6,993Other real estate owned 17,840 — — 17,840Total assets at fair value from continuing operations $24,833 $— $— $24,833Assets measured at fair value on a nonrecurring basis are included in the following table at December 31, 2013:(dollars in thousands) Total Level 1 Level 2 Level 3Impaired loans, net $2,038 $— $— $2,038Other real estate owned 18,263 — — 18,263Total assets at fair value from continuing operations $20,301 $— $— $20,301                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |

| X                                                                                                                                                                                                                 |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Details**Name:**us-gaap_FairValueAssetsAndLiabilitiesMeasuredOnRecurringAndNonrecurringBasisLineItems**Namespace Prefix:**us-gaap_**Data Type:**xbrli:stringItemType**Balance Type:**na**Period Type:**duration |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Tabular disclosure of the inputs and valuation techniques used to measure fair value, and a discussion of changes in valuation techniques and related inputs, if any, applied during the period to each separate class of assets, liabilities, and financial instruments classified in shareholders' equity that are measured on a recurring and/or nonrecurring basis.
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 2 -Subparagraph (bbb) -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19207-110258
+ Details**Name:**us-gaap_FairValueAssetsAndLiabilitiesMeasuredOnRecurringAndNonrecurringBasisValuationTechniquesTableTextBlock**Namespace Prefix:**us-gaap_**Data Type:**nonnum:textBlockItemType**Balance Type:**na**Period Type:**duration |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Tabular disclosure of assets and liabilities by class, including financial instruments measured at fair value that are classified in shareholders' equity, if any, that are measured at fair value on a nonrecurring basis in periods after initial recognition (for example, impaired assets). Disclosures may include, but are not limited to: (a) the fair value measurements recorded and the reasons for the measurements and (b) the level within the fair value hierarchy in which the fair value measurements are categorized in their entirety (levels 1, 2, 3).
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 5 -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19296-110258
+ Details**Name:**us-gaap_FairValueAssetsMeasuredOnNonrecurringBasisTextBlock**Namespace Prefix:**us-gaap_**Data Type:**nonnum:textBlockItemType**Balance Type:**na**Period Type:**duration |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Tabular disclosure of the fair value measurement of assets using significant unobservable inputs (Level 3), a reconciliation of the beginning and ending balances, separately presenting changes during the period attributable to the following: (1) total gains or losses for the period (realized and unrealized), segregating those gains or losses included in earnings (or changes in net assets) and gains or losses recognized in other comprehensive income (loss), and a description of where those gains or losses included in earnings (or changes in net assets) are reported in the statement of income (or activities); (2) purchases, sales, issues, and settlements (each type disclosed separately); and (3) transfers in and transfers out of Level 3 (for example, transfers due to changes in the observability of significant inputs), by class of asset.
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 3 -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19279-110258Reference 2: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 2 -Subparagraph (c) -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19207-110258
+ Details**Name:**us-gaap_FairValueAssetsMeasuredOnRecurringBasisUnobservableInputReconciliationTextBlock**Namespace Prefix:**us-gaap_**Data Type:**nonnum:textBlockItemType**Balance Type:**na**Period Type:**duration |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Tabular disclosure of the fair value of financial instruments, including financial assets and financial liabilities, and the measurements of those instruments, assets, and liabilities.
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 2 -Subparagraph (a) -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19207-110258Reference 2: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 825 -SubTopic 10 -Section 50 -Paragraph 10 -Subparagraph (a) -URI http://asc.fasb.org/extlink&oid=28364263&loc=d3e13433-108611Reference 3: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 825 -SubTopic 10 -Section 50 -Paragraph 11 -URI http://asc.fasb.org/extlink&oid=28364263&loc=d3e13467-108611Reference 4: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 825 -SubTopic 10 -Section 50 -Paragraph 12 -URI http://asc.fasb.org/extlink&oid=28364263&loc=d3e13476-108611Reference 5: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 825 -SubTopic 10 -Section 50 -Paragraph 30 -Subparagraph (a) -URI http://asc.fasb.org/extlink&oid=6957238&loc=d3e14172-108612Reference 6: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 825 -SubTopic 10 -Section 45 -Paragraph 2 -URI http://asc.fasb.org/extlink&oid=6447952&loc=d3e13220-108610
+ Details**Name:**us-gaap_FairValueByBalanceSheetGroupingTextBlock**Namespace Prefix:**us-gaap_**Data Type:**nonnum:textBlockItemType**Balance Type:**na**Period Type:**duration |
| X                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| - Definition
Tabular disclosure of assets and liabilities, including [financial] instruments measured at fair value that are classified in stockholders' equity, if any, that are measured at fair value on a recurring basis. The disclosures contemplated herein include the fair value measurements at the reporting date by the level within the fair value hierarchy in which the fair value measurements in their entirety fall, segregating fair value measurements using quoted prices in active markets for identical assets (Level 1), significant other observable inputs (Level 2), and significant unobservable inputs (Level 3).
+ References
Reference 1: http://www.xbrl.org/2003/role/presentationRef -Publisher FASB -Name Accounting Standards Codification -Topic 820 -SubTopic 10 -Section 50 -Paragraph 1 -URI http://asc.fasb.org/extlink&oid=25499696&loc=d3e19190-110258
+ Details**Name:**us-gaap_ScheduleOfFairValueAssetsAndLiabilitiesMeasuredOnRecurringBasisTableTextBlock**Namespace Prefix:**us-gaap_**Data Type:**nonnum:textBlockItemType**Balance Type:**na**Period Type:**duration |