A lithium battery structure, comprising: a first and a second battery units, each of the battery units including a first current collector, a first active material layer, a second active material layer and a second current collector, wherein the first current collector comprising: a conductive substrate, having a first surface, a second surface opposite and parallel to the first surface and a plurality of through holes extended from the first surface to the second surface; and an isolation layer, disposed on the first surface of the conductive substrate and essentially covering completely the first surface and sidewalls of the through holes, and extending to cover parts of the second surface; wherein the first active material layer is disposed on an uncovered area of the second surface, and the second active material layer and the second current collector sequentially disposed on the first surface of the conductive substrate completely covered by the isolation layer; wherein the first and the second battery units are essentially face-to-face disposed to each other by the first active material layers; an ion guiding layer, disposed between the first active material layers of the first and the second battery units and extending to the through holes; and a packaging structure, disposed between the second current collectors of the first and the second battery units to package the first and the second battery units. a first and a second battery units, each of the battery units including a first current collector, a first active material layer, a second active material layer and a second current collector, wherein the first current collector comprising: a conductive substrate, having a first surface, a second surface opposite and parallel to the first surface and a plurality of through holes extended from the first surface to the second surface; and an isolation layer, disposed on the first surface of the conductive substrate and essentially covering completely the first surface and sidewalls of the through holes, and extending to cover parts of the second surface; wherein the first active material layer is disposed on an uncovered area of the second surface, and the second active material layer and the second current collector sequentially disposed on the first surface of the conductive substrate completely covered by the isolation layer; a conductive substrate, having a first surface, a second surface opposite and parallel to the first surface and a plurality of through holes extended from the first surface to the second surface; and an isolation layer, disposed on the first surface of the conductive substrate and essentially covering completely the first surface and sidewalls of the through holes, and extending to cover parts of the second surface; wherein the first active material layer is disposed on an uncovered area of the second surface, and the second active material layer and the second current collector sequentially disposed on the first surface of the conductive substrate completely covered by the isolation layer; wherein the first and the second battery units are essentially face-to-face disposed to each other by the first active material layers; an ion guiding layer, disposed between the first active material layers of the first and the second battery units and extending to the through holes; and a packaging structure, disposed between the second current collectors of the first and the second battery units to package the first and the second battery units.