Navigate to Windows Settings -> Security Settings -> Advanced Audit Policy Configuration -> Audit Policy -> Logon/Logoff. Under that, enable Success and Failure auditing for Audit Logon, Audit Logoff, and Audit other logon/logoff events.