Utilizing the Death Certificates Pipeline (DCP), we identified 481 records as pneumonia and influenza deaths, 9 of which were false positives. The precision for this method was calculated at 98%. Like the keyword searching method, of the 9 false positives, 6 records mentioned pneumonia in the cause of death field but their corresponding ICD-10 codes failed to provide any code related to pneumonia and the remaining errors were due to the reporting of aspiration pneumonia on the death certificate. This method had only 1 false negative for the death literal stating "recurrent aspiration with pneumonia", thus yielding a recall at 99.8%, being less than keyword searching. F-measure was calculated at 99%. The level of agreement between the pipeline and the gold standard was almost perfect with a Cohen's kappa of 0.988. The precision and recall scores that are reported above suggest that the DCP is a better method for identifying pneumonia and influenza deaths than keywordsearching. Therefore, we investigated if this observation is supported by statistical analysis. Performing a Fisher's exact test at α = 0.05, significant difference was seen for both recall (p = 1.742e-05) and precision (p = 0.026). The McNemar's test result also showed DCP to be a better method with a p-value = 2.152e-05.