I think, it takes very little time to compute triangle area once the triangle is found. Why not have a single function

double minEnclosingTriangle(InputArray points, OutputArray triangle)

that returns the triangle area?

This will also resolve problem with Python bindings, because for Python both functions will take a single parameter and therefore can not be distinguished one from another.