The log-likelihood function for the logistic regression objective function.
LogisticRegressionFunction (const arma::mat &predictors, const arma::vec &responses, const double lambda=0)
LogisticRegressionFunction (const arma::mat &predictors, const arma::vec &responses, const arma::mat &initialPoint, const double lambda=0)
double Evaluate (const arma::mat ¶meters) const
Evaluate the logistic regression log-likelihood function with the given parameters. double Evaluate (const arma::mat ¶meters, const size_t i) const
Evaluate the logistic regression log-likelihood function with the given parameters, but using only one data point. const arma::mat & GetInitialPoint () const
Return the initial point for the optimization. void Gradient (const arma::mat ¶meters, arma::mat &gradient) const
Evaluate the gradient of the logistic regression log-likelihood function with the given parameters. void Gradient (const arma::mat ¶meters, const size_t i, arma::mat &gradient) const
Evaluate the gradient of the logistic regression log-likelihood function with the given parameters, and with respect to only one point in the dataset. const arma::mat & InitialPoint () const
Return the initial point for the optimization. arma::mat & InitialPoint ()
Modify the initial point for the optimization. const double & Lambda () const
Return the regularization parameter (lambda). double & Lambda ()
Modify the regularization parameter (lambda). size_t NumFunctions () const
Return the number of separable functions (the number of predictor points). const arma::mat & Predictors () const
Return the matrix of predictors. const arma::vec & Responses () const
Return the vector of responses.
arma::mat initialPoint
The initial point, from which to start the optimization. double lambda
The regularization parameter for L2-regularization. const arma::mat & predictors
The matrix of data points (predictors). const arma::vec & responses
The vector of responses to the input data points.
The log-likelihood function for the logistic regression objective function.
This is used by various mlpack optimizers to train a logistic regression model.
Definition at line 37 of file logistic_regression_function.hpp.
Evaluate the logistic regression log-likelihood function with the given parameters. Note that if a point has 0 probability of being classified directly with the given parameters, then Evaluate() will return nan (this is kind of a corner case and should not happen for reasonable models).
The optimum (minimum) of this function is 0.0, and occurs when each point is classified correctly with very high probability.
Parameters:
parameters Vector of logistic regression parameters.
Evaluate the logistic regression log-likelihood function with the given parameters, but using only one data point. This is useful for optimizers such as SGD, which require a separable objective function. Note that if the point has 0 probability of being classified correctly with the given parameters, then Evaluate() will return nan (this is kind of a corner case and should not happen for reasonable models).
The optimum (minimum) of this function is 0.0, and occurs when the point is classified correctly with very high probability.
Parameters:
parameters Vector of logistic regression parameters.
i Index of point to use for objective function evaluation.
Return the initial point for the optimization.
Definition at line 117 of file logistic_regression_function.hpp.
References initialPoint.
Evaluate the gradient of the logistic regression log-likelihood function with the given parameters.
Parameters:
parameters Vector of logistic regression parameters.
gradient Vector to output gradient into.
Evaluate the gradient of the logistic regression log-likelihood function with the given parameters, and with respect to only one point in the dataset. This is useful for optimizers such as SGD, which require a separable objective function.
Parameters:
parameters Vector of logistic regression parameters.
i Index of points to use for objective function gradient evaluation.
gradient Vector to output gradient into.
Return the initial point for the optimization.
Definition at line 50 of file logistic_regression_function.hpp.
References initialPoint.
Modify the initial point for the optimization.
Definition at line 52 of file logistic_regression_function.hpp.
References initialPoint.
Return the regularization parameter (lambda).
Definition at line 55 of file logistic_regression_function.hpp.
References lambda.
Modify the regularization parameter (lambda).
Definition at line 57 of file logistic_regression_function.hpp.
References lambda.
Return the number of separable functions (the number of predictor points).
Definition at line 120 of file logistic_regression_function.hpp.
Return the matrix of predictors.
Definition at line 60 of file logistic_regression_function.hpp.
References predictors.
Return the vector of responses.
Definition at line 62 of file logistic_regression_function.hpp.
References responses.
The initial point, from which to start the optimization.
Definition at line 124 of file logistic_regression_function.hpp.
Referenced by GetInitialPoint(), and InitialPoint().
The regularization parameter for L2-regularization.
Definition at line 130 of file logistic_regression_function.hpp.
Referenced by Lambda().
The matrix of data points (predictors).
Definition at line 126 of file logistic_regression_function.hpp.
Referenced by Predictors().
The vector of responses to the input data points.
Definition at line 128 of file logistic_regression_function.hpp.
Referenced by Responses().
Generated automatically by Doxygen for MLPACK from the source code.