Activation Function and output

Lets create a matrix of shape 5×5 to understand the activation function working: import numpy as np Y2=np.arange(25).reshape(5,5) print(Y2) array([[ 0, 1, 2, 3, 4], [ 5, 6, 7, 8, 9], [10, 11, 12, 13, 14], [15, 16, 17, 18, 19], [20, 21, 22, 23, 24]]) Now create a weight matrix of similar shape W3=np.arange(25).reshape(5,5) …

Parametric vs Non Parametric Algorithm

It depends on whether the number of parameters in the model grows as the number of examples in the dataset grows. Here, parameter means the entity that measures the model like median. Parametric :Fixed number of parameters regardless of the number of examples. Liner Regression Logistic Regression Linear Discriminant Analysis Perceptron Naive Bayes Non-Parametric: Not …

AIC vs BIC

AIC stands for Akaike’s Information Criteria and BIC known for Bayesian Information Criteria. Akaike’s Information Criteria was formed in 1973 on the other hand Bayesian Information Criteria in 1978. When comparing the Bayesian Information Criteria and the Akaike’s Information Criteria, penalty for additional parameters is more in BIC than AIC. AIC(M)=2k−2logL^MAIC(M)=2k−2log⁡L^M and BIC(M)=klogn−2logL^MBIC(M)=klog⁡n−2log⁡L^M Note: where n is …

Generalized Linear Models

Here general refers to the dependence on potentially more than one explanatory variable, v.s. the simple linear model : Some of the Generalized liner models are: 1-Ordinary Least Squares :Linear Regression fits a linear model with coefficients to minimize the residual sum of squares between the observed responses in the data set, and the responses …

P Value

When you perform a hypothesis test in statistics, a p-value helps you determine the significance of your results. A small p-value (typically ≤ 0.05) indicates strong evidence against the null hypothesis, so you reject the null hypothesis. A large p-value (> 0.05) indicates weak evidence against the null hypothesis, so you fail to reject the …

Measurement of Central Tendency

Central Tendency: A measure of central tendency is a single value that attempts to describe a set of data by identifying the central position within that set of data. As such, measures of central tendency are sometimes called measures of central location. The mean, median and mode are all valid measures of central tendency mean() …