Yes, it has all the properties of a covariance matrix because it is one. You can define a multivariate normal distribution for which A transpose A is the covariance matrix.