Loss Functions

Loss functions for training.

Base classes.

• Loss - Base class for loss functions
• LossType - Loss type enum
• CompositeLoss - Weighted combination of multiple losses

Reconstruction losses.

• MSELoss - Mean squared error
• mse_loss - MSE loss function
• R2Loss - R² coefficient loss
• r2_loss - R² loss function
• CosineEmbeddingLoss - Cosine similarity loss
• cosine_embedding_loss - Cosine loss function

Spectral losses.

• EigenvalueLoss - Eigenvalue optimization loss
• eigenvalue_loss - Eigenvalue loss function
• AdaptiveEigenvalueLoss - Adaptive eigenvalue gap loss
• adaptive_eigenvalue_loss - Adaptive eigenvalue loss function
• EigenvectorAlignmentLoss - Eigenvector alignment loss
• eigenvector_alignment_loss - Eigenvector alignment function
• SpectralContrastiveLoss - Spectral contrastive loss
• spectral_contrastive_loss - Spectral contrastive function
• LaplacianLoss - Graph Laplacian loss
• laplacian_loss - Laplacian loss function
• SpectralClusteringLoss - Spectral clustering loss
• spectral_clustering_loss - Spectral clustering function
• MinCutLoss - Min-cut loss for graph partitioning

Probabilistic losses.

• ELBOGaussianLoss - ELBO for Gaussian VAE
• elbo_gaussian_loss - ELBO Gaussian function
• ELBOGMMLoss - ELBO for Gaussian mixture VAE
• elbo_gmm_loss - ELBO GMM function
• ELBOLogCoshLoss - ELBO with log-cosh reconstruction
• elbo_log_cosh_loss - ELBO log-cosh function
• KLDivergenceLoss - KL divergence
• kl_divergence_loss - KL divergence function
• EntropyLoss - Entropy loss
• entropy_loss - Entropy loss function
• LogLikelihoodLoss - Log-likelihood loss
• loglikelihood_loss - Log-likelihood function
• MultivariateLogLikelihoodLoss - Multivariate log-likelihood
• multivariate_loglikelihood_loss - Multivariate log-likelihood function

Regularization losses.

• OrthogonalLoss - Orthogonality constraint loss
• orthogonal_loss - Orthogonality loss function
• DecorrelationLoss - Feature decorrelation loss
• decorrelation_loss - Decorrelation loss function

Knowledge distillation losses.

• DistillationLoss - Knowledge distillation
• distillation_loss - Distillation loss function
• FeatureMatchingLoss - Feature matching
• feature_matching_loss - Feature matching function
• SpectralPreservationLoss - Spectral properties preservation
• spectral_preservation_loss - Spectral preservation function

Utilities.

• check_eigenvalues_sorted - Check if eigenvalues are sorted