* - start working on implementation of sqrtm op Signed-off-by: Yurii <iuriish@yahoo.com> * - improving householder procedure Signed-off-by: Yurii <iuriish@yahoo.com> * - further polishing householder stuff Signed-off-by: Yurii <iuriish@yahoo.com> * - polishing hh pivoting qr procedure Signed-off-by: Yurii <iuriish@yahoo.com> * - polishing BiDiagonalUp procedure Signed-off-by: Yurii <iuriish@yahoo.com> * - polishing householder sequence class Signed-off-by: Yurii <iuriish@yahoo.com> * - polishing jacobi svd class Signed-off-by: Yurii <iuriish@yahoo.com> * - polishing svd stuff 1 Signed-off-by: Yurii <iuriish@yahoo.com> * - polishing svd stuff 2 Signed-off-by: Yurii <iuriish@yahoo.com> * - implementation and testing class which performs Hessenberg decomposition of square matrix Signed-off-by: Yurii <iuriish@yahoo.com> * - add static method to JacobiSVD class which makes the continuous Givens rotation generation algorithm Signed-off-by: Yurii <iuriish@yahoo.com> * - implementation and testing auxiliary methods of Schur decomp class Signed-off-by: Yurii <iuriish@yahoo.com> * some references here and there Signed-off-by: raver119 <raver119@gmail.com> * - trying figure out difference between eigen and our Schur alg Signed-off-by: Yurii <iuriish@yahoo.com> * - testing fixing bugs in Schur decomposition op Signed-off-by: Yurii <iuriish@yahoo.com> * - start to implement class which performs calculation of eigen values and vectors Signed-off-by: Yurii <iuriish@yahoo.com> * - add to EigenValsAndVecs method which calculates complex eigen vectors Signed-off-by: Yurii <iuriish@yahoo.com> * - testing and fixing bugs in EigenValsAndVecs class Signed-off-by: Yurii <iuriish@yahoo.com> * - implementation and testing triangularSolver class Signed-off-by: Yurii <iuriish@yahoo.com> * Added a 2D routine for triangular systems solve. Signed-off-by: shugeo <sgazeos@gmail.com> * Refactored triangularSolve2D routine and tests. Signed-off-by: shugeo <sgazeos@gmail.com> * Refactored another test for triangularSolve2D. Signed-off-by: shugeo <sgazeos@gmail.com> * Refactored test for triangularSolve for vector-bar case. Signed-off-by: shugeo <sgazeos@gmail.com> * Refactored triangularSolve2D routine and tests. Signed-off-by: shugeo <sgazeos@gmail.com> * - implementation of FullPivLU class Signed-off-by: Yurii <iuriish@yahoo.com> * - fix bugs in FullPivLU::solve method Signed-off-by: Yurii <iuriish@yahoo.com> * - correct permutation vector in FullPivLU::solve Signed-off-by: Yurii <iuriish@yahoo.com> * - correct include headers Signed-off-by: Yurii <iuriish@yahoo.com> * - implementation of Sqrtm class Signed-off-by: Yurii <iuriish@yahoo.com> * - testing and fixing bugs in Sqrtm class Signed-off-by: Yurii <iuriish@yahoo.com> * - include sqrtm classes to cuda folder, investigate in what places synchronization doesn't work Signed-off-by: Yurii <iuriish@yahoo.com> * Added implementation for cuda triangularSolve2D and also refactored triangularSolve2D for cpu. Signed-off-by: shugeo <sgazeos@gmail.com> * Eliminated waste implementations. Signed-off-by: shugeo <sgazeos@gmail.com> * - make offset calculation faster in t<> methods Signed-off-by: Yurii <iuriish@yahoo.com> * - rename refference T& NDArray::t<> method Signed-off-by: Yurii <iuriish@yahoo.com> * - further work on cuda sqrtm Signed-off-by: Yurii <iuriish@yahoo.com> * - provide correct synchronization to device in Sqrtm class Signed-off-by: Yurii <iuriish@yahoo.com> * - add tests for sqrtm op Signed-off-by: Yurii <iuriish@yahoo.com> * - correct fails which appeared while testing on jenkins Signed-off-by: Yurii <iuriish@yahoo.com> * - trying to find out mistake in svd::deflation method Signed-off-by: Yurii <iuriish@yahoo.com> * Revert "- trying to find out mistake in svd::deflation method" This reverts commit 19d37baddbc509028e4bc67bc932fe7449becdb6. * Revert "- trying to find out mistake in svd::deflation method" This reverts commit 19d37baddbc509028e4bc67bc932fe7449becdb6. Signed-off-by: Yurii <iuriish@yahoo.com> * - change call semantic of r<> and t<> methods Signed-off-by: Yurii <iuriish@yahoo.com> * - ged rid of ambiguity in * operator overloads for windows buikd Signed-off-by: Yurii <iuriish@yahoo.com> * - get rid of ambiguity in * operator overloads for windows build 2 Signed-off-by: Yurii <iuriish@yahoo.com> * - get rid of ambiguity in * operator overloads for windows build 3 Signed-off-by: Yurii <iuriish@yahoo.com> * - resolve conflicts with master Signed-off-by: Yurii <iuriish@yahoo.com> * cmakelists updated Signed-off-by: raver119@gmail.com <raver119@gmail.com> * - minor fix in merge cpu helper - make use of reference getter Signed-off-by: Yurii <iuriish@yahoo.com> Co-authored-by: raver119 <raver119@gmail.com> Co-authored-by: shugeo <sgazeos@gmail.com>
122 lines
4.3 KiB
C++
122 lines
4.3 KiB
C++
/*******************************************************************************
|
|
* Copyright (c) 2015-2018 Skymind, Inc.
|
|
*
|
|
* This program and the accompanying materials are made available under the
|
|
* terms of the Apache License, Version 2.0 which is available at
|
|
* https://www.apache.org/licenses/LICENSE-2.0.
|
|
*
|
|
* Unless required by applicable law or agreed to in writing, software
|
|
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
|
|
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
|
|
* License for the specific language governing permissions and limitations
|
|
* under the License.
|
|
*
|
|
* SPDX-License-Identifier: Apache-2.0
|
|
******************************************************************************/
|
|
|
|
//
|
|
// Created by Yurii Shyrma on 18.12.2017.
|
|
//
|
|
|
|
#ifndef LIBND4J_HOUSEHOLDER_H
|
|
#define LIBND4J_HOUSEHOLDER_H
|
|
|
|
|
|
#include "array/NDArray.h"
|
|
|
|
namespace sd {
|
|
namespace ops {
|
|
namespace helpers {
|
|
|
|
template <typename T>
|
|
class Householder {
|
|
|
|
public:
|
|
|
|
/**
|
|
* this method calculates Householder matrix P = identity_matrix - coeff * w * w^T
|
|
* P * x = [normX, 0, 0 , 0, ...]
|
|
* coeff - scalar
|
|
* w = [1, w1, w2, w3, ...]
|
|
* w = u / u0
|
|
* u = x - |x|*e0
|
|
* u0 = x0 - |x|
|
|
* e0 = [1, 0, 0 , 0, ...]
|
|
*
|
|
* x - input vector, remains unaffected
|
|
*/
|
|
// static NDArray evalHHmatrix(const NDArray& x);
|
|
|
|
/**
|
|
* this method evaluates data required for calculation of Householder matrix P = identity_matrix - coeff * w * w^T
|
|
* P * x = [normX, 0, 0 , 0, ...]
|
|
* coeff - scalar
|
|
* w = [1, w1, w2, w3, ...]
|
|
* w = u / u0
|
|
* u = x - |x|*e0
|
|
* u0 = x0 - |x|
|
|
* e0 = [1, 0, 0 , 0, ...]
|
|
*
|
|
* x - input vector, remains unaffected
|
|
* tail - the essential part of the vector w: [w1, w2, w3, ...]
|
|
* normX - this scalar is the first non-zero element in vector resulting from Householder transformation -> (P*x)
|
|
* coeff - scalar, scaling factor in Householder matrix formula
|
|
*/
|
|
static void evalHHmatrixData(const NDArray& x, NDArray& tail, T& coeff, T& normX);
|
|
|
|
static void evalHHmatrixDataI(NDArray& x, T& coeff, T& normX); // in-place, x to be affected
|
|
|
|
/**
|
|
* this method mathematically multiplies input matrix on Householder from the left P * matrix
|
|
*
|
|
* matrix - input matrix
|
|
* tail - the essential part of the Householder vector w: [w1, w2, w3, ...]
|
|
* coeff - scalar, scaling factor in Householder matrix formula
|
|
*/
|
|
static void mulLeft(NDArray& matrix, const NDArray& tail, const T coeff);
|
|
|
|
/**
|
|
* this method mathematically multiplies input matrix on Householder from the right matrix * P
|
|
*
|
|
* matrix - input matrix
|
|
* tail - the essential part of the Householder vector w: [w1, w2, w3, ...]
|
|
* coeff - scalar, scaling factor in Householder matrix formula
|
|
*/
|
|
static void mulRight(NDArray& matrix, const NDArray& tail, const T coeff);
|
|
|
|
|
|
|
|
};
|
|
|
|
|
|
// /**
|
|
// * this function reduce given matrix to upper bidiagonal form (in-place operation), matrix must satisfy following condition rows >= cols
|
|
// *
|
|
// * matrix - input 2D matrix to be reduced to upper bidiagonal from
|
|
// */
|
|
// template <typename T>
|
|
// void biDiagonalizeUp(NDArray& matrix);
|
|
|
|
// /**
|
|
// * given a matrix [m,n], this function computes its singular value decomposition matrix = u * s * v^T
|
|
// *
|
|
// * matrix - input 2D matrix to decompose, [m, n]
|
|
// * u - unitary matrix containing left singular vectors of input matrix, [m, m]
|
|
// * s - diagonal matrix with singular values of input matrix (non-negative) on the diagonal sorted in decreasing order,
|
|
// * actually the mathematically correct dimension of s is [m, n], however for memory saving we work with s as vector [1, p], where p is smaller among m and n
|
|
// * v - unitary matrix containing right singular vectors of input matrix, [n, n]
|
|
// * calcUV - if true then u and v will be computed, in opposite case function works significantly faster
|
|
// * fullUV - if false then only p (p is smaller among m and n) first columns of u and v will be calculated and their dimensions in this case are [m, p] and [n, p]
|
|
// *
|
|
// */
|
|
// void svd(const NDArray& matrix, NDArray& u, NDArray& s, NDArray& v, const bool calcUV = false, const bool fullUV = false)
|
|
|
|
|
|
|
|
}
|
|
}
|
|
}
|
|
|
|
|
|
#endif //LIBND4J_HOUSEHOLDER_H
|