cavis/libnd4j/include/helpers/cpu
Yurii Shyrma 23e4aa99ad
Shyrma lstm layer bp (#370)
* - start working on bp for lstm

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further working on bp for lstmLayer

Signed-off-by: Yurii <iuriish@yahoo.com>

* - minor change

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 2

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 3

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 4

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 5

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 6

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 7

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 8

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 9

Signed-off-by: Yurii <iuriish@yahoo.com>

* - provide lstmLayerCell and lstmLayerCellBp as separate CUSTOM_OPs

Signed-off-by: Yurii <iuriish@yahoo.com>

* - testing and fixing lstmLayerCellBp helper

Signed-off-by: Yurii <iuriish@yahoo.com>

* - implement lstmLayerCellBp as separate op

Signed-off-by: Yurii <iuriish@yahoo.com>

* - implement lstmLayerBp as separate op (not tested)

Signed-off-by: Yurii <iuriish@yahoo.com>

* - fixing calculations of dLdWp and dLdb in lstmLayerCellBp

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 10

Signed-off-by: Yurii <iuriish@yahoo.com>

* - fixing typo in lstmLayerTimeLoop

Signed-off-by: Yurii <iuriish@yahoo.com>

* - forgot to perform clipping of c array and calculate corresponding derivative in lstmLayerCellBp

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 10

Signed-off-by: Yurii <iuriish@yahoo.com>

* - testing and fixing bugs in lstmLayer_bp op 1

Signed-off-by: Yurii <iuriish@yahoo.com>

* - testing and fixing bugs in lstmLayer_bp op 2

Signed-off-by: Yurii <iuriish@yahoo.com>

* - turn off heavy tests for cuda for lstmLayer_bp op

Signed-off-by: Yurii <iuriish@yahoo.com>

* - forgot to nullify gradients at eliminated time steps (when sequnce length array is present )

Signed-off-by: Yurii <iuriish@yahoo.com>
2020-04-13 13:21:51 +03:00
..
loops Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
ConstantHelper.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
ConstantShapeHelper.cpp Shyrma broadcast (#302) 2020-03-10 16:29:09 +03:00
ConstantTadHelper.cpp profiling of stack and unstack ops (#261) 2020-03-03 07:32:37 +03:00
MmulHelper.cpp Shyrma lstm layer bp (#370) 2020-04-13 13:21:51 +03:00
PointersManager.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
biDiagonalUp.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
cublasHelper.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
hhColPivQR.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
hhSequence.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
householder.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
jacobiSVD.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
svd.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00