cavis/libnd4j/include/ops/declarable/generic/nn/recurrent
Yurii Shyrma 23e4aa99ad
Shyrma lstm layer bp (#370)
* - start working on bp for lstm

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further working on bp for lstmLayer

Signed-off-by: Yurii <iuriish@yahoo.com>

* - minor change

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 2

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 3

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 4

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 5

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 6

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 7

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 8

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 9

Signed-off-by: Yurii <iuriish@yahoo.com>

* - provide lstmLayerCell and lstmLayerCellBp as separate CUSTOM_OPs

Signed-off-by: Yurii <iuriish@yahoo.com>

* - testing and fixing lstmLayerCellBp helper

Signed-off-by: Yurii <iuriish@yahoo.com>

* - implement lstmLayerCellBp as separate op

Signed-off-by: Yurii <iuriish@yahoo.com>

* - implement lstmLayerBp as separate op (not tested)

Signed-off-by: Yurii <iuriish@yahoo.com>

* - fixing calculations of dLdWp and dLdb in lstmLayerCellBp

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 10

Signed-off-by: Yurii <iuriish@yahoo.com>

* - fixing typo in lstmLayerTimeLoop

Signed-off-by: Yurii <iuriish@yahoo.com>

* - forgot to perform clipping of c array and calculate corresponding derivative in lstmLayerCellBp

Signed-off-by: Yurii <iuriish@yahoo.com>

* - further work on bp for lstmLayer 10

Signed-off-by: Yurii <iuriish@yahoo.com>

* - testing and fixing bugs in lstmLayer_bp op 1

Signed-off-by: Yurii <iuriish@yahoo.com>

* - testing and fixing bugs in lstmLayer_bp op 2

Signed-off-by: Yurii <iuriish@yahoo.com>

* - turn off heavy tests for cuda for lstmLayer_bp op

Signed-off-by: Yurii <iuriish@yahoo.com>

* - forgot to nullify gradients at eliminated time steps (when sequnce length array is present )

Signed-off-by: Yurii <iuriish@yahoo.com>
2020-04-13 13:21:51 +03:00
..
dynamicBidirectionalRNN.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
dynamicRNN.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
gru.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
gruCell.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
lstm.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
lstmBlock.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
lstmBlockCell.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
lstmCell.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
lstmLayer.cpp Shyrma lstm layer bp (#370) 2020-04-13 13:21:51 +03:00
lstmLayerCell.cpp Shyrma lstm layer bp (#370) 2020-04-13 13:21:51 +03:00
sru.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
sruCell.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
staticBidirectionalRNN.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00
staticRNN.cpp some structure for ops (#337) 2020-03-23 07:28:54 +03:00