This means that when a model is being loaded (e.g., from a Keras H5 file), the default CNN2DFormat can be set. Currently it always defaults to 'Channels First' which can cause problems for some models.
* shutdown hook for UI server
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* logging exception
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* Fix MergeVertex serialization for NHWC case
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8999 Dropout JSON field ignore
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix Yolo2OutputLayer for NHWC data format
Signed-off-by: Alex Black <blacka101@gmail.com>
* ObjectDetectionRecordReader NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Timeouts and fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Increase default timeout to 90s due to slow PPC CI machines
Signed-off-by: Alex Black <blacka101@gmail.com>
* Another timeout tweak
Signed-off-by: Alex Black <blacka101@gmail.com>
* Svhn
Signed-off-by: Alex Black <blacka101@gmail.com>
* error code check in CudaMemoryManager
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* clear
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* clear model before exiting
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* MultiLayerNetwork/ComputationGraph.close() [WIP] (#460)
* MultiLayerNetwork/ComputationGraph.close()
Signed-off-by: Alex Black <blacka101@gmail.com>
* Copyright header
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* - fix for handling release of nested DataBuffers
- couple of additional tests for released DataBuffers
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* PW test: increase number of epochs slightly
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
Co-authored-by: Alex Black <blacka101@gmail.com>
* - numPrefixBlocks fix for threshold_encoding
- temparrays pointers fixed
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* auto configuration of memory workspace for gradients sharing
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* limit sparse encoding message size
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* one more workspace test
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* one more CUDA-specific test
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* one more CUDA-specific workspace test
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* one more CUDA-specific workspace test
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* one more CUDA-specific workspace test
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* add separate host/device reset for circular workspace mode
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* new PW builder method for encoder memory amount
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* "inplace" execution for threshold encoding
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
* Remove debug line from KerasConvolution2D
Signed-off-by: Alex Black <blacka101@gmail.com>
* Remove more debug lines
Signed-off-by: Alex Black <blacka101@gmail.com>
* Update docs links to new website URLs
Signed-off-by: Alex Black <blacka101@gmail.com>
* One more link
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8890 TestTransferStatsCollection timeout fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8890 RegressionTest timeout fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Increase timeout for flaky test
Signed-off-by: Alex Black <blacka101@gmail.com>
* Remove test dependency
Signed-off-by: Alex Black <blacka101@gmail.com>
* BLAS iamax + loop -> argmax
Signed-off-by: Alex Black <blacka101@gmail.com>
GloVe has been unmaintained and broken for a long time. The only people asking about it where those who were stumped by the broken example.
GloVe on its own has one intrinsic problem: a vocabulary of size N requires to build a matrix of NxN. This resulted in suboptimal performance for most people.
Overall, there are better performing approaches these days so it isn't worth the effort to fix this implementation.
Signed-off-by: Paul Dubs <paul.dubs@gmail.com>
* #8901 Avoid unnecessary warning in SameDiffLoss
Signed-off-by: Alex Black <blacka101@gmail.com>
* Improved error messages for conv2d layers - NCHW vs. NHWC
Signed-off-by: Alex Black <blacka101@gmail.com>
* Refactor nd4j-common: org.nd4j.* -> org.nd4j.common.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix CUDA (missed nd4j-common package refactoring changes)
Signed-off-by: Alex Black <blacka101@gmail.com>
* nd4j-kryo: org.nd4j -> org.nd4j.kryo
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix nd4j-common for deeplearning4j-cuda
Signed-off-by: Alex Black <blacka101@gmail.com>
* nd4j-grppc-client: org.nd4j.graph -> org.nd4j.remote.grpc
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-common: org.deeplearning4.* -> org.deeplearning4j.common.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-core: org.deeplearning4j.* -> org.deeplearning.core.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-cuda: org.deeplearning4j.nn.layers.* -> org.deeplearning4j.cuda.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* Import fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-nlp-*: org.deeplearning4.text.* -> org.deeplearning4j.nlp.(language).*
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-ui-model: org.deeplearning4j.ui -> org.deeplearning4j.ui.model
Signed-off-by: Alex Black <blacka101@gmail.com>
* datavec-spark-inference-{server/model/client}: org.datavec.spark.transform -> org.datavec.spark.inference.{server/model/client}
Signed-off-by: Alex Black <blacka101@gmail.com>
* datavec-jdbc: org.datavec.api -> org.datavec.jdbc
Signed-off-by: Alex Black <blacka101@gmail.com>
* Delete org.deeplearning4j.datasets.iterator.impl.MultiDataSetIteratorAdapter in favor of (essentially identical) org.nd4j.linalg.dataset.adapter.MultiDataSetIteratorAdapter
Signed-off-by: Alex Black <blacka101@gmail.com>
* ND4S fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* nd4j-common-tests: org.nd4j.* -> org.nd4j.common.tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Trigger CI
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8878 Ignore CUDA tests on modules with 'nd4j-native under cuda' issue
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix bad imports in tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Add ignore on test (already failing) due to #8882
Signed-off-by: Alex Black <blacka101@gmail.com>
* Import fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Additional import fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* merge conf
* merge conf
* tfkeras tests
* parameterized tests
* rename
* cuda versions
* jccp versions
* 'updates'
* updates
* rnn+mlp passing
* repeat
* updates
* tests
* Update pom.xml
* Update pom.xml
* rem print
* cnn1d model conversion fixed
* cnn1d activate fixed
* cnn1d outptut shape fix
* cnn1d bprop fix
* cnn1d stack fix
* KerasModelEndToEndTest - Remove permutes for NWC and NHWC format tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes and update test - input shapes (NCHW -> NHWC input)
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore for known bad tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Multiple fixes - MergeVertex, CNN1D layers, etc
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix issue with RNN/FF preprocessors, time distributed etc with NWC format
Signed-off-by: Alex Black <blacka101@gmail.com>
* LSTM NWC dropout fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Add sequence embedding layer NWC support (configurable output format)
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix expected shape in a couple of tests - NWC expected
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix EmbeddingSequenceLayer backprop for NWC output case + add gradient checks
Signed-off-by: Alex Black <blacka101@gmail.com>
* CnnToFeedForwardPreprocessor: align with Keras/TF; fix Keras reshape/flatten
Signed-off-by: Alex Black <blacka101@gmail.com>
* Update ConvDataFormatTests to match new reshape behaviour
Signed-off-by: Alex Black <blacka101@gmail.com>
* Switch hard-coded path to ResourceUtils.listClassPathfiles for TestTFKerasModelImport
Signed-off-by: Alex Black <blacka101@gmail.com>
* TestUtils fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix JSON serde issue with data formats
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix for input dtype inference; fix 2 tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Test fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8891 Ignore for TestVertxUIMultiSession until fixed
Signed-off-by: Alex Black <blacka101@gmail.com>
* Restore but deprecate TensorFlowCnnToFeedForwardPreProcessor for older zoo models
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore for deprecated preprocessor in DTypeTests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Remove debug printlns
Signed-off-by: Alex Black <blacka101@gmail.com>
Co-authored-by: Alex Black <blacka101@gmail.com>
* MKLDNNConvHelper: don't permute; pass in weight format arg
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix flaky tests unrelated to main branch change
Signed-off-by: Alex Black <blacka101@gmail.com>
* Don't log every extracted file for LFW and other auto-downloaded image loaders using BaseImageLoader.downloadAndUntar
Signed-off-by: Alex Black <blacka101@gmail.com>
* Increase default test timeout to 60 sec due to slow PPC CI machines
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix flaky NLP test (randomly fails due to no RNG seed set)
Signed-off-by: Alex Black <blacka101@gmail.com>
* fix Freemarker version mismatch: change version requested in TrainModule to 2.3.23 (freemarker.version in pom.xml)
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix checking multi-session mode in VertxUIServer.getInstance. Tested multiple calls in TestVertxUIMultiSession.
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UIServer.getInstance() to return existing instance
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* extend timeout for manual UI tests from 30 to 600 seconds
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* start and stop UI server synchronously (wait until complete), tests
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix for auto-attaching StatsStorage given in VertxUIServer#getInstance(Integer, boolean, Function<String,StatsStorage>), test improvements
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* exception handling, test improvements
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* add asynchronous method to start UI server
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UIServer.getInstance() to return existing instance
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UI server language setting in multi-session mode
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UI server system tab not loading data in multi-session mode
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* undo added InterruptedException in UIServer.getInstance()
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix async stopping of UIServer.stopAsync(Promise<Void>), added test
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* restore the daemon thread style behaviour of UIServer: don't keep the process alive just because the UI is running
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* speed up and don't @Ignore tests in TestVertxUI and TestVertxUIMultiSession, put longer tests to separate class TestVertxUIManual
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* Fixing issues from Sonar report
* Proper logger of exceptions
* Coding style fixes
* Use dup parameter
* Cleanup, minor issues
* Cuda compilation fixed and some minor fixes
* First steps for DL4J NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Conv2d NHWC forward pass works
Signed-off-by: Alex Black <blacka101@gmail.com>
* Conv2d NHWC backprop
Signed-off-by: Alex Black <blacka101@gmail.com>
* Conv2d backprop + fixes; subsampling fwd/bwd; improve tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Zero padding layer NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Cropping2D NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Deconv2d NHWC + clean up NHWC test framework code duplication
Signed-off-by: Alex Black <blacka101@gmail.com>
* CnnLossLayer NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Upsampling and batchnorm NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Space to depth
Signed-off-by: Alex Black <blacka101@gmail.com>
* Depthwise pt1
Signed-off-by: Alex Black <blacka101@gmail.com>
* Depthwise pt2 and LRN
Signed-off-by: Alex Black <blacka101@gmail.com>
* SpaceToBatch
Signed-off-by: Alex Black <blacka101@gmail.com>
* LocallyConnected2D
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix depthwise nhwc support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Upsampling NHWC - workaround for #8857
Signed-off-by: Alex Black <blacka101@gmail.com>
* Workaround for #8859 - SpaceToDepth
Signed-off-by: Alex Black <blacka101@gmail.com>
* Batch normalization workaround - #8860
Signed-off-by: Alex Black <blacka101@gmail.com>
* cuDNN fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Switch cudnn conv2d to permute based impl due to 'true' NHWC not working
Signed-off-by: Alex Black <blacka101@gmail.com>
* cuDNN subsampling helper NHWC fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Upsampling/batchnorm fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Small fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* CNN2D NHWC gradient checks (make CNNGradientCheckTest parameterized)
Signed-off-by: Alex Black <blacka101@gmail.com>
* Gradient checks, SConv2d, bunch of fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Small fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Global pooling NHWC support
Signed-off-by: Alex Black <blacka101@gmail.com>
* Also test both float and double for cuDNN NHWC tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Javadoc
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore failing keras import test until next PR
Signed-off-by: Alex Black <blacka101@gmail.com>
* Remove old nd4j-jackson dependencies
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix use of old/deprecated JSON serializer
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix deserialization
Signed-off-by: Alex Black <blacka101@gmail.com>
* Delete test using deleted ser/de classes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Delete another copy of old test
Signed-off-by: Alex Black <blacka101@gmail.com>
* Input format extended
* Deleted redundant code
* Added weights format to conv2d config
* Refactoring
* dl4j base test functionality
* Different tests base class per module
* Check base class for dl4j-graph subproject tests
* Check if test classes extend BaseDL4JTest
* Use nd4j-common-tests as transient dependency
* Enums and tests added
* Added codegenerated methods
* Use namespace methods
* Replace DifferentialFunctionFactory with codegenerated classes
* Fixed linspace
* Namespaces regenerated
* Namespaces used instead of factory
* Regenerated base classes
* Input format extended
* Added weights format to conv2d config
* Refactoring
* dl4j base test functionality
* Different tests base class per module
* Check base class for dl4j-graph subproject tests
* Check if test classes extend BaseDL4JTest
* Use nd4j-common-tests as transient dependency
* Enums and tests added
* Added codegenerated methods
* Use namespace methods
* Replace DifferentialFunctionFactory with codegenerated classes
* Fixed linspace
* Namespaces regenerated
* Regenerated base classes
* Regenerated namespaces
* Generate nd4j namespaces
* INDArrays accepting constructors
* Generated some ops
* Some fixes
* SameDiff ops regenerated
* Regenerated nd4j ops
* externalErrors moved
* Compilation fixes
* SquaredDifference - strict number of args
* Deprecated code cleanup. Proper base class for tests.
* Extend test classes with BaseND4JTest
* Extend test classes with BaseDL4JTest
* Legacy code
* DL4J cleanup
* Exclude test utils from base class check
* Tests fixed
* Arbiter tests fix
* Test dependency scope fix + pom.xml formatting
Signed-off-by: Alex Black <blacka101@gmail.com>
* Significant number of fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Another round of fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Another round of fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Few additional fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* DataVec missing test scope dependencies
Signed-off-by: Alex Black <blacka101@gmail.com>
Co-authored-by: Alex Black <blacka101@gmail.com>
* Increase default timeout on Spark tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8840 disable deeplearning4j-nlp-korean module for scala 2.12
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix for change-scala-versions.sh
Signed-off-by: Alex Black <blacka101@gmail.com>
* CUDA test fixes + more timeout issues
Signed-off-by: Alex Black <blacka101@gmail.com>
* More CUDA
Signed-off-by: Alex Black <blacka101@gmail.com>
* Small fix for cuDNN subsampling + same mode
Signed-off-by: Alex Black <blacka101@gmail.com>
* Flaky test fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Reduce memory requirements for ValidateCuDNN BN test
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix slow/ineffirient scalnet tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Increase timeouts to avoid failures if CI machines are slower than expected
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore flaky test (issue #8849) and increase timeout for slow CI downloads
Signed-off-by: Alex Black <blacka101@gmail.com>
Rhys Compton
Tamás Fenyvesi
Fariz Rahman
Alex Black
raver119
Serhii Shepel
Paul Dubs
Abdelrauf
Alexei KLENIN
Benjamin Possolo
Alexander Stoyakin