* #8890 TestTransferStatsCollection timeout fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8890 RegressionTest timeout fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Increase timeout for flaky test
Signed-off-by: Alex Black <blacka101@gmail.com>
* Remove test dependency
Signed-off-by: Alex Black <blacka101@gmail.com>
* BLAS iamax + loop -> argmax
Signed-off-by: Alex Black <blacka101@gmail.com>
* Refactor nd4j-common: org.nd4j.* -> org.nd4j.common.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix CUDA (missed nd4j-common package refactoring changes)
Signed-off-by: Alex Black <blacka101@gmail.com>
* nd4j-kryo: org.nd4j -> org.nd4j.kryo
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix nd4j-common for deeplearning4j-cuda
Signed-off-by: Alex Black <blacka101@gmail.com>
* nd4j-grppc-client: org.nd4j.graph -> org.nd4j.remote.grpc
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-common: org.deeplearning4.* -> org.deeplearning4j.common.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-core: org.deeplearning4j.* -> org.deeplearning.core.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-cuda: org.deeplearning4j.nn.layers.* -> org.deeplearning4j.cuda.*
Signed-off-by: Alex Black <blacka101@gmail.com>
* Import fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-nlp-*: org.deeplearning4.text.* -> org.deeplearning4j.nlp.(language).*
Signed-off-by: Alex Black <blacka101@gmail.com>
* deeplearning4j-ui-model: org.deeplearning4j.ui -> org.deeplearning4j.ui.model
Signed-off-by: Alex Black <blacka101@gmail.com>
* datavec-spark-inference-{server/model/client}: org.datavec.spark.transform -> org.datavec.spark.inference.{server/model/client}
Signed-off-by: Alex Black <blacka101@gmail.com>
* datavec-jdbc: org.datavec.api -> org.datavec.jdbc
Signed-off-by: Alex Black <blacka101@gmail.com>
* Delete org.deeplearning4j.datasets.iterator.impl.MultiDataSetIteratorAdapter in favor of (essentially identical) org.nd4j.linalg.dataset.adapter.MultiDataSetIteratorAdapter
Signed-off-by: Alex Black <blacka101@gmail.com>
* ND4S fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* nd4j-common-tests: org.nd4j.* -> org.nd4j.common.tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Trigger CI
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8878 Ignore CUDA tests on modules with 'nd4j-native under cuda' issue
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix bad imports in tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Add ignore on test (already failing) due to #8882
Signed-off-by: Alex Black <blacka101@gmail.com>
* Import fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Additional import fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* merge conf
* merge conf
* tfkeras tests
* parameterized tests
* rename
* cuda versions
* jccp versions
* 'updates'
* updates
* rnn+mlp passing
* repeat
* updates
* tests
* Update pom.xml
* Update pom.xml
* rem print
* cnn1d model conversion fixed
* cnn1d activate fixed
* cnn1d outptut shape fix
* cnn1d bprop fix
* cnn1d stack fix
* KerasModelEndToEndTest - Remove permutes for NWC and NHWC format tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes and update test - input shapes (NCHW -> NHWC input)
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore for known bad tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Multiple fixes - MergeVertex, CNN1D layers, etc
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix issue with RNN/FF preprocessors, time distributed etc with NWC format
Signed-off-by: Alex Black <blacka101@gmail.com>
* LSTM NWC dropout fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Add sequence embedding layer NWC support (configurable output format)
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix expected shape in a couple of tests - NWC expected
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix EmbeddingSequenceLayer backprop for NWC output case + add gradient checks
Signed-off-by: Alex Black <blacka101@gmail.com>
* CnnToFeedForwardPreprocessor: align with Keras/TF; fix Keras reshape/flatten
Signed-off-by: Alex Black <blacka101@gmail.com>
* Update ConvDataFormatTests to match new reshape behaviour
Signed-off-by: Alex Black <blacka101@gmail.com>
* Switch hard-coded path to ResourceUtils.listClassPathfiles for TestTFKerasModelImport
Signed-off-by: Alex Black <blacka101@gmail.com>
* TestUtils fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix JSON serde issue with data formats
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix for input dtype inference; fix 2 tests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Test fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8891 Ignore for TestVertxUIMultiSession until fixed
Signed-off-by: Alex Black <blacka101@gmail.com>
* Restore but deprecate TensorFlowCnnToFeedForwardPreProcessor for older zoo models
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore for deprecated preprocessor in DTypeTests
Signed-off-by: Alex Black <blacka101@gmail.com>
* Remove debug printlns
Signed-off-by: Alex Black <blacka101@gmail.com>
Co-authored-by: Alex Black <blacka101@gmail.com>
* MKLDNNConvHelper: don't permute; pass in weight format arg
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix flaky tests unrelated to main branch change
Signed-off-by: Alex Black <blacka101@gmail.com>
* Don't log every extracted file for LFW and other auto-downloaded image loaders using BaseImageLoader.downloadAndUntar
Signed-off-by: Alex Black <blacka101@gmail.com>
* fix Freemarker version mismatch: change version requested in TrainModule to 2.3.23 (freemarker.version in pom.xml)
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix checking multi-session mode in VertxUIServer.getInstance. Tested multiple calls in TestVertxUIMultiSession.
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UIServer.getInstance() to return existing instance
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* extend timeout for manual UI tests from 30 to 600 seconds
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* start and stop UI server synchronously (wait until complete), tests
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix for auto-attaching StatsStorage given in VertxUIServer#getInstance(Integer, boolean, Function<String,StatsStorage>), test improvements
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* exception handling, test improvements
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* add asynchronous method to start UI server
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UIServer.getInstance() to return existing instance
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UI server language setting in multi-session mode
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix UI server system tab not loading data in multi-session mode
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* undo added InterruptedException in UIServer.getInstance()
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* fix async stopping of UIServer.stopAsync(Promise<Void>), added test
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* restore the daemon thread style behaviour of UIServer: don't keep the process alive just because the UI is running
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* speed up and don't @Ignore tests in TestVertxUI and TestVertxUIMultiSession, put longer tests to separate class TestVertxUIManual
Signed-off-by: Tamás Fenyvesi <tamas.fenyvesi@doknet.hu>
* Fixing issues from Sonar report
* Proper logger of exceptions
* Coding style fixes
* Use dup parameter
* Cleanup, minor issues
* Cuda compilation fixed and some minor fixes
* Remove old nd4j-jackson dependencies
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix use of old/deprecated JSON serializer
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix deserialization
Signed-off-by: Alex Black <blacka101@gmail.com>
* Delete test using deleted ser/de classes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Delete another copy of old test
Signed-off-by: Alex Black <blacka101@gmail.com>
* Add a message to the runtime exception
Signed-off-by: Paul Dubs <paul.dubs@gmail.com>
* Output Convolutions as PNG instead of JPG
A lossless encoding is useful in this case, as it allows small details to be preserved
Signed-off-by: Paul Dubs <paul.dubs@gmail.com>
* Cholesky fixed
* Constructors added
* MatMul wrapper
* Constructor added
* Missing wrappers added
* Generate Linalg namespace added
* Output data types
* Unit tests
* Added mmul
* Code generation
* Code generated
* Build fixed
* Fixing signatures
* Tests fixed
* Tests fixed
* Added enum
* Fix tests
* Some fixes
* Eye test fixed
* SameDiff: small fix for renameVariable - also replace variable name in lossVariable list if necessary
Signed-off-by: Alex Black <blacka101@gmail.com>
* Some fixes
* Tests fixed
* Revert wrong fix
* Some fixes
* Some fixes
* Extending base test class
* Added pad
* Fixed for generated signatures
* Fixes due to nd4j codegen
* Backwards compatibility fixes
* Fixed errors in tests, reverted wrong changes
* Test fixed
* Added missing operations used for nd4s operators
* Compilation fixed
* Added meshgrid
* Fixed constructors
* fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fix bad commit (incorrectly reverted change from master)
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixed test
Co-authored-by: Alex Black <blacka101@gmail.com>
* #8777 MultiLayerNetwork.evaluate(MultiDataSetIterator) overload
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8768 SameDiff.equals
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8750 shade freemarker library and switch to it in DL4J UI
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8704 DL4J UI redirect
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8776 RecordReaderDataSetIterator builder collectMetaData fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8718 Fix DL4J doEvaluation metadata
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8715 ArchiveUtils - Add option to not log every extracted file
Signed-off-by: Alex Black <blacka101@gmail.com>
* No exception for evaluations that don't support metadata
Signed-off-by: Alex Black <blacka101@gmail.com>
* Fixes
Signed-off-by: Alex Black <blacka101@gmail.com>
* #8765 CompGraph+MDS fix for SharedTrainingMaster
Signed-off-by: Alex Black <blacka101@gmail.com>
* small fix
Signed-off-by: Alex Black <blacka101@gmail.com>
* Timeout
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore
Signed-off-by: Alex Black <blacka101@gmail.com>
* Revert freemarker shading
Signed-off-by: Alex Black <blacka101@gmail.com>
* Ignore
Signed-off-by: Alex Black <blacka101@gmail.com>
* Update Japanese translation for Deeplearning4J UI (#8525)
Signed-off-by: k-tamura <ktamura.biz.80@gmail.com>
* RL4J: Remove processing done on observations in Policy & Async (#8471)
* Removed processing from Policy.play() and fixed missing resets
Signed-off-by: unknown <aboulang2002@yahoo.com>
* Adjusted unit test to check if DQNs have been reset
Signed-off-by: unknown <aboulang2002@yahoo.com>
* Fixed a couple of problems, added and updated unit tests
Signed-off-by: unknown <aboulang2002@yahoo.com>
* Removed processing from AsyncThreadDiscrete
Signed-off-by: unknown <aboulang2002@yahoo.com>
* Fixed a few problems
Signed-off-by: unknown <aboulang2002@yahoo.com>
* python version bump
* increase
* RL4J: Replace gym-java-client with JavaCPP (#8595)
* RL4J: Replace gym-java-client with JavaCPP
Signed-off-by: Samuel Audet <samuel.audet@gmail.com>
Co-authored-by: Kohei Tamura <ktamura.biz.80@gmail.com>
Co-authored-by: Alexandre Boulanger <44292157+aboulang2002@users.noreply.github.com>
Co-authored-by: Max Pumperla <max.pumperla@googlemail.com>
Co-authored-by: Samuel Audet <samuel.audet@gmail.com>
* Timeouts added
* Added some ops
* Ops added
* Fixed tests
* Minor fix
* Some fixes
* Digamma added
* Small fixes
* Timeouts added
* Added some ops
* Ops added
* Fixed tests
* Minor fix
* Some fixes
* Digamma added
* Small fixes
* Fused batch norm fixes-
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* Tests switched off.
* Added test for resize_bicubic.
* Eliminated wasted in test of bicubic resize.
* Switched off multithreading explicit.
* HsvToRgb and RgbToHsv added
* Eliminated waste comments and conform proper float constants.
Signed-off-by: shugeo <sgazeos@gmail.com>
* Fixed multithreading with resize_bicubic helper for cpu platform.
Signed-off-by: shugeo <sgazeos@gmail.com>
* ResizeBicubic was fixed.
* Some fixes
* Fix op name
* Validation fixed.
* Clarifications for tests
* Wrappers and small fixes for new ops.
* cleaned up bert iterator tests (#110)
Signed-off-by: eraly <susan.eraly@gmail.com>
* Various pre-release fixes (#111)
* Various fixes
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* Fix default dtypes for MaxPoolWithArgmax
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* Small pre-release tweak (#112)
* Log UI address on launch as in previous Play-based UI
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* Logging level tweak for UI
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* http not https
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* datavec python ensure host (#113)
* ensure host
* one more host ensure
* info->debug
* [WIP] reverse improvements (#115)
* initial commit
Signed-off-by: raver119 <raver119@gmail.com>
* reverse draft
Signed-off-by: raver119 <raver119@gmail.com>
* reverse kernel
Signed-off-by: raver119 <raver119@gmail.com>
* reverse kernel
Signed-off-by: raver119 <raver119@gmail.com>
* 2 micro fixes
Signed-off-by: raver119 <raver119@gmail.com>
* Shugeo resize fix5 (#102)
* Refactored resize images ops to use TF-like bool args as input.
* Refactored helpers for cpu implementation of resize_bilinear and resize_nearest_neighbor ops.
* Refactored cuda implementation for image.resize_bilinear and image.resize_nearest_neighbor ops helpers.
* Refactored nearest_neighbor resize op.
* Added a pair of tests for special case of resize_bilinear algorithm.
* Fixed issue with resize_bilinear op.
* Refactored cpu implementation for helpers with resize_nearest_neighbor op.
* Final fixed for resize ops to conform TF v.1.5
* Refactored cuda helpers for resize_neares_neighbor op.
* Fixed resize_bilinear to accept proper data.
* Fixed issue with non-float input for resize_bilinear op.
* Refactored cuda helper for resize_bilinear to proper process non-float inputs.
* Added tests for resize_bilinear to int inputs.
* Fixed ResizeBilinear wrapper
* Tests fixed
* Fixed float and bool constant to avoid overflow for some kind of compilers.
* Corrected float constants with float data type.
* Added f suffix for float constants.
* Corrected float constant to avoid overflow with initializing lists.
* Corrected float initializing list with float input.
* Corrected bool constant with initalizing list.
* Corrected float and bool values with initializing lists.
* Fixed wrong constant.
* Fixed issue with 1x1 input picture for resize.
* ResizeBilinear default values on import fix
Signed-off-by: raver119 <raver119@gmail.com>
* Update shaded Jackson version to 2.10.1
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* Remove no longer needed scala compiler plugin from UI
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* Fix op name for BitwiseAnd op
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* TimeDistributedLayer mask array fix + test
Signed-off-by: AlexDBlack <blacka101@gmail.com>
* correct logsoftmax looss (#2)
* Small SameDiff listener fix (#4)
* Various fixes (#6)
* #7839 Fix for asXMatrix and tests
* #7866 EmbeddingSequenceLayer dtype fix + test
* #7856 SameDiff save/load stream methods
* #7859 RegressionEvaluation rank 4 fix + tests + axis configuration
* EvaluationBinary 3d/4d
* More evaluation 3d/4d tests
* #7847 Evaluation empty checks
* Small test ifx
* #7848 Fix median edge case
* Improve DL4J samediff layer tests
* [WIP] FastText wrapper implemented (#8)
* FastText implemented
* Some fixes
* Fix shapes for wordsNearest
* Validation of input vectors
* Fixes
* Fixed test
* Thread tagged
* Some tweaks
* setContextClassLoader for DeallocatorServiceThread
* Numpy format tests (#1)
* Various fixes (#11)
* #7852 SameDiff gather fix
* #7892 SameDiff placeholder to constant conversion
* #7890 validate input rank for MLN/CG init methods
* Fix broken permute shape calculation
* Permute and gather fixes
* Tests
* #7850 LogSumExp fix + test
* Handful of test fixes
* Empty arrays with non-scalar shapes (#10)
* minor rearrangements for lambdas
* empty tensors with non-scalar shapes
* numpy empty tensors with non-scalar shapes
* few more empty tweaks
* Small fixes
* conv3d signature update
* micro fix in batchnorm mkldnn
* Import fixes
* Fix
* MKL-DNN update
* Small fill fix
* fill with empty input + test
* Fixes
* Small error improvement
* Fix
* one special test
* couple of fixes for lstm
* Rewrite TFGraphMapper.getNDArrayFromTensor to be maintainable and less error prone
* Fixes
* FP16
* Unsigned
* BFloat16
* Fill op - empty tweaks
* - couple of fixes for empty arrays construction
- stack updated
* strided slice fix
* one transform test
* provide method for reducing shapeInfo in case of input array is empty
* Fixed reduceAlongDimensions to use empty input properly.
* couple of broadcast tests
* couple of tests broadcast tests + tweak to make them pass
* add check of non-empty to methods producing sub-arrays
* Fixed reshapeC with zeros in shape.
* complete empty check in reduce_... legacy ops
* Concat and cumsum/prod
* Tweak to empty shape inference on import
* add empty check to the rest of reduce legacy ops
* one more test
* correct typo in evalReduceShapeInfoEmpty
* Added tests for reduce_* ops to tests with zero shapes.
* few more tests for empty reductions
* Fixed strided_slice op with empty case and tests.
* one more empty reduction test
* Fixed strided_slice test.
* add empty check to NDArray::reshapei
* infOrMax
* empty min/max with infinity tests
* made unstack working correctly with empty arrays
* few IndexReduce tests + tweaks for empty shapes
* add test for empty concat
* few tests fixed
* Validation fix for reductions on empty shapes
* Reverse fix
* Reduction shape calc fixes
* SameDiff.generateOutputVariable: don't use shape function to determine number of outputs
* Range fix
* - NDArray constructor updated for scalars/empty arrays
- few tests fixed
* More fixes
* Empty creator fixes
* concat fix
* concat fix
* TF import tests: allow 'both all NaN' and 'both all inf' to pass
* Slice, zero fraction, and reshape fixes
* transpose, gather
* Zero fraction
* scalar cast fix
* Empty reduction axis support
* few more tests fixed
* Fixed input checks conforming with TF for concat op and tests.
* few tests fixed
* matmul scalar shape fix
* Fixed checkout for data type and scalarity with concat to allow non-empty scalars with vector concats.
* broadcast bool fix
* few more tests
* few more tests
* correct evalReduceShapeInfoEmpty
* argmax/argmin + tests
* one more empty edge case + one more test
* argmax/argmin/realdiv_bp tweaks
* empty reshape test + fix
* Helper fixes
* Small fixes
* Gather test fix
* Gather test fix
* Small fixes
* reduce scalar zero values
* scalar mean workaround
* Remove debug code
* along dim mean workaround
* one more test
* - equalsTo() tweak for empty arrays
- one more test
* broadcast tweaks
* Capsnet test runtime improvements
* Slow test speedups
* Next round of test speed improvements
* More test improvements
* Improve test speed
* Next round of test speedups
* Another round
* More test speedups
* Another round
* Another round of test speedups
* Another round of speedups...
* CuDNN test speedups + more tests extending BaseDL4JTest
* Minor fix + more BaseDL4JTest use in other modules
Alex Black
Tamás Fenyvesi
Fariz Rahman
Alexander Stoyakin
Paul Dubs
raver119
Samuel Audet
Serhii Shepel
skymindops