9c77bfa85f
* Adding more datatypes support in datavec-python * Using numpy C API for creating numpy arrays * Adding parameterized tests * Adding support for BFLOAT16 (by converting it to FLOAT) * Cleanup * Using casting instead of creating an array * Giving out a warning while casting array from BFLOAT16 to FLOAT * Add syncToPrimary and syncToSpecial methods to BaseDataBuffer Signed-off-by: Alex Black <blacka101@gmail.com> * Python exec: sync to host before passing pointers Signed-off-by: Alex Black <blacka101@gmail.com> * Added copyright header * use np api (#267) * python exec / numpy - check object type before cast (#268) * use np api * verify object before cast * fix cong * cuda fix * inplace test + tiny fix * more test * fix double alloc * rem tags * fix cuda check * Fix implicit CUDA dependency in datavec-python tests; remove new method, add test Signed-off-by: Alex Black <blacka101@gmail.com> Co-authored-by: Alex Black <blacka101@gmail.com> Co-authored-by: Fariz Rahman <farizrahman4u@gmail.com>
Monorepo of Deeplearning4j
Welcome to the new monorepo of Deeplearning4j that contains the source code for all the following projects, in addition to the original repository of Deeplearning4j moved to deeplearning4j:
- https://github.com/eclipse/deeplearning4j/tree/master/libnd4j
- https://github.com/eclipse/deeplearning4j/tree/master/nd4j
- https://github.com/eclipse/deeplearning4j/tree/master/datavec
- https://github.com/eclipse/deeplearning4j/tree/master/arbiter
- https://github.com/eclipse/deeplearning4j/tree/master/nd4s
- https://github.com/eclipse/deeplearning4j/tree/master/rl4j
- https://github.com/eclipse/deeplearning4j/tree/master/scalnet
- https://github.com/eclipse/deeplearning4j/tree/master/pydl4j
- https://github.com/eclipse/deeplearning4j/tree/master/jumpy
- https://github.com/eclipse/deeplearning4j/tree/master/pydatavec
To build everything, we can use commands like
./change-cuda-versions.sh x.x
./change-scala-versions.sh 2.xx
./change-spark-versions.sh x
mvn clean install -Dmaven.test.skip -Dlibnd4j.cuda=x.x -Dlibnd4j.compute=xx
or
mvn -B -V -U clean install -pl '!jumpy,!pydatavec,!pydl4j' -Dlibnd4j.platform=linux-x86_64 -Dlibnd4j.chip=cuda -Dlibnd4j.cuda=9.2 -Dlibnd4j.compute=<your GPU CC> -Djavacpp.platform=linux-x86_64 -Dmaven.test.skip=true
An example of GPU "CC" or compute capability is 61 for Titan X Pascal.
Want some examples?
We have separate repository with various examples available: https://github.com/eclipse/deeplearning4j-examples
In the examples repo, you'll also find a tutorial series in Zeppelin: https://github.com/eclipse/deeplearning4j-examples/tree/master/tutorials