6de00bf75f
* [WIP] Fix compilation after nd4j changes (#37) * Fix compilation. * Some tests fixed * Disable tests temporarily. * Restored test * Tests restored. * Test restored. * [WIP] perf tests (#40) * special maxpool test Signed-off-by: raver119 <raver119@gmail.com> * special maxpool test Signed-off-by: raver119 <raver119@gmail.com> * Shyrma bnorm bp (#41) Batchnorm backprop mkldnn * Add SameDiff memory reuse memory manager (array cache) (#39) * Attention op comments Signed-off-by: AlexDBlack <blacka101@gmail.com> * ArrayCacheMemoryMgr - first pass Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tweak array cache for use with SameDiff identity arrays Signed-off-by: AlexDBlack <blacka101@gmail.com> * ArrayCacheMemoryMgr javadoc and properly get max memory Signed-off-by: AlexDBlack <blacka101@gmail.com> * LRU cache policy + add tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Resize arrays internally if required for ArrayCacheMemoryMgr Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test improvement Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * SameDiff op runtime benchmarking listener (#42) Signed-off-by: AlexDBlack <blacka101@gmail.com> * INLINE_LOOPS for windows Signed-off-by: raver119 <raver119@gmail.com> * [WIP] ThreadPool (#8) This PR removes OpenMP use in 95% of cases
72 lines
2.1 KiB
C++
72 lines
2.1 KiB
C++
/*******************************************************************************
|
|
* Copyright (c) 2015-2018 Skymind, Inc.
|
|
*
|
|
* This program and the accompanying materials are made available under the
|
|
* terms of the Apache License, Version 2.0 which is available at
|
|
* https://www.apache.org/licenses/LICENSE-2.0.
|
|
*
|
|
* Unless required by applicable law or agreed to in writing, software
|
|
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
|
|
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
|
|
* License for the specific language governing permissions and limitations
|
|
* under the License.
|
|
*
|
|
* SPDX-License-Identifier: Apache-2.0
|
|
******************************************************************************/
|
|
|
|
//
|
|
// @author raver119@gmail.com
|
|
//
|
|
|
|
#ifndef SAMEDIFF_THREADPOOL_H
|
|
#define SAMEDIFF_THREADPOOL_H
|
|
|
|
#include <list>
|
|
#include <vector>
|
|
#include <thread>
|
|
#include <atomic>
|
|
#include <mutex>
|
|
#include <execution/BlockingQueue.h>
|
|
#include <execution/CallableWithArguments.h>
|
|
#include <execution/CallableInterface.h>
|
|
#include <execution/Ticket.h>
|
|
#include <queue>
|
|
|
|
namespace samediff {
|
|
class ThreadPool {
|
|
private:
|
|
static ThreadPool* _INSTANCE;
|
|
|
|
std::vector<std::thread*> _threads;
|
|
std::vector<BlockingQueue<CallableWithArguments*>*> _queues;
|
|
std::vector<CallableInterface*> _interfaces;
|
|
|
|
std::mutex _lock;
|
|
std::atomic<int> _available;
|
|
std::queue<Ticket*> _tickets;
|
|
protected:
|
|
ThreadPool();
|
|
~ThreadPool();
|
|
public:
|
|
static ThreadPool* getInstance();
|
|
|
|
/**
|
|
* This method returns list of pointers to threads ONLY if num_threads of threads were available upon request, returning empty list otherwise
|
|
* @param num_threads
|
|
* @return
|
|
*/
|
|
Ticket* tryAcquire(int num_threads);
|
|
|
|
/**
|
|
* This method marks specified number of threads as released, and available for use
|
|
* @param num_threads
|
|
*/
|
|
void release(int num_threads = 1);
|
|
|
|
void release(Ticket *ticket);
|
|
};
|
|
}
|
|
|
|
|
|
#endif //DEV_TESTS_THREADPOOL_H
|