Answer by Darrell Ulm · Mar 15 at 07:42 PM
Would it be possible to just use Spark-Mlib with the classification and regression libraries, specifically the multilayer perceptron classifier here:
and define extra methods around the multilayer perceptron classifier to have recurrent connections. It looks like this would take extra code, and not finding anything that indicates that the Mlib multilayer perceptron classifier is anything other than feed-forward.
Also interested in this topic, found there was a talk about this at Spark Summit East 2016 : https://spark-summit.org/east-2016/events/deep-recurrent-neural-networks-for-sequence-learning-in-spark/ with presentation links.
I believe what was done was the presenters wrote custom code to handle recurrent connections and training, possibly using the existing Spark-Mlib. May be worth a look.
Answer by runawayhorse001 · Mar 16 at 09:03 PM