IoT with Apache MXNet and Apache NiFi and MiniFi

IoT with Apache MXNet and Apache NiFi and MiniFi

Wednesday, April 18
11:50 AM - 12:30 PM
Convention Hall I - C

A hands-on deep dive on using Apachee MiniFi with Apache MXNet on the edge device including Raspberry Pi with Movidius and NVidia Jetson TX1. We run deep learning models on the edge device and send images, sensor data and deep learning results if values exceed norms. Using S2S data is sent to NiFi for further processing, additional deep learning processing, data augmentation. A stream of data is landed as ORC files in HDFS with Hive tables on-top.

Processed data in AVRO format with a schema stored in Schema Registry. Visualization is shown in Zeppelin.

Use Cases: Security Camera Monitoring, Utility Asset Anomaly Detection, Temperature and Humdiity filtering for devices.

This talk builds on several existing articles I have written:
https://community.hortonworks.com/articles/142686/real-time-ingesting-and-transforming-sensor-and-so.html
https://community.hortonworks.com/articles/121916/controlling-big-data-flows-with-gestures-minifi-ni.html
https://community.hortonworks.com/articles/83100/deep-learning-iot-workflows-with-raspberry-pi-mqtt.html
https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html
https://community.hortonworks.com/articles/130814/sensors-and-image-capture-and-deep-learning-analys.html
https://community.hortonworks.com/articles/107379/minifi-for-image-capture-and-ingestion-from-raspbe.html
https://community.hortonworks.com/articles/118132/minifi-capturing-converting-tensorflow-inception-t.html
https://community.hortonworks.com/articles/136039/integrating-nvidia-jetson-tx1-running-tensorrt-int-3.html
https://community.hortonworks.com/articles/101904/part-2-iot-augmenting-gps-data-with-weather.html

Presentation Video

SPEAKERS

Timothy Spann
Solutions Engineer
Hortonworks
Tim Spann was a Senior Solutions Architect at AirisData working with Apache Spark and Machine Learning. Previously he was a Senior Software Engineer at SecurityScorecard ("http://securityscorecard.com/) helping to build a reactive platform for monitoring real-time 3rd party vendor security risk in Java and Scala. Before that he was a Senior Field Engineer for Pivotal focusing on CloudFoundry, HAWQ and Big Data. He is an avid blogger and the Big Data Zone Leader for Dzone (https://dzone.com/users/297029/bunkertor.html). He runs the the very successful Future of Data Princeton meetup with over 830 members at http://www.meetup.com/futureofdata-princeton/. He is currently a Solutions Engineer at Hortonworks in the Princeton New Jersey area. You can find all the source and material behind his talks at his Github and Community blog: https://github.com/tspannhw/ApacheDeepLearning101 https://community.hortonworks.com/users/9304/tspann.html