Wednesday, November 21, 2018

IoT & Intelligent Edge on drone : Under the hood & Bill of Material

DISCLAIMER : No NDA algorithms of AI will be found here. It is up to everyone to create its own ones. Appart from that, you will find the  ingredients needed to have an industrial AI running on the Edge ! After a period of R&D starting in 2016, this project was OpenSourced in Jan 2018 when Scott Guthrie arrived in Paris for a Redshirt Tour 18 (can be found here, even if our doc is partially obsolete due to technology evolution : https://github.com/azugfr/RedShirtTour-IoT-Edge-AI-Lab)

NEXT : I will carry on adding more info progressively in this article.

NEXT : I will explain how to get an effective Keynote that involves Julia White – Vice President Corporate Microsoft Azure worldwide.

NEXT : our team will share as Open Source on GITHUB the code that is NOT under NDA.



INTRODUCTION

Context : During the Keynote of Julia White at Microsoft Experiences 2018(*), with Guilhem Villemin, I had the opportunity to illustrate Julia’s point regarding IoT, IoT Edge and AI = Intelligent Edge : https://www.youtube.com/watch?v=S3ZPtwAPG8Q&t=92m28s&feature=youtu.be 

(*) Largest European Microsoft event with 20000 people registered, over 150000 connected on live TV, plus many thousands on replay

 image image

I was acting as a Microsoft Regional Director (“RD program” known worldwide by Microsoft), and an Azure MVP, working as a FTE for VISEO.

image image


BOM – Bill of Material

  • Team : You need a solid Rambo Team, that will succeed in due time no matter how hard the work is, and a great customer ALTAMETRIS (100% spin-of the SNCF railway), and Craftsman (well, here Cratfswoman – Sacha Lhopital that code in a CleanCode manner and with AI expertise), and Artem Sheiko – who I am refering to during the Keynote, our DataScientists.
    • image
    • image image
    • image
      • Vincent Thavonekham : Project Director & Speaker of the Keynote
      • Igor Leontiev : CSA Lead – Cloud Solution Architect
      • Artem Sheiko : DataScientist
      • Sacha Lhopital : AI Dev & Azure IoT Dev ; https://www.meetup.com/fr-FR/MUGLyon/events/250854003/

      • Christophe Creuseveau : Director IoT Dev Team – Grenoble and about 10 people in his team (months on Azure IoT Edge + weeks on Azure Cognitive Services) ==> MANY Thanks
      • Industrial customer :
    • and many other people who helped us, particularly my colleagues in Grenoble


  • Massive amount of data
    • Many thousands of images and video as a DataSet per AI to be created
      image
    • Many real devices on the top of photo & video


  • Azure Subscription
    • To orchestrate DevOps deployment of the various Docker containers : modules Azure IoT Hub > IoT Edge
    • To centralize the source code : Azure DevOps CI/CD + GIT


  • DRONE : a real industrial drone running on Linux
    • Either this one (worth > 1/2 million $) ; if you are one of the 10 people in the world who owns that monster. Or the one guy in France : Nicolas Pollet the CEO of ALTAMETRIS below.
      image
    • Or, the one on stage (worth > 20 000$ to 40 000$)
      image
    • Alternatively, use another drone without Linux, but add an external “box” running Linux in parallel (could a Raspberry PI, but your AI has to be very low CPU demanding), but you will not have the ability to get the Drone’s telemetry (coordinate, orientation, battery level, …)



ON THE EDGE SIDE : Microsoft IoT Edge

  • Igor Leontiev created 3 ADVANTECH IoT Boxes :
  1. One for CI/CD DevOps, and advanced debugging tools and GUI
  2. Another one with a home-made version of a Linux distribution :
    • no GUI Linux for sparing resources for the AI compute
      image
    • already packaged an IoT Edge SDK
    • already packaged a Docker application
  3. A last box used as a Dev R&D box, to try many combinations of installations
    • version of Linux,
    • GUI vs no-GUI,
    • Version of camera and tricky drivers for Linux combined with the fact that we are in a Docker Container
    • Type of camera : USB vs. RJ45 vs. Wifi
    • type of AI (many versions of TensorFlow, OpenCV …),
    • Power needed in terms of CPU to run YOLO libraries,
  • Last but not least Igor also created a streaming server so that the OUTPUT of the camera is not the “barebone RAW” image captured, but a version enhanced with what the AI has been detected as object / defect. With possible output :
    • VGA cable (via an tiny and fragile adapter from Drone=> VGA
    • RJ45
    • Wifi

For the demo, we used RJ45 as a plan A, and a VGA as plan B just in case.
By experience, the organizers of MS Experiences prefered to ban any Wifi. Luckily, we has 3 possibilities


VISEO & IMAGE ACQUISITION

Similarly to a real professional camera, it is not a regular camera that we are using, but a camera composed into two distinct pieces. One coming from Germany, and the other one imported from Japan.

  1. An industrial Sensor, of brand iDS
    sensor_iDS
  2. A professional lens
    Lens
  3. All combined
    image
  4. Installing the drivers – testing on Windows, then on Linux, then Docker+Linux !
    image
  5. once deployed in the Drone
    https://twitter.com/VISEOGroup/status/1060129485717209088
    image

    image




HOW TO CREATE THE AI “home-made” ?

This is another story that needs a white paper itself. Without disclosing any NDA information, be armed with :

  • a lot of patience : hours, days, nights !!!
    training, and re-training, and re-training, and re-training, and re-training, and re-training…. the AI model, up until you get an adequate one
    image image
  • some more hours, days, nights assessing the model on Linux – Here Artem Sheiko, the master chef of this AI
    image
  • And lots of coffee, next to a skeptical customer top expert in Railway field that will push us to the limits !!
    image


APPENDICES

Friday, October 26, 2018

On the Home page & Keynote of the largest Microsoft event in Europe


I got selected to talk during a Keynote of the largest Microsoft event in Europe. I’ll be presenting Azure IoT Edge, AI (Azure Custom Vision with Object Detection, and also Custom AI based on OpenCV/TensorFlow) deployed on Drones for ALTAMETRIS, to inspect the SNCF infrastructure.

Microsoft Experiences : it’s 15000 people, 300000 users connected on Live-Streaming


On the home page:  https://experiences18.microsoft.fr/ 

!image


image


image


In 3 days, I got over 2000 views and kind feedback

image


https://www.linkedin.com/feed/update/urn:li:activity:6461365896681222144/

image

Sunday, June 10, 2018

GDPR is everywhere !! Microsoft is asking for Data Protection Requirement Attestation

You want to work with Microsoft ? Ensure you know well your GDPR and are Legally organized with it.*

image

Saturday, February 24, 2018

Microsoft Corp has selected France to launch the First “IoT in a Day” event with SaaS Microsoft IoT Central

image

This is only the beginning of the History for “IoT in a Day”, a worldwide event where Microsoft Corp presents Azure IoT, including Microsoft IoT Central, the SaaS IoT product that eases greatly IoT, so much that even someone who doesn’t know coding can setup IoT project.

CONTEXT :

The specificity of “IoT in a Day” is that within 1 day, one could see an end-to-end IoT scenario : a bit of theories, a deep dive testimonial of customers, a manipulation of true devices with firmware upgrade and Wifi configuration, then Azure connection, with telemetry display ! Key success factors for IoT (based on worldwide feedback, official Eclipse IoT fundation framework and 40 IoT projects, and customers’ feedback)

Microsoft Corp has selected Igor Leontiev and I to organize this event, respectively Azure MVP and Microsoft Regional Director, after having passed a worldwide selection, backed up with 40 IoT projects and customer’s testimonials.

https://twitter.com/rahulmsft/status/962888077583695872
image 

AGENDA OF THE FREE TRAINING :

(see here for details of the day in French: www.viseo.com/fr/actualite/iot-day-compte-rendu)

  • Welcome & Networking
  • Keynote by the customer LPG Systems
  • General presentation IoT
  • IoT Lab – Part 1 (IoT with simulator)
  • Free lunch + networking with Microsoft Corp and France, LPG and VISEO
  • IoT Lab – Part 2 (IoT with True ‘device’)
  • Return on experience from LPG about Azure IoT
  • IoT Lab – Part 3


FEEDBACK :

image

Attendees provided really enthusiastic feedback of this format ; this is the very first of a series that is going to be deployed worldwide for the next following months. Next will be in Chicago, then many others in France on Key cities. Stay tuned for the other locations. Follow my Twitter.

Here is a summary of the event : https://t.co/olPQA7TZC3 

 
  ©2018 photo credit : Marc Obregon


SOUVENIRS :

Some souvenirs from Microsoft France head-quarter:

clip_image001


A pause in the training with Rahul, from MS Corp, detailing their strategy
clip_image002

clip_image003

Celebrating the success in Lovely Paris !
clip_image004

clip_image005

clip_image006

Thursday, February 15, 2018

Global Azure Bootcamp 2018 ! Call 4 Speaker and program


5th time it is organized in Lyon, along the hundreds other Cities worldwide

  1. To select the talks you are interested in the most, please complete the Survey : https://tinyurl.com/ycz8kc3e
  2. To have the official worldwide info : https://global.azurebootcamp.net/locations/france-lyon/
  3. To register : https://www.meetup.com/fr-FR/MUGLyon/events/247817761
  4. You are a Speaker ? Here is the Call for Speaker (same as the survey, just fill in the last question) : https://tinyurl.com/ycz8kc3e


Here is the program :.

GAB2018-Lyon_AgendaV9



image

Thursday, February 1, 2018

How to have an easy report on your Azure consumption ? with an Azure EA

Many times I got asked to tell where to get the API Key to perform your self cost reporting, using Cloudyn, or PowerBI, or your own Code using Web API.

Very easy !

(this post is a update simplified from this one : http://blog.thavo.com/2016/10/cost-on-azure-where-to-start.html)

AZURE ENTERPRISE AGREEMENT PORTAL

1. go to https://ea.azure.com
image

2. Move from “Manage” to “Report”

image

3. Choose “Download Usage” > “API Access Key”

image

image


The API Key should look something like :

image

POWER BI WEB APP

Go to PowerBI : https://powerbi.microsoft.com

image

image image


Fill in the questions and the API Key, then it works straight after


image