Friday, February 23, 2018

Infrastructure 3.0 for AI and ML: HW & SW

another very interesting podcast interview, and an article

The Cloudcast: The Cloudcast #333 - Infrastructure 3.0 for AI and ML

Infrastructure 3.0: Building blocks for the AI revolution | VentureBeat

"The commercial internet that came of age in the late ’90s and early ’00s owes its existence to the x86 instruction set (Intel), the standardized operating system (Microsoft), .... Infrastructure 1.0.
...
This category of technologies — Linux, KVM, Xen, Docker, Kubernetes, Mesos, MySQL, MongoDB, Kafka, Hadoop, Spark... Infrastructure 2.0 ...
 was ultimately concerned with the question “How do we connect the world?” 

Today’s generation of technology rephrases the question to ask, “How do we make sense of the world?..Infrastructure 3.0 — will be about unlocking the potential of ML/AI and providing the building blocks for intelligent systems. As with previous generations, there will be new projects, platforms, and companies that emerge and challenge the current incumbency.

Thursday, February 22, 2018

BrickPi: Raspberry Pi Rubiks Cube Solving Robot

How To Build a Raspberry Pi Rubiks Cube Solving Robot - YouTube


BrickPi - Dexter Industries

BrickPi3 Starter Kit - Dexter Industries: $180 (LEGO parts no included)

or GoPiGo Beginner Starter Kit: the Raspberry Pi Robot Car: $200

Also available on Amazon.com: Dexter Industries

Dexter Industries is a company that designs robots for education, researchers, and hobbyists. The company makes several products that expand the LEGO Mindstorms system, Raspberry Pi, and Arduino prototyping system."

BrickPi was mentioned by chief AWS evangelist Jeff Barr here:
AWS Greengrass – Run AWS Lambda Functions on Connected Devices | AWS News Blog

And here is the "smart part:"

Raspberry Pi cameras takes photos of each side of the cube.

Video suggest using this Python tool for solving the cube:
muodov/kociemba: A pure Python and pure C ports of Kociemba's algorithm for solving Rubik's cube @ GitHub

The tool is using this algorithm:
Solve Rubik's Cube with Cube Explorer

And here is a proof that Rubik's cube can be solved in 20 steps of less.
God's Number is 20 : "With about 35 CPU-years of idle computer time donated by Google, a team of researchers has essentially solved every position of the Rubik's Cube™, and shown that no position requires more than twenty moves."

Cube Animation comes from here:
twisty.js


Tuesday, February 20, 2018

Cloud Computing => Edge Computing: AWS Greengrass, Azure IoT Edge

A very interesting, and well informed, view of the next wave of evolution of computing!

The Cloudcast: The Cloudcast #334 - The Future of Edge Computing

"... talks with Derek Collison (@derekcollison, Founder and CEO at Synadia Communications, board member of CNCF, former CTO of VMware, Architect of Cloud Foundry,  technical director at Google,  TIBCO,etc.) about the future of edge computing, the impact of AI/ML on edge systems, and how Telcos and open source communities will evolve with edge computing opportunities."


"Edge computing allows data produced by internet of things (IoT) devices to be processed closer to where it is created instead of sending it across long routes to data centers or clouds.
Doing this computing closer to the edge of the network lets organizations analyze important data in near real-time – a need of organizations across many industries,"

Network World - How Edge Computing Works [diagram]

Edge computing - Wikipedia

Interesting "edge" use-cases are "cloud functions" and Machine Learning inference.
ML models can be created by training on cloud, and then deployed to edge for faster response time.

That is exactly what AWS already offers with AWS Greengrass - Amazon Web Services.
Optionally combined with customized HW, i.e. optimized for ML and/or IoT, it really becomes a new platform.  AWS Greengrass – Run AWS Lambda Functions on Connected Devices | AWS News Blog
Introducing AWS Greengrass @ SlideShare
Greengrass is software (bring your own hardware); Manage from cloud console or API;
price $1.5/year/device.

Microsoft also provides a similar integrated solution:
Azure IoT Edge | Microsoft Azure | Pricing - IoT Edge | Microsoft Azure
Azure IoT Hub is required for the secure management of devices and services deployed to the edge via Azure IoT Edge. Pricing—IoT Hub | Microsoft Azure (based on number of messages/month)"There is no charge for using Azure IoT Edge. Azure IoT Edge allows you to run multiple Azure services on the edge. These Azure services running on IoT Edge will be billed according to their specific pricing."

Containers are a very good technology for deploying and updating software,
and even small computers like Raspberry Pi it can run both Docker and Kubernetes.
"Edge" container management is not standardized (yet), but that could change over time...


SCaLE 13x Derek Collison NATS A new nervous system for distributed cloud platforms - YouTube

GopherCon 2014 High Performance Systems in Go by Derek Collison - YouTube

derekcollison/nats-go: NATS client for Go @ GitHub

Apcera | Interview with its Founder & CEO - Derek Collison

Our Apcera Enterprise Solutions Defined | Apcera



Monday, February 19, 2018

Blockchain @ Azure

An excellent overview of Blockchain technology and Microsoft efforts and products for it:
Blockchain - MS Dev Show Podcast

Microsoft Azure Blockchain forum

Announcing the Coco Framework for enterprise blockchain networks | Blog | Microsoft Azure

Ethereum Project
Home - Hyperledger

#1: B2B transactions leveraging blockchain go into production

Blockchain technology is started 10 yeast ago by "Satoshi Nakamoto"
(still ) unknown person or people who designed bitcoin and created its original reference implementation

Bitcoin: A Peer-to-Peer Electronic Cash System (PDF)
Bitcoin: A Peer-to-Peer Electronic Cash System | Satoshi Nakamoto Institute

The original source code was for Windows only, in C++. Current source:



Saturday, February 17, 2018

"Designing Distributed Systems" free ebook by k8s co-founder



Q&A with Kubernetes Founder Brendan Burns on Containers and Distributed System Patterns @ InfoQ

"...Brendan Burns outlined many of the patterns that enables distributed systems programming in the blog he wrote in 2015. He and David Oppenheimer, both original contributors for Kubernetes, presented a paper at Usenix based around design patterns and containers shortly after.

InfoQ caught up with Burns, who recently authored an ebook titled Designing Distributed Systems, Patterns and Paradigms for Scaleable Microservices. He talks about distributed systems patterns and how containers enable it."




Google "AMP stories"

Accelerated Mobile Pages Project – AMP

Accelerated Mobile Pages - Wikipedia
"The Accelerated Mobile Pages Project (AMP) is an open-source website publishing technology designed to improve the performance of web content and advertisements. The AMP Project led by Google is a competitor to Facebook's Instant Articles, and includes several other large search, social and web publishing platforms around the world."

"The AMP framework consists of three components:
  • AMP HTML which is a standard HTML with web components
  • AMP JavaScript which manages resource loading; and 
  • AMP caches which can serve and validate AMP pages
...Google reports that AMP pages served in Google search typically load in less than one second and use 10 times less data than the equivalent non-AMP pages"
AMP vs PWA... whats the difference? - Google Groups




Introducing AMP Stories - YouTube
"The AMP story format is a recently launched addition to the AMP Project that provides content publishers with a mobile-focused format for delivering news and information as visually rich, tap-through stories."

Stories – AMP
A Pod Races Through the Hyperloop for the First Time

Google AMP for Email will probably make Gmail even more annoying - SlashGear
"Your email is about to come a whole lot more interactive – or a whole lot more annoying, depending on how you look at it – with Google baking AMP into Gmail. The new project builds on AMP – or Accelerated Mobile Pages – which have been part of the search giant’s push to speed up the mobile web by encouraging publishers to use pared-back, lightweight versions of their normal pages."



Friday, February 16, 2018

Azure Notebook: Python Data Science Handbook



Azure Notebooks are running pre-configured Jupyter Notebooks on the cloud, no setup required!
There are useful samples, and one of them is a complete book, also available online on GitHub!

Book CoverPythonDataScienceHandbook (jakevdp) - Microsoft Azure Notebooks

"This repository contains the entire Python Data Science Handbook, in the form of (free!) Jupyter notebooks. You can read the book in its entirety online at GitHib:"

Python Data Science Handbook | Python Data Science Handbook

"This website contains the full text of the Python Data Science Handbook by Jake VanderPlas; the content is available on GitHub in the form of Jupyter notebooks."



Amazon Web Service is also using Jupyter Notebooks in the "cloud",
as usual with a "fancy" name "SageMaker" 

Thursday, February 15, 2018

security free certificates: Let's Encrypt + IIS, Azure; AWS

An excellent article by Rick Strahl with instructions for setting up free SSL/TLS with IIS web server.

Let's Encrypt Certificates TLS - Securing IIS Web Sites with Let's Encrypt Certificates
@ CODE magazine

"TLS is no longer an option but a necessity for any website, large and small. And now, with new tooling and free certificates available from Let’s Encrypt and a few other providers, there’s no longer any excuse to not use encrypted HTTP, even on small hobby or sample sites. Anything public should just run on HTTPS. Setting up a new certificate, even on Windows and IIS can now literally be done in a few minutes and the renewal process can be fully automated. It’s essentially fire and forget."
...
"Certify the Web provides a nice GUI for managing certificates along with some advanced options and support features..."





"Let’s Encrypt is a free, automated, and open Certificate Authority."


Troy Hunt: Everything you need to know about loading a free Let's Encrypt certificate into an Azure website



New – AWS Certificate Manager – Deploy SSL/TLS-Based Apps on AWS | AWS News Blog

"The new AWS Certificate Manager (ACM) is designed to simplify and automate many of the tasks traditionally associated with management of SSL/TLS certificates. ACM takes care of the complexity surrounding the provisioning, deployment, and renewal of digital certificates! Certificates provided by ACM are verified by Amazon’s certificate authority (CA), Amazon Trust Services (ATS).

Even better, you can do all of this at no extra cost. SSL/TLS certificates provisioned through AWS Certificate Manager are free!"


Wednesday, February 14, 2018

Pluralsight "Skill IQ" + Stack Overflow "Developer Story"

Pluralsight and Stack Overflow Partner to Help Developers Assess Their Technology Skills | Pluralsight

"Pluralsight, the enterprise technology learning company, today announced a partnership with Stack Overflow to provide developers with the tools they need to grow their skills, share their knowledge, and build more successful careers. Through the partnership, developers can showcase their experience, career highlights and technology expertise by displaying their Pluralsight IQ on their Stack Overflow Developer Story."

Get your Skill IQ

"In as little as five minutes and 20 questions, you can identify your knowledge gaps and strengths with our skill assessments.
Your results tell you where to start within a learning path, so you can develop the skills you need most and not waste time on what you already know."


Developer Story - Stack Overflow

"When Stack Overflow launched, it gave developers a better way to find answers. Your Developer Story gives you a better way to find a job you love based on what you can do, not just where you worked."


Microsoft Azure Technical Sales = Growth

How Microsoft Revolutionized Its Sales Team--Plus 9 More Insights From CFO Amy Hood @ Forbes

"In the wake of Microsoft's 56% commercial-cloud revenue growth in its just-completed quarter, some recent public comments from executive vice-president and CFO Amy Hood offer remarkable insights into why everything in Redmond seems to be humming along beautifully these days."


"Microsoft's booming cloud growth follows its decision to
invest heavily in hiring technically sophisticated salespeople."

  1. "New-Age Salespeople: Capable Of Writing Shippable Microsoft Code"
"They're not paid on selling a contract of Azure—so not on bookings—but rather as customers are successful, meaning they get projects up and running, the meter starts spinning on Azure, and that's when they get rewarded."



Tuesday, February 13, 2018

Data Science on Microsoft Azure (meetup event)

Philly Azure February Meeting | Philly Azure (Malvern, PA) | Meetup

Philly Azure February - Data Science and Azure Data Catalog - YouTube

Philly Azure - YouTube - YouTube

PhillyAzure - Mixer



python-overview



DaveVoyles/phl-reactor-bot

DaveVoyles - Microsoft Azure Notebooks

Dave Voyles (@DaveVoyles) | Twitter

Dave Voyles | LinkedIn


Machine learning algorithm cheat sheet | Microsoft Docs

Microsoft Azure Notebooks

State Farm Distracted Driver Detection | Kaggle


suggested books:

Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking: Foster Provost, Tom Fawcett: 8601400897911: Amazon.com: Books

Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems: Aurélien Géron: 9781491962299: Amazon.com: Books


mentioned AI/ML hardware platform:

Jetson TK1 Embedded Development Kit|NVIDIA
"The NVIDIA Jetson TK1 developer kit gives you everything you need to unlock the power of the GPU for embedded systems applications."

Monday, February 12, 2018

Mozilla IoT gateway: Web of Things (WoT)

Mozilla releases Internet of Things gateway solution - SD Times

"Mozilla is working to create a framework of software and services that can bridge the communication gap between connected devices. ... anyone can now build their own Things Gateway to control their connected device directly from the web,” the company wrote in a blog post.

The gateway provides an implementation of a Web of Things gateway. “The ‘Web of Things’ (WoT) is the idea of taking the lessons learned from the World Wide Web and applying them to IoT. It’s about creating a decentralized Internet of Things by giving Things URLs on the web to make them linkable and discoverable, and defining a standard data model and APIs to make them interoperable,” the company wrote."

Saturday, February 10, 2018

book: Building the Web of Things


Building the Web of Things: With examples in Node.js and Raspberry Pi

Web + IoT  = Web of Things

Building the Web of Things: With examples in Node.js and Raspberry Pi: Dominique Guinard, Vlad Trifa: 4708364232599: Amazon.com: Books


Web of Things – Architecting the Web of Things, for techies and thinkers!

Web of Things - Wikipedia
"The Web of Things (WoT) is a term used to describe approaches, software architectural styles and programming patterns that allow real-world objects to be part of the World Wide Web. Similarly to what the Web (Application Layer) is to the Internet (Network Layer),[1] the Web of Things provides an Application Layer that simplifies the creation of Internet of Things applications"

W3C Web of Things at W3C
Web of Things application domains

Wednesday, February 07, 2018

Azure Cosmos DB + Apache Spark

Apache Spark Connector for Azure Cosmos DB @ Azure Friday

"Azure Cosmos DB Spark Connector enables Azure Cosmos DB to act as an input source or output sink for Apache Spark jobs."

Azure/azure-cosmosdb-spark Wiki @ GitHub

Azure Cosmos DB – Globally Distributed Database Service | Microsoft Azure

Apache Spark™ - Lightning-Fast Cluster Computing

AWS Lambda += GoLang, .Net Core 2.0

Announcing Go Support for AWS Lambda | AWS Compute Blog

AWS Lambda Supports Go

"You can now develop your AWS Lambda function code using Go. Lambda lets you run code without provisioning and managing servers. You simply upload your Go executable artifact as a ZIP file through the AWS CLI or Lambda console and select the go1.x runtime. With Lambda, you can use Go's native tools to build and package ... code... documentation for more details."

Serverless Framework example for Golang and Lambda

Serverless Golang API with AWS Lambda – A Cloud Guru


AWS Lambda .NET Core 2.0 Support Released | AWS Developer Blog

Tuesday, February 06, 2018

SpaceX: Tesla roadster in space!

SpaceX launches its powerful Falcon Heavy rocket for the first time - The Verge

Live Views of Starman - YouTube
Elon Musk’s Tesla roadster, which launched on top of SpaceX’s Falcon Heavy earlier today, is going farther out into the Solar System than originally planned. - The Verge

Floating through space, SpaceX's 'Starman' mesmerizes the world



SpaceX launches world's most powerful rocket - YouTube

SpaceX's Falcon Havy launch produced some stunning images - Feb. 6, 2018

book: A Curious Moon: PostgreSQL + NASA

A book that is a mix of PosgreSQL tutorial, Data Science, real NASA data from Cassini spacecraft, and some fictional scientists to make the whole thing very interesting.


A Curious Moon - Big Machine

"Mostly a PostgreSQL tutorial, this book also has a narrative element in the spirit of The Martian...

Follow along with Dee Yan, our fictional data science intern, as she assumes the job of interim database administrator at the fictional aerospace startup, Red:4. She’ll learn PostgreSQL like we all do: on the job and under pressure. Red:4 is bidding on a mission to one of Saturn’s moons, Enceladus, considered to be a primary candidate for alien life..."

podcast and link:
Postgres and Curious Moon with Rob Conery @ .NET Rocks! vNext

DevOps automation tool: Ansible @ Azure


Ansible logo.svg
Ansible is Simple IT Automation

IT Automation with Ansible

Based on OpenSSH & WinRM, no Agents required.

Microsoft is adding native OpenSSH to Windows 10 - The Verge

Ansible (software) - Wikipedia
"Ansible is software that automates software provisioning, configuration management, and application deployment."
"The name "Ansible" references a fictional instantaneous hyperspace communication system"

Running Ansible on Azure
"... how to run Ansible playbooks on Azure using Cloud Shell, a browser-based shell experience hosted in the cloud... also demonstrates how to use the Ansible extension for VS Code to accelerate Ansible playbook development using auto-completion and code snippets, and then run it inside Docker or Cloud Shell."

Ansible playbook roles to get the latest Azure modules:
Azure.azure_modules (Ansible Galaxy)
Azure.azure_preview_modules (Ansible Galaxy)

Monday, February 05, 2018

AWS Service Catalog

AWS Podcast | Listen & Learn About AWS


AWS Service Catalog

"AWS Service Catalog allows organizations to create and manage catalogs of IT services that are approved for use on AWS. These IT services can include everything from virtual machine images, servers, software, and databases to complete multi-tier application architectures. AWS Service Catalog allows you to centrally manage commonly deployed IT services, and helps you achieve consistent governance and meet your compliance requirements, while enabling users to quickly deploy only the approved IT services they need."


free class: Introducing Font Awesome 5

Introducing Font Awesome 5 | Wilder Minds Training

New Day for Wilder Minds Training - Shawn Wildermuth

| Font Awesome

Saturday, February 03, 2018

Event-Driven Architecture: Azure Event Grid

Azure - Event-Driven Architecture in the Cloud with Azure Event Grid
@MSDN manazine February 2018

"One of the core tenants of an event-driven architecture is to reverse the dependencies that existing services may have with each other."
Services That Contain Logic About Other Services=>A Centralized Service That Reverses Dependencies Between the Other Services
Azure Event Grid Overview

20 years of Open Source

Before "Open Source" the name was "free software" (typically GPL)
A new name opened door for more collaboration in software development.

"Source" indicates compiled programming languages,
while source code of scripting languages is transferred in open by default.
"Open (source) code" could be more specific, but maybe more complicated name. 
"How I coined the term 'open source' | Opensource.com
Christine Peterson publishes her account of that fateful day, 20 years ago.
In a few days, on February 3, the 20th anniversary of the introduction of the term "open source software"

"We mean free as in freedom (free speech), not free as in beer."

Friday, February 02, 2018

GCP, AWS, Azure, IBM cloud: $ billions

what is the size of "cloud computing" business?

Google's Diane Greene: People were 'grossly underestimating' its cloud

"Google's cloud doesn't have any more "deal blockers" in the way of new business, Google Cloud CEO Diane Greene told CNBC (Greene was a founder and CEO at VMware)
Google CEO Sundar Pichai announced that the Google Cloud Platform and the G Suite portfolio of productivity apps, combined, now represent a "billion-dollar-per-quarter business."

Amazon Web Services brought in more than $5 billion in the quarter

Microsoft had said its commercial cloud business, including the Azure public cloud, had revenue exceeding $5 billion during the quarter."

HP Voice Printing with Alexa, Google Assistant & Cortana

HP Voice Printing Now Supports Alexa, Google Assistant & Cortana | Androidheadlines.com



Alexa can now control your HP printer

No, you don’t need a voice-controlled printer in your life - The Verge

may be able to o combine with

HP Instant Ink | HP® Official Site - Sign up here

Thursday, February 01, 2018

Awesome IoT @GitHub


Awesome

Awesome IoT | awesome-iot
"A curated list of IoT.
"phodal/awesome-iot: Awesome IoT. A collaborative list of great resources about IoT Framework, Library, OS, Platform @GitHub

Simliar Projects
  • Awesome Azure IoT - A curated list of awesome Azure Internet of Things projects and resources.
  • Awesome Android Things - A curated list of awesome Android Things tutorials, libraries and much more at one place
  • Awesome OpenIoT - A curated list of awesome open source IoT frameworks, libraries and software.
  • Awesome IoT - A curated list of awesome Internet of Things projects and resources.