AI: Amazon free ML training

Amazon opens up its internal machine learning training to everyone

AWS Training and Certification - Machine Learning
"Dive deep into the same machine learning (ML) curriculum used to train Amazon’s developers and data scientists. We offer 30+ digital ML courses totaling 45+ hours, plus hands-on labs and documentation, originally developed for Amazon's internal use."

Amazon’s own ‘Machine Learning University’ now available to all developers | AWS Machine Learning Blog

Slack on LAMP stack cloud

It is not only Facebook running on PHP and MySQL, apparently Slack is also...

Slack Messaging Architecture with Keith Adams - Software Engineering Daily
podcast with chief architect at Slack
And it is hosted on AWS cloud... Slack Case Study – Amazon Web Services (AWS)

Google Fi += iPhone

Google Fi

Project Fi is now Google Fi, and it will work with iPhones and most Android devices - The Verge

Google Fi’s iPhone debut comes with caveats


Google Fi - Device Promotion Terms


Project Fi is now Google Fi, and it will work with iPhones and most Android devices - The Verge

cloud execs rotation

Google Cloud CEO Greene being replaced by former Oracle exec Kurian

"Amazon Web Services controls 34 percent of the cloud infrastructure services market, according to Synergy Research. Microsoft is second at about 15 percent, followed by IBM in third and Google in fourth, both with market share in the single digits."

$(Microsoft) > $(Apple)

Microsoft (briefly) passed Apple to become the most valuable US company today | Ars Technica

"Microsoft reached a market capitalization of close to $813 billion today, with Apple falling only about a billion behind.
...
The last time Microsoft secured this lead was in 2010. Earlier this year, Apple became the first US company to achieve a $1 trillion market cap. Amazon followed shortly after."

How Microsoft Regained Its Crown As The World's Biggest Company

AWS re:Invent 2018 (!)

AWS re:Invent 2018 | Amazon Web Services

NOV. 26 – 30, 2018 LAS VEGAS, NV

Amazon Web Services - YouTube

2018 re:Invent Product Announcements

AWS re:Invent 2018 Keynote - Andy Jassy - YouTube



AWS re:Invent 2018 - Monday Night Live with Peter DeSantis - YouTube

AWS re:Invent 2018 - Keynote with Werner Vogels - YouTube


AWS Re:Invent: New Machine Learning, Data, Infrastructure Services - The New Stack

How AWS Reinvented the Internet and Became Amazon’s Cash Cow

What To Expect From AWS re:Invent 2018?

CoreRT: .NET Core to native compiler

Compiling to "native" is nothing new for .NET "Mono" variant that does that to be able to run on iOS, by leveraging LLVM toolchain. Windows 10 .NET apps are also pre-compile for target platforms. Still, for mainstream .NET development compiling to native (no JIT) is new. With Kotlin having that feature in Java ecosystem, as well as Go being native by default for micro-services, having option to pre-compile C# is a welcome addition.

dotnet/corert: This repo contains CoreRT, a .NET Core runtime optimized for AOT (ahead of time compilation) scenarios, with the accompanying compiler toolchain. @ GitHub

corert/intro-to-corert.md at master · dotnet/corert

CoreRT - A .NET Runtime for AOT · Performance is a Feature!


.NET Core - Publishing Options with .NET Core @ MSDN magazine

c# - Compiling .net core app with CoreRT / another AOT - Stack Overflow

Fission: Serverless on Kubernetes + Azure Functions Open Source

Fission: Serverless on Kubernetes with Soam Vasani - Software Engineering Daily


Serverless Functions for Kubernetes - Fission (fission.io)



Serverless Workflows for Kubernetes | Fission




There is another open source cloud functions platform,
the one that is actual used on Azure public cloud!

Azure/azure-functions-host: The host/runtime that powers Azure Functions  @ GitHub

Azure/azure-functions-core-tools: Command line tools for Azure Functions @ GitHub

Azure/Azure-Functions @ GitHub (links)

SpaceX Starlink internet satellites * 7000

SpaceX gets approval to launch 7,000 internet-beaming satellites - The Verge

SpaceX gets FCC approval to deploy thousands more internet satellites

Starlink (satellite constellation) - Wikipedia

SpaceX Gives More Details on how their Starlink Internet Service Will Work. Less Satellites, Lower Orbit, Shorter Transmission times, Shorter Lifespans - Universe Today



Elon Musk on making Starlink – Space Internet Company - YouTube

Internet From Space X In 2020? Only If Elon Musk Wins Again - YouTube

Low Latency Routing in Space - YouTube

Intel Neural Compute Stick 2

Intel Neural Compute Stick 2 promises 8x the power at a silly price - SlashGear
$99

Intel has revealed its second-generation artificial intelligence USB stick, with the Neural Compute Stick 2 promising up to eight times the performance of its predecessor

HTTP/3: HTTP-over-QUIC UDP

HTTP-over-QUIC to be renamed HTTP/3 | ZDNet

"IETF agrees to base the next major iteration of HTTP on Google's QUIC protocol
The HTTP-over-QUIC experimental protocol will be renamed to HTTP/3 and is expected to become the third official version of the HTTP protocol, officials at the Internet Engineering Task Force (IETF) have revealed.

This will become the second Google-developed experimental technology to become an official HTTP protocol upgrade after Google's SPDY technology became the base of HTTP/2.

HTTP-over-QUIC is a rewrite of the HTTP protocol that uses Google's QUIC instead of TCP (Transmission Control Protocol) as its base technology.

QUIC stands for "Quick UDP Internet Connections" and is, itself, Google's attempt at rewriting the TCP protocol as an improved technology that combines HTTP/2, TCP, UDP, and TLS (for encryption), among many other things."

The next version of HTTP won’t be using TCP | Ars Technica

QUIC - Wikipedia

Google: Let's Talk AI

Home - Let's Talk AI

online event and videos

Schedule - Let's Talk AI

Software-Defined Networking (SDN) and cloud

Software-Defined Networking (SDN) Definition - Open Networking Foundation


Software-defined networking - Wikipedia

Software Defined Networking (SDN): The Big Picture | Pluralsight

OpenFlow - Wikipedia

Android Foldable Phones

Android Gets Ready for Foldable Phones, Kotlin 1.3, Improves Tooling @InfoQ

Android Developers Blog: Unfolding right now at #AndroidDevSummit!

"There are two variants broadly speaking: two-screen devices and one-screen devices. When folded, foldables look like phones, fitting in your pocket or purse. When unfolded, their defining feature is what we call screen continuity."

Microsoft Connect(); 2018: Azure + AI

Microsoft Connect(); 2018 Conference | Microsoft Azure

"December 4, 2018 for a full day of dev-focused delight—including updates on Azure and Visual Studio, keynotes, demos, and real-time coding with experts—live from the Microsoft Azure and AI Conference."

web: IPFS: InterPlanetary File System (!), FileChain, DTube, multihash, Merkle DAG

IPFS is designed to be a protocol for next generation web,
compatible with current web, and even with current file systems!

It is a "content addressable" system, similar to Git and blockchains including Ethereum.
And it is much more than that, a completely generic "data graph" with immutable data,
that enables "faster than speed of light" data access (by pre-loading).

In addition, it has security and performance baked-in to design from start,
and open source team with access to leading distributed systems science!

IPFS is the Distributed Web (https://ipfs.io/)

InterPlanetary File System - Wikipedia 

InterPlanetary File System (IPFS) is a protocol and network designed to create a content-addressable, peer-to-peer method of storing and sharing hypermedia in a distributed file system.[2]

Why it is named "Inter Planetary"?
Because it is designed to be able to provide effective access to web from Mars!
And if it can work well from other planet, it can make web work well on any place on Earth, too.


IPFS is mentioned in this Azure Podcast, apparently Microsoft is working on it:

Episode 254 - DevCon 4  from 11:50 to 14:50

ITFS is a pear-to-pear, decentralized content sharing network, where resources are identified by content hash value (like in Git and Docker), and hashes could be shared via block-chain or some other method.

All content is immutable (since content changes are changing hash), and new versions just point to previous versions. The reason Microsoft and enterprises are interested is to augment block-chain with larger size content, making "private IPFS networks.

IPFS - Simply Explained - YouTube

IPFS Alpha Demo - YouTube

Stanford Seminar - IPFS and the Permanent Web - YouTube

DEVCON1: IPFS - Juan Batiz-Benet - YouTube

IPFS - Hands On Intro - Speaker Deck

Juan Benet of Filecoin, Protocol Labs and IPFS: "Filecoin" | Blockstack Berlin 2018 - YouTube

Juan Benet: Enter the Merkle Forest - YouTube  about IPLD, IPNS  (IPLD @ Protocol Labs)

The next Internet Revolution | Juan Benet | TEDxSanFrancisco - YouTube

Juan Benet | LinkedIn (creator of IPFS project)

Protocol Labs | Crunchbase   (protocol.ai)



IPFS @ GitHub

ipfs/ipfs: Peer-to-peer hypermedia protocol

ipfs/go-ipfs: IPFS implementation in Go

ipfs/js-ipfs: IPFS implementation in JavaScript


solidity - What datatype should I use for an IPFS address hash? - Ethereum Stack Exchange

Why do IPFS hashes start with "Qm"? · Issue #22 · ipfs/faq
"IPFS represents the hash of files and objects using Multihash format and Base58 encoding. The letters Qmhappen to correspond with the algorithm (SHA-256) and length (32 bytes) used by IPFS"

go-multihash/multihash at master · multiformats/go-multihash

InterPlanetary File System @ ipfs.io

"IPFS is a peer-to-peer distributed file system that seeks to connect all computing devices with the same system of files. In some ways, IPFS is similar to the World Wide Web, but IPFS could be seen as a single BitTorrent swarm, exchanging objects within one Git repository. In other words, IPFS provides a high-throughput, content-addressed block storage model, with content-addressed hyperlinks. This forms a generalized Merkle directed acyclic graph (DAG). IPFS combines a distributed hash table, an incentivized block exchange, and a self-certifying namespace. IPFS has no single point of failure, and nodes do not need to trust each other.[4] Distributed Content Delivery saves bandwidth and prevents DDoS attacks which HTTP struggles with."

https://filecoin.io : IPFS + BlockChain

Introducing Filecoin, a decentralized storage network - YouTube 

DTube : IPFS "youtube"

Base58 - Wikipedia
"Base58 is a group of binary-to-text encoding schemes used to represent large integers as alphanumeric text, introduced by Satoshi Nakamoto for use with Bitcoin.[1] It has since been applied to other cryptocurrencies and applications. It is similar to Base64 but has been modified to avoid both non-alphanumeric characters and letters which might look ambiguous when printed..."

related?
Interplanetary Internet - Wikipedia

Intergalactic Computer Network - Wikipedia

Merkle tree - Wikipedia

"In cryptography and computer science, a hash tree or Merkle tree is a tree in which every leaf node is labelled with the hash of a data block and every non-leaf node is labelled with the cryptographic hash of the labels of its child nodes. Hash trees allow efficient and secure verification of the contents of large data structures. Hash trees are a generalization of hash lists and hash chains."

Understanding the IPFS White Paper part 2 – Hacker Noon





A Beginner’s Guide to IPFS – Hacker Noon


more info...

InterPlanetary File System (IPFS) Tutorial - Building the Distributed Web - YouTube

How to Host a Website with IPFS - YouTube

Comcast Open Source

Hanselminutes Technology Podcast - Fresh Air and Fresh Perspectives for Developers - Moving companies to Open Source with the Head of Comcast's Open Source Office Nithya Ruff

http://comcast.github.io
223 repositories!

Open Source Comcast projects

Comcast @ GitHub

http://innovationfund.comcast.com/

https://todogroup.org

ChromeDP: Chrome automation with GoLang

Automate Chrome with Golang and ChromeDP | Emir Ribic

chromedp: A New Way to Drive the Web - GopherCon SG 2017 - YouTube

ribice/golang-chrome-automation: Automate Chrome tasks with Golang and ChromeDP @GitHub

chromedp/chromedp: A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

Package chromedp is a faster, simpler way to drive browsers supporting the Chrome DevTools Protocol in Go using the without external dependencies (ie, Selenium, PhantomJS, etc).

"JAM Stack": JavaScript, APIs, markup

JAM Stack with Phil Hawksworth - Software Engineering Daily

The JAMStack is a way of building applications consisting of JavaScript, APIs and markup

MEAN architecture,  LAMP stack... JAMStack

JavaScript which could be served statically (AWS S3), but it could be used very dynamically direct from the client (SPA) and then using things like APIs and, sitting on top of the markup.

JAMstack | JavaScript, APIs, and Markup

Modern web development architecture based on client-side JavaScript, reusable APIs, and prebuilt Markup.

AI SW GitHub popularity

Microsoft allies with Facebook on PyTorch, ONNX AI software

Salesforce + Docker

Docker inks partnership with MuleSoft as Salesforce takes a strategic stake | TechCrunch.
"Docker and MuleSoft have announced a broad deal to sell products together and integrate their platforms. As part of it, Docker is getting an investment from Salesforce, the CRM giant that acquired MuleSoft for $6.5 billion last spring."

Docker has raised $92 million in new funding | TechCrunch

"The new funding is a signal that while Docker may have lost its race with Google’s Kubernetes over whose toolkit would be the most widely adopted,"

Flogo: Event-Driven tool for GoLang

Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis - Software Engineering Daily

Flogo is an event-driven ecosystem for building applications around streams of events.
This is an open source GoLang tool from TIBCO

TIBCOSoftware/flogo: Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps. @GitHub

Google DSPL: Dataset Publishing Language

Overview | Dataset Publishing Language | Google Developers

"Describe your data to enable powerful visualizations
DSPL is the Dataset Publishing Language, a representation language for the data and metadata of datasets. Datasets described in this format can be processed by Google and visualized in the Google Public Data Explorer.

Features

• Use existing data: Just add an XML metadata file to your existing CSV data files
• Powerful visualizations: Unleash the full capabilities of the Google Public Data Explorer, including the animated bar chart, motion chart, and map visualization
• Linkable concepts: Link to concepts in other datasets or create your own that others can use
• Multi-language: Create datasets with metadata in any combination of languages
• Geo-enabled: Make your data mappable by adding latitude and longitude data to your concept definitions. For even easier mapping, link to Google's canonical geographic concepts.
• Fully open: Freely use the DSPL format in your own applications"

DSPL Tutorial  |  Dataset Publishing Language  |  Google Developers

states.csv  |  Dataset Publishing Language  |  Google Developers

Amazon HQ2 / 2 * 2 + 1

Amazon’s HQ2 Hunger Games Are Over, and Jeff Bezos Won | WIRED

Amazon announces NYC and Northern Virginia as HQ2 winners - CNET

"...Amazon picked not one, but two locations for its HQ2 project.
.... selected Long Island City in New York City's Queens borough and National Landing (a new name for the Crystal City neighborhood) in Arlington, Virginia, outside Washington, DC. The picks, which were already widely anticipated for the past week, are expected to each land 25,0000 well-paid jobs.

...

Amazon also said it has selected Nashville to host a new 5,000-person "center of excellence" for its operations business, which handles customer fulfillment, transportation, supply chain and other activities. It plans to start hiring at all three locations next year.

...
New York is offering Amazon $1.525 billion in incentives, and Virginia $573 million, pegged to the company's proposal to create 25,000 jobs at each location. Tennessee is offering up to $102 million for 5,000 jobs. As part of these agreements, the positions in all three cities will need to have an average wage of $150,000, Amazon said."

that is $40K / person in incentives

The Battle for Amazon HQ2 Was a Con – No Mercy / No Malice – Medium

Bezos tells employees, "One day, Amazon will fail" and to stay hungry

Jeff Bezos 2018 Interview - The Big Picture

GraphQL vs REST, SOAP (legacy :)

Home - GraphQL

Facebook’s GraphQL gets its own open-source foundation | TechCrunch



facebook/graphql: GraphQL is a query language and execution engine tied to any backend service. @ GitHub

graphql/graphql-js: A reference implementation of GraphQL for JavaScript

graphql-go/graphql: An implementation of GraphQL for Go / Golang

Getting Started With GraphQL Using Golang

web screen recorder tool: CloudApp

Screen Recorder: Video, Webcam, GIF Recording Software for Mac & PC | CloudApp
"CloudApp is an easy-to-use screen recorder that brings video, webcam, screenshot annotation, and GIF creation securely to the cloud. Capture, share, and accelerate your business communication."

Plans & Pricing | CloudApp
has free option

Features | CloudApp

"Serverless is future of cloud computing"

David Patterson is co-creator of RISC computing architecture, that is running most of computing devices now. He is still very active optimizing computing architectures, at Berkeley and Google.
His current

great podcast interview:
Computer Architecture with Dave Patterson - Software Engineering Daily

"Dave Patterson and John Hennessy created the RISC architecture: Reduced Instruction Set Compiler architecture (they got Turing Award for that)

...

He is involved in the Berkeley RISELab and works at Google on the Tensor Processing Unit."

the interview ends with this statement: 

"serverless is future of cloud computing"

tools: Outliners

Outliner - Wikipedia
An outliner (or outline processor) is a specialized type of text editor (word processor) used to create and edit outlines, which are text files which have a tree structure, for organization. Textual information is contained in discrete sections called "nodes", which are arranged according to their topic–subtopic (parent–child) relationships

Little Outliner Demo - YouTube

Little Outliner demo

Dave Winer - Wikipedia

Dave Winer on The Open Web, Blogging, Podcasting and More | Internet History Podcast


datluong/awesome-outliners: A list of really good outliners @ GitHub

@CodeWisdom

Programming Wisdom (@CodeWisdom) | Twitter

“Any fool can write code that a computer can understand. Good programmers write code that humans can understand.” – Martin Fowler

— Programming Wisdom (@CodeWisdom) November 11, 2018

“Simplicity is prerequisite for reliability.” - Edsger W. Dijkstra

— Programming Wisdom (@CodeWisdom) November 9, 2018

“There is no problem in computer science that can't be solved using another level of indirection. But that usually will create another problem.” - David Wheeler

— Programming Wisdom (@CodeWisdom) September 18, 2018

101 Fastest DNS Servers

from Ben Piper | IT Author

101 Public DNS Servers Sorted by Speed | Ben Piper

public-dns-sorted-20180304.pdf

Including:
Google DNS servers: 8.8.8.8 and 8.8.4.4. 

and Level3: 4.2.2.1 and 4.2.2.2

"Not all DNS servers behave the same way. Some will return intentionally incorrect responses, usually if the query is for a malicious domain"

Get Started  |  Public DNS  |  Google Developers

Web Performance Tools

Web Performance Tools in 2018 with Benjamin Howarth @ .NET Rocks! vNext

• RomanSPA on GitHub
• YUI Framework
• KnockoutJS
• YSlow
• PhantomJS
• WebPageTest
• Lighthouse
• JMeter
• Umbraco
• MiniProfiler
• Glimpse on GitHub
• Simian Army

Next UI: Telepathy !

Apparently technology for direct brain communication is coming soon

Mary Lou Jepsen: Toward Practical Telepathy - The Long Now

"Mary Lou Jepsen founds programs and companies on the hairy edges of physics, invents solutions and takes them to prototype all the way through to high volume mass production. She's done this at Intel, MIT’s Media Lab, One Laptop Per Child, Pixel Qi, Google X, and Facebook (Oculus). She is the founder and CEO of Openwater, which is "devising a new generation of imaging technologies, with high resolution and low costs, enabling medical diagnoses and treatments, and a new era of fluid and affordable brain-to-computer communications."

Mary Lou Jepsen - Wikipedia

Technology | Openwater

How we can use light to see deep inside our bodies and brains | Mary Lou Jepsen - YouTube

book: The Deep Learning Revolution

The Deep Learning Revolution (The MIT Press): Terrence J. Sejnowski: 9780262038034: Amazon.com: Books


Learning How to Learn: Powerful mental tools to help you master tough subjects | Coursera


The Deep Learning Revolution | The MIT Press


Recommendations | Barbara Oakley


The deep-learning revolution: How understanding the brain will let us supercharge AI - TechRepublic


Professor Terrence Sejnowski - Deep Learning: Artificial Intelligence Meets Human Intelligence - YouTube

build tool: Google Bazel

Bazel with Tony Aiuto | Google Cloud Platform Podcast

Bazel grew from Google’s internal build system, Blaze, to become the open source Bazel that it is today. The aim of the project is to quickly make very large builds across multiple languages.

• Bazel site
• BazelCon site
• Bazel on GitHub site
• Bazel Discuss on Google Groups site
• Bazel on Slack site

serverless cloud: Azure Durable Functions

Azure Durable Functions 

"Durable Functions is an extension of Azure Functions and Azure WebJobs that lets you write stateful functions in a serverless environment. The extension manages state, checkpoints, and restarts for you."

  

Durable Functions Samples 

Azure Durable Functions with Maxime Rouiller @.NET Rocks! vNext

Polly Project 

Azure Logic Apps 

Azure Application Insights 

Serverless Mix Tape 

Max's Blog

podcast & book: How the Internet Happened

‘How the Internet Happened’ Review: Building a World Online - WSJ

podcast interview with the author
Triangulation 371 Brian McCullough

How the Internet Happened: From Netscape to the iPhone: Brian McCullough: 9781631493072: Amazon.com: Books

Internet History Podcast | From Netscape To The iPad

Podcasts By Chapter | Internet History Podcast

How the Internet Happened | W. W. Norton & Company

Brian McCullough: History in the digital age - YouTube (TED talk)

tool: Soapbox: Screen Recorder for Chrome

like Camtasia, in web browser

Soapbox - A Free Webcam and Screen Recorder for Chrome

"Soapbox is a Chrome extension that enables anyone to record,
edit, share, and measure presentation videos."

link from .NET Rocks! vNext

IoT: "Meadow" .NET solution platform device

Interesting and a bit unusual IoT solution, not based on Linux, but on .NET (mono) running on SoC (System on a Chip)

IoT and .NET with Bryan Costanich @ .NET Rocks! vNext

The Future is Tiny – Bryan Costanich – Medium

bryan costanich | LinkedIn

Wilderness Labs on GitHub 

Meadow Kickstarter
$50

"The power of Raspberry Pi in the computing factor of an Arduino, and the manageability of a mobile app."

ESP32 SoC

Micro-Controller Operating Systems - Wikipedia

RaspberryPI 

Azure Sphere 

Ring

Particle

besides being more battery efficient,
SoC is very cost effective for embedded solutions, here are base prices:

Amazon.com: Espressif ESP32 ESP32-DEVKITC inc ESP-WROOM-32 soldered dils CE FCC Fresh Stock: Office Products
$12.95

ESP32 | Mouser Electronics, Inc.
$3

AWS Quest 2018

capturing attention in attention economy...

AWS Quest 2018

a robot's journey to AWS re:invent 2018

Citus Data: PostgreSQL @ cloud

podcast interviews:

PostgreSQL on Azure with Craig Kerstiens @ .NET Rocks! vNext

Scaling PostgreSQL with Citus Data's Ozgun Erdogan - Software Engineering Daily

Postgres Sharding and Scalability with Marco Slot - Software Engineering Daily

some links:

Postgres Weekly

Postgres

Citus Data

PostgreSQL on Azure

PGLoader

marten

npgsql

psql

"Chromebook" Data Science

There is a lot of useful things that can be done from a web browser...

"Chromebook" name here is used as a symbol of web-only apps.

Welcome to Chromebook Data Science

Chromebook Data Science (price is adjustable $0-500)

"Chromebook Data Science (CBDS) is a free online educational to help anyone who can read, write, and use a computer to move into data science, the number one rated job. It is a sequence of 12 MOOCs offered by faculty members in the Johns Hopkins Department of Biostatistics, Bloomberg School of Public Health."

R, not Python