Thursday, March 30, 2017

SpaceX Rocket reused

Used SpaceX Rocket Launches Satellite, Then Lands in Historic 1st Reflight

cloud big data: Amazon Athena, Facebook Presto, Azure HDInsight

Amazon Athena FAQs – Amazon Web Services (AWS)

"Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to setup or manage, and you can start analyzing data immediately. You don’t even need to load your data into Athena, it works directly with data stored in S3. To get started, just log into the Athena Management Console, define your schema, and start querying. 

Amazon Athena uses Presto with full standard SQL support and works with a variety of standard data formats, including CSV, JSON, ORC, Apache Parquet and Avro. While Amazon Athena is ideal for quick, ad-hoc querying and integrates with Amazon QuickSight for easy visualization, it can also handle complex analysis, including large joins, window functions, and arrays.

Amazon Athena helps you analyze data stored in Amazon S3."

What is Presto? – Amazon Web Services (AWS)

Presto | Distributed SQL Query Engine for Big Data

"Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes."


"HDInsight is the only fully-managed cloud Hadoop offering that provides optimized open source analytic clusters for Spark, Hive, MapReduce, HBase, Storm, Kafka, and R Server backed by a 99.9% SLA."

Most efficient car: Hyundai Ioniq

2017’s Top Ten Tech Cars: Hyundai Ioniq - IEEE Spectrum
Hyundai Ioniq

"The most energy-efficient car in America isn’t a Tesla, Toyota, or even the remarkable Chevrolet Bolt. It’s a Hyundai. With a range of 200 kilometers (124 miles), the all-electric Ioniq comes nowhere near the Bolt’s astounding 383 km (238 miles). But the Hyundai’s gasoline equivalent of 1.73 liters per 100 kilometers (136 mpge) tops all current EVs.
...
Ioniqs match the slippery 0.24 drag coefficient of the Tesla Model S, making them the most aerodynamic models on U.S. roads.
...
Hyundai is experimenting in California with a way to lure buyers from conventional cars: a cellphone-style subscription plan. It bundles unlimited mileage, charging costs, scheduled maintenance, and replacement of worn-out items into a single monthly payment."


The New Ioniq - One Car Three Options | HyundaiUSA

Wednesday, March 29, 2017

AI free ebook: Artificial Intelligence Now


Artificial Intelligence Now

Artificial Intelligence Now - O'Reilly Media

  • "The AI landscape: the platforms, businesses, and business models shaping AI growth; plus a look at the emerging AI stack
  • Technology: AI’s technical underpinnings and deep learning capabilities, tools, and tutorials
  • Homebuilt autonomous systems: "hobbyist" applications that showcase AI tools, libraries, cloud processing, and mobile computing
  • Natural language: strategies for scoping and tackling NLP projects
  • Use cases: an analysis of two of the leading-edge use cases for artificial intelligence—chat bots and autonomous vehicles
  • Integrating human and machine intelligence: development of human-AI hybrid applications and workflows; using AI to map and access large-scale knowledge databases"

The current state of machine intelligence 3.0.

Tuesday, March 28, 2017

APFS : new Apple iOS filesystem

Apple Quietly Upgrades the File System of Millions of iOS Devices

"With the release of iOS 10.3 to the general public, millions of devices will be upgraded to use Apple’s new file system, APFS,
...
APFS does not normalize Unicode filenames, or the fact that APFS allows multiple files whose names differ only in case to exist in the same directory.
...
the migration does not actually moves data, rather it writes APFS metadata into HFS+ free space. This approach has the advantage that if anything goes wrong with the conversion, the user is still left with a valid HFS+ partition."

free book: Serverless Ops (cloud Function Services)


Serverless Ops

Serverless Ops - O'Reilly Media

"Amazon, Microsoft, Google, and IBM are among the dozen organizations that now provide serverless compute options in the cloud—also known as Function-as-a-Service..."

Guide to SSL Certificates

Ultimate Guide to SSL Certificates for Your Blog – WPLikeAPro – Medium
"An SSL certificate is absolutely necessary for anyone who wants to get the most out of their blog, or website..."

Monday, March 27, 2017

IaaC: Infrastructure as Code: Terraform

Introduction - Terraform by HashiCorp

"Terraform is a tool for building, changing, and versioning infrastructure safely and efficiently. Terraform can manage existing and popular service providers as well as custom in-house solutions.

Configuration files describe to Terraform the components needed to run a single application or your entire datacenter. Terraform generates an execution plan describing what it will do to reach the desired state, and then executes it to build the described infrastructure. As the configuration changes, Terraform is able to determine what changed and create incremental execution plans which can be applied.

The infrastructure Terraform can manage includes low-level components such as compute instances, storage, and networking, as well as high-level components such as DNS entries, SaaS features, etc."

Atlas Workflow

Thursday, March 23, 2017

cloud event: Microsoft Data Amp

Introducing Microsoft Data Amp | SQL Server Blog

on April 19, online event Microsoft Data Amp.

cloud event: AWS Online Tech Talks

AWS Monthly Webinar Series - Cloud Computing Education

"The AWS Online Tech Talks is a selection of live online presentations that cover a broad range of topics at varying technical levels. These tech talks feature technical sessions led by AWS solutions architects and engineers, live demonstrations, customer examples and Q&A with AWS experts."

webinar_banner

Tuesday, March 21, 2017

Social Big Data, Economy, Measure to Improve


With world connected and instrumented, it is now more then ever possible to OPTIMIZE investments into social investments, based on science not on impulse and opinions.

This is a fascinating presentation for anybody who deals with data:
Bjorn Lomborg: From Feel-Good to High-Yield Good: How to Improve Philanthropy and Aid - The Long Now

"Bjorn Lomborg does cost/benefit analysis on global good. There are surprises when you examine what are the highest-yield targets in the domains of health, poverty, education, reduced violence, gender equality, climate change, biodiversity, and good governance."
An interesting story how "economy" data started, and huge benefit of doing this.

Planet Money : NPR #522: The Invention Of 'The Economy'
"A hundred years ago, nobody talked about "the economy." That's because easy ways to measure and talk about it hadn't been invented. On today's show: how we started boiling nations down to a number."


Peter Drucker quote: You can't manage what you don't measure.



Lord Kelvin quote: If you can not measure it, you can not improve it.

If you can not measure it, you can not improve it. - Lord Kelvin


Monday, March 20, 2017

WWW 21 years ago



Kako su izgledali sajtovi pre 20 godina? | PC Press (in Serbian language)
21+ years ago I wrote a simple "web crawler" tool,
to help download web pages of then popular web sites
to be added to a CD that was included with popular book "Internet" that I co-authored. Thanks to Dragan Vecerina who tirelessly managed and used then quite unreliable network connections we did download many of those sites, way before Google even existed... Good times...

PC Press: book Internet

Here are state-of-the-art Apple and Microsoft web sites from 1995 :)



Visual Studio 2017 Poster

Visual Studio 2017 Poster | The Visual Studio Blog

Visual Studio 2017 Poster (web)

Visual Studio 2017 keyboard shortcuts

This one poster shows off what’s new in Visual Studio 2017 | On MSFT

Azure Managed Disks

Azure Managed Disks Deep Dive, Lessons Learned and Benefits – Rumors about Azure, SQL Server & Data in the Cloud….
6

Visual Studio 2017 - MS Dev Show Podcast

Sunday, March 19, 2017

IoT Device Identity Management

With data, devices, documents and any other management
there is always a need for "unique identifiers".
With billions of IoT devices that is even more critical, and harder to do right.

Current useful identity properties
  • SSN (USA Social Security Number)
  • VIN number for cars
  • MAC network address
  • IPv6 address
  • GUID
  • Serial Number for class of device models (not globally unique, less useful)
IoT Device Identity Management | DigiCert.com

identity-and-access-management-for-the-iot.pdf

Gartner Names Okta a Leader for Third Year Running in Gartner's IDaaS Magic Quadrant
 Identity and Access Management as a Service (IDaaS)



Identity and Security Management for the Internet of Things @ GlobalSign


IoT Cloud: AWS "Device Shadows", Azure "Device Twins"

Device Shadows for AWS IoT - AWS IoT

"A thing shadow (sometimes referred to as a device shadow) is a JSON document that is used to store and retrieve current state information for a thing (device, app, and so on). The Thing Shadows service maintains a thing shadow for each thing you connect to AWS IoT. You can use thing shadows to get and set the state of a thing over MQTT or HTTP, regardless of whether the thing is connected to the Internet. Each thing shadow is uniquely identified by its name."

{
    "state" : {
        "desired" : {
          "color" : "RED",
          "sequence" : [ "RED", "GREEN", "BLUE" ]
        },
        "reported" : {
          "color" : "GREEN"
        }
    },
    "metadata" : {
        "desired" : {
            "color" : {
                "timestamp" : 12345
            },
            "sequence" : {
                "timestamp" : 12345
            }
        },
        "reported" : {
            "color" : {
                "timestamp" : 12345
            }
        }
    },
    "version" : 10,
    "clientToken" : "UniqueClientToken",
    "timestamp": 123456789
}




"AWS IoT provides a thing registry that helps you manage your things. A thing is a representation of a specific device or logical entity. It can be a physical device or sensor (for example, a light bulb or a switch on a wall). It can also be a logical entity like an instance of an application or physical entity that does not connect to AWS IoT but is related to other devices that do (for example, a car that has engine sensors or a control panel)."


{

    "version": 3, 

    "thingName": "MyLightBulb", 
    "defaultClientId": "MyLightBulb", 
    "thingTypeName": "LightBulb", 
    "attributes": {
        "model": "123", 
        "wattage": "75"
    }
}


***

Get started with Azure IoT Hub device twins (Node) | Microsoft Docs

"Device twins are JSON documents that store device state information (metadata, configurations, and conditions). IoT Hub persists a device twin for each device that you connect to IoT Hub."

Tesla: battery upgrade via software update

Another "first" from Tesla: upgrading hardware (battery capacity) over the internet.
Pay over web account, and the car get's longer range.
Essentially the capacity is limited by software.

Tesla — 75 kWh Battery Capacity Upgrade

Order a Tesla Model S | Tesla


Tesla discontinuing Model S 60 and 60D on April 17, ahead of Model 3 ramp

Tesla is discontinuing its cheapest car, the 60kWh Model S - The Verge

HP or TI calculators during 80's used to do such trick with memory.
TI-59 / TI-58 - Wikipedia

Microsoft did this with Windows NT server & workstation ware the same except for a config flag.


Friday, March 17, 2017

Azure Functions timer = Unix cron++ (crontab)

Azure Functions timer trigger | Microsoft Docs
{second} {minute} {hour} {day} {month} {day-of-week}
To trigger once every five minutes:
"schedule": "0 */5 * * * *"
To trigger once at the top of every hour:
"schedule": "0 0 * * * *",
Azure Functions Overview | Microsoft Docs

crontab.guru - the cron schedule expression editor

Cron - Wikipedia
 ┌───────────── minute (0 - 59)
 │ ┌───────────── hour (0 - 23)
 │ │ ┌───────────── day of month (1 - 31)
 │ │ │ ┌───────────── month (1 - 12)
 │ │ │ │ ┌───────────── day of week (0 - 6) (Sunday to Saturday;
 │ │ │ │ │                                       7 is also Sunday)
 │ │ │ │ │
 │ │ │ │ │
 * * * * *  command to execute

Azure Functions have 6 position, added position for seconds in front of minutes.

crontab.org - CRONTAB(5)

AI cloud: Microsoft Azure + Nvidia HGX-1

Microsoft and NVIDIA tackle AI cloud computing with HGX-1 - SD Times

“The HGX-1 hyperscale GPU accelerator will do for AI cloud computing what the ATX standard did to make PCs pervasive today. It will enable cloud-service providers to easily adopt NVIDIA GPUs to meet surging demand for AI computing.”
...
The HGX-1 was designed alongside Microsoft’s Project Olympus to provide hyperscale data centers with a fast path for AI. Project Olympus is Microsoft’s next-generation hyperscale cloud hardware design"

Mindshift: book & online class


Mindshift: Break Through Obstacles to Learning and Discover Your Hidden Potential: Barbara Oakley: 9781101982853: Amazon.com: Books

Mindshift: Break Through Obstacles to Learning and Discover Your Hidden Potential - McMaster University | Coursera

"About this course: Mindshift is designed to help boost your career and life in today’s fast-paced learning environment. Whatever your age or stage, Mindshift teaches you essentials such as how to get the most out of online learning and MOOCs, how to seek out and work with mentors, the secrets to avoiding career ruts (and catastrophes) and general ruts in life, and insights such as the value of selective ignorance over general competence. We’ll provide practical insights from science about how to learn and change effectively even in maturity, and we’ll build on what you already know to take your life’s learning in fantastic new directions. This course is designed to show you how to look at what you’re learning, and your place in what’s unfolding in the society around you, so you can be what you want to be, given the real world constraints that life puts on us all. You’ll see that by using certain mental tools and insights, you can learn and do more—far more—than you might have ever dreamed."


book's web site: Mindshift - Barbara Oakley

Book-Extract-Chapter-1-Mindshift.pdf
Another very popular course and a book from same authors:

Learning How to Learn: Powerful mental tools to help you master tough subjects - University of California, San Diego | Coursera

A Mind For Numbers: How to Excel at Math and Science (Even If You Flunked Algebra) 1, Barbara Oakley - Amazon.com

Saturday, March 11, 2017

Microsoft MakeCode for micro:bit programming

Microsoft MakeCode
"Microsoft MakeCode provides a programming experience based around Blocks and JavaScript (technically, a subset of TypeScript). The experience has a built-in progression from simple block-based editor, through in-browser text editor with robust auto-completion and auto-fixing, all the way to a professional integrated development environment (Visual Studio Code)."

cloud tool: Terraform

Terraform by HashiCorp

"Define infrastructure as code to increase operator productivity and transparency.

Use Terraform to create resources across all major infrastructure providers
(AWS, GCP, Azure, OpenStack, VMware, and more)."




Google Python Fire for auto-generated CLIs

Google ignites Python library for command lines | JavaWorld

"With its Python Fire library, Google is offering Python developers a mechanism to easily generate command-line interfaces."

Wednesday, March 08, 2017

solar: Hawai island Kauai += Tesla battery packs

Tesla battery packs power the Hawaiian island of Kauai after dark

"Using stored energy from Tesla's power packs is expected to save KIUC 1.6 million gallons of diesel fuel annually, which has traditionally been the way the utility generates power after dark."


Tesla built a huge solar energy plant on the island of Kauai - The Verge

AI: Google cloud += Kaggle

Google buys Kaggle and its gaggle of AI geeks - CNET

"Google acquires what it calls the globe's largest community of AI enthusiasts (data scientists and machine learning geeks)"


Quantum Computers: IBM, Google, Microsoft

Microsoft: Quantum Computing is now feasible, it is an engineering challenge to make it usable.

An Introduction to Quantum Computing | MVP Led TechDays Online February 2017 | Channel 9
from video: "atom is too large; quantum is dealing with electrons and photons"
"if an electron is size of an apple, an atom is size of the Earth"


Brian Beckman: Project Quark - A New Beginning for Quantum Computing Rises from the Ashes of Theoret | Going Deep | Channel 9

Quantum computers ready to leap out of the lab in 2017 : Nature News & Comment

Inside Microsoft’s quest for a topological quantum computer : Nature News & Comment


The Race to Sell True Quantum Computers Begins Before They Really Exist | WIRED



IBM Is Now Letting Anyone Play With Its Quantum Computer | WIRED

Quantum Computing Is Real, and D-Wave Just Open-Sourced It | WIRED


Quantum computing - Wikipedia

Tuesday, March 07, 2017

Alibaba Cloud: Aliyun

Ambitious Alibaba takes aim at the kings of cloud computing | TechCrunch

"NASDAQ-listed Amazon’s market cap exceeds $400 billion, while Alibaba is valued at $250 billion according to its NYSE share price.
...
Two years ago, Alibaba decided to take the cloud part of its business more seriously and expand outside of China with a billion dollar investment in Aliyun (now known as Alibaba Cloud in English). At the time, Alibaba Cloud’s president Simon Hu made a bold prediction, telling Reuters, “Our goal is to overtake Amazon in four years, whether that’s in customers, technology, or worldwide scale.”

...
Alibaba is sixth in the world behind AWS, Microsoft, Google, IBM and Salesforce in infrastructure, platform and hosted private cloud services"

VS2017 Microservices Architecture

GitHub - dotnet/eShopOnContainers: Easy to get started sample reference microservice and container based application (Currently in ALPHA state, ongoing progress, accepting feedback and pull-requests). Cross-platform on Linux and Windows Containers, powered by .NET Core and Docker engine. Supports .CSPROJ with Visual Studio 2017 and also CLI based environments with Docker CLI, dotnet CLI, VS Code or any other code editor

Visual Studio 2017

Visual Studio Drone

March 7-8 | Visual Studio 2017 Launch Event
Visual Studio 2017 Launch and 20th Anniversary Event

What's New in Visual Studio 2017

Downloads | Visual Studio Official Site

How to make an offline installer for VS2017 - Scott Hanselman

Channel 9: Videos for developers from the people building Microsoft Products & Services

Azure CLI 2.0 on Python

Original Azure Command Line Interface (xplat CLI) is based on node.js (JavaScript).
New version is based on Python. Apparently Linux admins prefer Python.
Or just use PowerShell (core :)

Azure CLI 2.0 | Azure Friday | Channel 9
"Azure CLI 2.0 is optimized for managing and administering Azure resources from the command line, and for building automation scripts that work against the Azure Resource Manager."

Azure Command Line 2.0 now generally available | Blog | Microsoft Azure

Exploring the new DevOps - Azure Command Line Interface 2.0 (CLI) - Scott Hanselman

Install the Azure CLI 2.0 | Microsoft Docs

Azure/azure-cli: Command-line tools for Azure. @ GitHub

Azure CLI 2.0 Highlight Reel

Sunday, March 05, 2017

Azure Stack: software subscription

Azure Stack TP3 Delivers Hybrid Application Innovation and Introduces Pay-as-you-Use Pricing Model | Blog | Microsoft Azure

“It’s going to be essentially the same as Azure — there’s no upfront fee. It’s a pay-as-you-go model,” said Julia White, corporate vice president for Microsoft’s cloud business, in an interview with GeekWire. “As you use the services in Azure Stack, the meters would spin just like you were using Azure in the public cloud.”

"The prices will be lower than those for the Azure public cloud, reflecting the fact that customers are running their own servers, explained Jeffrey Snover,Microsoft Enterprise Cloud Group technical fellow"

Microsoft's 'Azure Stack' for on-premises servers will use pay-as-you-go cloud pricing model - GeekWire

Saturday, March 04, 2017

IoT: protocol IOP, data format ION

IoT may need more efficient protocols and data formats... 
Competing with Google (HTTP2, ProtoBuf) is challenging... 
Still, for example Angular.js was well challenged by React.js, and Angular2 is adjusted. 

ION - IAP Object Notation @jenkov.com
"ION uses a binary encoding to make it faster to read and write, more compact, and to make it possible to embed binary data. ION's encoding is described in the text ION Encoding."

"IAP (Internet Application Protocol) network protocol is designed to replace HTTP for the many use cases where HTTP is inappropriate. Why HTTP2 and WebSocekts are not enough."

"With the Internet of Things (IoT) we will have a lot more different devices communicating via the internet. Different devices send and receive different types of data, and have different communication patterns. A new network protocol should take that into account. Similarly the next generation of the web, being it Web 3.0 or Web 4.0 (or whatever name it gets), will most likely add new types of data and communication patterns to the ones already existing."

Nanosai - Intelligent & Versatile Distributed Systems
"Making the Internet Great Again! Distributed Computing Rebooted"
:-)

"Amazon Ion is a richly-typed, self-describing, hierarchical data serialization format offering interchangeable binary and text representations. The text format (a superset of JSON) is easy to read and author, supporting rapid prototyping. The binary representation is efficient to store, transmit, and skip-scan parse. The rich type system provides unambiguous semantics for long-term preservation of business data which can survive multiple generations of software evolution."



Friday, March 03, 2017

JavaScript: pdf.js vs webpdf.js

even for image processing, JavaScript replacing C++...
pdf.js: free vs non-free (good marketing)
It is just that PDF is not good for web, plain HTML is better for web.

Introducing Foxit's new JavaScript PDF Viewer - Foxit SDK | PDF technology | Proven, robust, and 
battle-tested

cloud: AWS typo to bring down internet

Summary of the Amazon S3 Service Disruption in the Northern Virginia (US-EAST-1) Region
"an authorized S3 team member using an established playbook executed a command which was intended to remove a small number of servers for one of the S3 subsystems that is used by the S3 billing process. Unfortunately, one of the inputs to the command was entered incorrectly and a larger set of servers was removed than intended... Removing a significant portion of the capacity caused each of these systems to require a full restart. While these subsystems were being restarted, S3 was unable to service requests..."

AWS says a typo caused the massive S3 failure this week | PCWorld

AWS cloudsplains what happened during S3 storage outage | TechCrunch

Massive Amazon cloud service outage disrupts sites
a more than four-hour problem... A big portion of Amazon Web Services' Amazon S3 system went offline Tuesday afternoon, a service used by 148,213 sites according to SimilarTech


Thursday, March 02, 2017

SHA1 insecurity, HTTPS, Git

Google Online Security Blog: Announcing the first SHA1 collision



"Here are some numbers that give a sense of how large scale this computation was:
Nine quintillion (9,223,372,036,854,775,808) SHA1 computations in total
6,500 years of CPU computation to complete the attack first phase
110 years of GPU computation to complete the second phase"

Chrome and Firefox do not accept HTTPS based on SHA1 anymore.

Git is using SHA-1 for hashes (detecting changes) but not for security protection.
> SHA1 is not used for security in Git -S[], --gpg-sign[=]... | Hacker News

Git fscked by SHA-1 collision? Not so fast, says Linus Torvalds • The Register
"the sky isn't falling. There's a big difference between using a cryptographic hash for things like security signing, and using one for generating a 'content identifier' for a content-addressable system like git."