Saturday, September 22, 2018

cloud: AWS S3 Select: many data formats

Amazon S3 Announces New Features for S3 Select

"Amazon S3 Select works on objects stored in CSV and JSON format... (now it also added) support for Apache Parquet format, JSON Arrays, and BZIP2 compression for CSV and JSON objects... 

no XML :)
but why not Google's Protocol Buffers?

Selecting Content from Objects - Amazon Simple Storage Service

Google AI: Public Datasets, Search, TPU v3

a very informative interview with current lead of Google AI research

Google AI with Jeff Dean | Google Cloud Platform Podcast


  • Google Dataset Search is in beta site
  • Expanding our Public Datasets for geospatial and ML-based analytics blog
    • Zip Code Tabulation Area (ZCTA) site
  • Google AI and Kaggle Inclusive Images Challenge site
  • We are rated in the top 100 technology podcasts on iTunes site
  • What makes TPUs fine-tuned for deep learning? blog