Getting started with Google BigQuery by Kiran Vasadi

• Fully Managed structured data store queryable with SQL
• very easy to use
• Fast, in that almost no slowdown with BigData
• Cost-effective
• Built on Google's infrastructure Components
• Basic Operations are available within WebUI
• You can 'dryrun' from Web UI to check the amount of data to be scanned
• You can use the command line interface (bq) to integrate BigQuery into your workflow
• API are provided for Python Java

What you pay for

• Storage - $0.020 per GB / month
• Queries - $5 per TB processed (scanned)
• Streaming inserts - $0.01 per 100,000 rows until July 20.2015. After July 20,2015 $0.01 per 200MB, with individual rows calculated using a 1 KB minimum size

A Simple Example

       Load 1TB data to a table every day, keep each table for a month

    

      Query the daily data 5 times every day to aggregation 

      For storage:

      1TB * 20 (tables) = $0.020 * 1000 * 30 = $600

      For Queries:

      1TB * 5 (Queries) * 30(days) = $750

How your data is stored

• Your data is stored

           1. in thousands of disk (depending on the size)

           2. in columnar format

           3. Compressed

               (However, the cost is based on uncompressed size)

• Record: A Collection of one or more other fields

References for this Blog

https://cloud.google.com/bigquery/
https://cloud.google.com/bigquery/what-is-bigquery
https://cloud.google.com/bigquery/docs/reference/rest/v2/
https://en.wikipedia.org/wiki/BigQuery

https://cloud.google.com/files/Redbus.pdf

https://www.reddit.com/r/bigquery/comments/28ialf/173_million_2013_nyc_taxi_rides_shared_on_bigquery/

Regards,

Kiran Kumar Vasadi

Architect Big Data Cloud

Mobile: +918977081119

Skype ID : kiranvasadi

Google Cloud Certified Professional Data Engineer 

I am thankful to all those who said No to me It's because of them i did it myself !  ..Einstein