Google BigQuery

Mountain View, CA, USA
Jan 12, 2022   |  By Aswin Ramakrishnan, Sr.
Bayer Crop Science uses Google Cloud to analyze billions of acres of land to better understand the characteristics of the soil that produces our food crops. Bayer’s teams of data scientists are leveraging services from across Google Cloud to load, store, analyze, and visualize geospatial data to develop unique business insights. And because much of this important work is done using publicly-available data, you can too!
Jan 6, 2022   |  By Nick Orlove
Today we’re announcing a public preview for the BigQuery native JSON data type, a capability which brings support for storing and analyzing semi-structured data in BigQuery. With this new JSON storage type and advanced JSON features like JSON dot notation support, adaptable data type changes, and new JSON functions, semi-structured data in BigQuery is now intuitive to use and query in its native format.
Dec 20, 2021   |  By Vrishali Shah
In the BigQuery Spotlight series, we talked about Monitoring. This post focuses on using Audit Logs for deep dive monitoring. BigQuery Audit Logs are a collection of logs provided by Google Cloud that provide insight into operations related to your use of BigQuery. A wealth of information is available to you in the Audit Logs. Cloud Logging captures events which can show “who” performed “what” activity and “how” the system behaved.
Dec 16, 2021   |  By Priyanka Vergadia
Data teams across companies have continuous challenges of consolidating data, processing it and making it useful. They deal with challenges such as a mixture of multiple ETL jobs, long ETL windows capacity-bound on-premise data warehouses and ever-increasing demands from users. They also need to make sure that the downstream requirements of ML, reporting and analytics are met with the data processing.
Dec 1, 2021   |  By Vidya Shanmugam
As customers grow their analytical workloads and footprint on BigQuery, their monitoring and management requirements evolve - they want to be able to manage their environments at scale, take action in context. They also desire capacity management capabilities to optimize their BigQuery environments. With our BigQuery Administrator Hub capabilities, customers can now better manage BigQuery at scale.
Oct 29, 2021   |  By Brian Welcker
Mistakes are part of human nature. Who hasn’t left their car unlocked or accidentally hit “reply all” on an email intended to be private? But making mistakes in your enterprise data warehouse, such as accidentally deleting or modifying data, can have a major impact on your business.
Sep 24, 2021   |  By Leigha Jarett
BigQuery is a fully-managed enterprise data warehouse that helps you manage and analyze your data with built-in features like machine learning, geospatial analysis, and intelligent caching for business intelligence. To help you make the most of BigQuery, we’re offering the following no cost, on-demand training opportunities.
Sep 15, 2021   |  By Matthew Smith
After migrating a Data Warehouse to Google Cloud BigQuery, ETL and Business Intelligence developers are often tasked with upgrading and enhancing data pipelines, reports and dashboards. Data teams who are familiar with SQL Server Integration Services (SSIS) and SQL Server Reporting Services (SSRS) are able to continue to use these tools with BigQuery, allowing them to modernize ETL pipelines and BI platforms after an initial data migration is complete.
Sep 9, 2021   |  By Drew Whang
Advertising agencies are faced with the challenge of providing the precision data that marketers require to make better decisions at a time when customers’ digital footprints are rapidly changing. They need to transform customer information and real-time data into actionable insights to inform clients what to execute to ensure the highest campaign performance.
Sep 8, 2021   |  By Anna Epishova
When you build a data warehouse, the important question is how to ingest data from the source system to the data warehouse. If the table is small you can fully reload a table on a regular basis, however, if the table is large a common technique is to perform incremental table updates. This post demonstrates how you can enhance incremental pipeline performance when you ingest data into BigQuery.
Nov 20, 2021   |  By Google BigQuery
Has your data team outgrown its on-premise traditional data warehouse? Are you looking for a system to store data that is secure, scalable, and cost effective? In this episode of Architecting with Google Cloud, Priyanka Vergadia speaks with Gary Morreale, the Director of Data Services from Independence Blue Cross about how his team migrated from Terradata to Bigquery on Google Cloud Platform. Listen as Gary Morreale discusses his team’s giant undertaking on migrating dataware to BigQuery.
Nov 18, 2021   |  By Google BigQuery
Have you ever been asked to prepare a slide deck containing many data points? Maybe you sifted through the data yourself along with copying and pasting the data over and over again—talk about a huge time commitment. In this video, Leigha Jarett discusses how you can use Google Apps Scripts to automate data-driven slide development and save yourself a lot of time.
Aug 26, 2021   |  By Google BigQuery
Want to ensure that your BigQuery environment stays cost effective and secure? In this episode of BigQuery Spotlight, we’ll examine how monitoring your data warehouse can optimize costs, help you pinpoint which queries need to be optimized, and audit both data-sharing and access. Watch to learn how BigQuery gives you the flexibility to export any of these data sources back into your data warehouse for custom reporting.
Aug 19, 2021   |  By Google BigQuery
Want to become more scalable with programmatic data workflows? In this episode of BigQuery Spotlight, we’ll examine BigQuery APIs so you can manage data warehousing resources, and take action on your data, programmatically and effectively.
Aug 17, 2021   |  By Google BigQuery
Data harnessed through tools such as BigQuery allow organizations to deliver personalized experiences, make data-driven business decisions, and unlock new streams of revenue. In this video, we go through the challenges of putting data into action and show how APIs can help. Watch to learn how Apigee makes it simple and easy to package your business data as APIs!
Aug 12, 2021   |  By Google BigQuery
Want everyone in your organization to be able to easily find the data they need, while minimizing overall risk, and ensuring regulatory compliance? In this episode of BigQuery Spotlight, we’ll examine BigQuery data governance so you can ensure your data is secure. We’ll also go over Cloud Data Loss Prevention and an open-source framework for data quality validation.
Aug 5, 2021   |  By Google BigQuery
Did you know that optimizing SQL queries can be cost efficient? In this episode of BigQuery Spotlight, we speak to some strategies for optimizing your BigQuery queries. We’ll walk through what happens behind the scenes for more complex queries, and show you specific tactics you can use to optimize your SQL. Watch to learn some great techniques on how to make your queries more performant!
Jul 22, 2021   |  By Google BigQuery
How does BigQuery’s internal storage work? In this episode of BigQuery Spotlight, we share how BigQuery stores data so you can make informed decisions on how to optimize your BigQuery storage. We’ll also talk about partitioning, as well as clustering and how it allows for efficient lookups.
Jul 15, 2021   |  By Google BigQuery
What are jobs in BigQuery and how does the reservation model work? In this episode of BigQuery Spotlight, we’ll review jobs, reservations, and best practices for managing workload in BigQuery. We’ll also walk you through the difference between BI Engine reservations and standard reservations, so you can decide what will work best for you.
Jul 1, 2021   |  By Google BigQuery
What is a BigQuery table and how does it work? In this episode of BigQuery Spotlight, we’ll review the different types of tables in BigQuery, including managed tables, external tables, and virtual tables with logical and materialized views. We’ll also walk you through the use of views, which are virtual tables defined by a SQL query.

BigQuery is Google's serverless, highly scalable, enterprise data warehouse designed to make all your data analysts productive at an unmatched price-performance. Because there is no infrastructure to manage, you can focus on analyzing data to find meaningful insights using familiar SQL without the need for a database administrator.

Analyze all your data by creating a logical data warehouse over managed, columnar storage, as well as data from object storage and spreadsheets. Build and operationalize machine learning solutions with simple SQL. Easily and securely share insights within your organization and beyond as datasets, queries, spreadsheets, and reports. BigQuery allows organizations to capture and analyze data in real time using its powerful streaming ingestion capability so that your insights are always current, and it’s free for up to 1 TB of data analyzed each month and 10 GB of data stored.