Ingesting Streaming data from PubSub to Bigquery has never been that much easy, earlier we need to write script using Apache Beam and to run that Apache Beam Script we need to use DataFlow(Apache Beam Runner).But now with May 2022 Update from Google Cloud, Pub/Sub Subscription has the new feature of “write to bigquery”, It’s the variant of the push operation. This will be selected if you want to deliver messages directly to an existing BigQuery table.

Being compliant with separation of duties among teams, in a large enterprise cloud environment is quite a challenge to achieve, we at Evonence are excited about demonstrating Cloud Run CI/CD pipeline across multiple projects using cloud build adhering to Google Cloud Platform’s best practices.