gasmaskhome

I am trying to run an app that uses a kafka producer (Python client), and an apache beam pipeline t… Read more How To Consume Messages Using Beam's External Kafka Transform (locally)

I can't create a custom Google Cloud Dataflow template using the wordcount example following th… Read more How To Create Google Cloud Dataflow Wordcount Custom Template In Python?

Since a few days our python dataflow jobs result in an error on worker startup: 'ERROR: Could n… Read more Apache Beam 2.19.0 Not Running On Cloud Dataflow Anymore Due To Could Not Find A Version That Satisfies The Requirement Setuptools>=40.8

I am trying to use apache beam's google datastore api to ReadFromDatastore p = beam.Pipeline(op… Read more Apache Beam Google Datastore Readfromdatastore Entity Protobuf

When I run Beam program i'm getting below error. 2021-05-20T17:04:42.166994441ZError message … Read more Attributeerror: '_dofnparam' Object Has No Attribute 'start' [while Running 'write To Gcs-ptransform-146']