Either use ELT (e.g. materialized views) and pass off the task to the data warehouse or use a ETL tool like Cloud Dataflow that gives you observability. What you don't want to use is a cluster-native ETL tool where you have to parse the logs yourself.