<div dir="ltr">Hi David,<div><br></div><div>I would take a look at Secret Manager[1] as a way to store your private key material confidentially. Perhaps consider Cloud Run[2] as a mechanism for execution of arbitrary code, in this case for instance with the encryption/decryption pipeline using the python runtime and python-gnupg[3] library.</div><div><br></div><div>You might instead find Cloud Pub/Sub[4] and Dataflow[5] to be useful for streaming the data from your on-prem environment to GCS, and from GCS to BigQuery.</div><div><br></div><div>In short, yes, there are a variety of ways to perform the steps that you're talking about on GCP. You should be able to develop a proof of concept on a small scale while staying within the limits of the free tier[6]. I'm not quite clear on why you would want to encrypt the data when you will eventually decrypt it for storage into BigQuery, but yes, it is feasible.</div><div><br></div><div>C.J.</div><div><br></div><div>[1] <a href="https://cloud.google.com/secret-manager">https://cloud.google.com/secret-manager</a></div><div>[2] <a href="https://cloud.google.com/run">https://cloud.google.com/run</a></div><div>[3] <a href="https://pypi.org/project/python-gnupg/">https://pypi.org/project/python-gnupg/</a></div><div>[4] <a href="https://cloud.google.com/pubsub">https://cloud.google.com/pubsub</a></div><div>[5] <a href="https://cloud.google.com/dataflow">https://cloud.google.com/dataflow</a></div><div>[6] <a href="https://cloud.google.com/free">https://cloud.google.com/free</a></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Aug 16, 2022 at 11:33 AM David Gordon <<a href="mailto:DavidWGordon1011@outlook.com">DavidWGordon1011@outlook.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US" style="overflow-wrap: break-word;">
<div class="gmail-m_-4262253732840793727WordSection1">
<p class="MsoNormal">CJ,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">We were looking for a server-less solution. What we want to do is take data from a legacy mainframe system, encrypt it via PGP, and then via GKE transfer it to Cloud Storage. From there we want to decrypt it via GnuPG, save it in Cloud
Storage and then load it into Big Query.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
<p class="MsoNormal">David <u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0in 0in">
<p class="MsoNormal"><b>From:</b> C.J. Collier <<a href="mailto:cjac@colliertech.org" target="_blank">cjac@colliertech.org</a>> <br>
<b>Sent:</b> Tuesday, August 16, 2022 10:23 AM<br>
<b>To:</b> David Gordon <<a href="mailto:DavidWGordon1011@outlook.com" target="_blank">DavidWGordon1011@outlook.com</a>><br>
<b>Cc:</b> <a href="mailto:gnupg-users@gnupg.org" target="_blank">gnupg-users@gnupg.org</a><br>
<b>Subject:</b> Re: GNUPG and Google Cloud<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Hi there!<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Are you looking for a server-less solution or will a Debian instance on GCE or GKE suffice?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">You can "deploy" GNUPG with apt-get. Decrypting content would require getting a private key or an agent onto the system.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Can you give more details about what you're looking for?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">C.J. in Cloud Support, Seattle<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">GCP Technical Solutions Engineer<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Tue, Aug 16, 2022, 05:49 David Gordon via Gnupg-users <<a href="mailto:gnupg-users@gnupg.org" target="_blank">gnupg-users@gnupg.org</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal">Can GnuPG be deployed to GCP to decrypt files? If so, is there a recommended approach?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
<p class="MsoNormal">David<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Sent from
<a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgo.microsoft.com%2Ffwlink%2F%3FLinkId%3D550986&data=05%7C01%7C%7Cad6622d2400147059b4508da7f92dad8%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637962565967612968%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=A2zN6aWVAIQ7H8Zhq2JiSIZ2cEjDy2yKCQdRIX7T7bA%3D&reserved=0" target="_blank">
Mail</a> for Windows<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
Gnupg-users mailing list<br>
<a href="mailto:Gnupg-users@gnupg.org" target="_blank">Gnupg-users@gnupg.org</a><br>
<a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.gnupg.org%2Fmailman%2Flistinfo%2Fgnupg-users&data=05%7C01%7C%7Cad6622d2400147059b4508da7f92dad8%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637962565967612968%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EnvRhaqhJaDX%2FlpIwBGk3QjuMcIXh5Gcppuypi5kNYw%3D&reserved=0" target="_blank">https://lists.gnupg.org/mailman/listinfo/gnupg-users</a><u></u><u></u></p>
</blockquote>
</div>
</div>
</div>
</blockquote></div>