[Epic] Trino data gateway

[brendangadd]

• Add Trino component to source control #924
• Deploy Trino with ArgoCD #925
• Allow Trino coordinator access to kube-apiserver via namespace controller #928
• Add X-Forwarded-Proto: https header via VirtualService #926
• Secure Hive #927
• Implement Trino Secrets #980
• Use Trino DBAPI client without HTTPS #931
• Add Trino CLI to workspace container images #929
• Verify JWT Auth configuration #979
• Research into Define RBAC administration process #991
• Local testing of trino RBAC #1058
• Auto-authenticate Trino CLI #930
• Create terraform secret for trino shared secret #1076
• Add Trino to ArgoCd Manifest #1059
• secret still in https://github.com/StatCan/aaw-trino/blob/main/hive-metastore/values.yaml#L10
• Deploy trino into dev - Virtual Service #1075
• Deploy Trino into dev - Add Netpols #1065
• Implement using Postgres instead of MariaDB for hive-metastore #982
• Configure hive connector with Azure Storage #1103
• feat : Implement Postgres in Dev  #1165

Kind into DEV

• Create a managed Database #1173
• Patch hive-standalone-metastore CVEs #1178
• Modify hive-metastore chart to use managed postgreql db #1183
• Test Trino-hive set up in Dev #1182
• Create an external table from a sas7bdat file #1246
• Investigate running queries as --user namespacename in notebooks #1248
• Investigate storage account permissions in Azure #1247
• Implement JWT alternative authentication #1283
• Investigate Jwt endpoint on Dev #1106
• Investigate JVM crash on blob-csi mounted pods #1299
• Investigate restricting third-party access to user's container #1312
• JWT auth: Load public key on Trino coordinator #1313
• Configure JXM and Enable Hive connector storage caching #1321
• Create Trino Schema Controller #1319

Implement RBAC Controller

• Investigate and determine RBAC controller logic #1287
• Implement RBAC Controller for AAW containers #1298
• Implement RBAC Controller for FDI container

Deploy to PROD

• Implement postgres in prod for hive metastore #1277
• Rollout Trino to Prod #1320
• Create prot-b trino instance #1339
• Refactor Trino to use Env Vars for Dev/Prod Split #1522
• Trino: Reduce verbose of Trino Coordinator pod #1588
• Fix: Networking of Prot-b Trino #1589

RBAC

• Investigate into RBAC for Azure Storage/Trino #1189

Other

• User documentation (example usage with all supported languages)
• [Doc] Trino - developer / repo documentation #1338
• Update hive-metastore to use ADLS binaries and test using ADLS containers #1286
• Onboard LSDDP onto Trino Dev #1374
• Implement Oauth2.0 in Trino and refactor Trino controllers #1475
• Setup JMX connector #1491
• Use UPN claim for Trino Oauth2.0 #1495

Other

• Investigate Oauth redirect link not working on Jupyterlab terminal

Knowledge Transfer with @wg102

• https://github.com/StatCan/daaas-private/issues/92
• Create an env var for user-namespace. We no longer have personal namespaces in PROD. In PROD we would use aaw-teams ns https://github.com/StatCan/aaw-kubeflow-profiles-controller/blob/main/cmd/trino-schema.go#L70

[wg102]

Creating a sub category following the events of #1165. This needed more break down and to simplify it, we decided to keep it into the same epic

[bryanpaget]

Next steps: SAS Grid connectivity? #1537

[rohank07]

A upstream ticket to lookout for trinodb/trino#9441 - ask for authentication on start-up