scio

A Scala API for Apache Beam and Google Cloud Dataflow.

A Scala feature transformation library for data science and machine learning

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

A Giter8 template for scio

A collection of Scio exercises inspired by Ruby Koans and many others.

Playground for Apache Beam and Scio experiments, driven by real-world use cases.

Learn how to develop and test stateful streaming and batch data pipelines

Community-supported add-ons for Scio

leverage cats type classes and data types in scio pipelines

Dataflow job to dump the content coming from a PubSub subscription into Cloud storage

Example of how to run Scio job with Dataflow Flex Template

A Scio extension that allows SPARQL to query a collection of triples

Collection of additional string interpolators to use in your scio pipeline

Functional Big Data Processing API

Main repository of IndexGADM

Playing w/ Scio

WIP: Moving data from GCS to BigQuery.

Learning challenge for Scala/Scio

Scio job to import discogs xml dumps into BigQuery

Comparing Bigdata IOs