The Geek Out: Riding Moonstreams

Concepts: Moonstream

Concepts: Dagster

Downloading events

Using configurable resources

Adding DQ checks with dagster_pandas

Writing out Parquet with an IOManager

Tying it all together with Jobs & Repositories

Running our job

Next steps

Libraries

Acknowledgements

CEO & Co-founder, Cloudwall Capital

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

GoLand vs Visual Studio Code: Which one is the best IDE for Go?

PostgreSQL Logging in .NET Core

Driving Straight for Real Using PID

MLops Task 2

Blazor with Auth0, using the Management API

How to upgrade your version of PHP to 7.0 on macOS Sierra

Event Storming for Order Management System

Laravel Livewire is a frontend framework package for Laravel Framework.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Kyle Downey

Kyle Downey

CEO & Co-founder, Cloudwall Capital

More from Medium

A compact way to store your dataframes to S3 directly from Python

Google Maps Integration (regardless of which CRS it is)

The Golden Rule of Data Access: Scrape Others as You Would Want to be Scraped

MLOps helps across all stages of ML project