Build a Self-Serve Data Platform you own this product

prerequisites
intermediate Python • basic pandas
skills learned
build a self-serve data platform • build a small data catalog • consume data inside a data mesh • store data products
Sven Balnojan
1 week · 6-8 hours per week · INTERMEDIATE
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside

You’re a consultant working for Messflix Inc., a movie and TV-show streaming platform. Your task is to set up a Python prototype implementation of the data mesh to roll out the technical components of a data mesh. Using Python and pandas, you’ll write a Python function that creates an empty CSV file with the predefined attributes of your data product, builds a data catalog by creating Python functions that write to the CSV file, and sets up standardized access to the CSV datasets. When you’re done, you’ll have hands-on experience building a minimal self-serve data platform using simple techniques.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

project author

Sven Balnojan

Sven Balnojan is a data technologist and product-person focused on helping the world extract more value from the exponentially growing amount of data. He’s passionate about all things data, including machine learning, AI, and business intelligence. As a manager of internal data teams, he’s been integral in easing their transitions from being a service-oriented to platform-oriented data team. He enjoys getting his hands dirty as a data developer, whether in the field of machine learning, data engineering, or data DevOps.

For his PhD in mathematics, Sven wrote a thesis in the field of singularity theory. He’s the co-author of Manning’s Data Mesh in Action and author of the Three Data Point Thursday newsletter. He blogs on datacisions.com and makes appearances in various online talks.

prerequisites

This liveProject is for data architects, developers, and data team members who want to understand the workings of a data mesh. To begin these liveProjects you’ll need to be familiar with the following:

TOOLS
  • Intermediate Python
  • Basic Docker
  • Basic Bash

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

related titles

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Build a Self-Serve Data Platform project for free

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Build a Self-Serve Data Platform project for free