Insights

Insights

Gain expert strategies, real-world perspectives, and best practices in data engineering, analytics, and AI. Explore our latest insights to stay ahead in the ever-evolving data landscape.

Browse by topic

AI Safety Artificial Intelligence Business Intelligence CI/CD & DataOps Cloud Infrastructure Data Architecture Data Engineering Data Governance Data Ingestion Data Marts Architecture Data Operating Model Data Orchestration Data Platforms Data Security Data Strategy DataOps Pipelines Enterprise Automation Entra ID GCP GitHub Actions Kubernetes Prefect Python SAP Sustainability Data Terraform dbt dbt Recovery & Rebuilds dlt

Scaling Secure Data Access: A Systematic RBAC Approach Using Entra ID

Data Governance Data Security Entra ID

Establish scalable, secure access controls for your data platform with a systematic RBAC strategy built on Microsoft Entra ID. This article outlines a five-phase implementation—from user persona mapping to automated auditing—designed to balance flexibility, compliance, and operational efficiency.

Getting to Your First Flow Run: Prefect Worker & Deployment Setup

Data Orchestration Data Engineering Prefect Kubernetes

Run your first data ingestion workflow with Prefect, Docker, and Kubernetes. This guide walks through containerized flow execution, Prefect worker deployment, and clean deployment configs, laying the foundation for a scalable, maintainable orchestration layer.

Flat Tables vs. Snowflake Semantic Models: The Ultimate BI Data Debate

Data Marts Architecture Data Architecture Business Intelligence

Structuring data for BI is a key decision that impacts performance, scalability, and data consistency. This article compares flat tables and semantic models, highlighting the strengths and trade-offs of each. Learn how a hybrid approach can offer the best of both worlds—combining consistency, flexibility, and efficient analytics across tools and teams.

Driving Sustainability with Data: Improving CO₂ Emissions Reporting Across Supply Chains

Data Strategy Business Intelligence Sustainability Data

Accurate CO₂ emissions reporting is vital for meeting sustainability goals and regulatory requirements. This article delves into the challenges of Scope 3 emissions, the importance of clean data, and how structured data systems like sustainability marts can improve reporting, ensure compliance, and support better decision-making for businesses.

Roles in the Context of the Analytics Workflow

Data Strategy Data Operating Model Data Engineering

Code-based analytics workflows offer a unique advantage - the ability to combine robust collaboration with strict governance. While technically straightforward to implement, this approach only reaches its full potential when aligned with well-adapted business and analytics processes.

How to Setup Data Platform Infrastructure on Google Cloud Platform with Terraform

Data Orchestration Cloud Infrastructure GCP Terraform

Learn how to set up a secure, scalable data platform infrastructure on Google Cloud Platform (GCP) using Terraform. This step-by-step guide covers VPC configuration, Compute Engine setup, firewall rules, Identity-Aware Proxy (IAP), Cloud NAT, and more, ensuring a cost-effective, flexible, and secure foundation for your data platform.